-- Logs begin at Thu 2022-06-16 17:32:03 UTC, end at Thu 2022-06-16 20:06:14 UTC. -- Jun 16 18:16:25.279557 n-d-846209-2 systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:16:25.288530 n-d-846209-2 devstack@n-api.service[103882]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:16:25 2022] *** Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: nodename: n-d-846209-2 Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: machine: x86_64 Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: clock source: unix Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: pcre jit disabled Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: detected number of CPU cores: 4 Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: current working directory: / Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:16:25.290627 n-d-846209-2 devstack@n-api.service[103882]: your processes number limit is 47680 Jun 16 18:16:25.291295 n-d-846209-2 devstack@n-api.service[103882]: your memory page size is 4096 bytes Jun 16 18:16:25.291295 n-d-846209-2 devstack@n-api.service[103882]: detected max file descriptor number: 2048 Jun 16 18:16:25.291295 n-d-846209-2 devstack@n-api.service[103882]: lock engine: pthread robust mutexes Jun 16 18:16:25.291295 n-d-846209-2 devstack@n-api.service[103882]: thunder lock: enabled Jun 16 18:16:25.291295 n-d-846209-2 devstack@n-api.service[103882]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:16:25.291295 n-d-846209-2 devstack@n-api.service[103882]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:16:25.335468 n-d-846209-2 devstack@n-api.service[103882]: Python main interpreter initialized at 0x5577a0cc49c0 Jun 16 18:16:25.335468 n-d-846209-2 devstack@n-api.service[103882]: python threads support enabled Jun 16 18:16:25.335468 n-d-846209-2 devstack@n-api.service[103882]: your server socket listen backlog is limited to 100 connections Jun 16 18:16:25.335468 n-d-846209-2 devstack@n-api.service[103882]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:16:25.335890 n-d-846209-2 devstack@n-api.service[103882]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:16:25.335890 n-d-846209-2 devstack@n-api.service[103882]: *** Operational MODE: preforking *** Jun 16 18:16:25.336189 n-d-846209-2 devstack@n-api.service[103882]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:16:25.336189 n-d-846209-2 devstack@n-api.service[103882]: spawned uWSGI master process (pid: 103882) Jun 16 18:16:25.336412 n-d-846209-2 systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:16:25.337523 n-d-846209-2 devstack@n-api.service[103882]: spawned uWSGI worker 1 (pid: 103883, cores: 1) Jun 16 18:16:25.337523 n-d-846209-2 devstack@n-api.service[103882]: spawned uWSGI worker 2 (pid: 103884, cores: 1) Jun 16 18:16:25.337523 n-d-846209-2 devstack@n-api.service[103882]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:16:26.024523 n-d-846209-2 devstack@n-api.service[103883]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:16:26.053145 n-d-846209-2 devstack@n-api.service[103884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:16:27.216718 n-d-846209-2 devstack@n-api.service[103883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:16:27.216718 n-d-846209-2 devstack@n-api.service[103883]: from cryptography.utils import int_from_bytes Jun 16 18:16:27.217351 n-d-846209-2 devstack@n-api.service[103883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:16:27.217351 n-d-846209-2 devstack@n-api.service[103883]: from cryptography.utils import int_from_bytes Jun 16 18:16:27.228549 n-d-846209-2 devstack@n-api.service[103884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:16:27.228549 n-d-846209-2 devstack@n-api.service[103884]: from cryptography.utils import int_from_bytes Jun 16 18:16:27.229063 n-d-846209-2 devstack@n-api.service[103884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:16:27.229063 n-d-846209-2 devstack@n-api.service[103884]: from cryptography.utils import int_from_bytes Jun 16 18:16:29.811510 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:16:29.812085 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:16:29.812268 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:16:29.812503 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:16:29.812920 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:16:29.813021 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:16:29.813118 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:16:29.813203 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.813290 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:16:29.813525 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.813627 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:16:29.813839 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.813964 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:16:29.814192 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.814373 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.814518 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.814617 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.814820 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.814909 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.815133 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.815235 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.815447 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.815542 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.815758 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.815851 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.816010 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.816108 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.816320 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.816416 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.816637 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846209-2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.816736 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.816927 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.817014 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.817234 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.817328 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.817537 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.817638 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846209-2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.817846 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.817965 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.818173 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.818270 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.818477 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.818573 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.818776 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.818918 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.819080 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.819325 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.819628 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.819749 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.819855 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.820004 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.820171 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.820305 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.820481 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.820626 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.820784 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.820935 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.821095 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.821234 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.821434 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.821586 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.821822 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.821948 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.822160 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.822269 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.822460 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.823181 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.823330 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.823476 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846209-2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.823660 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.823922 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.824066 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.824208 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.824354 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.824478 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846209-2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.824639 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.824782 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.824945 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.825080 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.825249 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.825381 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.825566 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.825709 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.825882 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.826048 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.826207 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.826344 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.826529 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.826672 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.826845 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.826976 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.827158 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.827295 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.827469 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.827606 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.827764 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.827902 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.828065 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.828201 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.828374 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.828505 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.828670 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.828800 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.828973 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.829100 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.829272 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.829409 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.829542 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.829676 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.829803 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.829970 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.830133 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.830263 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.830395 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.830527 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.830700 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.830842 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.830980 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.831113 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.831246 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.831385 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.831535 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.831739 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.831872 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.832008 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.832145 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.832272 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.832408 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.832544 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.832757 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.832893 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.833029 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.833174 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.833301 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.833426 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.833557 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.833689 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.833815 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.834011 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.834151 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.834316 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.834445 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.834621 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.834756 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.834924 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.835067 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.835228 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.835365 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.835546 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.835675 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.835857 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.836000 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.836175 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.836312 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.836481 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.836626 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.836796 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.836932 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.837119 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.837259 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.837421 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.837559 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.837727 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.837857 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.838117 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.838389 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.839048 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.839212 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.839344 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.839477 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.839603 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.839738 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.839925 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.840069 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.840233 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.840395 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.840532 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.840702 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.840911 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.841040 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.841165 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.841297 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.841431 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.841564 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.841713 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.841940 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.842075 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.842213 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.842347 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.842482 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.842617 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.842766 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.842960 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.843089 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.843213 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.843349 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.843486 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.843612 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.843744 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.843875 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.844001 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.844126 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.844292 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.844423 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.844597 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.844727 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.844900 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.845039 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.845202 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.845339 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.845505 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.845643 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.845805 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.845975 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.846133 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.846269 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.846435 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.846573 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.846736 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.846879 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.847013 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.847139 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.847313 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.847455 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.847625 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.847769 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.847924 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.848054 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.848221 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.848358 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.848524 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.848664 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.848801 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.848933 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.849098 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.849229 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.849408 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.849547 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.849706 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.849846 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.850015 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.850145 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.850322 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.850464 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.850614 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.850751 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.850915 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.851052 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.851214 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.851364 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.851514 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.851649 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.851812 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.851951 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.852152 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.852290 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.852420 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.852545 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.852679 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.852805 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.852958 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.853157 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.853284 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.853407 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.853540 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.853671 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.853804 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.854028 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.854219 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.854372 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.854510 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.854636 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.854797 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.855019 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.855165 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.855289 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.855500 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.855660 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.855796 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.855922 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.856056 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.856242 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.856374 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.856542 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.856672 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.856858 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:16:29.856988 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.857193 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.857321 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.857521 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.857649 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.857846 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.858035 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.858190 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.858337 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.858498 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.858628 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.858810 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.858948 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.859133 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.859281 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.859440 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.859570 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.859747 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.859877 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.860053 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.860194 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.860364 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.860492 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.860675 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.860813 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.860982 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.861120 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.861300 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.861513 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.861642 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.861767 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.861892 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.862059 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.862267 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.862399 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.862532 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.862658 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.862832 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.862977 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.863156 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.863282 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.863464 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.863567 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.863790 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.863904 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.864112 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.864219 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.864418 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.864516 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.864737 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.864836 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.865050 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.865148 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.865358 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.865468 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.865662 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.865761 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.865989 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.866104 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.866307 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.866397 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.866613 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.866709 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.866922 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.867010 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.867234 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.867324 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.867541 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.867642 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.867845 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.867933 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.868153 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.868251 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.868460 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.868556 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.868762 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.868849 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.869065 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.869163 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.869378 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.869487 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.869709 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.869887 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.870150 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.870265 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.870560 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.870654 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.870876 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.870974 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.871189 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.871287 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.871507 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.871595 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.871806 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.871894 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.872112 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.872278 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.872491 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.872632 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.872761 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.872887 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.873029 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.873164 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.873382 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.873519 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.873652 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.873790 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.873972 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.874101 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.874227 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.874364 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.874499 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.874637 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.874798 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.874930 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.875104 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.875243 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.875410 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.875552 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.875709 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.875839 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.876016 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.876142 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.876319 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.876459 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.876619 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.876749 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.876931 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.877058 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.877233 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.877369 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.877792 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.877952 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.878140 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.878267 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.878440 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.878583 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.878740 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.878867 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.879045 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.879173 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.879349 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.879473 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.879650 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.879778 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.879950 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.880083 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.880254 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.880384 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.880561 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.880687 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.880865 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.880993 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.881181 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.881334 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.881496 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.881633 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.881809 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.881970 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.882119 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.882237 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.882438 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.882646 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.882784 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.882921 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.883047 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.883173 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.883338 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.883545 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.883672 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.883811 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.883937 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.884069 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.884203 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.884338 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.884492 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.884632 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.884798 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.884933 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.885610 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.885750 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.886065 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.886227 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.886358 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.886493 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.886617 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.886743 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.886877 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.887005 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.887171 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.887302 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.887475 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.887606 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.887779 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.887917 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.888103 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.888233 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.888410 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.888555 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.888714 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.888845 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.889018 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.889161 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.889320 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.889451 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.889659 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.889791 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.889985 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.890118 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.890304 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.890521 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.890652 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.890786 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.890920 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.891047 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.891206 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.891381 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.891509 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.891636 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.891811 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.891942 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.892121 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.892267 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.892440 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.892570 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.892776 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.892915 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.893042 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.893180 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.893344 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.893473 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.893677 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.893807 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.893983 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.894130 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.894297 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.894428 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.894596 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.894725 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.894910 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.895042 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.895226 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.895355 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.895524 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.895652 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.895832 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.895964 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.896162 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.896290 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.896470 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.896608 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.896781 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.896920 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.897088 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.897218 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.897395 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.897533 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.897753 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.897887 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.898114 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.898306 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.898445 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.898637 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.898769 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.898952 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.899090 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.899273 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.899403 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.899581 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.899707 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.899902 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.900042 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.900212 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.900342 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.900531 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.900659 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.901409 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.901542 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.901804 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.901970 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.902148 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.902280 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.902469 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.902599 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.902781 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.902903 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.903095 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.903212 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.903415 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.903519 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.903726 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.903837 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.904033 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.904136 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.904340 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.904439 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.904640 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.904752 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.904943 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.905042 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.905246 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.905350 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.905553 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.905661 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.905857 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.906061 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.906190 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.906317 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.906476 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.906630 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.906781 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.906910 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.907084 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.907212 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.907386 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.907518 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.907686 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.907825 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.907987 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.908122 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.908290 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.908422 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.908602 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.908731 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.908914 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.909049 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.909220 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.909357 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.909517 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.909653 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.909815 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.909973 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.910158 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.910289 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.910461 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.910599 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.910756 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.910894 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.911054 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.911184 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.911351 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.911481 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.911657 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.911795 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.911967 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.912105 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.912263 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.912398 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.912586 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.912727 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.912868 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.913061 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.913191 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.913316 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.913440 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.913576 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.913744 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.913970 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.914115 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.914243 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.914380 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.914514 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.914680 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.914812 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.914982 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.915113 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.915288 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.915419 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.915591 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.915719 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.915890 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.916027 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.916195 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.916346 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.916548 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.916685 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.916860 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.917098 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.917240 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.917413 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.917550 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.917721 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.917853 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.918061 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.918191 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.918350 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.918488 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.918665 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.918795 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.918977 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.919238 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.919537 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.919674 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.919864 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.919993 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.920201 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.920329 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.920484 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.920616 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.920796 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.920924 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.921113 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.921242 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.921435 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.921570 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.921761 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.921898 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.922107 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.922254 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.922417 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.922561 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.922721 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.922858 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.923022 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.923231 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.923370 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.923496 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.923621 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.923745 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.923896 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.924103 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.924245 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.924371 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.924497 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.924629 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.924756 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.924890 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.925055 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.925185 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.925354 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.925485 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.925650 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.925788 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.925976 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.926119 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.926275 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.926403 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.926578 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.926716 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.926873 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.927002 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.927176 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.927306 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.927482 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.927625 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.927769 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.927897 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.928068 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.928199 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.928365 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.928496 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.928660 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.928789 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.928988 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.929123 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.929320 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.929510 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.929697 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.929825 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.929960 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.930088 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.930266 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.930385 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.930564 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.930681 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.930885 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.931011 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.931186 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.931304 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.931486 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.931602 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.931785 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.931914 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.932610 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.932730 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.932909 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.933071 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.933289 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.933515 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.933606 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.933818 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.933931 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.934160 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.934299 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.934464 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.934578 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.934759 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.934874 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.935058 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.935170 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.935355 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.935454 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.935660 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.935758 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.935962 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.936069 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.936259 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.936358 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.936556 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.936645 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.936858 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.936960 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.937156 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.937244 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.937452 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.937548 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.937756 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.937853 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.938075 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.938180 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.938383 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.938470 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.938685 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.938786 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.938984 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.939073 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.939281 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.939370 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.939583 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.939671 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.939881 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.939969 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.940177 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.940266 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.940482 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.940571 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.940783 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.940870 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.941081 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.941169 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.941378 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.941467 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.941679 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.941767 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.942000 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.942100 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.942298 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.942389 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.942601 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.942689 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.942902 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.943011 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.943209 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.943298 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.943504 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.943601 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.943805 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.943972 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.944102 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.944191 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.944401 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.944526 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.944791 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.944903 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.945103 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.945252 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.945409 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.945551 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.945687 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.945842 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.946033 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.946172 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.946313 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.946455 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.946597 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.946711 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.946945 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.947146 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.947303 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.947452 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.947678 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.948260 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.948453 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.948593 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.948742 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.948927 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.949081 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.949237 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.949372 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.949545 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.949680 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.949891 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.950019 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.950217 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.950308 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.950576 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.950666 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.950879 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.950969 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.951187 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.951284 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.951495 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.951584 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.951794 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.951988 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.952120 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.952260 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.952389 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.952556 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.952724 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.952862 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.952972 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.953154 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.953292 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.953521 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.953748 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.953888 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954063 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954192 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954327 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954454 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954589 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954716 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954855 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.954990 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.955116 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.955298 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.955428 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.955595 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.955729 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.955898 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.956037 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.956195 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.956395 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.956538 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.956669 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.956796 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.956921 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.957061 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.957196 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.957362 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.957501 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.957669 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.957800 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.958014 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.958164 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.958324 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.958456 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.958633 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.958772 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.958932 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.959060 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.959237 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.959367 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.959540 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.959678 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.959839 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.959968 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.960198 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.960369 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.960572 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.960795 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.960949 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.961077 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.961204 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.961330 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.961464 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.961600 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.961729 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.961855 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.962004 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.962115 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.962284 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.962520 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.962659 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.962829 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.963013 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.963138 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.963374 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.963506 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.963759 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.963883 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.964067 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.964234 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.964379 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.964549 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.964681 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.964862 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.964993 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.965165 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.965308 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.965574 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.965716 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.965878 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.966030 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.966209 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.966348 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.966558 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.966688 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.966814 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.966940 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.967075 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.967205 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.967376 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.967507 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.967695 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.967825 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.967995 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.968127 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.968294 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.968425 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.968595 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.968726 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.968916 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.969048 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.969214 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.969346 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.969528 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.969665 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.969849 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.970044 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.970247 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.970377 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.970549 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.970690 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.970873 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.971001 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.971244 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.971374 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.971549 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.971698 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.971866 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.971998 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.972180 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.972319 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.972496 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.972628 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.972795 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.972934 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.973086 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.973223 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.973389 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.973521 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.973694 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.973842 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.974051 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.974194 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.974324 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.974450 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.974621 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.974753 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.974921 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.975060 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.975232 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.975361 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.975544 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.975675 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.975851 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.975983 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.976160 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.976288 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.976481 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.976698 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.976864 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.976993 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.977169 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.977311 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.977485 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.977627 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.977803 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.977966 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.978131 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.978277 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.978432 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.978549 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.978738 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.978898 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.979092 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.979234 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.979422 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.979557 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.979692 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.979829 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.979995 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.980141 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.980301 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.980434 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.980613 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.980744 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.980914 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.981052 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.981215 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.981347 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.981515 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.981646 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.981819 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.981970 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.982146 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.982276 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.982463 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.982593 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.982768 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.982899 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.983084 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.983212 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.983398 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.983526 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.983700 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.983830 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984002 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984213 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984344 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984479 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984617 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984744 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984870 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.984998 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.985156 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.985296 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.985474 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.985604 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.985781 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.985934 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.986137 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.986284 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.986450 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.986581 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.986778 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.986901 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.987103 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.987261 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.987391 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.987517 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.987715 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.987848 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.988026 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.988158 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.988341 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.988472 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.988656 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.988786 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.988971 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.989101 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.989271 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.989402 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.989571 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.989700 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.989869 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.990041 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.990194 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.990337 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.990493 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.990622 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.990830 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.990958 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.991084 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.991209 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.991376 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.991515 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.991651 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.991779 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.991949 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.992071 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.992248 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.992387 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.992567 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.992706 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.992873 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.993003 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.993172 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.993312 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.993471 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.993603 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.993769 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.993900 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.994135 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.994357 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.995001 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.995133 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.995303 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.995503 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.995648 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.995777 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.995928 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.996060 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.996255 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.996387 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.996587 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.996721 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.996904 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.997040 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.997235 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.997337 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.997559 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.997659 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.997875 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.997996 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.998224 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.998345 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.998543 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.998660 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.998861 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.998960 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.999181 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.999273 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.999496 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.999594 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.999809 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:29.999898 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.000126 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.000225 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.000444 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.000534 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.000764 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.001035 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.001327 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.001432 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.001657 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.001755 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.001993 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.002087 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.002307 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.002413 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.002869 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.002957 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.003180 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.003271 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.003487 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.003593 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.003798 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.003897 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.004103 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.004253 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.004519 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.004660 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.004791 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.004920 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.005047 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.005207 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.005347 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.005483 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.005641 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.005798 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.006061 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.006256 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.006387 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.006514 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.006640 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.006766 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.006901 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.007060 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.007305 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.007435 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.007574 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.007709 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.007848 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.007977 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.008105 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.008232 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.008407 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.008539 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.008717 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.008857 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.009024 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.009166 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.009335 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.009464 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.009641 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.009771 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.009990 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.010153 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.010924 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.011094 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.011313 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.011443 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.011629 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.011761 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.011944 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.012086 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.012258 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.012397 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.012586 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.012721 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.012909 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.013049 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.013223 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.013355 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.013534 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.013695 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.013827 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.013978 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.014179 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.014435 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.014730 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.014874 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.015042 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.015175 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.015372 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.015503 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.015692 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.015822 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.016001 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.016131 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.016311 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.016441 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.016628 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.016758 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.016931 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.017060 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.017232 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.017469 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.017602 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.017737 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.017865 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.018023 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.018151 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.018290 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.018440 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.018580 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.018744 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.018874 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.019043 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.019175 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.019342 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.019480 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.019654 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.019783 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.019960 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.020180 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.020488 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.020622 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.020816 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.020945 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.021129 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.021258 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.021444 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.021574 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.021754 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.021886 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.022087 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.022230 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.022394 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.022525 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.022695 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.022833 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.023063 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.023193 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.023371 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.023503 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.023678 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.023809 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.023981 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.024125 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.024283 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.024404 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.024586 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.024791 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.024924 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.025060 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.025195 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.025324 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.025450 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.025585 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.026278 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.026480 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.026614 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.026771 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.027000 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.027129 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.027255 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.027395 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.027608 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.027739 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.027873 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.028009 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.028147 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.028276 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.028407 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.028542 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.028670 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.028804 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029015 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029155 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029290 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029418 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029545 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029671 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029812 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.029962 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.030093 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.030220 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.030347 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.030483 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.030621 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.030749 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.030924 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.031070 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.031269 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.031409 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.031587 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.031719 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.031889 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.032020 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.032190 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.032331 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.032504 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.032638 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.032811 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.032943 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.033129 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.033275 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.033435 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.033567 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.033740 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.033872 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.034108 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.034260 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.034422 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.034567 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.034838 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.034963 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.035268 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.035383 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.035584 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.035686 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.035912 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.036015 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.036239 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.036340 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.036544 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.036643 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.036845 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.036945 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.037146 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.037253 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.037465 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.037566 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.037771 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.037879 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.038103 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.038203 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.038410 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.038508 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.038718 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.038820 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.039021 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.039118 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.039325 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.039413 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.039633 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.039731 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.039935 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.040024 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.040240 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.040341 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.040545 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.040642 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.040846 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.040950 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.041150 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.041238 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.041592 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.041690 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.041971 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.042073 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.042778 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.042875 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.043115 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.043214 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.043431 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.043530 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.043745 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.043836 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.044066 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.044163 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.044367 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.044466 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.044674 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.044778 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.044975 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.045066 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.045281 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.045369 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.045588 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.045685 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.045899 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.046001 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.046231 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.046332 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.046533 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.046632 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.046840 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.046937 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.047242 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.047330 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.047555 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.047646 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.047872 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.047971 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.048171 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.048267 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.048484 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.048581 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.048799 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.048895 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.049104 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.049194 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.049412 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.049501 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.049722 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.049817 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.050052 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.050145 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.050382 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.050472 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.050703 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.050791 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.051021 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.051119 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.051324 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.051415 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.051621 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.051710 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.051921 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.052020 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.052221 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.052309 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.052529 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.052617 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.052831 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.052928 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.053133 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.053241 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.053432 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.053523 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.053730 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.053819 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.054052 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.054144 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.054352 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.054453 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.054651 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.054801 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.054950 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.055047 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.055251 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.055339 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.055544 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.055634 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.055841 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.055939 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.056140 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.056231 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.056439 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.056528 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.056734 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.056821 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.057066 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.057164 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.057371 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.057462 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.057668 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.057759 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.057988 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.058164 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.058284 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.058374 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.058581 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.058669 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.058878 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.059008 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.059173 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.059263 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.059505 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.059603 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.059815 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.059913 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.060132 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.060222 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.060438 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.060542 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.060745 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.060835 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.061043 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.061131 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.061356 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.061444 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.061717 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.061823 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.062027 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.062120 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.062333 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.062424 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.062644 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.062733 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.062951 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.063040 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.063258 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.063356 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.063566 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.063663 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.063868 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.063956 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.064170 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.064273 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.064474 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.064575 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.064782 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.064906 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.065102 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.065239 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.065404 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.065503 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.065715 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.065812 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.066051 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.066160 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.066367 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.066457 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.066677 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.066769 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.066984 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.067074 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.067289 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.067378 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.067599 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.067687 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.067903 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.068074 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.068209 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.068298 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.068511 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.068599 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.068816 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.068908 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.069123 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.069247 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.069438 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.069535 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.069760 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.069856 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.070258 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.070365 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.070448 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.070541 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.070734 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.070825 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.071054 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.071142 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.071375 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.071472 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.071691 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.071787 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.072019 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.072108 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.072341 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.072442 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.072939 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.073045 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.073357 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.073446 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.073546 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.073631 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:16:30.073713 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.073962 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:16:30.074190 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:16:30.137659 n-d-846209-2 devstack@n-api.service[103883]: INFO dbcounter [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Registered counter for database nova_api Jun 16 18:16:30.138355 n-d-846209-2 devstack@n-api.service[103884]: INFO dbcounter [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Registered counter for database nova_api Jun 16 18:16:30.159658 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_db.sqlalchemy.engines [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.161475 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_db.sqlalchemy.engines [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.166302 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writer thread running {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.168816 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writer thread running {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.223719 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.context [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=103883) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:16:30.225523 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.context [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=103884) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:16:30.227859 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:30.230096 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:30.230385 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_concurrency.lockutils [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:30.231694 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:30.231979 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_concurrency.lockutils [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:30.232789 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_concurrency.lockutils [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:30.234327 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:30.234806 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_concurrency.lockutils [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:30.236344 n-d-846209-2 devstack@n-api.service[103883]: INFO dbcounter [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Registered counter for database nova_cell0 Jun 16 18:16:30.236938 n-d-846209-2 devstack@n-api.service[103884]: INFO dbcounter [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Registered counter for database nova_cell0 Jun 16 18:16:30.240256 n-d-846209-2 devstack@n-api.service[103883]: INFO dbcounter [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Registered counter for database nova_cell1 Jun 16 18:16:30.240800 n-d-846209-2 devstack@n-api.service[103884]: INFO dbcounter [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Registered counter for database nova_cell1 Jun 16 18:16:30.247998 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_db.sqlalchemy.engines [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.249575 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_db.sqlalchemy.engines [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.252876 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_db.sqlalchemy.engines [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.253855 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writer thread running {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.255173 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writer thread running {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.255817 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_db.sqlalchemy.engines [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.396142 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writer thread running {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.400070 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writer thread running {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.407303 n-d-846209-2 devstack@n-api.service[103883]: INFO dbcounter [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Registered counter for database nova_cell0 Jun 16 18:16:30.410344 n-d-846209-2 devstack@n-api.service[103884]: INFO dbcounter [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Registered counter for database nova_cell0 Jun 16 18:16:30.414769 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_db.sqlalchemy.engines [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.419622 n-d-846209-2 devstack@n-api.service[103884]: DEBUG oslo_db.sqlalchemy.engines [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:16:30.420127 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writer thread running {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.424020 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writer thread running {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:16:30.765509 n-d-846209-2 devstack@n-api.service[103883]: WARNING keystonemiddleware.auth_token [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:16:30.767216 n-d-846209-2 devstack@n-api.service[103884]: WARNING keystonemiddleware.auth_token [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:16:30.772766 n-d-846209-2 devstack@n-api.service[103883]: WARNING keystonemiddleware.auth_token [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:16:30.774743 n-d-846209-2 devstack@n-api.service[103884]: WARNING keystonemiddleware.auth_token [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:16:31.120847 n-d-846209-2 devstack@n-api.service[103883]: WARNING keystonemiddleware.auth_token [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:16:31.126474 n-d-846209-2 devstack@n-api.service[103884]: WARNING keystonemiddleware.auth_token [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:16:31.126863 n-d-846209-2 devstack@n-api.service[103883]: WARNING keystonemiddleware.auth_token [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:16:31.132333 n-d-846209-2 devstack@n-api.service[103883]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577a0cc49c0 pid: 103883 (default app) Jun 16 18:16:31.132703 n-d-846209-2 devstack@n-api.service[103884]: WARNING keystonemiddleware.auth_token [None req-c76f97a0-4a62-497d-a6fa-0481e30a9d5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:16:31.134512 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:31.136255 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002365 Jun 16 18:16:31.136668 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Thu Jun 16 18:16:31 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:31.138905 n-d-846209-2 devstack@n-api.service[103884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577a0cc49c0 pid: 103884 (default app) Jun 16 18:17:50.836291 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:50.839620 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002215 Jun 16 18:17:50.840224 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:17:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:50.852880 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writing DB stats nova_api:SELECT=3 {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:50.854539 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writing DB stats nova_cell0:SELECT=3 {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:50.855458 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writing DB stats nova_cell1:SELECT=3 {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:50.857748 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:51.326287 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-12539064-e52c-4c56-a23d-3711f3f43196 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:51.362595 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-12539064-e52c-4c56-a23d-3711f3f43196 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.515038 Jun 16 18:17:51.363136 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:17:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:53.599845 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:53.600855 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-9459d747-cd25-4641-80bd-15a664adafdc None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 16 18:17:53.601248 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:53.670061 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3f1f4417-8cbe-4f02-b781-62affa32e23e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:53.690281 n-d-846209-2 devstack@n-api.service[103884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:17:53.690281 n-d-846209-2 devstack@n-api.service[103884]: warnings.warn(msg) Jun 16 18:17:53.730413 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3f1f4417-8cbe-4f02-b781-62affa32e23e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.122128 Jun 16 18:17:53.731306 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:17:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:17:53.746050 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writing DB stats nova_api:SELECT=3 {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:53.747326 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writing DB stats nova_cell1:SELECT=3 {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:53.748150 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writing DB stats nova_cell0:SELECT=3 {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:53.749241 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:53.967314 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-ab1c9f07-358e-43ad-96b2-a14efb96e924 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:53.969846 n-d-846209-2 devstack@n-api.service[103883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:17:53.969846 n-d-846209-2 devstack@n-api.service[103883]: warnings.warn(msg) Jun 16 18:17:54.035371 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-ab1c9f07-358e-43ad-96b2-a14efb96e924 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295401 Jun 16 18:17:54.046108 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jun 16 18:17:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:56.324730 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3f1f4417-8cbe-4f02-b781-62affa32e23e admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:56.325752 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3f1f4417-8cbe-4f02-b781-62affa32e23e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 16 18:17:56.326626 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:56.444096 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-888483a8-9e16-47c2-89b5-3547fbb879cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:56.464671 n-d-846209-2 devstack@n-api.service[103883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:17:56.464671 n-d-846209-2 devstack@n-api.service[103883]: warnings.warn(msg) Jun 16 18:17:56.485462 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-888483a8-9e16-47c2-89b5-3547fbb879cf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152218 Jun 16 18:17:56.486639 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:17:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:17:56.507851 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-9eb75873-d750-4eb7-9df6-1a6f4d94baff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:56.509999 n-d-846209-2 devstack@n-api.service[103884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:17:56.509999 n-d-846209-2 devstack@n-api.service[103884]: warnings.warn(msg) Jun 16 18:17:56.544228 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-9eb75873-d750-4eb7-9df6-1a6f4d94baff admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048216 Jun 16 18:17:56.544973 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jun 16 18:17:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:58.819153 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-888483a8-9e16-47c2-89b5-3547fbb879cf admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:58.821419 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-888483a8-9e16-47c2-89b5-3547fbb879cf admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002767 Jun 16 18:17:58.823797 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:58.908866 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-065d961d-b65f-4035-a24b-c40683ca3642 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:58.937686 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-065d961d-b65f-4035-a24b-c40683ca3642 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107517 Jun 16 18:17:58.938593 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:17:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:17:58.959077 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-e1610a95-9c3b-43a7-8b11-5a82ca5fbfd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:58.990692 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-e1610a95-9c3b-43a7-8b11-5a82ca5fbfd3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036051 Jun 16 18:17:58.991891 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jun 16 18:17:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:01.491648 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-065d961d-b65f-4035-a24b-c40683ca3642 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:01.492707 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-065d961d-b65f-4035-a24b-c40683ca3642 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 16 18:18:01.493113 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:01.560483 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-271a25ff-501f-4fed-a502-c596e36208b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:01.582589 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-271a25ff-501f-4fed-a502-c596e36208b6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082743 Jun 16 18:18:01.591736 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:18:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:18:01.595845 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-b7f35785-9c43-4851-b622-5b80fdedfb56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:01.625567 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-b7f35785-9c43-4851-b622-5b80fdedfb56 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033295 Jun 16 18:18:01.627085 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jun 16 18:18:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:18:04.152439 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-271a25ff-501f-4fed-a502-c596e36208b6 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:04.153446 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-271a25ff-501f-4fed-a502-c596e36208b6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 16 18:18:04.153860 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:18:04.227566 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-979b4782-04f6-47f7-b42a-95113574f5df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "vcpus": 4}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:04.250302 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-979b4782-04f6-47f7-b42a-95113574f5df admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085543 Jun 16 18:18:04.250929 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:18:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:18:04.268438 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-e294098b-20a0-4b4f-b4a0-38d767698974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:04.296688 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-e294098b-20a0-4b4f-b4a0-38d767698974 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031989 Jun 16 18:18:04.297263 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jun 16 18:18:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:06.912067 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-979b4782-04f6-47f7-b42a-95113574f5df admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:06.913368 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-979b4782-04f6-47f7-b42a-95113574f5df admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001844 Jun 16 18:18:06.914358 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:07.012699 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-7841b253-cb27-41c0-b05f-c87b02dd3df2 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:07.045177 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-7841b253-cb27-41c0-b05f-c87b02dd3df2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.123808 Jun 16 18:18:07.046104 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:18:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:09.776940 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-979b4782-04f6-47f7-b42a-95113574f5df admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:09.778027 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-979b4782-04f6-47f7-b42a-95113574f5df admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002722 Jun 16 18:18:09.778460 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:09.863381 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-7c36581a-4455-4d8f-88bc-d20d77ce9e81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:09.887985 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-7c36581a-4455-4d8f-88bc-d20d77ce9e81 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.101329 Jun 16 18:18:09.888880 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:18:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:18:09.905279 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-ba297044-9f3a-447a-9668-1d39860c1ced admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:09.939481 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-ba297044-9f3a-447a-9668-1d39860c1ced admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041490 Jun 16 18:18:09.954009 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jun 16 18:18:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:13.202634 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-7c36581a-4455-4d8f-88bc-d20d77ce9e81 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:13.204306 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-7c36581a-4455-4d8f-88bc-d20d77ce9e81 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002141 Jun 16 18:18:13.210874 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:13.289131 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-25e25f20-b9ce-47d1-b1a3-c9638c954f8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:13.333591 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-25e25f20-b9ce-47d1-b1a3-c9638c954f8e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.120853 Jun 16 18:18:13.336249 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:18:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:18:13.348366 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-a0efb3f4-811e-4c7e-978c-b2a4f1b058d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:13.378366 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-a0efb3f4-811e-4c7e-978c-b2a4f1b058d6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033519 Jun 16 18:18:13.394525 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jun 16 18:18:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:16.096731 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-25e25f20-b9ce-47d1-b1a3-c9638c954f8e admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:16.097826 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-25e25f20-b9ce-47d1-b1a3-c9638c954f8e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jun 16 18:18:16.098296 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:16.193079 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-cf414417-73a0-45e6-82ef-495ff8522f70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "name": "m1.medium"}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:16.220421 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-cf414417-73a0-45e6-82ef-495ff8522f70 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.112220 Jun 16 18:18:16.221187 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:18:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:18:16.244798 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-0af36c65-882f-45cc-81eb-9de0487d7940 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:16.275654 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-0af36c65-882f-45cc-81eb-9de0487d7940 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042273 Jun 16 18:18:16.276334 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jun 16 18:18:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:18.930905 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-cf414417-73a0-45e6-82ef-495ff8522f70 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:18.932596 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-cf414417-73a0-45e6-82ef-495ff8522f70 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Jun 16 18:18:18.933009 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:19.029294 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-29ed921d-956c-49c5-af6e-3fde3d594968 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:19.055100 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-29ed921d-956c-49c5-af6e-3fde3d594968 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.108241 Jun 16 18:18:19.056167 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:18:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:18:19.076277 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-eb1632a1-0ca4-4730-9bf5-70ebc5fb01f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:19.113671 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-eb1632a1-0ca4-4730-9bf5-70ebc5fb01f8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044015 Jun 16 18:18:19.114269 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jun 16 18:18:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:21.601298 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-29ed921d-956c-49c5-af6e-3fde3d594968 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:21.602636 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-29ed921d-956c-49c5-af6e-3fde3d594968 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Jun 16 18:18:21.603446 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:21.677045 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-dde5ca54-0308-4298-ab5e-597ed2f91c90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:21.710354 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-dde5ca54-0308-4298-ab5e-597ed2f91c90 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.096366 Jun 16 18:18:21.711703 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jun 16 18:18:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:18:21.725053 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-9cdadd6e-b414-4d93-a01a-21b7abf02c34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:21.729261 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:18:21.752720 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-9cdadd6e-b414-4d93-a01a-21b7abf02c34 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031479 Jun 16 18:18:21.753578 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jun 16 18:18:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:51.839403 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-dde5ca54-0308-4298-ab5e-597ed2f91c90 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:51.840454 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-dde5ca54-0308-4298-ab5e-597ed2f91c90 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 16 18:18:51.840857 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:18:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:51.851842 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:18:51.905485 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-dbcf7dbf-f599-4d7d-898e-c88a683ffea0 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:51.923020 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-dbcf7dbf-f599-4d7d-898e-c88a683ffea0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075603 Jun 16 18:18:51.923566 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:18:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:52.922034 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-dde5ca54-0308-4298-ab5e-597ed2f91c90 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:52.923807 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-dde5ca54-0308-4298-ab5e-597ed2f91c90 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 16 18:18:52.924058 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:53.141736 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-b13055f2-3eb5-4d01-b219-e10a34ff1e17 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:53.147417 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.wsgi [None req-b13055f2-3eb5-4d01-b219-e10a34ff1e17 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-b13055f2-3eb5-4d01-b219-e10a34ff1e17 admin admin] Request method failure captured: Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: Accept: application/json Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: Accept-Encoding: gzip, deflate Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: Connection: keep-alive Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: Content-Length: 0 Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: Host: 10.222.0.27 Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: Openstack-Api-Version: compute 2.90 Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: Openstack-System-Scope: None Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: User-Agent: python-novaclient Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Auth-Token: gAAAAABiq3QMSNR7pQCHkfTVcjggEekiLKoDP9RpRlfX5y82oFh-5b89eq2Q8DpL3WIzuruXpQzkSceUlf-igM7nMN2JYGwv3GbB5_ohbgKeRVP1lzX84pwSyidOZOys14b3_aYYVWWyK0iZ_itA3oSBPudqIVWbMzlExQncm9RS8kE4gTgjFtM Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Domain-Id: None Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Domain-Name: None Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Identity-Status: Confirmed Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Is-Admin-Project: True Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Domain-Id: default Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Domain-Name: Default Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Name: admin Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Role: member,admin,reader Jun 16 18:18:53.151302 n-d-846209-2 devstack@n-api.service[103884]: X-Roles: member,admin,reader Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6dc5aff04774f5ba2e3780674d9ea59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant: admin Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant-Name: admin Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-User: admin Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-User-Domain-Id: default Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-User-Domain-Name: Default Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-User-Id: b36b1839e5a844789f6e3ac1799c9848 Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: X-User-Name: admin Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: method: > Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: exception: Flavor 42 could not be found. Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: action_args: {'id': '42'} Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:53.153004 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:53.154179 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.155659 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-b13055f2-3eb5-4d01-b219-e10a34ff1e17 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:53.156943 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-b13055f2-3eb5-4d01-b219-e10a34ff1e17 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065907 Jun 16 18:18:53.156943 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:18:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:18:53.162441 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-57abcf63-c2d6-4e6d-bd6f-2d80d4284460 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:53.165407 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:18:53.186766 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-57abcf63-c2d6-4e6d-bd6f-2d80d4284460 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027876 Jun 16 18:18:53.187338 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:18:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:53.206771 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-de4f7b07-4933-436d-86e5-5c65aaef5fac admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:53.230137 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-de4f7b07-4933-436d-86e5-5c65aaef5fac admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026944 Jun 16 18:18:53.230705 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:18:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:53.240280 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-e634c443-c277-41b5-a765-de9507ee0fcd admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:53.247945 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.wsgi [None req-e634c443-c277-41b5-a765-de9507ee0fcd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-e634c443-c277-41b5-a765-de9507ee0fcd admin admin] Request method failure captured: Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: Accept: application/json Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: Accept-Encoding: gzip, deflate Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: Connection: keep-alive Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: Content-Length: 0 Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: Host: 10.222.0.27 Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: Openstack-Api-Version: compute 2.90 Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: Openstack-System-Scope: None Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: User-Agent: python-novaclient Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Auth-Token: gAAAAABiq3QMSNR7pQCHkfTVcjggEekiLKoDP9RpRlfX5y82oFh-5b89eq2Q8DpL3WIzuruXpQzkSceUlf-igM7nMN2JYGwv3GbB5_ohbgKeRVP1lzX84pwSyidOZOys14b3_aYYVWWyK0iZ_itA3oSBPudqIVWbMzlExQncm9RS8kE4gTgjFtM Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Domain-Id: None Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Domain-Name: None Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Identity-Status: Confirmed Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Is-Admin-Project: True Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Domain-Id: default Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Domain-Name: Default Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Name: admin Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Role: member,admin,reader Jun 16 18:18:53.251250 n-d-846209-2 devstack@n-api.service[103883]: X-Roles: member,admin,reader Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6dc5aff04774f5ba2e3780674d9ea59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant: admin Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant-Name: admin Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-User: admin Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-User-Domain-Id: default Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-User-Domain-Name: Default Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-User-Id: b36b1839e5a844789f6e3ac1799c9848 Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: X-User-Name: admin Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: method: > Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: exception: Flavor 42 could not be found. Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: action_args: {'id': '42'} Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:53.252791 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:53.253696 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:53.254983 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-e634c443-c277-41b5-a765-de9507ee0fcd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:53.256194 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-e634c443-c277-41b5-a765-de9507ee0fcd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015971 Jun 16 18:18:53.256194 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:18:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:18:54.150386 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-de4f7b07-4933-436d-86e5-5c65aaef5fac admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:54.151488 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-de4f7b07-4933-436d-86e5-5c65aaef5fac admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Jun 16 18:18:54.151886 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:54.351824 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-116a234a-4961-4af6-95c1-5bc30de6d9f6 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:54.358240 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.wsgi [None req-116a234a-4961-4af6-95c1-5bc30de6d9f6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-116a234a-4961-4af6-95c1-5bc30de6d9f6 admin admin] Request method failure captured: Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: Accept: application/json Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: Accept-Encoding: gzip, deflate Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: Connection: keep-alive Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: Content-Length: 0 Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: Host: 10.222.0.27 Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: Openstack-Api-Version: compute 2.90 Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: Openstack-System-Scope: None Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: User-Agent: python-novaclient Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Auth-Token: gAAAAABiq3QOnt1PDmCkFIzdAbateC_kqMaGWbfwhImzMSodlTXMBkeW87wxX4tZj28y96jxdScOFyi5VGAw03dB6vqF-lPUMSBsvc314v1AwG0FpHV1FVQnJreowRSByjWUCBlM8GKCDi80qkpEyrZp8rFoaoGnx3bIFsdA099D1BHfmkQ8Cx8 Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Domain-Id: None Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Domain-Name: None Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Identity-Status: Confirmed Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Is-Admin-Project: True Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Domain-Id: default Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Domain-Name: Default Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Name: admin Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Role: member,admin,reader Jun 16 18:18:54.359797 n-d-846209-2 devstack@n-api.service[103883]: X-Roles: member,admin,reader Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6dc5aff04774f5ba2e3780674d9ea59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant: admin Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant-Name: admin Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-User: admin Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-User-Domain-Id: default Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-User-Domain-Name: Default Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-User-Id: b36b1839e5a844789f6e3ac1799c9848 Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: X-User-Name: admin Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: method: > Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: exception: Flavor 84 could not be found. Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: action_args: {'id': '84'} Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:54.361367 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:54.362311 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.363546 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-116a234a-4961-4af6-95c1-5bc30de6d9f6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:54.364845 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-116a234a-4961-4af6-95c1-5bc30de6d9f6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067558 Jun 16 18:18:54.364845 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:18:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:18:54.374452 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-b0de815a-dcf3-4cbf-8ee1-f8e3f619223b admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:54.392608 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-b0de815a-dcf3-4cbf-8ee1-f8e3f619223b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021680 Jun 16 18:18:54.393184 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:18:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:54.403073 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-72e7081e-520f-49a6-b744-8ca900259fec admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:54.418772 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-72e7081e-520f-49a6-b744-8ca900259fec admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019238 Jun 16 18:18:54.419355 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:18:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:54.429393 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-dfb75582-e404-420c-9c8e-d88f8c0e6f90 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:54.436047 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.wsgi [None req-dfb75582-e404-420c-9c8e-d88f8c0e6f90 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-dfb75582-e404-420c-9c8e-d88f8c0e6f90 admin admin] Request method failure captured: Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: Accept: application/json Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: Accept-Encoding: gzip, deflate Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: Connection: keep-alive Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: Content-Length: 0 Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: Host: 10.222.0.27 Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: Openstack-Api-Version: compute 2.90 Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: Openstack-System-Scope: None Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: User-Agent: python-novaclient Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Auth-Token: gAAAAABiq3QOnt1PDmCkFIzdAbateC_kqMaGWbfwhImzMSodlTXMBkeW87wxX4tZj28y96jxdScOFyi5VGAw03dB6vqF-lPUMSBsvc314v1AwG0FpHV1FVQnJreowRSByjWUCBlM8GKCDi80qkpEyrZp8rFoaoGnx3bIFsdA099D1BHfmkQ8Cx8 Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Domain-Id: None Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Domain-Name: None Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Identity-Status: Confirmed Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Is-Admin-Project: True Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Domain-Id: default Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Domain-Name: Default Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Name: admin Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Role: member,admin,reader Jun 16 18:18:54.437593 n-d-846209-2 devstack@n-api.service[103884]: X-Roles: member,admin,reader Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6dc5aff04774f5ba2e3780674d9ea59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant: admin Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant-Name: admin Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-User: admin Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-User-Domain-Id: default Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-User-Domain-Name: Default Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-User-Id: b36b1839e5a844789f6e3ac1799c9848 Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: X-User-Name: admin Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: method: > Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: exception: Flavor 84 could not be found. Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: action_args: {'id': '84'} Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:54.439185 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:54.440220 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:54.441668 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-dfb75582-e404-420c-9c8e-d88f8c0e6f90 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:54.443040 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-dfb75582-e404-420c-9c8e-d88f8c0e6f90 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013602 Jun 16 18:18:54.443040 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:18:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:18:55.333007 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-72e7081e-520f-49a6-b744-8ca900259fec admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:55.334669 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-72e7081e-520f-49a6-b744-8ca900259fec admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Jun 16 18:18:55.335169 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:55.538565 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-459203fb-74ab-47d3-a705-6300f8525661 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:55.549250 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.wsgi [None req-459203fb-74ab-47d3-a705-6300f8525661 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-459203fb-74ab-47d3-a705-6300f8525661 admin admin] Request method failure captured: Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: Accept: application/json Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: Accept-Encoding: gzip, deflate Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: Connection: keep-alive Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: Content-Length: 0 Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: Host: 10.222.0.27 Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: Openstack-Api-Version: compute 2.90 Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: Openstack-System-Scope: None Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: User-Agent: python-novaclient Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Auth-Token: gAAAAABiq3QPn2XPnRha7sWsAiUsXnkU67Ag8wXazEXJ0qsa5cVLIQUQXrionML6TTbflAtv__a0xVKPyDeZYEF3_TO_HWzbyQge48aHYwwleHn7hV3my4VB0pXw6YPl5OBh5vEDXycCxsvdN2WRF-3E9DeLyEv8_0vGDdAyU1SNRjIJi_8av28 Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Domain-Id: None Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Domain-Name: None Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Identity-Status: Confirmed Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Is-Admin-Project: True Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Domain-Id: default Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Domain-Name: Default Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Project-Name: admin Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Role: member,admin,reader Jun 16 18:18:55.551908 n-d-846209-2 devstack@n-api.service[103884]: X-Roles: member,admin,reader Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6dc5aff04774f5ba2e3780674d9ea59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant: admin Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-Tenant-Name: admin Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-User: admin Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-User-Domain-Id: default Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-User-Domain-Name: Default Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-User-Id: b36b1839e5a844789f6e3ac1799c9848 Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: X-User-Name: admin Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: method: > Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: exception: Flavor 451 could not be found. Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: action_args: {'id': '451'} Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:55.553615 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:55.554551 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.555617 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-459203fb-74ab-47d3-a705-6300f8525661 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:55.556989 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-459203fb-74ab-47d3-a705-6300f8525661 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.078188 Jun 16 18:18:55.556989 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:18:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:18:55.564836 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-7b27ad43-b65f-43cc-92dc-03456cd9625b admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:55.579103 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-7b27ad43-b65f-43cc-92dc-03456cd9625b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017785 Jun 16 18:18:55.579701 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:18:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:55.591018 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:55.605922 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019331 Jun 16 18:18:55.606496 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:18:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:55.616707 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-12610431-7e44-493f-b061-c742534b2c30 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:55.622641 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.wsgi [None req-12610431-7e44-493f-b061-c742534b2c30 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-12610431-7e44-493f-b061-c742534b2c30 admin admin] Request method failure captured: Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: Accept: application/json Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: Accept-Encoding: gzip, deflate Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: Connection: keep-alive Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: Content-Length: 0 Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: Host: 10.222.0.27 Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: Openstack-Api-Version: compute 2.90 Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: Openstack-System-Scope: None Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: User-Agent: python-novaclient Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Auth-Token: gAAAAABiq3QPn2XPnRha7sWsAiUsXnkU67Ag8wXazEXJ0qsa5cVLIQUQXrionML6TTbflAtv__a0xVKPyDeZYEF3_TO_HWzbyQge48aHYwwleHn7hV3my4VB0pXw6YPl5OBh5vEDXycCxsvdN2WRF-3E9DeLyEv8_0vGDdAyU1SNRjIJi_8av28 Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Domain-Id: None Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Domain-Name: None Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Identity-Status: Confirmed Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Is-Admin-Project: True Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Domain-Id: default Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Domain-Name: Default Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Project-Name: admin Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Role: member,admin,reader Jun 16 18:18:55.624166 n-d-846209-2 devstack@n-api.service[103883]: X-Roles: member,admin,reader Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6dc5aff04774f5ba2e3780674d9ea59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6dc5aff04774f5ba2e3780674d9ea59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant: admin Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant-Id: c6dc5aff04774f5ba2e3780674d9ea59 Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-Tenant-Name: admin Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-User: admin Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-User-Domain-Id: default Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-User-Domain-Name: Default Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-User-Id: b36b1839e5a844789f6e3ac1799c9848 Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: X-User-Name: admin Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: method: > Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: exception: Flavor 451 could not be found. Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: action_args: {'id': '451'} Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:55.626657 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:55.628464 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: ERROR nova.api.openstack.wsgi Jun 16 18:18:55.630497 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-12610431-7e44-493f-b061-c742534b2c30 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:55.632376 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-12610431-7e44-493f-b061-c742534b2c30 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012710 Jun 16 18:18:55.632376 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:18:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:18:56.557258 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:56.558325 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jun 16 18:18:56.561485 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:18:56.782975 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-3f63514e-3e67-4abb-a38f-8d41f0ee2a32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:56.807531 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-3f63514e-3e67-4abb-a38f-8d41f0ee2a32 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085126 Jun 16 18:18:56.808096 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jun 16 18:18:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:18:57.741348 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:57.742425 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 16 18:18:57.742824 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:57.950128 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-6b705603-fe59-4193-839e-d51e1906a09e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:57.971310 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-6b705603-fe59-4193-839e-d51e1906a09e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.079015 Jun 16 18:18:57.971889 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jun 16 18:18:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:18:58.918206 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:58.919216 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 16 18:18:58.919621 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:59.136761 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-070b03a7-3beb-48b9-a03f-20d7352c0e85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:59.157773 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-070b03a7-3beb-48b9-a03f-20d7352c0e85 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083030 Jun 16 18:18:59.158399 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jun 16 18:18:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:19:00.103005 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:00.104481 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Jun 16 18:19:00.104889 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:19:00.315865 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-1d25f6ed-da4a-4e0c-86c9-d2ae91a65dad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:19:00.336016 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-1d25f6ed-da4a-4e0c-86c9-d2ae91a65dad admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083771 Jun 16 18:19:00.336749 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jun 16 18:19:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:19:01.314642 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:01.316022 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jun 16 18:19:01.316608 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:19:01.535654 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-d5c46d95-d07a-4d54-80c8-7cc96480d528 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:01.562309 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-d5c46d95-d07a-4d54-80c8-7cc96480d528 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.096395 Jun 16 18:19:01.562981 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Thu Jun 16 18:19:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:19:52.247395 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:52.248796 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-3dd41e8c-309b-4ff5-ab47-d364d3f1dd5c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jun 16 18:19:52.249218 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jun 16 18:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:19:52.261378 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:19:52.318185 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-9593b915-6cfd-4a90-b60d-fc7321515f83 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:52.340455 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-9593b915-6cfd-4a90-b60d-fc7321515f83 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084539 Jun 16 18:19:52.341002 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:19:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:19:52.365044 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-49eb54f2-c9a9-446e-819e-37f9fd2ecab5 admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:52.371737 n-d-846209-2 devstack@n-api.service[103884]: DEBUG dbcounter [-] [103884] Writing DB stats nova_api:SELECT=14 {{(pid=103884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:19:52.377768 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-49eb54f2-c9a9-446e-819e-37f9fd2ecab5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016538 Jun 16 18:19:52.378400 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1282 bytes} [Thu Jun 16 18:19:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:52.391291 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-3ee2f455-c0d1-4abb-a307-a33452513168 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:52.401330 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-3ee2f455-c0d1-4abb-a307-a33452513168 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013833 Jun 16 18:19:52.401762 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1285 bytes} [Thu Jun 16 18:19:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:52.424662 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-dd1afe89-fc16-4401-b614-443f0e3c9e6a admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:52.438702 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-dd1afe89-fc16-4401-b614-443f0e3c9e6a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.023425 Jun 16 18:19:52.439620 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1285 bytes} [Thu Jun 16 18:19:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:52.455973 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-71770fcf-2ccc-4e94-918f-0516e0965074 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:52.464673 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-71770fcf-2ccc-4e94-918f-0516e0965074 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012382 Jun 16 18:19:52.465239 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1282 bytes} [Thu Jun 16 18:19:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:25:21.665150 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-dd1afe89-fc16-4401-b614-443f0e3c9e6a admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:21.666190 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-dd1afe89-fc16-4401-b614-443f0e3c9e6a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 16 18:25:21.666585 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:25:21.823622 n-d-846209-2 devstack@n-api.service[103883]: DEBUG dbcounter [-] [103883] Writing DB stats nova_api:SELECT=6 {{(pid=103883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:25:21.948671 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-5e734f0f-62fa-48a8-958a-bb32fb87026d admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:21.949846 n-d-846209-2 devstack@n-api.service[103883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:25:21.949846 n-d-846209-2 devstack@n-api.service[103883]: warnings.warn(msg) Jun 16 18:25:21.951074 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-5e734f0f-62fa-48a8-958a-bb32fb87026d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:21.951511 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-5e734f0f-62fa-48a8-958a-bb32fb87026d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:21.952358 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-5e734f0f-62fa-48a8-958a-bb32fb87026d admin admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:21.952783 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-5e734f0f-62fa-48a8-958a-bb32fb87026d admin admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:22.009498 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-5e734f0f-62fa-48a8-958a-bb32fb87026d admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.187262 Jun 16 18:25:22.010109 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:25:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:25:22.891067 n-d-846209-2 devstack@n-api.service[103884]: DEBUG nova.api.openstack.wsgi [None req-dd1afe89-fc16-4401-b614-443f0e3c9e6a admin admin] Calling method '>' {{(pid=103884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:22.892177 n-d-846209-2 devstack@n-api.service[103884]: INFO nova.api.openstack.requestlog [None req-dd1afe89-fc16-4401-b614-443f0e3c9e6a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002223 Jun 16 18:25:22.892575 n-d-846209-2 devstack@n-api.service[103884]: [pid: 103884|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jun 16 18:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:25:23.088568 n-d-846209-2 devstack@n-api.service[103883]: DEBUG nova.api.openstack.wsgi [None req-c03fe359-2323-43ef-8b4f-3b77565c3862 admin admin] Calling method '>' {{(pid=103883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:23.089739 n-d-846209-2 devstack@n-api.service[103883]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:25:23.089739 n-d-846209-2 devstack@n-api.service[103883]: warnings.warn(msg) Jun 16 18:25:23.090983 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-c03fe359-2323-43ef-8b4f-3b77565c3862 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:23.091422 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-c03fe359-2323-43ef-8b4f-3b77565c3862 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:23.092205 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-c03fe359-2323-43ef-8b4f-3b77565c3862 admin admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:23.092632 n-d-846209-2 devstack@n-api.service[103883]: DEBUG oslo_concurrency.lockutils [None req-c03fe359-2323-43ef-8b4f-3b77565c3862 admin admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:23.116277 n-d-846209-2 devstack@n-api.service[103883]: INFO nova.api.openstack.requestlog [None req-c03fe359-2323-43ef-8b4f-3b77565c3862 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.081491 Jun 16 18:25:23.116748 n-d-846209-2 devstack@n-api.service[103883]: [pid: 103883|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:25:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:26:10.630419 n-d-846209-2 devstack@n-api.service[103882]: Thu Jun 16 18:26:10 2022 - graceful shutdown triggered... Jun 16 18:26:10.630097 n-d-846209-2 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 18:26:10.632047 n-d-846209-2 devstack@n-api.service[103883]: Gracefully killing worker 1 (pid: 103883)... Jun 16 18:26:10.632473 n-d-846209-2 devstack@n-api.service[103884]: Gracefully killing worker 2 (pid: 103884)... Jun 16 18:26:11.631206 n-d-846209-2 devstack@n-api.service[103882]: worker 1 buried after 1 seconds Jun 16 18:26:11.631206 n-d-846209-2 devstack@n-api.service[103882]: worker 2 buried after 1 seconds Jun 16 18:26:11.631206 n-d-846209-2 devstack@n-api.service[103882]: goodbye to uWSGI. Jun 16 18:26:11.632680 n-d-846209-2 systemd[1]: devstack@n-api.service: Succeeded. Jun 16 18:26:11.633257 n-d-846209-2 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 18:26:11.636010 n-d-846209-2 systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:26:11.652571 n-d-846209-2 devstack@n-api.service[119194]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:26:11 2022] *** Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: nodename: n-d-846209-2 Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: machine: x86_64 Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: clock source: unix Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: pcre jit disabled Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: detected number of CPU cores: 4 Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: current working directory: / Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: your processes number limit is 47680 Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: your memory page size is 4096 bytes Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: detected max file descriptor number: 2048 Jun 16 18:26:11.671608 n-d-846209-2 devstack@n-api.service[119194]: lock engine: pthread robust mutexes Jun 16 18:26:11.672764 n-d-846209-2 devstack@n-api.service[119194]: thunder lock: enabled Jun 16 18:26:11.672764 n-d-846209-2 devstack@n-api.service[119194]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:26:11.672764 n-d-846209-2 devstack@n-api.service[119194]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:26:11.718446 n-d-846209-2 devstack@n-api.service[119194]: Python main interpreter initialized at 0x559c21bed9c0 Jun 16 18:26:11.718446 n-d-846209-2 devstack@n-api.service[119194]: python threads support enabled Jun 16 18:26:11.718446 n-d-846209-2 devstack@n-api.service[119194]: your server socket listen backlog is limited to 100 connections Jun 16 18:26:11.718446 n-d-846209-2 devstack@n-api.service[119194]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:26:11.718888 n-d-846209-2 devstack@n-api.service[119194]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:26:11.718888 n-d-846209-2 devstack@n-api.service[119194]: *** Operational MODE: preforking *** Jun 16 18:26:11.719169 n-d-846209-2 devstack@n-api.service[119194]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:26:11.719169 n-d-846209-2 devstack@n-api.service[119194]: spawned uWSGI master process (pid: 119194) Jun 16 18:26:11.719379 n-d-846209-2 systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:26:11.720048 n-d-846209-2 devstack@n-api.service[119194]: spawned uWSGI worker 1 (pid: 119206, cores: 1) Jun 16 18:26:11.732016 n-d-846209-2 devstack@n-api.service[119194]: spawned uWSGI worker 2 (pid: 119207, cores: 1) Jun 16 18:26:11.732016 n-d-846209-2 devstack@n-api.service[119194]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:26:12.401629 n-d-846209-2 devstack@n-api.service[119206]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:26:12.402391 n-d-846209-2 devstack@n-api.service[119207]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:26:13.712889 n-d-846209-2 devstack@n-api.service[119207]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:26:13.712889 n-d-846209-2 devstack@n-api.service[119207]: from cryptography.utils import int_from_bytes Jun 16 18:26:13.714104 n-d-846209-2 devstack@n-api.service[119207]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:26:13.714104 n-d-846209-2 devstack@n-api.service[119207]: from cryptography.utils import int_from_bytes Jun 16 18:26:13.728672 n-d-846209-2 devstack@n-api.service[119206]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:26:13.728672 n-d-846209-2 devstack@n-api.service[119206]: from cryptography.utils import int_from_bytes Jun 16 18:26:13.729269 n-d-846209-2 devstack@n-api.service[119206]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:26:13.729269 n-d-846209-2 devstack@n-api.service[119206]: from cryptography.utils import int_from_bytes Jun 16 18:26:16.172400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:26:16.172992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:26:16.173140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:26:16.173493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:26:16.173756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:26:16.174177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.174503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.174825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.175145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.175483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.175837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.176246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.176570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.176963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.177233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.177546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.177878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846209-2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.178256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.178571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.178861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.179190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.179495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.179823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.180128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.180638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.181101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.181413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.181730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.182110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.182418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.182751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.183075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.183391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.183723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.184033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.184447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846209-2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.184772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.185129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.185453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.185888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.186261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.186545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.186873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.187205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.187745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.187895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.188160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.188482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.188806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.189107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.189419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.189732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.190088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.190389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.190696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.190950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.191786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.192239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.192800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.193146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.193403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.193658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.194012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.194343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.194649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.194959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.195268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.195578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.195885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.196193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.196502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.196805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.197128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.197445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.197770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.198105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.198426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.199090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.199090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.199386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.199728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.200060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.200366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.200686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.201009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.201319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.201629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.201958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.202286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.202635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.203082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.203328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.203523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.203853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.204176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.204484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.204793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.205099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.205401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.205708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.206043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.206353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.206662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.207027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.207337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.207644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.207952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.208787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.209073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.209395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.209706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.210036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.210350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.210656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.210977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.211285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.211591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.211916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.212220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.212526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.212851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.213158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.213467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.213785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.214114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.214417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.214742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.215052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.215359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.215666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.215981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.216288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.216593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.216896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.217200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.217500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.217818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.218168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.218478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.218785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.219098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.219414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.219758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.220088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.220433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.220749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.221081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.221415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.221736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.222077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.222490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.222878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.223214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.223633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.223954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.224277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.224594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.224927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.225247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.225566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.225885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.226221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.226540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.226868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.227192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.227502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.227852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.228192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.228512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.228836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.229168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.229500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.229921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.230154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.230476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.230813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.231131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.231452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.231766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.232079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.232390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.232704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.233024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.233366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.233684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.234026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.234342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.234660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.234974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.235285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.235595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.235900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.236203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.236507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.237002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.237307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.237631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.237981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.238560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.238906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.239226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.239535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.239854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.240171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.240479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.240797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.241109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.241415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.241742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.242081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.242389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.242714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.243020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.243333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.243646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.243960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.244271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.244578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.244892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.245215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.245529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.245840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.246293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.246640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.246839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.247163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.247487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.247806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.248110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.248414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.248718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.249024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.249404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.250327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.250327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.250327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.250646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.250822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.251124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.251447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.251995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.252317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.252620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.252928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.253280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.254224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.254576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.254918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.255232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.255557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.255871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.256189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.256502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.256815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.257128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.257437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.257759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.258095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.258421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.258730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.259053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.259364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.259684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.259988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.260313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.260651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.260984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.261297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.261618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.262033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.262350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.262940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.262940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.263155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.263463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.263783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.264090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.264407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.264972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.265296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.265605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.265936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.266246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.266557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.266885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.267216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.267527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.267837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.268157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.268464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.268775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.269086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.269468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.270648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.270648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.270926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.271214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.271647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.271958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.272277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.272590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.272897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.273202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.273523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.273849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.274188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.274511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.274832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.275144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.275450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.275776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.276086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.276393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.276699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.277003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.277348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.277659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.277984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.278307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.278632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.278940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.279261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.279572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.279884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.280208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.280528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.280837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.281149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.281461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.281770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.282104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.282427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.282737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.283046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.283375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.283665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.283974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.284289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.284864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.285233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.285550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.286003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.286330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.286655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.286986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.287318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.287661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.287970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.288280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.288585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.288893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.289203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.289509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.289814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.290142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.290452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.290606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:26:16.291118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.291286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:26:16.291390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.291478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:26:16.291618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.291618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.291798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:26:16.291884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:26:16.291965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.292221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.292410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.292520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.292613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.292816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.292916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.293139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.293240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.293456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.293556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.293760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.293851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.294085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.294193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.294389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.294482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.294731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.294824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.295020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.295130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.295338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.295431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.295671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846209-2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.295774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.296000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.296104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.296303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.296397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.296607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.296760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.296926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.297031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.297228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.297320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.297532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.297624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.297837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.297957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.298172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.298373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.298493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.298688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.298794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.298997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.299089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.299310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.299409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.299647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.299747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.299957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.300054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.300260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.300362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.300609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.300867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.301039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.301242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.301561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.301665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.301810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.302003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.302137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.302415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846209-2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.302515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.302736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.302829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.303042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.303139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.303355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.303455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.303665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.303758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.303970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.304061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.304287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.304392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.304593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.304694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.304897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.304997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.305202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.305308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.305512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.305610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.305884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.306017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.306154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.306252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.306467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.306567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.306782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.306875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.307087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.307190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.307393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.307492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.307705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.307811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.308011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.308104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.308318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.308416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.308581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.308679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.308895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.309079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.309238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.309389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.309521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.309719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.309882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.310064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.310161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.310375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.310476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.310683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.310776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.310989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.311080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.311300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.311399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.311607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.311749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.311914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.312011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.312215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.312315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.312520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.312611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.312823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.312914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.313127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.313231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.313435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.313527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.313742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.313840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.314074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.314181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.314380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.314480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.314709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.314801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.315016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.315121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.315374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.315474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.315667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.315764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.315979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.316072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.316813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.317009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.317113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.317568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.317808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.317961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.318053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.318204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.318298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.318521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.318627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.318833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.318965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.319145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.319267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.319450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.319587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.319755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.319915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.320076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.320260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.320389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.320571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.320702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.320829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.321023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.321139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.321348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.321441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.321671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.321808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.321998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.322106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.322311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.322404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.322622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.322722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.322932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.323033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.323240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.323341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.323555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.323648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.323863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.323953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.324172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.324271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.324482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.324675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.324790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.324897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.325098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.325195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.325431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.325533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.325707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.325814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.326044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.326140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.326351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.326445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.326675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.326780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.327001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.327134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.327288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.327423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.327596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.327697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.327917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.328017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.328203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.328304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.328507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.328607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.328906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.328997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.329217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.329309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.329525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.329616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.329832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.329949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.330169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.330262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.330479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.330569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.330792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.330904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.331095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.331227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.331398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.331489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.331717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.332579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.332913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.333056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.333228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.333381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.333541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.333697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.333853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.334108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.334211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.334424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.334526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.334737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.334837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.335050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.335142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.335361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.335463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.335666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.335758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.335987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.336094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.336295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.336397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.336612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.336710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.336931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.337031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.337245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.337356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.337569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:26:16.337662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.337934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.338031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.338274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.338385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.338629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.338756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.338949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.339072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.339372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.339541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.339908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.340915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.341116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.341240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.341430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.341547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.341750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.341899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.342069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.342180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.342393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.342488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.342722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.342860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.343035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.343142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.343351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.343452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.343675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.343784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.343993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.344087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.344316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.344424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.344644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.344757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.344969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.345089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.345281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.345410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.345585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.345711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.345888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.346030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.346217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.346382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.346555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.346670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.346831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.346951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.347137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.347271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.347604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.347922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.348249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.348390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.348539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.348686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.348844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.348971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.349165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.349285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.349470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.349602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.349792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.349955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.350184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.350312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.350436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.350568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.350749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.350877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.351054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.351204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.351435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.351571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.351709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.351841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.351969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.352105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.352273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.352382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.352578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.352671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.352925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.353071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.353280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.353381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.353531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.353649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.353861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.353993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.354222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.354365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.354529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.354623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.354834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.354932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.355151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.355254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.355460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.355597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.355776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.355884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.356105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.356241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.356408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.356526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.356706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.356809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.357015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.357109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.357318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.357413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.357621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.357734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.358935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.359140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.359282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.359462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.359573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.359763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.359861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.360074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.360176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.360427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.360589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.360739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.360881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.361032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.361187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.361340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.361558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.361704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.361855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.362036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.362182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.362329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.362477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.362626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.362776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.362941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.363645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.363794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.363946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.364250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.364406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.364576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.364733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.364890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.365043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.365187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.365387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.365542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.365697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.365849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.366071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.366218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.366370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.366524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.366725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.366874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.367026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.367177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.367321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.367473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.367631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.367783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.367928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.368071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.368221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.368373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.368520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.368689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.368835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.368977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.369128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.369441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.369584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.369724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.369876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.369989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.370094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.370189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.370334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.370463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.370643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.370952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.371053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.371262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.371358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.371616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.371761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.371907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.372045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.372213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.372356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.372541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.372646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.372877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.372977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.373194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.373285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.373509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.373623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.373824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.373966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.374166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.374258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.374489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.374631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.374807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.374912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.375113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.375215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.375428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.375535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.375743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.375834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.376056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.376146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.376366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.376459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.376675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.376782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.376989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.377082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.377301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.377393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.377611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.377732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.377938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.378039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.378248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.378359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.378561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.378660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.379433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.379827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.379997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.380259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.380404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.380575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.380714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.380888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.381033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.381203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.381365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.381572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.381741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.381919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.382074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.382212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.382486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.382605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.382734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.382838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.383058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.383160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.383388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.383493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.383690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.383791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.384017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.384298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.384431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.384534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.384681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.384783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.384913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.385015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.385225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.385327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.385531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.385645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.385850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.385990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.386186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.386281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.386497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.386632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.386811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.386912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.387118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.387221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.387442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.387656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.387758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.388006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.388099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.388324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.388426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.388649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.388741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.388969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.389069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.389282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.389382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.389843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.389981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.390197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.390317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.390501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.390643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.390806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.390898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.391114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.391293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.391419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.391512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.391721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.391814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.392025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.392176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.392336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.392489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.392640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.392746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.392933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.393038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.393242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.393345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.393554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.393694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.393867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.394052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.394193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.394548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.394703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.394930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.395023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.395242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.395344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.395546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.395648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.395852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.395955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.396158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.396252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.396464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.396563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.396778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.396884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.397082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.397183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.397391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.397491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.397695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.397796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.398037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.398134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.398342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.398435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.398651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.398761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.399007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.399107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.399324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.399435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.399627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.399728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.399929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.400042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.400240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.400344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.400551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.400689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.400868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.400963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.401175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.401269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.401485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.401579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.401789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.401890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.402127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.402244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.402448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.402689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.403019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.403115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.403337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.403430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.403665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.403803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.403989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.404102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.404291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.404400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.404595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.404700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.404899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.405014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.405223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.405330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.405536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.405649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.405846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.405994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.406187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.406304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.406498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.406611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.406808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.406900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.407113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.407204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.407422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.407516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.407729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.407829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.408034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.408126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.408337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.408439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.408642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.408734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.408946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.409046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.409249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.409342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.409557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.409658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.409943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.410079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.410320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.410656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.410849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.410992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.411090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.411323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.411433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.411568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.411724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.412040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.412377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.412752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.412876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.413049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.413165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.413323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.413428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.413748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.413851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.414037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.414148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.414298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.414410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.414603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.414712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.414951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.415059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.415260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.415376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.415660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.415775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.416082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.416396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.416719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.417180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.417292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.417382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.417468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.417656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.417817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.417986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.418086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.418317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.418426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.418657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.418780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.418975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.419079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.419295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.419390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.419595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.419699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.419899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.419996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.420206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.420382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.420566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.420737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.420882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.421046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.421207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.421351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.421507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.421659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.421809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.421974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.422984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.423172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.423274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.423487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.423581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.423791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.423939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.424095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.424191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.424397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.424490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.424698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.424805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.424999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.425100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.425300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.425393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.426142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.426268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.426448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.426791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.427069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.427171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.427383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.427484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.427683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.427777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.428010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.428126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.428331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.428475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.428646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.428804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.428960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.429105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.429258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.429411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.429568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.429711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.429853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.430020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.430188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.430371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.430517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.430613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.430803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.430943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.431114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.431255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.431428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.431522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.431740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.431832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.432047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.432148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.432355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.432455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.432661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.432765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.432971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.433126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.433277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.433369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.433603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.433710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.433979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.434126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.434259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.434347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.434563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.434670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.434874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.435670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.435670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.435832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.435922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.435999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.436882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.437132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.437446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.437766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.438100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.438236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.438421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.438526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.438736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.438864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.439092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.439270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.439376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.439626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.439737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.439983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.440209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.440335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.440639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.440775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.440900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.441016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.441159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.442098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.442485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.442813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.442930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.443032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.443191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.443297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.443593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.443706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.443862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.443975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.444190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.444302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.444553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.444736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.444827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:26:16.444904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.445120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.445438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.445758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.446222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.446543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.446859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.447223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.447624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.447798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.448180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.448454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.448839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.449157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.449505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.449795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.450142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.450587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.450972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.451214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.451519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.451842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.452160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.452475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.453043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.453271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.453502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.454149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.454149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.454551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.454824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.455031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.455343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.455671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.455979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.456288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.456595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.457045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.457868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.458236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.458664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.458985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.459297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.459715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.460034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.460743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.460743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.461209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.461349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.461594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.462014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.462246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.462574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.462900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.463219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.463537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.463848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.464174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.464502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.464946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.465140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.465562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.465879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.466220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.466546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.466876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.467186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.467505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.467816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.468127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.468435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.468760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.469068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.469384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.469698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.470085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.470371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.470687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.471011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.471333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.471643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.472027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.472281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.472781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.473559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.473968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.474842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.474842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.474842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.475650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.475650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.475881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.476031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.476367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.476703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.477017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.477354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.477778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.478057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.478381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.478723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.479031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.479343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.479651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.479941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.480264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.480571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.480884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.481237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.481797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.481797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.482229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.482436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.482751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.483270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.483840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.483840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.484264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.484418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.484584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.484975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.485249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.485763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.485954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.486413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.486663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.486978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.487311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.487909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.488654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.489469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.489815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.490193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.490497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.490823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.491147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.491476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.492915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.492915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.492915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.493370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.493370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.493681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.494405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.494405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.494632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.494950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.495269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.495604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.495931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.496262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.496607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.496933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.497255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.497578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.497897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.498292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.498609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.498922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.499242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.499562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.499878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.500195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.500508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.500832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.501140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.501459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.501768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.502112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.502433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.502763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.503103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.503425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.504339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.505242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.505575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.506186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.507273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.507273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.507273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.507734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.507884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.508156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.508529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.508741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.508926 n-d-846209-2 devstack@n-api.service[119207]: INFO dbcounter [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Registered counter for database nova_api Jun 16 18:26:16.509098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.509427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.510367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.510715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.511072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.511413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.511742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.512084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.512413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.512997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.513360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.513690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.514055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.514397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.515202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.515530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.515851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.516173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.516466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.516789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.517107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.517418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.517728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.518137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.518477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.518768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.519084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.519414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.519792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.521195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.521195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.521195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.521195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.521559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.521559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.521828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.522159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.522476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.522785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.523097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.523405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.523719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.524024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.524335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.524827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.525225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.525542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.525850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.526302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.526608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.526934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.527248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.527561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.527922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.528241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.528861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.529198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.529522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.529866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.530195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_db.sqlalchemy.engines [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.530310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.530783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.531784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.531784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.532126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.532266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.534710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.534710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.534710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.534710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.534710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.534710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.535657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.536054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.536380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.537954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.537954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.537954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.537954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.538319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.538454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.538782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.539106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.539428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.539745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.540385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.540492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.540852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.541296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.541700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.542064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.542539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.543105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.543427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.543758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.544088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.544489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.544823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.545152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.545739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.546225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.546545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.547288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.547288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.547545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.547864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.548181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.548490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.548797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.549215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.549442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.549730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.549834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writer thread running {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:16.550073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.550398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.551237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.551894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.551991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.552252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.552560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.552871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.553177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.553483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.554402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.554402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.554402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.554746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.554985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.555290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.555846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.556161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.556465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.556768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.557105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.557477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.557781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.558123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.558443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.558773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.559084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.559406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.559729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.560069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.560382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.560717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.561029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.561342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.561652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.561985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.562302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.562677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.563015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.563346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.563655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.563982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.564304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.564624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.564939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.565243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.565575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.565937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.566982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.567343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.567607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.567886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.568264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.568638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.568977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.569365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.569683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.570038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.570397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.570750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.571100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.571452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.571806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.572124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.572439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.572745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:26:16.572991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:26:16.620958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.context [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119207) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:26:16.625268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:16.627007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:16.627911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:16.631236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:16.633295 n-d-846209-2 devstack@n-api.service[119207]: INFO dbcounter [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Registered counter for database nova_cell0 Jun 16 18:26:16.637400 n-d-846209-2 devstack@n-api.service[119207]: INFO dbcounter [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Registered counter for database nova_cell1 Jun 16 18:26:16.638127 n-d-846209-2 devstack@n-api.service[119206]: INFO dbcounter [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Registered counter for database nova_api Jun 16 18:26:16.646193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_db.sqlalchemy.engines [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.648685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_db.sqlalchemy.engines [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.654401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writer thread running {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:16.656020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writer thread running {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:16.659081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_db.sqlalchemy.engines [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.667263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writer thread running {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:16.726517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.context [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119206) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:26:16.730706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:16.732315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:16.733131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:16.735113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:16.737114 n-d-846209-2 devstack@n-api.service[119206]: INFO dbcounter [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Registered counter for database nova_cell0 Jun 16 18:26:16.742234 n-d-846209-2 devstack@n-api.service[119206]: INFO dbcounter [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Registered counter for database nova_cell1 Jun 16 18:26:16.751238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_db.sqlalchemy.engines [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.752761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_db.sqlalchemy.engines [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.761753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writer thread running {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:16.763120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writer thread running {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:16.816631 n-d-846209-2 devstack@n-api.service[119207]: INFO dbcounter [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Registered counter for database nova_cell0 Jun 16 18:26:16.824258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_db.sqlalchemy.engines [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.829145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writer thread running {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:16.920431 n-d-846209-2 devstack@n-api.service[119206]: INFO dbcounter [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Registered counter for database nova_cell0 Jun 16 18:26:16.930416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_db.sqlalchemy.engines [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:26:16.935498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writer thread running {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:26:17.160788 n-d-846209-2 devstack@n-api.service[119207]: WARNING keystonemiddleware.auth_token [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:26:17.168114 n-d-846209-2 devstack@n-api.service[119207]: WARNING keystonemiddleware.auth_token [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:26:17.268419 n-d-846209-2 devstack@n-api.service[119206]: WARNING keystonemiddleware.auth_token [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:26:17.275727 n-d-846209-2 devstack@n-api.service[119206]: WARNING keystonemiddleware.auth_token [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:26:17.515624 n-d-846209-2 devstack@n-api.service[119207]: WARNING keystonemiddleware.auth_token [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:26:17.522458 n-d-846209-2 devstack@n-api.service[119207]: WARNING keystonemiddleware.auth_token [None req-4c74ee3f-cf9e-461a-b683-89333f8359ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:26:17.527815 n-d-846209-2 devstack@n-api.service[119207]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559c21bed9c0 pid: 119207 (default app) Jun 16 18:26:17.622068 n-d-846209-2 devstack@n-api.service[119206]: WARNING keystonemiddleware.auth_token [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:26:17.628012 n-d-846209-2 devstack@n-api.service[119206]: WARNING keystonemiddleware.auth_token [None req-29b30ec5-6008-42d6-9a10-2f539af208aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:26:17.633992 n-d-846209-2 devstack@n-api.service[119206]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559c21bed9c0 pid: 119206 (default app) Jun 16 18:27:02.674710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:02.676524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:02.677874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:02.679542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:03.557308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:03.558490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:03.559256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:03.560034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:03.855416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03346d76-efe4-4637-bcda-7bf269ffe32a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:03.857669 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:03.857669 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:03.858998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03346d76-efe4-4637-bcda-7bf269ffe32a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:03.859459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03346d76-efe4-4637-bcda-7bf269ffe32a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:03.860266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03346d76-efe4-4637-bcda-7bf269ffe32a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:03.860713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03346d76-efe4-4637-bcda-7bf269ffe32a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:03.905592 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03346d76-efe4-4637-bcda-7bf269ffe32a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.243825 Jun 16 18:27:03.906210 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:27:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:04.287894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '.version_select at 0x7f86757770d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:04.288869 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:04.288869 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:04.302841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119207) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 16 18:27:04.303662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:04.304103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:04.332108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:04.332664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:04.346666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:04.347525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:04.355201 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fadd960c-a853-4fa9-a93e-5aa7d055dfeb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.447735 Jun 16 18:27:04.355795 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2/2] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jun 16 18:27:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:04.360157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae66a5b7-c73b-4291-a7f5-c6a691753631 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1565388687"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:04.381736 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:04.381736 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:04.382806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-ae66a5b7-c73b-4291-a7f5-c6a691753631 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid 4f7893cc-0726-4069-97d8-aad2504dd1b6 for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:04.449531 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae66a5b7-c73b-4291-a7f5-c6a691753631 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.092649 Jun 16 18:27:04.456105 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:04.545809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bc72f25b-9dac-458f-a262-e8db1dd5fa49 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1180948852", "id": 2111812897, "os-flavor-access:is_public": "False"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:04.547957 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:04.547957 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:04.585959 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bc72f25b-9dac-458f-a262-e8db1dd5fa49 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.128358 Jun 16 18:27:04.586777 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 4/4] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:04 2022] POST /compute/v2.1/flavors => generated 431 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:04.707163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48c7225c-7dfe-4093-84be-4af0c989e19a tempest-AZAdminNegativeTestJSON-496051965 tempest-AZAdminNegativeTestJSON-496051965-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-48c7225c-7dfe-4093-84be-4af0c989e19a tempest-AZAdminNegativeTestJSON-496051965 tempest-AZAdminNegativeTestJSON-496051965-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '43b71ab3104343449d5709877100d57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31589917ef3465db9f570c401546462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48c7225c-7dfe-4093-84be-4af0c989e19a tempest-AZAdminNegativeTestJSON-496051965 tempest-AZAdminNegativeTestJSON-496051965-project] Request method failure captured: Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X1bVMhoH75-bhRpxcG59EG8NuJZaqyDGFJbRakJL7nXywNJgeuZqV-MNm_4-3ZSICdHG8RDk1bdvuBl1QCufL2Z_LZbt8opT6rERAReGzOKtqIFEGZRkJUpEUPhfnu9l_qYFL4ZcZ2enE6u5dDo4spRDwsnoNmMFly4JhpztvaZR0 Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:04.715354 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: e31589917ef3465db9f570c401546462 Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AZAdminNegativeTestJSON-496051965 Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e31589917ef3465db9f570c401546462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e31589917ef3465db9f570c401546462"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e31589917ef3465db9f570c401546462", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e31589917ef3465db9f570c401546462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AZAdminNegativeTestJSON-496051965 Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: e31589917ef3465db9f570c401546462 Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-496051965 Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AZAdminNegativeTestJSON-496051965-project Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 43b71ab3104343449d5709877100d57e Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AZAdminNegativeTestJSON-496051965-project Jun 16 18:27:04.716409 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: action_args: {} Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:04.717101 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 16 18:27:04.718113 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:04.721607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48c7225c-7dfe-4093-84be-4af0c989e19a tempest-AZAdminNegativeTestJSON-496051965 tempest-AZAdminNegativeTestJSON-496051965-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:04.721607 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48c7225c-7dfe-4093-84be-4af0c989e19a tempest-AZAdminNegativeTestJSON-496051965 tempest-AZAdminNegativeTestJSON-496051965-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.167591 Jun 16 18:27:04.721607 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1/5] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Jun 16 18:27:03 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:04.785337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-25185b9d-b394-453a-974b-29b86ca6079f tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:04.787076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25185b9d-b394-453a-974b-29b86ca6079f tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:04.787483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25185b9d-b394-453a-974b-29b86ca6079f tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:04.788285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25185b9d-b394-453a-974b-29b86ca6079f tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:04.788724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25185b9d-b394-453a-974b-29b86ca6079f tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:04.814322 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-25185b9d-b394-453a-974b-29b86ca6079f tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.226176 Jun 16 18:27:04.815470 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 5/6] 10.222.0.27 () {58 vars in 1163 bytes} [Thu Jun 16 18:27:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:04.903717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1933861687", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:05.095735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Calling method '.version_select at 0x7f8675719af0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:05.097490 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:05.097490 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:05.099698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:05.100397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:05.119227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:05.120038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:05.133068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:05.133526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:05.140375 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-57b60687-8282-4444-afb9-e71f3523534a tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.323596 Jun 16 18:27:05.141160 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 6/7] 10.222.0.27 () {60 vars in 1207 bytes} [Thu Jun 16 18:27:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:27:05.154624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb1e6138-5e9f-4663-a9d7-70e24eb6a0c1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:05.156056 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:05.156056 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:05.164386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb1e6138-5e9f-4663-a9d7-70e24eb6a0c1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:05.165188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb1e6138-5e9f-4663-a9d7-70e24eb6a0c1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:05.452061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:27:05.833602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:27:05.834468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:27:05.835055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:27:05.835676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:27:05.836249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:27:05.838581 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eb1e6138-5e9f-4663-a9d7-70e24eb6a0c1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.687238 Jun 16 18:27:05.840811 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 7/8] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:05.848330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-84a7fa62-c7c4-4ba5-8a74-85c39879ad6c tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "185e4d953af84d0d8b6a845c95f281d0"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:05.850951 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:05.850951 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:05.853792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:05.854406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:05.855353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:05.855876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:05.893753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Getting quotas for project 870d5ffbd56d4cc7a6707953009a8355. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:27:05.902251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Getting quotas for user 40edf1dc85ef42b0a1e64655904f3d55 and project 870d5ffbd56d4cc7a6707953009a8355. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:27:05.915941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:27:05.919312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:27:06.001662 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ef25f32-339b-4ff0-a849-8fdb235dc56c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285453 Jun 16 18:27:06.003899 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2/9] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:27:06.014662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-def3fec2-4462-4494-aa8d-00795125782a tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:06.015831 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.015831 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:06.018439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-def3fec2-4462-4494-aa8d-00795125782a tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:06.020091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-def3fec2-4462-4494-aa8d-00795125782a tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:06.023720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-def3fec2-4462-4494-aa8d-00795125782a tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:06.024870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-def3fec2-4462-4494-aa8d-00795125782a tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:06.117799 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-def3fec2-4462-4494-aa8d-00795125782a tempest-AZAdminV2TestJSON-1637204635 tempest-AZAdminV2TestJSON-1637204635-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.112134 Jun 16 18:27:06.129960 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3/10] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Jun 16 18:27:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:06.129960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-932e245a-085e-48ba-b58f-20fa49292788 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:06.131089 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.131089 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:06.166577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-932e245a-085e-48ba-b58f-20fa49292788 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:06.167202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-932e245a-085e-48ba-b58f-20fa49292788 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:06.240484 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-932e245a-085e-48ba-b58f-20fa49292788 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-846209-2. Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-932e245a-085e-48ba-b58f-20fa49292788 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 39 Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:06.263288 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: {"add_host": {"host": "n-h2-846209-2"}} Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:06.265578 n-d-846209-2 devstack@n-api.service[119206]: exception: Aggregate 1 already has host n-h2-846209-2. Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-846209-2'}}} Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result.read() Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:27:06.266656 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-846209-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi session.flush() Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:27:06.267980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:27:06.270195 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:27:06.271313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result.read() Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-846209-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 16, 18, 27, 6, 219450), 'updated_at': None, 'host': 'n-h2-846209-2', 'aggregate_id': 1}] Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:06.273433 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-846209-2. Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.274882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-846209-2. Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:06.278036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:06.280829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-846209-2. Jun 16 18:27:06.280829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.280829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-932e245a-085e-48ba-b58f-20fa49292788 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-846209-2. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:06.282883 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-932e245a-085e-48ba-b58f-20fa49292788 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.162804 Jun 16 18:27:06.285087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 4/11] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:06 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jun 16 18:27:06.286926 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-84a7fa62-c7c4-4ba5-8a74-85c39879ad6c tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2111812897/action" status: 200 len: 97 microversion: 2.1 time: 0.444256 Jun 16 18:27:06.288220 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 8/12] 10.222.0.27 () {60 vars in 1199 bytes} [Thu Jun 16 18:27:05 2022] POST /compute/v2.1/flavors/2111812897/action => generated 97 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:06.298893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5e167063-fc81-4dcc-804d-55f87bbf8826 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:06.300076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5e167063-fc81-4dcc-804d-55f87bbf8826 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:06.305565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7ae7287-3c17-4613-b604-96fd873d9824 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:06.307326 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.307326 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:06.318260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7ae7287-3c17-4613-b604-96fd873d9824 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:06.318706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7ae7287-3c17-4613-b604-96fd873d9824 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:06.419678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5e167063-fc81-4dcc-804d-55f87bbf8826 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:06.437310 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5e167063-fc81-4dcc-804d-55f87bbf8826 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1220 microversion: 2.1 time: 0.150879 Jun 16 18:27:06.438713 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 5/13] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:06 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1220 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:06.506999 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7ae7287-3c17-4613-b604-96fd873d9824 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.215471 Jun 16 18:27:06.508622 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 9/14] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:06 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:06.524433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18eec61e-1ecd-470f-954d-34d7f356b8ab tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:06.525435 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.525435 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:06.621390 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-18eec61e-1ecd-470f-954d-34d7f356b8ab tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.103656 Jun 16 18:27:06.622726 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 10/15] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:06 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:06.639004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f3acda5-4d3c-44ad-94ae-7babc0548e07 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-192374439"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:06.645220 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.645220 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:06.646309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-1f3acda5-4d3c-44ad-94ae-7babc0548e07 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid ab400d8e-76a8-4238-bf8d-cf1fc5e5068d for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:06.684608 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f3acda5-4d3c-44ad-94ae-7babc0548e07 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.055345 Jun 16 18:27:06.692130 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 11/16] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:06 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:06.900198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15006b28-d840-4fde-8b66-db92c31a751c tempest-FlavorsAccessTestJSON-934015323 tempest-FlavorsAccessTestJSON-934015323-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:06.937007 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15006b28-d840-4fde-8b66-db92c31a751c tempest-FlavorsAccessTestJSON-934015323 tempest-FlavorsAccessTestJSON-934015323-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.496472 Jun 16 18:27:06.937589 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 6/17] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:06 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:06.939394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af120477-a306-4203-abd1-5655c09f41ea tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:06.943145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-257b751f-470b-4fbb-82a1-5a0a91dd1477 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-374802029"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:06.944410 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.944410 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:06.945286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-257b751f-470b-4fbb-82a1-5a0a91dd1477 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Generated uuid a88fe7cc-a9a2-4416-b140-f31e08ddaeea for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:06.947639 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.947639 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:06.953929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af120477-a306-4203-abd1-5655c09f41ea tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '24d55a95f74b41b4aa70f4fc4db62f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ec4b54cd784767a8c95ff7a0effc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af120477-a306-4203-abd1-5655c09f41ea tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Request method failure captured: Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 39 Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X0T9OLVmXNeLCqLLszb3mmO44mcTFwb3puyHtGaoIigNJhqmGlRzZH2hY11lr725AK-chW-De_tOALWR-96FsdeTwMPnWEqryG8vGp3nnKn0izqlyF6JgCLlcip_YzJ7lPh3xucuAl-NjKX9deGhkHHGgps4ktKJhJmvQOkvrjVpM Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:06.961694 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50ec4b54cd784767a8c95ff7a0effc2e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 24d55a95f74b41b4aa70f4fc4db62f78 Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: {"add_host": {"host": "n-h2-846209-2"}} Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:06.964358 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-846209-2'}}} Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:06.965856 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 16 18:27:06.968034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:06.971316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af120477-a306-4203-abd1-5655c09f41ea tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:06.972630 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af120477-a306-4203-abd1-5655c09f41ea tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.277341 Jun 16 18:27:06.974781 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 12/18] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:06 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 282 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:06.985055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d00f9b9-c2cd-48c0-b9f7-b19a84f89ad8 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "185e4d953af84d0d8b6a845c95f281d0"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:06.988233 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:06.988233 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:07.028049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-257b751f-470b-4fbb-82a1-5a0a91dd1477 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.089044 Jun 16 18:27:07.029687 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 7/19] 10.222.0.27 () {62 vars in 1204 bytes} [Thu Jun 16 18:27:06 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:07.038439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc11fe90-9130-4b24-9770-aea4086f8f5a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:07.040187 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:07.040187 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:07.078599 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc11fe90-9130-4b24-9770-aea4086f8f5a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.046958 Jun 16 18:27:07.082021 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 8/20] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:07 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:07.093634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf9d6d91-55f0-4ced-b3a8-b1a1c22bde69 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1060862694"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:07.245836 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:07.245836 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:07.295157 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf9d6d91-55f0-4ced-b3a8-b1a1c22bde69 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.210663 Jun 16 18:27:07.295811 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 9/21] 10.222.0.27 () {62 vars in 1209 bytes} [Thu Jun 16 18:27:07 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:07.301662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d15ff5f-9667-42f9-8b8e-6612ddc04b75 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1653936480"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:07.303269 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:07.303269 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:07.304701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-9d15ff5f-9667-42f9-8b8e-6612ddc04b75 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid 57c73b54-d1a4-4186-8792-819c0ecc2ddc for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:07.339721 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9d15ff5f-9667-42f9-8b8e-6612ddc04b75 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041636 Jun 16 18:27:07.344235 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 10/22] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:07.354682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fcef469a-f411-45b4-86a7-f0455aee7b04 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:07.358596 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:07.358596 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:07.380614 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fcef469a-f411-45b4-86a7-f0455aee7b04 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.029744 Jun 16 18:27:07.380614 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 11/23] 10.222.0.27 () {60 vars in 1189 bytes} [Thu Jun 16 18:27:07 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:07.395632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-568495264"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:07.399821 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:07.399821 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:07.423518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119206) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 16 18:27:07.425644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:07.426707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:07.436037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:07.436870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:07.447892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-568495264 could not be found. Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 57 Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:07.451312 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: {"add_host": {"host": "tempest-nonexist_host-568495264"}} Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:07.452636 n-d-846209-2 devstack@n-api.service[119206]: exception: Compute host tempest-nonexist_host-568495264 could not be found. Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-568495264'}}} Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-568495264' is not mapped to any cell Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:07.453395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 16 18:27:07.454392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-568495264 could not be found. Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-568495264 could not be found. Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:07.455903 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.456916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:07.456916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:07.456916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:07.456916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:07.456916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:07.456916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-568495264 could not be found. Jun 16 18:27:07.456916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:07.460427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-568495264 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:07.461516 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6cd0ea1-d90b-4f89-8860-85be3aedbcfd tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.083743 Jun 16 18:27:07.462888 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 12/24] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:07 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:07.471077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c0bde0e-456c-483a-b088-c86554070461 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:07.472740 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:07.472740 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:07.483787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c0bde0e-456c-483a-b088-c86554070461 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:07.484492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c0bde0e-456c-483a-b088-c86554070461 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:07.642365 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d00f9b9-c2cd-48c0-b9f7-b19a84f89ad8 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2111812897/action" status: 200 len: 21 microversion: 2.1 time: 0.665521 Jun 16 18:27:07.647637 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 13/25] 10.222.0.27 () {60 vars in 1199 bytes} [Thu Jun 16 18:27:06 2022] POST /compute/v2.1/flavors/2111812897/action => generated 21 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:07.657439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:07.658495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:07.690475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:07.690936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:07.691729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:07.692479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:08.219023 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c0bde0e-456c-483a-b088-c86554070461 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.754532 Jun 16 18:27:08.221453 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 13/26] 10.222.0.27 () {62 vars in 1231 bytes} [Thu Jun 16 18:27:07 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:08.227870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-031db984-8b82-4643-ad4d-b2bb1e2684f9 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:08.228954 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:08.228954 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:08.264250 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-031db984-8b82-4643-ad4d-b2bb1e2684f9 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.040920 Jun 16 18:27:08.270653 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:08 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:08.653412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:08.704446 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d282aff-a6f4-479b-b445-967bae688546 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1224 microversion: 2.1 time: 1.055223 Jun 16 18:27:08.705545 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 14/28] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:07 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1224 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:08.710945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff2db6d0-5904-4923-92f2-e89d114e5456 tempest-FlavorsAccessTestJSON-934015323 tempest-FlavorsAccessTestJSON-934015323-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:08.738971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-897a777b-b1b7-40f4-90fb-d02dcb04cce1 tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1090778425", "id": 789109488, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:08.740996 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:08.740996 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:08.750889 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff2db6d0-5904-4923-92f2-e89d114e5456 tempest-FlavorsAccessTestJSON-934015323 tempest-FlavorsAccessTestJSON-934015323-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043756 Jun 16 18:27:08.752457 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 15/29] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:08.768695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80f9629f-765a-49c3-b0aa-e4d56a05e9e3 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:08.773657 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:08.773657 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:08.783987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-897a777b-b1b7-40f4-90fb-d02dcb04cce1 tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.511554 Jun 16 18:27:08.784844 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 15/30] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:27:08 2022] POST /compute/v2.1/flavors => generated 468 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:08.790138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-01ee66c9-dd75-4454-959d-c9273494a9a4 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:08.791213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80f9629f-765a-49c3-b0aa-e4d56a05e9e3 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:08.791752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80f9629f-765a-49c3-b0aa-e4d56a05e9e3 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-01ee66c9-dd75-4454-959d-c9273494a9a4 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 283 Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:08.808360 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:08.809639 n-d-846209-2 devstack@n-api.service[119206]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:27:08.810491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:27:08.811119 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:27:08.812170 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:27:08.812877 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:27:08.812877 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.812877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-01ee66c9-dd75-4454-959d-c9273494a9a4 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:08.812877 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-01ee66c9-dd75-4454-959d-c9273494a9a4 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.023620 Jun 16 18:27:08.813149 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 16/31] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Jun 16 18:27:08 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:27:08.817893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-190b4b1f-5ef8-4f20-aea4-25c37b91d3ce tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:08.819295 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:08.819295 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:08.889228 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-190b4b1f-5ef8-4f20-aea4-25c37b91d3ce tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2111812897" status: 202 len: 0 microversion: 2.1 time: 0.073156 Jun 16 18:27:08.891153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 17/32] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:27:08 2022] DELETE /compute/v2.1/flavors/2111812897 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:08.909642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ead45cfe-bb70-4d33-b113-2f7105f09908 tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:08.912963 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:08.912963 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:08.971718 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-80f9629f-765a-49c3-b0aa-e4d56a05e9e3 tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.216830 Jun 16 18:27:08.972552 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 16/33] 10.222.0.27 () {62 vars in 1231 bytes} [Thu Jun 16 18:27:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:08.979044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69aff039-fd2f-4197-ba8c-95939975ebd5 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69aff039-fd2f-4197-ba8c-95939975ebd5 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 27 Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:08.983191 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: {"aggregate": {"name": ""}} Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:08.984488 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi '' Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:08.985207 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:27:08.986759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:08.989386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69aff039-fd2f-4197-ba8c-95939975ebd5 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:08.990971 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69aff039-fd2f-4197-ba8c-95939975ebd5 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016762 Jun 16 18:27:08.992003 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 17/34] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:08 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:27:09.001192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ede46765-bdf3-4619-aa6f-ddddf876b755 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.031706 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ede46765-bdf3-4619-aa6f-ddddf876b755 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.037488 Jun 16 18:27:09.032765 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 18/35] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:08 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:09.038266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bade8d36-1989-4003-8026-7d9ff5d5a04e tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.039408 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.039408 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.076002 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bade8d36-1989-4003-8026-7d9ff5d5a04e tempest-AggregatesAdminTestV241-1645666941 tempest-AggregatesAdminTestV241-1645666941-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.039043 Jun 16 18:27:09.076992 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1192 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.090222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7d71a01-399e-4d60-820a-74451ff2b55b tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1712068283"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.091565 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.091565 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.092437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7d71a01-399e-4d60-820a-74451ff2b55b tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '24d55a95f74b41b4aa70f4fc4db62f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ec4b54cd784767a8c95ff7a0effc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7d71a01-399e-4d60-820a-74451ff2b55b tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Request method failure captured: Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 60 Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X0T9OLVmXNeLCqLLszb3mmO44mcTFwb3puyHtGaoIigNJhqmGlRzZH2hY11lr725AK-chW-De_tOALWR-96FsdeTwMPnWEqryG8vGp3nnKn0izqlyF6JgCLlcip_YzJ7lPh3xucuAl-NjKX9deGhkHHGgps4ktKJhJmvQOkvrjVpM Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:09.094063 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50ec4b54cd784767a8c95ff7a0effc2e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 24d55a95f74b41b4aa70f4fc4db62f78 Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: {"aggregate": {"name": "tempest-test_aggregate-1712068283"}} Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:09.095515 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1712068283'}}} Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:09.097158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:09.098945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 16 18:27:09.100198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.105260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7d71a01-399e-4d60-820a-74451ff2b55b tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:09.110165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7d71a01-399e-4d60-820a-74451ff2b55b tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.031860 Jun 16 18:27:09.110921 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 20/37] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:09.118710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-407889d5-2560-4b1b-97cc-40e8502b4048 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-402712132", "id": 191146472, "os-flavor-access:is_public": "False"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.124147 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.124147 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.158589 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-407889d5-2560-4b1b-97cc-40e8502b4048 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.045256 Jun 16 18:27:09.160939 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 21/38] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/flavors => generated 427 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.165668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61950c42-67d1-4e95-b78f-f78144b20fd4 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1558513806"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.168283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-61950c42-67d1-4e95-b78f-f78144b20fd4 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid 98a2b70d-d0e0-4444-851e-8e83bf985315 for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:09.180382 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ead45cfe-bb70-4d33-b113-2f7105f09908 tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/789109488/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.287144 Jun 16 18:27:09.181230 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 18/39] 10.222.0.27 () {62 vars in 1261 bytes} [Thu Jun 16 18:27:08 2022] POST /compute/v2.1/flavors/789109488/os-extra_specs => generated 62 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:09.202486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f5f4e16-8f67-47c4-a2e5-be6789ee2c6f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-266929937", "name": "tempest-test_aggregate-1069018053"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.212925 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61950c42-67d1-4e95-b78f-f78144b20fd4 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048675 Jun 16 18:27:09.214253 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 22/40] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.223479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7d5fed3-11fe-43f8-8e65-4342180d9bf6 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.230700 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.230700 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.244252 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.244252 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:09.246505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-4f5f4e16-8f67-47c4-a2e5-be6789ee2c6f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid 851fae4f-9f45-4996-9a70-6d1543d15971 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:09.256478 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7d5fed3-11fe-43f8-8e65-4342180d9bf6 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/191146472/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.039323 Jun 16 18:27:09.259614 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 23/41] 10.222.0.27 () {58 vars in 1205 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/flavors/191146472/os-flavor-access => generated 21 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:09.264250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=11,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:09.266145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-008c4e4b-4421-46b6-8603-c85a1750aadc tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.267027 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.267027 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.299795 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f5f4e16-8f67-47c4-a2e5-be6789ee2c6f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.115845 Jun 16 18:27:09.300501 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 19/42] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.317412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3cb35f1e-7501-4747-9f72-662e2c1cd006 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1558513806"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.322962 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.322962 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:09.324398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-3cb35f1e-7501-4747-9f72-662e2c1cd006 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid 7df85e1e-6089-4fbd-b8c2-0b70760c7955 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:09.333593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:09.344070 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3cb35f1e-7501-4747-9f72-662e2c1cd006 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1558513806 already exists. Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3cb35f1e-7501-4747-9f72-662e2c1cd006 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 60 Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:09.354776 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: {"aggregate": {"name": "tempest-test_aggregate-1558513806"}} Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:09.355885 n-d-846209-2 devstack@n-api.service[119206]: exception: Aggregate tempest-test_aggregate-1558513806 already exists. Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1558513806'}}} Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 16 18:27:09.356852 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1558513806 already exists. Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:09.357865 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1558513806 already exists. Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1558513806 already exists. Jun 16 18:27:09.359221 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.359883 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-008c4e4b-4421-46b6-8603-c85a1750aadc tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/789109488" status: 202 len: 0 microversion: 2.86 time: 0.094758 Jun 16 18:27:09.359883 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 24/43] 10.222.0.27 () {60 vars in 1198 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/flavors/789109488 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:27:09.360974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3cb35f1e-7501-4747-9f72-662e2c1cd006 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1558513806 already exists. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:09.368024 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3cb35f1e-7501-4747-9f72-662e2c1cd006 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.062186 Jun 16 18:27:09.368225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e0c4d26-b973-491a-ab58-aa9e86f98f3c tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.368309 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 20/44] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:09.382300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7edc7027-ed44-4648-8a19-4d1c32540966 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.383468 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.383468 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:09.404707 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7edc7027-ed44-4648-8a19-4d1c32540966 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.037660 Jun 16 18:27:09.405349 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 21/45] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.419540 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e0c4d26-b973-491a-ab58-aa9e86f98f3c tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/191146472" status: 202 len: 0 microversion: 2.1 time: 0.061830 Jun 16 18:27:09.419900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9aee9991-3614-4fdd-85d3-07a15fa61707 tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.420701 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 25/46] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/flavors/191146472 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:09.428660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bbc8bd06-08e1-4c73-8656-dc5652cd7afa tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.429829 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.429829 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.464420 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bbc8bd06-08e1-4c73-8656-dc5652cd7afa tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.041887 Jun 16 18:27:09.465087 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 26/47] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:09.472644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2edc9b2f-0691-44a8-b7a6-a8d5933e6f22 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.474102 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.474102 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.474399 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9aee9991-3614-4fdd-85d3-07a15fa61707 tempest-FlavorMetadataValidation-1488569042 tempest-FlavorMetadataValidation-1488569042-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.061552 Jun 16 18:27:09.475468 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 22/48] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:27:09.480238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-088c2ae1-d991-4c6f-ba9a-5e6c83560390 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.491342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2edc9b2f-0691-44a8-b7a6-a8d5933e6f22 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:09.492210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2edc9b2f-0691-44a8-b7a6-a8d5933e6f22 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:09.554947 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-088c2ae1-d991-4c6f-ba9a-5e6c83560390 tempest-FlavorsAccessTestJSON-554189500 tempest-FlavorsAccessTestJSON-554189500-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078041 Jun 16 18:27:09.557400 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 23/49] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:09.572517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc872680-8cb9-4d2e-bd98-91a854876979 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-758425104"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.573960 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.573960 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:09.575104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-fc872680-8cb9-4d2e-bd98-91a854876979 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid 35d97804-8f7f-4e6e-9d26-24b9d728e1a7 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:09.608170 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fc872680-8cb9-4d2e-bd98-91a854876979 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.048461 Jun 16 18:27:09.614818 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 24/50] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.623078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20f4d548-29bf-4852-9e62-3de434300718 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.630908 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.630908 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:09.646758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-20f4d548-29bf-4852-9e62-3de434300718 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '24d55a95f74b41b4aa70f4fc4db62f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ec4b54cd784767a8c95ff7a0effc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20f4d548-29bf-4852-9e62-3de434300718 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Request method failure captured: Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X0T9OLVmXNeLCqLLszb3mmO44mcTFwb3puyHtGaoIigNJhqmGlRzZH2hY11lr725AK-chW-De_tOALWR-96FsdeTwMPnWEqryG8vGp3nnKn0izqlyF6JgCLlcip_YzJ7lPh3xucuAl-NjKX9deGhkHHGgps4ktKJhJmvQOkvrjVpM Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:09.649344 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50ec4b54cd784767a8c95ff7a0effc2e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 24d55a95f74b41b4aa70f4fc4db62f78 Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 16 18:27:09.651123 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '7'} Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:09.651772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 16 18:27:09.653558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.655887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20f4d548-29bf-4852-9e62-3de434300718 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:09.657142 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-20f4d548-29bf-4852-9e62-3de434300718 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.039613 Jun 16 18:27:09.658941 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 25/51] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:09.669799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f3c47018-5e64-45bc-9ec4-8554e255513c tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.705149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f3c47018-5e64-45bc-9ec4-8554e255513c tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.039916 Jun 16 18:27:09.705981 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 26/52] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:09.717387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69f90920-6482-4cbb-988d-85ab313721c8 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.718651 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.718651 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:09.732095 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-69f90920-6482-4cbb-988d-85ab313721c8 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69f90920-6482-4cbb-988d-85ab313721c8 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:09.733862 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: exception: Aggregate -1 could not be found. Jun 16 18:27:09.735123 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '-1'} Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 18:27:09.735817 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.737523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69f90920-6482-4cbb-988d-85ab313721c8 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69f90920-6482-4cbb-988d-85ab313721c8 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022450 Jun 16 18:27:09.740226 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 27/53] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:09.742633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2edc9b2f-0691-44a8-b7a6-a8d5933e6f22 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.1 time: 0.276247 Jun 16 18:27:09.743673 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 27/54] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.745869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.747173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:09.751293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-761ad28f-7237-4ab3-a9d7-83379503c53a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-442543482"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:09.753358 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.753358 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.756461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:09.756916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:09.758420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:09.758420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:09.758876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-761ad28f-7237-4ab3-a9d7-83379503c53a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid f8e73e30-8fcc-49c0-bb43-ecf3ef3bb905 for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:09.788596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-761ad28f-7237-4ab3-a9d7-83379503c53a tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.043344 Jun 16 18:27:09.789849 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 28/55] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:09.799952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc7ae1c8-31ae-41ac-acd2-3fd827f2d2c6 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.801655 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.801655 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.803098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc7ae1c8-31ae-41ac-acd2-3fd827f2d2c6 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '24d55a95f74b41b4aa70f4fc4db62f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ec4b54cd784767a8c95ff7a0effc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc7ae1c8-31ae-41ac-acd2-3fd827f2d2c6 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Request method failure captured: Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X0T9OLVmXNeLCqLLszb3mmO44mcTFwb3puyHtGaoIigNJhqmGlRzZH2hY11lr725AK-chW-De_tOALWR-96FsdeTwMPnWEqryG8vGp3nnKn0izqlyF6JgCLlcip_YzJ7lPh3xucuAl-NjKX9deGhkHHGgps4ktKJhJmvQOkvrjVpM Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:09.805928 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50ec4b54cd784767a8c95ff7a0effc2e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 24d55a95f74b41b4aa70f4fc4db62f78 Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 16 18:27:09.807106 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '8'} Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:09.807746 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 16 18:27:09.808748 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.812119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc7ae1c8-31ae-41ac-acd2-3fd827f2d2c6 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:09.813320 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc7ae1c8-31ae-41ac-acd2-3fd827f2d2c6 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.017872 Jun 16 18:27:09.815303 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 29/56] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:09.833374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9e568b58-5dd4-44c2-9dda-df1dc7aa86ad tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.835955 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.835955 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.884201 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9e568b58-5dd4-44c2-9dda-df1dc7aa86ad tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.064139 Jun 16 18:27:09.884693 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 30/57] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:09 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:09.914777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daa04c86-e7ff-45e5-b097-4432ea8586d1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.915798 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.915798 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.927867 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-daa04c86-e7ff-45e5-b097-4432ea8586d1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daa04c86-e7ff-45e5-b097-4432ea8586d1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:09.937944 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: exception: Aggregate -1 could not be found. Jun 16 18:27:09.939130 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '-1'} Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.940469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 16 18:27:09.941631 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.943755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daa04c86-e7ff-45e5-b097-4432ea8586d1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:09.946227 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-daa04c86-e7ff-45e5-b097-4432ea8586d1 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.047516 Jun 16 18:27:09.949227 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 31/58] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:09.953670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:09.960957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67268cf3-3c9b-4108-ae72-209dcf48e608 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:09.962287 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:09.962287 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:09.965400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67268cf3-3c9b-4108-ae72-209dcf48e608 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '24d55a95f74b41b4aa70f4fc4db62f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ec4b54cd784767a8c95ff7a0effc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67268cf3-3c9b-4108-ae72-209dcf48e608 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Request method failure captured: Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X0T9OLVmXNeLCqLLszb3mmO44mcTFwb3puyHtGaoIigNJhqmGlRzZH2hY11lr725AK-chW-De_tOALWR-96FsdeTwMPnWEqryG8vGp3nnKn0izqlyF6JgCLlcip_YzJ7lPh3xucuAl-NjKX9deGhkHHGgps4ktKJhJmvQOkvrjVpM Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:09.967897 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50ec4b54cd784767a8c95ff7a0effc2e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 24d55a95f74b41b4aa70f4fc4db62f78 Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 16 18:27:09.969064 n-d-846209-2 devstack@n-api.service[119207]: action_args: {} Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:09.969694 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:09.971326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67268cf3-3c9b-4108-ae72-209dcf48e608 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:09.972359 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-378bcf40-e19d-4384-9aae-a9eeee3f29d6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1299 microversion: 2.1 time: 0.230845 Jun 16 18:27:09.972441 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67268cf3-3c9b-4108-ae72-209dcf48e608 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015048 Jun 16 18:27:09.972511 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:09.972577 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 32/60] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:27:09 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:10.994498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:10.996690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:11.020902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:11.021534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:11.022468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:11.023012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:11.178210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1797717614", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "availability_zone": "tempest-test_az-266929937"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:11.199850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:11.200478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:11.202291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:11.203049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:11.335742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:27:11.773764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:11.794570 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-efc9eba2-6931-465a-97e4-3a2da7d19609 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.805437 Jun 16 18:27:11.797876 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 33/61] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:10 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:12.640796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4576f529-b5d7-4f2a-bf10-724f81588023 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-630644646", "ram": 512, "vcpus": 1, "disk": 10, "id": 1166539236, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:12.645038 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:12.645038 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:12.703486 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4576f529-b5d7-4f2a-bf10-724f81588023 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.901617 Jun 16 18:27:12.704147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 34/62] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:11 2022] POST /compute/v2.1/flavors => generated 415 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:12.724778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-965e090b-a365-475e-9ef8-f1715c67e8a6 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:12.742323 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:12.742323 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:12.850805 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-965e090b-a365-475e-9ef8-f1715c67e8a6 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1166539236/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.129674 Jun 16 18:27:12.856426 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 35/63] 10.222.0.27 () {60 vars in 1223 bytes} [Thu Jun 16 18:27:12 2022] POST /compute/v2.1/flavors/1166539236/os-extra_specs => generated 66 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:12.870145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:12.871246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:12.887674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:12.888402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:12.889711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:12.890642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:12.958783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:27:12.959371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:27:12.960927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:27:12.961715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:27:12.962477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:27:12.999144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:13.004513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:13.007417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:13.009061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:13.103734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Getting quotas for project 27ef48c31ea74d87abed40ba2382065a. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:27:13.116473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Getting quotas for user 22fe310ea65a428eb57dce5ebf917ef7 and project 27ef48c31ea74d87abed40ba2382065a. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:27:13.151807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:27:13.158156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:27:13.294356 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a72ad7ec-cfa8-426b-86c1-89ad9686a7da tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.806408 Jun 16 18:27:13.297297 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 29/64] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:27:13.301284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:13.310244 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0b264ab1-3bc5-475c-90f2-3fc5abf1f8c3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.452290 Jun 16 18:27:13.325935 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 36/65] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:12 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:13.332258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2c6298a4-cf38-4e70-8b73-b6f87db927dc tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:13.332902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2c6298a4-cf38-4e70-8b73-b6f87db927dc tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:13.579738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2c6298a4-cf38-4e70-8b73-b6f87db927dc tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:13.631127 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2c6298a4-cf38-4e70-8b73-b6f87db927dc tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1242 microversion: 2.1 time: 0.301172 Jun 16 18:27:13.632081 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 37/66] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:13 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1242 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:13.924274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31f94556-9e16-4ed1-a380-33c812f1515f tempest-FlavorsExtraSpecsTestJSON-88291115 tempest-FlavorsExtraSpecsTestJSON-88291115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:13.941239 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31f94556-9e16-4ed1-a380-33c812f1515f tempest-FlavorsExtraSpecsTestJSON-88291115 tempest-FlavorsExtraSpecsTestJSON-88291115-project] 10.222.0.27 "GET /compute/v2.1/flavors/1166539236/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.640700 Jun 16 18:27:13.941830 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 30/67] 10.222.0.27 () {58 vars in 1202 bytes} [Thu Jun 16 18:27:13 2022] GET /compute/v2.1/flavors/1166539236/os-extra_specs => generated 66 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:13.952093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e699db6-2ef7-4acf-9811-6a595b9ac506 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:13.953985 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:13.953985 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:14.000159 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e699db6-2ef7-4acf-9811-6a595b9ac506 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1166539236/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052172 Jun 16 18:27:14.002872 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 31/68] 10.222.0.27 () {60 vars in 1223 bytes} [Thu Jun 16 18:27:13 2022] POST /compute/v2.1/flavors/1166539236/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:14.021403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e636391d-2d1d-4163-83a7-8473635f2de9 tempest-FlavorsExtraSpecsTestJSON-88291115 tempest-FlavorsExtraSpecsTestJSON-88291115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:14.074144 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e636391d-2d1d-4163-83a7-8473635f2de9 tempest-FlavorsExtraSpecsTestJSON-88291115 tempest-FlavorsExtraSpecsTestJSON-88291115-project] 10.222.0.27 "GET /compute/v2.1/flavors/1166539236/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.044533 Jun 16 18:27:14.075933 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 32/69] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:27:14 2022] GET /compute/v2.1/flavors/1166539236/os-extra_specs/hw:numa_nodes => generated 22 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:14.096390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66da13ef-b823-48b2-b0bd-2a8220aa32d1 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:14.144531 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66da13ef-b823-48b2-b0bd-2a8220aa32d1 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1166539236/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061210 Jun 16 18:27:14.153944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 33/70] 10.222.0.27 () {60 vars in 1223 bytes} [Thu Jun 16 18:27:14 2022] POST /compute/v2.1/flavors/1166539236/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:14.164185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9ae8a3f9-c4e8-49f4-9485-5817bcf6b6a3 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:14.188554 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9ae8a3f9-c4e8-49f4-9485-5817bcf6b6a3 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1166539236/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033445 Jun 16 18:27:14.197054 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 34/71] 10.222.0.27 () {58 vars in 1202 bytes} [Thu Jun 16 18:27:14 2022] GET /compute/v2.1/flavors/1166539236/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:14.205832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7640a812-0cb7-4029-8f19-2537edff9d7b tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:14.212507 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:14.212507 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:14.265109 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7640a812-0cb7-4029-8f19-2537edff9d7b tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1166539236/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.067507 Jun 16 18:27:14.265818 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 35/72] 10.222.0.27 () {60 vars in 1264 bytes} [Thu Jun 16 18:27:14 2022] PUT /compute/v2.1/flavors/1166539236/os-extra_specs/hw:numa_nodes => generated 22 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:14.279210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54f19638-abc9-4e66-b527-973c7c1a7af9 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:14.303634 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54f19638-abc9-4e66-b527-973c7c1a7af9 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1166539236/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030780 Jun 16 18:27:14.309484 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 36/73] 10.222.0.27 () {58 vars in 1202 bytes} [Thu Jun 16 18:27:14 2022] GET /compute/v2.1/flavors/1166539236/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:14.315635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92f224bc-7bc6-4cbb-8d64-4b883631b5f1 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:14.316678 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:14.316678 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:14.354657 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92f224bc-7bc6-4cbb-8d64-4b883631b5f1 tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1166539236/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.043590 Jun 16 18:27:14.358727 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 37/74] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:27:14 2022] DELETE /compute/v2.1/flavors/1166539236/os-extra_specs/hw:numa_nodes => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:14.369646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:14.370347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:14.378145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:14.378598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:14.379770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:14.393328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:14.448864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:14.581434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-191f618c-3ed2-4e14-8154-04047df9195b req-703ab6bb-5096-48e0-8653-726621e6865d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23ed8c4-5c3e-4d9a-9208-018a061b793b", "tag": "501ae637-d93d-408c-bf75-aae3930eebbd"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:14.612367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-191f618c-3ed2-4e14-8154-04047df9195b req-703ab6bb-5096-48e0-8653-726621e6865d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:14.613451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-191f618c-3ed2-4e14-8154-04047df9195b req-703ab6bb-5096-48e0-8653-726621e6865d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:14.644070 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-191f618c-3ed2-4e14-8154-04047df9195b req-703ab6bb-5096-48e0-8653-726621e6865d service nova] Creating event network-changed:501ae637-d93d-408c-bf75-aae3930eebbd for instance b23ed8c4-5c3e-4d9a-9208-018a061b793b on n-h2-846209-2 Jun 16 18:27:14.645267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-191f618c-3ed2-4e14-8154-04047df9195b req-703ab6bb-5096-48e0-8653-726621e6865d service nova] Acquired lock "compute-rpcapi-router" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:27:14.646842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29f7e49d-3947-4ac7-87c6-99764cee391e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:14.647447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29f7e49d-3947-4ac7-87c6-99764cee391e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:14.648468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29f7e49d-3947-4ac7-87c6-99764cee391e None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:14.649166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29f7e49d-3947-4ac7-87c6-99764cee391e None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:14.661264 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.compute.rpcapi [None req-29f7e49d-3947-4ac7-87c6-99764cee391e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:27:14.662586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29f7e49d-3947-4ac7-87c6-99764cee391e None None] Releasing lock "compute-rpcapi-router" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:27:14.717629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:14.718834 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-29f7e49d-3947-4ac7-87c6-99764cee391e None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.060807 Jun 16 18:27:14.723636 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 38/75] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:27:14.744861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0cfa550-2149-4418-837d-636b2625cc3c tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:14.747934 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-147eca73-4e7a-4d16-8b3d-e7dd9dfa79d3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.387723 Jun 16 18:27:14.749868 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:14.749868 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:14.753989 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 38/76] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:14 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:14.812226 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a0cfa550-2149-4418-837d-636b2625cc3c tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1166539236/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.084527 Jun 16 18:27:14.812806 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 39/77] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:27:14 2022] DELETE /compute/v2.1/flavors/1166539236/os-extra_specs/hw:cpu_policy => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:14.827730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a60722b8-8464-4094-be5f-26ffd4230d48 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:14.829585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a60722b8-8464-4094-be5f-26ffd4230d48 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:14.978173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a60722b8-8464-4094-be5f-26ffd4230d48 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:14.994581 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a60722b8-8464-4094-be5f-26ffd4230d48 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1242 microversion: 2.1 time: 0.177072 Jun 16 18:27:14.995327 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:14 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1242 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:15.006925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a64e871-bd76-4ea9-9a41-a0e3af59d5cf tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:15.044859 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a64e871-bd76-4ea9-9a41-a0e3af59d5cf tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1166539236/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048065 Jun 16 18:27:15.052079 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1202 bytes} [Thu Jun 16 18:27:14 2022] GET /compute/v2.1/flavors/1166539236/os-extra_specs => generated 19 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:15.081468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffbc20af-d0ca-460e-aeab-39e878d7aaaf tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:15.088138 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:15.088138 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:15.148442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ffbc20af-d0ca-460e-aeab-39e878d7aaaf tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1166539236" status: 202 len: 0 microversion: 2.1 time: 0.086137 Jun 16 18:27:15.149408 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 42/80] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:27:15 2022] DELETE /compute/v2.1/flavors/1166539236 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:15.159044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19cf1c21-fdf2-4ae3-9778-60ee40d7fc5c tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:15.206817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19cf1c21-fdf2-4ae3-9778-60ee40d7fc5c tempest-FlavorsExtraSpecsTestJSON-975684392 tempest-FlavorsExtraSpecsTestJSON-975684392-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052397 Jun 16 18:27:15.226020 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 43/81] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:15.622911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f86741b6310>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:15.624750 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:15.624750 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:15.631635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.632961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.680053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.682127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.726321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.726692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.746261 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cb52b095-070f-48cb-b502-94970bef623b tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.988404 Jun 16 18:27:15.747098 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 39/82] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:15.762897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f867435f430>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:15.763785 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:15.763785 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:15.772842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:15.773322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.774156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.776304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:15.801417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.808502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.810756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.813139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.837365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.840565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.889469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.890222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:15.921563 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b512d34a-c739-4705-b1fc-e095ffc04535 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.151685 Jun 16 18:27:15.931643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 44/83] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jun 16 18:27:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:15.953695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f86745223a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:15.956380 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:15.956380 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:15.959882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:15.961496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.012863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.023341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.056002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.057665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.076728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa1b79a1-6108-435d-b256-093e0baec51c tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.137360 Jun 16 18:27:16.083105 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 45/84] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:16.091714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:16.101488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:16.118728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.120618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.122208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.122961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.266785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:16.280511 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78b972c3-6d93-4291-b9ab-b7cfe1e3fdd8 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1290 microversion: 2.1 time: 0.195507 Jun 16 18:27:16.285304 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 46/85] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:16 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1290 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:16.293844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7bc2265c-7a33-4823-baa5-68da5c677560 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f86744c81f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:16.297061 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:16.297061 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:16.301341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bc2265c-7a33-4823-baa5-68da5c677560 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.301341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bc2265c-7a33-4823-baa5-68da5c677560 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.351411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:16.351524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bc2265c-7a33-4823-baa5-68da5c677560 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.351524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bc2265c-7a33-4823-baa5-68da5c677560 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.362777 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-60f013c6-b17b-4813-9444-0f29e40b5a7b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.597102 Jun 16 18:27:16.363314 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7bc2265c-7a33-4823-baa5-68da5c677560 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.076489 Jun 16 18:27:16.363481 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 40/86] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:15 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:16.379474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 47/87] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:16.383310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81f51ff7-c70a-457d-9906-57b46f9f58d8 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f8674112940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:16.384086 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:16.384086 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:16.385514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81f51ff7-c70a-457d-9906-57b46f9f58d8 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.385683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81f51ff7-c70a-457d-9906-57b46f9f58d8 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.417704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81f51ff7-c70a-457d-9906-57b46f9f58d8 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.040312 Jun 16 18:27:16.418862 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 41/88] 10.222.0.27 () {58 vars in 1178 bytes} [Thu Jun 16 18:27:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:16.430907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f86744c8160>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:16.431715 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:16.431715 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:16.432902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.433347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.445343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=79,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:16.451981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.452430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.469195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.469650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.478632 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b7069da5-a6ab-4eb8-b782-22cf570ae418 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051454 Jun 16 18:27:16.479206 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 48/89] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:16.489377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-65e64383-16d8-4c20-bdc4-5c7aa06e8704 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f8674112820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:16.490210 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:16.490210 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:16.491413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65e64383-16d8-4c20-bdc4-5c7aa06e8704 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.491851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65e64383-16d8-4c20-bdc4-5c7aa06e8704 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.525930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65e64383-16d8-4c20-bdc4-5c7aa06e8704 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.526750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65e64383-16d8-4c20-bdc4-5c7aa06e8704 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.534299 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-65e64383-16d8-4c20-bdc4-5c7aa06e8704 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.049048 Jun 16 18:27:16.535224 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 42/90] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:16.546734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5d3f797d-cd8c-4c3c-b519-aa0bdc2947d0 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f8674547f70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:16.547523 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:16.547523 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:16.548782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f797d-cd8c-4c3c-b519-aa0bdc2947d0 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.549296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f797d-cd8c-4c3c-b519-aa0bdc2947d0 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.568622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f797d-cd8c-4c3c-b519-aa0bdc2947d0 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.569067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f797d-cd8c-4c3c-b519-aa0bdc2947d0 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.578228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5d3f797d-cd8c-4c3c-b519-aa0bdc2947d0 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.035068 Jun 16 18:27:16.579124 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 49/91] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:16 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:16.593857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Calling method '.version_select at 0x7f8674112d30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:16.595087 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:16.595087 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:16.597679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.599206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.622758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.623844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.651126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.652177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.661385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9707746-2d41-49db-a156-7d9a3d820176 tempest-HypervisorAdminTestJSON-1776480428 tempest-HypervisorAdminTestJSON-1776480428-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:27:16.663078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f09a935-8d26-4668-a1a5-f717f48fbab8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.664146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f09a935-8d26-4668-a1a5-f717f48fbab8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.665208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f09a935-8d26-4668-a1a5-f717f48fbab8 None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:16.665851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f09a935-8d26-4668-a1a5-f717f48fbab8 None None] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:16.678379 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.rpcapi [None req-6f09a935-8d26-4668-a1a5-f717f48fbab8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:27:16.679841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f09a935-8d26-4668-a1a5-f717f48fbab8 None None] Releasing lock "compute-rpcapi-router" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:27:17.307017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:17.308113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:17.321139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:17.321599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:17.322422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:17.322855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:17.516972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:17.536452 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3270cc60-caf7-4911-b265-da243d343aeb tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1290 microversion: 2.1 time: 0.231285 Jun 16 18:27:17.539109 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 50/92] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:17 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1290 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:17.550472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:17.555766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:17.593803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:17.597101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:17.598613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:17.599361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:17.823606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:17.839112 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1437c9e-fc52-40fc-8b71-936ceeeedff4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.298118 Jun 16 18:27:17.840838 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 51/93] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:17 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:18.286972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c8d2d9c-ef34-4e23-a738-a9369cb64c46 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Calling method '.version_select at 0x7f867435fb80>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:18.335054 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-7c8d2d9c-ef34-4e23-a738-a9369cb64c46 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] HTTP exception thrown: Image not found. Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c8d2d9c-ef34-4e23-a738-a9369cb64c46 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Request method failure captured: Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/images/9e36e294-4c72-4f46-ba70-345ab575e7d6/metadata/os_distro HTTP/1.1 Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YFoHdlF5JhVkGFbUjyFLus8fWt7Bss_rHYS01HDvDsHUbHRmXFHGpdzVUP4APe-D4jKMNykCF6Zm8f7nGu0K5Lwgz9LGHaZalTraxC93I_N1RW-PuBpCc2gDaiXFmqBFpKTnK7pIPN4S9S4K5qT0SGq1x8U8xT0nXRblrizny7Zio Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:18.345979 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e36e9e81d3594519b4e5c156d298fef2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 19ee6d2f7e564a33b1ad8ab9913194cf Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'image_id': '9e36e294-4c72-4f46-ba70-345ab575e7d6', 'id': 'os_distro'} Jun 16 18:27:18.347418 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.348215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9e36e294-4c72-4f46-ba70-345ab575e7d6 Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.349231 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9e36e294-4c72-4f46-ba70-345ab575e7d6 could not be found. Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:27:18.350288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:27:18.351280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.354101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c8d2d9c-ef34-4e23-a738-a9369cb64c46 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:18.355143 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c8d2d9c-ef34-4e23-a738-a9369cb64c46 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] 10.222.0.27 "DELETE /compute/v2.1/images/9e36e294-4c72-4f46-ba70-345ab575e7d6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.512225 Jun 16 18:27:18.355849 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 52/94] 10.222.0.27 () {58 vars in 1292 bytes} [Thu Jun 16 18:27:17 2022] DELETE /compute/v2.1/images/9e36e294-4c72-4f46-ba70-345ab575e7d6/metadata/os_distro => generated 62 bytes in 514 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:18.371511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57b0081e-681c-44f1-82da-b5aeda6b4b84 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Calling method '.version_select at 0x7f8674385280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:18.410614 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-57b0081e-681c-44f1-82da-b5aeda6b4b84 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] HTTP exception thrown: Image not found. Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57b0081e-681c-44f1-82da-b5aeda6b4b84 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Request method failure captured: Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/images/f13aa885-0d3d-4020-bed2-00e17491c8c9/metadata/os_version HTTP/1.1 Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YFoHdlF5JhVkGFbUjyFLus8fWt7Bss_rHYS01HDvDsHUbHRmXFHGpdzVUP4APe-D4jKMNykCF6Zm8f7nGu0K5Lwgz9LGHaZalTraxC93I_N1RW-PuBpCc2gDaiXFmqBFpKTnK7pIPN4S9S4K5qT0SGq1x8U8xT0nXRblrizny7Zio Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:18.413158 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e36e9e81d3594519b4e5c156d298fef2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 19ee6d2f7e564a33b1ad8ab9913194cf Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'image_id': 'f13aa885-0d3d-4020-bed2-00e17491c8c9', 'id': 'os_version'} Jun 16 18:27:18.414294 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.414968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f13aa885-0d3d-4020-bed2-00e17491c8c9 Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.415962 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f13aa885-0d3d-4020-bed2-00e17491c8c9 could not be found. Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:27:18.417258 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:27:18.418288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.420983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57b0081e-681c-44f1-82da-b5aeda6b4b84 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:18.422063 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-57b0081e-681c-44f1-82da-b5aeda6b4b84 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] 10.222.0.27 "GET /compute/v2.1/images/f13aa885-0d3d-4020-bed2-00e17491c8c9/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.057678 Jun 16 18:27:18.423135 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 53/95] 10.222.0.27 () {58 vars in 1292 bytes} [Thu Jun 16 18:27:18 2022] GET /compute/v2.1/images/f13aa885-0d3d-4020-bed2-00e17491c8c9/metadata/os_version => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:18.433502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cafcc8db-9e0e-461f-95c9-abe4265373d1 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Calling method '.version_select at 0x7f867435f9d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:18.473506 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-cafcc8db-9e0e-461f-95c9-abe4265373d1 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] HTTP exception thrown: Image not found. Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cafcc8db-9e0e-461f-95c9-abe4265373d1 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Request method failure captured: Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/images/e1e40ee5-e760-4892-962f-056c57388572/metadata HTTP/1.1 Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YFoHdlF5JhVkGFbUjyFLus8fWt7Bss_rHYS01HDvDsHUbHRmXFHGpdzVUP4APe-D4jKMNykCF6Zm8f7nGu0K5Lwgz9LGHaZalTraxC93I_N1RW-PuBpCc2gDaiXFmqBFpKTnK7pIPN4S9S4K5qT0SGq1x8U8xT0nXRblrizny7Zio Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:18.484091 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e36e9e81d3594519b4e5c156d298fef2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 19ee6d2f7e564a33b1ad8ab9913194cf Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'image_id': 'e1e40ee5-e760-4892-962f-056c57388572'} Jun 16 18:27:18.485327 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.486664 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1e40ee5-e760-4892-962f-056c57388572 Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.487659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1e40ee5-e760-4892-962f-056c57388572 could not be found. Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:27:18.488659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:27:18.489597 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.494082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cafcc8db-9e0e-461f-95c9-abe4265373d1 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:18.500067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cafcc8db-9e0e-461f-95c9-abe4265373d1 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] 10.222.0.27 "GET /compute/v2.1/images/e1e40ee5-e760-4892-962f-056c57388572/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071017 Jun 16 18:27:18.501003 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 54/96] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:27:18 2022] GET /compute/v2.1/images/e1e40ee5-e760-4892-962f-056c57388572/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:18.512907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94da2c5a-f983-4341-942e-a4c4fd4bfb49 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Action: 'update_all', calling method: .version_select at 0x7f867435f9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:18.605428 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-94da2c5a-f983-4341-942e-a4c4fd4bfb49 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] HTTP exception thrown: Image not found. Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94da2c5a-f983-4341-942e-a4c4fd4bfb49 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Request method failure captured: Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/images/4d557744-2b38-485c-a997-e5fecfb8dd98/metadata HTTP/1.1 Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 57 Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YFoHdlF5JhVkGFbUjyFLus8fWt7Bss_rHYS01HDvDsHUbHRmXFHGpdzVUP4APe-D4jKMNykCF6Zm8f7nGu0K5Lwgz9LGHaZalTraxC93I_N1RW-PuBpCc2gDaiXFmqBFpKTnK7pIPN4S9S4K5qT0SGq1x8U8xT0nXRblrizny7Zio Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:18.608454 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e36e9e81d3594519b4e5c156d298fef2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 19ee6d2f7e564a33b1ad8ab9913194cf Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:27:18.610083 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'image_id': '4d557744-2b38-485c-a997-e5fecfb8dd98', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.610851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4d557744-2b38-485c-a997-e5fecfb8dd98 Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.611759 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4d557744-2b38-485c-a997-e5fecfb8dd98 could not be found. Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:18.612818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:27:18.614732 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.616200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94da2c5a-f983-4341-942e-a4c4fd4bfb49 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:18.616200 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94da2c5a-f983-4341-942e-a4c4fd4bfb49 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] 10.222.0.27 "PUT /compute/v2.1/images/4d557744-2b38-485c-a997-e5fecfb8dd98/metadata" status: 404 len: 62 microversion: 2.1 time: 0.102201 Jun 16 18:27:18.616200 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 55/97] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:27:18 2022] PUT /compute/v2.1/images/4d557744-2b38-485c-a997-e5fecfb8dd98/metadata => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:18.622284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:18.622990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:18.636127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:18.636686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:18.639473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:18.640048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:18.671975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:18.803717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:18.818373 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-42bafb73-48e8-4cfe-8481-191992f10279 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1290 microversion: 2.1 time: 0.206695 Jun 16 18:27:18.826038 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 56/98] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:18 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1290 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:18.841214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8dd569d2-46ed-43ee-b34f-721d3ac7764d tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Action: 'update', calling method: .version_select at 0x7f867435f790>, body: {"meta": {"os_distro": "alt"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:18.882150 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8dd569d2-46ed-43ee-b34f-721d3ac7764d tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] HTTP exception thrown: Image not found. Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8dd569d2-46ed-43ee-b34f-721d3ac7764d tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Request method failure captured: Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/images/49d28f23-73b8-48c0-aded-4516bfee5a9c/metadata/os_distro HTTP/1.1 Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 30 Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YFoHdlF5JhVkGFbUjyFLus8fWt7Bss_rHYS01HDvDsHUbHRmXFHGpdzVUP4APe-D4jKMNykCF6Zm8f7nGu0K5Lwgz9LGHaZalTraxC93I_N1RW-PuBpCc2gDaiXFmqBFpKTnK7pIPN4S9S4K5qT0SGq1x8U8xT0nXRblrizny7Zio Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:18.884394 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e36e9e81d3594519b4e5c156d298fef2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 19ee6d2f7e564a33b1ad8ab9913194cf Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: {"meta": {"os_distro": "alt"}} Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:27:18.886479 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'image_id': '49d28f23-73b8-48c0-aded-4516bfee5a9c', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.889007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 49d28f23-73b8-48c0-aded-4516bfee5a9c Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:18.890217 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49d28f23-73b8-48c0-aded-4516bfee5a9c could not be found. Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:18.891158 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:27:18.892740 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:18.894808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8dd569d2-46ed-43ee-b34f-721d3ac7764d tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:18.894808 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8dd569d2-46ed-43ee-b34f-721d3ac7764d tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] 10.222.0.27 "PUT /compute/v2.1/images/49d28f23-73b8-48c0-aded-4516bfee5a9c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.058833 Jun 16 18:27:18.894808 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 57/99] 10.222.0.27 () {60 vars in 1309 bytes} [Thu Jun 16 18:27:18 2022] PUT /compute/v2.1/images/49d28f23-73b8-48c0-aded-4516bfee5a9c/metadata/os_distro => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:18.900353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:18.902905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:18.931364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:18.932020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:18.932969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:18.933417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:19.194480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:19.218273 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d0aba3d9-2985-4606-ba4c-889ed2c36123 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.329416 Jun 16 18:27:19.223093 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 58/100] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:18 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:19.236648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-73ecb8a1-2499-46e5-b589-ec716a1d0692 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Action: 'create', calling method: .version_select at 0x7f8674351dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:19.283786 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-73ecb8a1-2499-46e5-b589-ec716a1d0692 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] HTTP exception thrown: Image not found. Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-73ecb8a1-2499-46e5-b589-ec716a1d0692 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Request method failure captured: Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/images/3a59d6f8-0873-4107-9545-5baee8f70e9f/metadata HTTP/1.1 Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 57 Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YFoHdlF5JhVkGFbUjyFLus8fWt7Bss_rHYS01HDvDsHUbHRmXFHGpdzVUP4APe-D4jKMNykCF6Zm8f7nGu0K5Lwgz9LGHaZalTraxC93I_N1RW-PuBpCc2gDaiXFmqBFpKTnK7pIPN4S9S4K5qT0SGq1x8U8xT0nXRblrizny7Zio Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:19.287632 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e36e9e81d3594519b4e5c156d298fef2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e36e9e81d3594519b4e5c156d298fef2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e36e9e81d3594519b4e5c156d298fef2 Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-797077388 Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 19ee6d2f7e564a33b1ad8ab9913194cf Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-797077388-project Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:27:19.288956 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'image_id': '3a59d6f8-0873-4107-9545-5baee8f70e9f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:19.289678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3a59d6f8-0873-4107-9545-5baee8f70e9f Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:27:19.290639 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3a59d6f8-0873-4107-9545-5baee8f70e9f could not be found. Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:19.291642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:27:19.292656 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:19.296853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-73ecb8a1-2499-46e5-b589-ec716a1d0692 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:19.297856 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-73ecb8a1-2499-46e5-b589-ec716a1d0692 tempest-ImagesMetadataNegativeTestJSON-797077388 tempest-ImagesMetadataNegativeTestJSON-797077388-project] 10.222.0.27 "POST /compute/v2.1/images/3a59d6f8-0873-4107-9545-5baee8f70e9f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072999 Jun 16 18:27:19.299295 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 59/101] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Jun 16 18:27:19 2022] POST /compute/v2.1/images/3a59d6f8-0873-4107-9545-5baee8f70e9f/metadata => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:19.849721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:19.850976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:19.864431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:19.864932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:19.866182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:19.866804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:19.965847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:19.975748 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aaf07395-d287-490e-b49f-c7a1c376f64c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1290 microversion: 2.1 time: 0.134216 Jun 16 18:27:19.987202 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 60/102] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:19 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:20.239182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:20.239802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:20.246433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:20.246887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:20.247671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:20.248319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:20.421411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:20.434554 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d08a281-8147-4922-b9b4-0e63b560e643 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.199714 Jun 16 18:27:20.435364 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 61/103] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:20 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:20.571507 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6f09a935-8d26-4668-a1a5-f717f48fbab8 None None] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 3.982723 Jun 16 18:27:20.573107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 43/104] 10.222.0.27 () {58 vars in 1172 bytes} [Thu Jun 16 18:27:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 3985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:20.932870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c22922ce-877b-4957-9273-1c96a2d45d5f tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-436734522", "ram": 512, "vcpus": 1, "disk": 10, "id": 1650721656, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:20.934972 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:20.934972 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:20.955618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c22922ce-877b-4957-9273-1c96a2d45d5f tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.216733 Jun 16 18:27:20.956619 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 62/105] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:20 2022] POST /compute/v2.1/flavors => generated 415 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:20.999571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:21.000221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:21.007519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:21.007978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:21.008773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:21.009222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:21.077174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:21.086414 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f174231-9ba2-4c16-aeb0-c081abe4ae8c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1296 microversion: 2.1 time: 0.091919 Jun 16 18:27:21.090049 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 63/106] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:20 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:21.452564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:21.453186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:21.464663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-031e7021-dd88-49ae-a771-f3fcff72a062 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:21.470944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:21.471725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:21.472544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:21.472981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:21.482468 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-031e7021-dd88-49ae-a771-f3fcff72a062 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] HTTP exception thrown: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-031e7021-dd88-49ae-a771-f3fcff72a062 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Request method failure captured: Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/flavors/1650721656/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YG2UlQPdKrZVNxK6pbeP1MM-pXTCbimHfuhBpiD_iC6QTfZsy5ArE2oSYKBm5MYUh3ci8QXCI2craCCoHraDTzYRGjyJNvm_q1DvWd0-ygancbZQcs6r0GU8SpixVbGcd2jmvbGDEVEs0O-vC9nWYnlWtYN3ZFnIraeakhN046iKQ Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:21.484806 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9babc290027c4623a2159115167d2173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9babc290027c4623a2159115167d2173", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fa3398a54b5e4bf9a2b5a872cc976515 Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:21.487576 n-d-846209-2 devstack@n-api.service[119206]: exception: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'flavor_id': '1650721656', 'id': 'hw:cpu_thread_policy'} Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.488361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.489840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.489840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.489840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.489840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:21.489840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:21.489840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.489840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.491730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-031e7021-dd88-49ae-a771-f3fcff72a062 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Returning 404 to user: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:21.492965 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-031e7021-dd88-49ae-a771-f3fcff72a062 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] 10.222.0.27 "GET /compute/v2.1/flavors/1650721656/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.523631 Jun 16 18:27:21.493940 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 44/107] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:27:20 2022] GET /compute/v2.1/flavors/1650721656/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 527 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:27:21.507925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4197ccb-0ab3-4385-b175-57a37a7a09d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:21.510525 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:21.510525 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:21.512913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f4197ccb-0ab3-4385-b175-57a37a7a09d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'fa3398a54b5e4bf9a2b5a872cc976515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9babc290027c4623a2159115167d2173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4197ccb-0ab3-4385-b175-57a37a7a09d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Request method failure captured: Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/flavors/1650721656/os-extra_specs HTTP/1.1 Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 66 Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YG2UlQPdKrZVNxK6pbeP1MM-pXTCbimHfuhBpiD_iC6QTfZsy5ArE2oSYKBm5MYUh3ci8QXCI2craCCoHraDTzYRGjyJNvm_q1DvWd0-ygancbZQcs6r0GU8SpixVbGcd2jmvbGDEVEs0O-vC9nWYnlWtYN3ZFnIraeakhN046iKQ Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:21.515462 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9babc290027c4623a2159115167d2173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9babc290027c4623a2159115167d2173", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fa3398a54b5e4bf9a2b5a872cc976515 Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 16 18:27:21.516852 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'flavor_id': '1650721656', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:21.518304 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 16 18:27:21.519616 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.522368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4197ccb-0ab3-4385-b175-57a37a7a09d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:21.523418 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4197ccb-0ab3-4385-b175-57a37a7a09d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] 10.222.0.27 "POST /compute/v2.1/flavors/1650721656/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023616 Jun 16 18:27:21.524476 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 45/108] 10.222.0.27 () {60 vars in 1223 bytes} [Thu Jun 16 18:27:21 2022] POST /compute/v2.1/flavors/1650721656/os-extra_specs => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:27:21.535787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2be6de2f-a0ff-4f5a-ab6b-b1e543ca27bc tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:21.578704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2be6de2f-a0ff-4f5a-ab6b-b1e543ca27bc tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1650721656/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048459 Jun 16 18:27:21.581337 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 46/109] 10.222.0.27 () {60 vars in 1223 bytes} [Thu Jun 16 18:27:21 2022] POST /compute/v2.1/flavors/1650721656/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:27:21.592027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55bebf1c-c610-4c96-a664-6d8fe30c006f tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:21.592882 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:21.592882 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:21.594093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55bebf1c-c610-4c96-a664-6d8fe30c006f tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'fa3398a54b5e4bf9a2b5a872cc976515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9babc290027c4623a2159115167d2173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55bebf1c-c610-4c96-a664-6d8fe30c006f tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Request method failure captured: Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YG2UlQPdKrZVNxK6pbeP1MM-pXTCbimHfuhBpiD_iC6QTfZsy5ArE2oSYKBm5MYUh3ci8QXCI2craCCoHraDTzYRGjyJNvm_q1DvWd0-ygancbZQcs6r0GU8SpixVbGcd2jmvbGDEVEs0O-vC9nWYnlWtYN3ZFnIraeakhN046iKQ Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:21.597609 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9babc290027c4623a2159115167d2173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9babc290027c4623a2159115167d2173", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fa3398a54b5e4bf9a2b5a872cc976515 Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:21.599063 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'flavor_id': '1650721656', 'id': 'hw:numa_nodes'} Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:21.599747 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 16 18:27:21.601012 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.603520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55bebf1c-c610-4c96-a664-6d8fe30c006f tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:21.604830 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55bebf1c-c610-4c96-a664-6d8fe30c006f tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017825 Jun 16 18:27:21.605946 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 47/110] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:27:21 2022] DELETE /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:21.621675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71720c31-76fa-44bd-bad5-85c1da5de41a tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:21.659161 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71720c31-76fa-44bd-bad5-85c1da5de41a tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1650721656/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043931 Jun 16 18:27:21.660376 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 48/111] 10.222.0.27 () {60 vars in 1223 bytes} [Thu Jun 16 18:27:21 2022] POST /compute/v2.1/flavors/1650721656/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:21.671777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0989af8f-e661-4fe5-a96f-e15cea4866f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:21.673931 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:21.673931 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:21.676211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0989af8f-e661-4fe5-a96f-e15cea4866f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'fa3398a54b5e4bf9a2b5a872cc976515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9babc290027c4623a2159115167d2173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0989af8f-e661-4fe5-a96f-e15cea4866f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Request method failure captured: Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 22 Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YG2UlQPdKrZVNxK6pbeP1MM-pXTCbimHfuhBpiD_iC6QTfZsy5ArE2oSYKBm5MYUh3ci8QXCI2craCCoHraDTzYRGjyJNvm_q1DvWd0-ygancbZQcs6r0GU8SpixVbGcd2jmvbGDEVEs0O-vC9nWYnlWtYN3ZFnIraeakhN046iKQ Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:21.678158 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9babc290027c4623a2159115167d2173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9babc290027c4623a2159115167d2173", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9babc290027c4623a2159115167d2173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 9babc290027c4623a2159115167d2173 Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fa3398a54b5e4bf9a2b5a872cc976515 Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: {"hw:numa_nodes": "1"} Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:21.679552 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'flavor_id': '1650721656', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:21.680395 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 16 18:27:21.681601 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.683732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0989af8f-e661-4fe5-a96f-e15cea4866f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:21.684788 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0989af8f-e661-4fe5-a96f-e15cea4866f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988 tempest-FlavorsExtraSpecsNegativeTestJSON-1621952988-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017916 Jun 16 18:27:21.686138 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 49/112] 10.222.0.27 () {60 vars in 1264 bytes} [Thu Jun 16 18:27:21 2022] PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:21.696552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35ee4254-36e1-4b3a-a53d-c08efd41cd0a tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:21.709697 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-35ee4254-36e1-4b3a-a53d-c08efd41cd0a tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] HTTP exception thrown: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35ee4254-36e1-4b3a-a53d-c08efd41cd0a tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Request method failure captured: Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/flavors/1650721656/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YIgLEBP6IiKcdKd1WXNr7XkgBCJIMz-F_xg5dhpMy521SmIhKla0qR8gkx2jvSx2SKiT55QYqdjNbbGPFUgjwrnplRgRk2YWoy38i_i2LPWqd4tqf0yvekNSbM58ywzwSfY8117tsEKiz99Pa0EC9-5pSY9FMv_3ma2zEHplCbiaI Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 83e3d6eab6294360bed71f4884f02c29 Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:21.711945 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_83e3d6eab6294360bed71f4884f02c29", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 83e3d6eab6294360bed71f4884f02c29 Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: db88af2104eb4324b99e4244e338f480 Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:21.713109 n-d-846209-2 devstack@n-api.service[119206]: exception: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'flavor_id': '1650721656', 'id': 'hw:cpu_thread_policy'} Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.713818 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.714984 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.714984 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.714984 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.714984 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:21.714984 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:21.714984 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. Jun 16 18:27:21.714984 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.715355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:21.717145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35ee4254-36e1-4b3a-a53d-c08efd41cd0a tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Returning 404 to user: Flavor 1650721656 has no extra specs with key hw:cpu_thread_policy. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:21.718604 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-35ee4254-36e1-4b3a-a53d-c08efd41cd0a tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1650721656/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.026897 Jun 16 18:27:21.720687 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 50/113] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:27:21 2022] DELETE /compute/v2.1/flavors/1650721656/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:27:21.730936 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f62db308-5c42-4a52-ac4d-1081474debf7 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.279206 Jun 16 18:27:21.731709 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 64/114] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:21 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:21.734963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a470238c-2d7b-4e39-b8c2-3872150476f6 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:21.738394 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a470238c-2d7b-4e39-b8c2-3872150476f6 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a470238c-2d7b-4e39-b8c2-3872150476f6 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Request method failure captured: Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 27 Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YIgLEBP6IiKcdKd1WXNr7XkgBCJIMz-F_xg5dhpMy521SmIhKla0qR8gkx2jvSx2SKiT55QYqdjNbbGPFUgjwrnplRgRk2YWoy38i_i2LPWqd4tqf0yvekNSbM58ywzwSfY8117tsEKiz99Pa0EC9-5pSY9FMv_3ma2zEHplCbiaI Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 83e3d6eab6294360bed71f4884f02c29 Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:21.740428 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_83e3d6eab6294360bed71f4884f02c29", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 83e3d6eab6294360bed71f4884f02c29 Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: db88af2104eb4324b99e4244e338f480 Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: {"hw:cpu_policy": "shared"} Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:21.741814 n-d-846209-2 devstack@n-api.service[119206]: exception: Request body and URI mismatch Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'flavor_id': '1650721656', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.742638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.743671 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:21.743671 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:21.743671 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 16 18:27:21.743671 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.743671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a470238c-2d7b-4e39-b8c2-3872150476f6 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:21.743671 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a470238c-2d7b-4e39-b8c2-3872150476f6 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.014935 Jun 16 18:27:21.743671 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 51/115] 10.222.0.27 () {60 vars in 1264 bytes} [Thu Jun 16 18:27:21 2022] PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes => generated 73 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:27:21.758840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c4ad4ab2-3b24-45d5-965d-9cca92c93d7e tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c4ad4ab2-3b24-45d5-965d-9cca92c93d7e tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Request method failure captured: Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 49 Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YIgLEBP6IiKcdKd1WXNr7XkgBCJIMz-F_xg5dhpMy521SmIhKla0qR8gkx2jvSx2SKiT55QYqdjNbbGPFUgjwrnplRgRk2YWoy38i_i2LPWqd4tqf0yvekNSbM58ywzwSfY8117tsEKiz99Pa0EC9-5pSY9FMv_3ma2zEHplCbiaI Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 83e3d6eab6294360bed71f4884f02c29 Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:21.762037 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_83e3d6eab6294360bed71f4884f02c29", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83e3d6eab6294360bed71f4884f02c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 83e3d6eab6294360bed71f4884f02c29 Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: db88af2104eb4324b99e4244e338f480 Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 16 18:27:21.763214 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'flavor_id': '1650721656', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance: Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 16 18:27:21.763841 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.765288 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:21.766336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:21.766336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:21.766336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:27:21.766336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:27:21.766336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 18:27:21.766336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:21.769288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c4ad4ab2-3b24-45d5-965d-9cca92c93d7e tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:21.770358 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c4ad4ab2-3b24-45d5-965d-9cca92c93d7e tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.015193 Jun 16 18:27:21.771038 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 65/116] 10.222.0.27 () {60 vars in 1264 bytes} [Thu Jun 16 18:27:21 2022] PUT /compute/v2.1/flavors/1650721656/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:27:21.785673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab0b45b1-5e88-4ea5-a870-86ff2d17fdc0 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:21.786912 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:21.786912 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:21.821632 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab0b45b1-5e88-4ea5-a870-86ff2d17fdc0 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1650721656" status: 202 len: 0 microversion: 2.1 time: 0.043956 Jun 16 18:27:21.826225 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 52/117] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:27:21 2022] DELETE /compute/v2.1/flavors/1650721656 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:21.849771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3ffbd9a-9372-4aa5-800c-422b62aae0ca tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:21.871344 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3ffbd9a-9372-4aa5-800c-422b62aae0ca tempest-FlavorsExtraSpecsNegativeTestJSON-331515246 tempest-FlavorsExtraSpecsNegativeTestJSON-331515246-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043498 Jun 16 18:27:21.871948 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 53/118] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:22.106584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:22.107389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:22.120863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:22.122652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:22.124021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:22.124780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:22.252553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:22.265265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a7568ab6-b48b-4596-a78a-a592dbfee80c tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1296 microversion: 2.1 time: 0.163125 Jun 16 18:27:22.276829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-283e77e7-0be3-4552-82fe-c28a33f3a7b8 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-916982019", "id": 514085758, "os-flavor-access:is_public": "False"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:22.277751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 54/119] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:22 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1296 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:22.278580 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:22.278580 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:22.305633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-283e77e7-0be3-4552-82fe-c28a33f3a7b8 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.509969 Jun 16 18:27:22.313932 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 66/120] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:21 2022] POST /compute/v2.1/flavors => generated 435 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:22.320614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bd022b6e-d3a1-4b6f-9caa-9f29fce495fe tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:22.321994 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:22.321994 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:22.770733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:22.771282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:22.778704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:22.779450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:22.780368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:22.780966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:22.881489 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bd022b6e-d3a1-4b6f-9caa-9f29fce495fe tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/514085758/action" status: 200 len: 96 microversion: 2.1 time: 0.566756 Jun 16 18:27:22.883164 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 55/121] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:22 2022] POST /compute/v2.1/flavors/514085758/action => generated 96 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:22.892860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61321ea9-336e-41a5-9b54-8e5866dc7f3e tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:23.078186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:23.090183 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e53ab651-0933-4bfa-a763-3b1efdba43f1 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.323465 Jun 16 18:27:23.092848 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 67/122] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:22 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:23.134363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=14 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:23.284841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:23.285597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:23.293697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:23.294407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:23.295368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:23.295950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:23.479072 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-61321ea9-336e-41a5-9b54-8e5866dc7f3e tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] HTTP exception thrown: Flavor access already exists for flavor 20 and project de1eef0349434965b1de9b1b0bb91537 combination. Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61321ea9-336e-41a5-9b54-8e5866dc7f3e tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Request method failure captured: Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/flavors/514085758/action HTTP/1.1 Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 67 Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YHNUho7FlmY9mEQ1hE1y1yEan3GKPZxA0IflQVlKyWX4j4lksocOUf2rBys5ERYNSxhT1MNmp6hskMiDL-QQizUgXFDj9_cduEFYe3F86yvf3RBYEP9HzygN93Iu3R7vrBIvqHrO9sYCshbkdnfJ0v2KQzobvjfSgVLNpX-m6QaZk Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f1b37c005f7b41b5a63ceb42c02e5c59 Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:23.483804 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b37c005f7b41b5a63ceb42c02e5c59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f1b37c005f7b41b5a63ceb42c02e5c59 Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 120fd652d1be443db2f8cff6894dd6e3 Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: {"addTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} Jun 16 18:27:23.485158 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: exception: Flavor access already exists for flavor 20 and project de1eef0349434965b1de9b1b0bb91537 combination. Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '514085758', 'body': {'addTenantAccess': {'tenant': 'de1eef0349434965b1de9b1b0bb91537'}}} Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result.read() Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:27:23.486831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '20-de1eef0349434965b1de9b1b0bb91537' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi session.flush() Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:27:23.487878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:27:23.488874 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:27:23.489993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result.read() Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '20-de1eef0349434965b1de9b1b0bb91537' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 16, 18, 27, 23, 469754), 'updated_at': None, 'flavor_id': 20, 'project_id': 'de1eef0349434965b1de9b1b0bb91537'}] Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:23.491112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 20 and project de1eef0349434965b1de9b1b0bb91537 combination. Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:23.492004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 20 and project de1eef0349434965b1de9b1b0bb91537 combination. Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:23.493193 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:23.498077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 20 and project de1eef0349434965b1de9b1b0bb91537 combination. Jun 16 18:27:23.498077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:23.498077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61321ea9-336e-41a5-9b54-8e5866dc7f3e tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Returning 409 to user: Flavor access already exists for flavor 20 and project de1eef0349434965b1de9b1b0bb91537 combination. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:23.498077 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61321ea9-336e-41a5-9b54-8e5866dc7f3e tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/514085758/action" status: 409 len: 152 microversion: 2.1 time: 0.608023 Jun 16 18:27:23.498077 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 56/123] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:22 2022] POST /compute/v2.1/flavors/514085758/action => generated 152 bytes in 609 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:27:24.127285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:24.153995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Calling method '.version_select at 0x7f867403b820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:24.154905 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:24.154905 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:24.156421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:24.156888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:24.161041 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f9b305f5-c754-44d5-9086-22de0458caa7 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.881354 Jun 16 18:27:24.161975 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 68/124] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:23 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:24.190479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:24.192475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:24.198874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52e7ae4e-bd15-4867-875c-2ce991128933 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:24.207844 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:24.207844 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:24.208302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:24.208470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:24.216610 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4ac071ba-99d6-41e5-935c-fe7637370c8c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.702138 Jun 16 18:27:24.217594 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 57/125] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:27:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:24.224230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:24.225162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:24.241173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:24.242963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:24.244787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:24.247040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:24.660350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:24.805493 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52e7ae4e-bd15-4867-875c-2ce991128933 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/514085758/action" status: 200 len: 21 microversion: 2.1 time: 0.642021 Jun 16 18:27:24.812809 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 69/126] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:24 2022] POST /compute/v2.1/flavors/514085758/action => generated 21 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:24.822159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfcd97e2-aa70-448b-800a-34190844605c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Calling method '.version_select at 0x7f86744c81f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:24.823562 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:24.823562 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:24.828330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd97e2-aa70-448b-800a-34190844605c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:24.828950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd97e2-aa70-448b-800a-34190844605c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:24.876391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd97e2-aa70-448b-800a-34190844605c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:24.876391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd97e2-aa70-448b-800a-34190844605c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:24.894294 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfcd97e2-aa70-448b-800a-34190844605c tempest-HypervisorAdminV228Test-1388337989 tempest-HypervisorAdminV228Test-1388337989-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.079174 Jun 16 18:27:24.896103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 70/127] 10.222.0.27 () {60 vars in 1192 bytes} [Thu Jun 16 18:27:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:24.901982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dee51e17-095c-4e9f-9d68-b0f9da0ad9d4 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:24.922212 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:24.922212 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:24.983826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:25.015081 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dee51e17-095c-4e9f-9d68-b0f9da0ad9d4 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/514085758" status: 202 len: 0 microversion: 2.1 time: 0.115919 Jun 16 18:27:25.019630 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 71/128] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:27:24 2022] DELETE /compute/v2.1/flavors/514085758 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:25.056767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24e8e2a9-35d7-47aa-a1b9-e91a19e9cecf tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:25.081499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:25.102994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f1f7453-32ee-44ac-b00e-9b7a096338dd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.884056 Jun 16 18:27:25.104161 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 58/129] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:24 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:25.154923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-24e8e2a9-35d7-47aa-a1b9-e91a19e9cecf tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.125004 Jun 16 18:27:25.156317 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 72/130] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:25.177101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0aaa821-56f4-4c53-a48e-4480ef945732 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1086210812", "id": 1660792327, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:25.185620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:25.186580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:25.189450 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:25.189450 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:25.197161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:25.200257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:25.203553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:25.204193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:25.239424 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c0aaa821-56f4-4c53-a48e-4480ef945732 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.071164 Jun 16 18:27:25.244380 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 59/131] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:25 2022] POST /compute/v2.1/flavors => generated 438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:25.251907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72d266cf-fdb4-4c16-8eb6-1218362fdc52 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:25.258038 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:25.258038 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:25.274499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-72d266cf-fdb4-4c16-8eb6-1218362fdc52 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72d266cf-fdb4-4c16-8eb6-1218362fdc52 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Request method failure captured: Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/flavors/1660792327/os-flavor-access HTTP/1.1 Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YHNUho7FlmY9mEQ1hE1y1yEan3GKPZxA0IflQVlKyWX4j4lksocOUf2rBys5ERYNSxhT1MNmp6hskMiDL-QQizUgXFDj9_cduEFYe3F86yvf3RBYEP9HzygN93Iu3R7vrBIvqHrO9sYCshbkdnfJ0v2KQzobvjfSgVLNpX-m6QaZk Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f1b37c005f7b41b5a63ceb42c02e5c59 Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:25.276602 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b37c005f7b41b5a63ceb42c02e5c59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f1b37c005f7b41b5a63ceb42c02e5c59 Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 120fd652d1be443db2f8cff6894dd6e3 Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: exception: Access list not available for public flavors. Jun 16 18:27:25.277881 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'flavor_id': '1660792327'} Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 16 18:27:25.278592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:25.279911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72d266cf-fdb4-4c16-8eb6-1218362fdc52 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:25.285845 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72d266cf-fdb4-4c16-8eb6-1218362fdc52 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1660792327/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.031232 Jun 16 18:27:25.286821 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 60/132] 10.222.0.27 () {58 vars in 1208 bytes} [Thu Jun 16 18:27:25 2022] GET /compute/v2.1/flavors/1660792327/os-flavor-access => generated 91 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:27:25.295783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46e2dc50-3e34-4afa-a257-fae995f5f6c3 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:25.296518 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:25.296518 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:25.348623 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46e2dc50-3e34-4afa-a257-fae995f5f6c3 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1660792327" status: 202 len: 0 microversion: 2.1 time: 0.056694 Jun 16 18:27:25.352633 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 61/133] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:27:25 2022] DELETE /compute/v2.1/flavors/1660792327 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:25.357818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b030a643-bf8c-4c35-a5d4-d555218e605b tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:25.408345 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b030a643-bf8c-4c35-a5d4-d555218e605b tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054270 Jun 16 18:27:25.422436 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 62/134] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:25.429671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8e45161-46b6-4f94-8a84-901bf8e1bc8e tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-575175863", "id": 529453194, "os-flavor-access:is_public": "False"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:25.467645 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8e45161-46b6-4f94-8a84-901bf8e1bc8e tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.040901 Jun 16 18:27:25.470006 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 63/135] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:25 2022] POST /compute/v2.1/flavors => generated 435 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:27:26.084495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:26.097945 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e03c99ba-e985-4b5d-9837-a6a3f6c304de tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.919375 Jun 16 18:27:26.102692 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 73/136] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:25 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:26.122492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:26.123232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:26.141514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:26.143155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:26.143963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:26.144391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:26.399499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0df76ea-dcf3-4032-b747-64e616eafc6d tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:26.401841 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:26.401841 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:26.403989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0df76ea-dcf3-4032-b747-64e616eafc6d tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '34cecb471ae64ee6857a4d5152701285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1eef0349434965b1de9b1b0bb91537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:26.404758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0df76ea-dcf3-4032-b747-64e616eafc6d tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Request method failure captured: Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/flavors/529453194/action HTTP/1.1 Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 67 Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YFGFkO-6do-vvgcxmkHCHwM1H9dn5vq652e3mAJFnzn-7aeX4y0c3r8bp5pGMirWLXCa9TOplCwZ2gaR5Cs52L22HB4sFcSoU1sht1ZYJ_Sii7LGlaTdT65avy6Q0xi6r6CiwuaGIjH0gve_KIuAv11BTKGzhxeG7wCP506Rgbto8 Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: de1eef0349434965b1de9b1b0bb91537 Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-932075293 Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:26.412473 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de1eef0349434965b1de9b1b0bb91537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de1eef0349434965b1de9b1b0bb91537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de1eef0349434965b1de9b1b0bb91537", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de1eef0349434965b1de9b1b0bb91537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-932075293 Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: de1eef0349434965b1de9b1b0bb91537 Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-932075293 Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsAccessNegativeTestJSON-932075293-project Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 34cecb471ae64ee6857a4d5152701285 Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-932075293-project Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: {"addTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} Jun 16 18:27:26.413808 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '529453194', 'body': {'addTenantAccess': {'tenant': 'de1eef0349434965b1de9b1b0bb91537'}}} Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:26.415112 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 16 18:27:26.416116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:26.417164 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4bab2a11-bc93-46dd-94d9-1f80159495fb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.298814 Jun 16 18:27:26.419067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0df76ea-dcf3-4032-b747-64e616eafc6d tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:26.421033 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 74/137] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:26 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:26.422252 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a0df76ea-dcf3-4032-b747-64e616eafc6d tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] 10.222.0.27 "POST /compute/v2.1/flavors/529453194/action" status: 403 len: 130 microversion: 2.1 time: 0.941346 Jun 16 18:27:26.425000 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 64/138] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:25 2022] POST /compute/v2.1/flavors/529453194/action => generated 130 bytes in 946 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:26.441057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97fa5831-fba2-4228-951c-add1f771a982 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:26.441843 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:26.441843 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:26.490168 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97fa5831-fba2-4228-951c-add1f771a982 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/529453194" status: 202 len: 0 microversion: 2.1 time: 0.053436 Jun 16 18:27:26.491379 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 75/139] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:27:26 2022] DELETE /compute/v2.1/flavors/529453194 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:26.500697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d204c9d0-1295-4cff-972e-20ce99a80f02 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:26.565987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d204c9d0-1295-4cff-972e-20ce99a80f02 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069189 Jun 16 18:27:26.568378 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 65/140] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:26.589619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-efac85ec-a35c-4078-b151-f1e7907edea9 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-17950912", "id": 885865839, "os-flavor-access:is_public": "False"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:26.593477 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:26.593477 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:26.615478 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-efac85ec-a35c-4078-b151-f1e7907edea9 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.031655 Jun 16 18:27:26.617076 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 76/141] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:26 2022] POST /compute/v2.1/flavors => generated 434 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:26.629335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71fd8d48-5a7d-40b7-850a-d10eafd6f011 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:26.677227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:27.121387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:27.122233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:27.143737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:27.144609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:27.149407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:27.152326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:27.309965 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71fd8d48-5a7d-40b7-850a-d10eafd6f011 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/885865839/action" status: 200 len: 96 microversion: 2.1 time: 0.677840 Jun 16 18:27:27.309965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 66/142] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:26 2022] POST /compute/v2.1/flavors/885865839/action => generated 96 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:27:27.321508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca5711ca-7f08-4cee-a199-b3a78b80dfc5 tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:27.324085 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:27.324085 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:27.325049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ca5711ca-7f08-4cee-a199-b3a78b80dfc5 tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '34cecb471ae64ee6857a4d5152701285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1eef0349434965b1de9b1b0bb91537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca5711ca-7f08-4cee-a199-b3a78b80dfc5 tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Request method failure captured: Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/flavors/885865839/action HTTP/1.1 Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 70 Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YFGFkO-6do-vvgcxmkHCHwM1H9dn5vq652e3mAJFnzn-7aeX4y0c3r8bp5pGMirWLXCa9TOplCwZ2gaR5Cs52L22HB4sFcSoU1sht1ZYJ_Sii7LGlaTdT65avy6Q0xi6r6CiwuaGIjH0gve_KIuAv11BTKGzhxeG7wCP506Rgbto8 Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: de1eef0349434965b1de9b1b0bb91537 Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-932075293 Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:27.331348 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de1eef0349434965b1de9b1b0bb91537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de1eef0349434965b1de9b1b0bb91537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de1eef0349434965b1de9b1b0bb91537", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de1eef0349434965b1de9b1b0bb91537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-932075293 Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: de1eef0349434965b1de9b1b0bb91537 Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-932075293 Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsAccessNegativeTestJSON-932075293-project Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 34cecb471ae64ee6857a4d5152701285 Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-932075293-project Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: {"removeTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} Jun 16 18:27:27.339224 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '885865839', 'body': {'removeTenantAccess': {'tenant': 'de1eef0349434965b1de9b1b0bb91537'}}} Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can( Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:27.341494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 16 18:27:27.343847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:27.358965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca5711ca-7f08-4cee-a199-b3a78b80dfc5 tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:27.358965 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca5711ca-7f08-4cee-a199-b3a78b80dfc5 tempest-FlavorsAccessNegativeTestJSON-932075293 tempest-FlavorsAccessNegativeTestJSON-932075293-project] 10.222.0.27 "POST /compute/v2.1/flavors/885865839/action" status: 403 len: 133 microversion: 2.1 time: 0.016634 Jun 16 18:27:27.358965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 67/143] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:27 2022] POST /compute/v2.1/flavors/885865839/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:27.358965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0dfc3af9-dcac-403b-8de1-bd0def4f1c58 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "de1eef0349434965b1de9b1b0bb91537"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:27.707925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:27.723222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=78,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4,nova_api:DELETE=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:27.732008 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b09b8920-d0b5-47b5-9f4a-4ac12c3cbe44 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.614860 Jun 16 18:27:27.735117 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 77/144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:27 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:27.743813 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0dfc3af9-dcac-403b-8de1-bd0def4f1c58 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/885865839/action" status: 200 len: 21 microversion: 2.1 time: 0.404062 Jun 16 18:27:27.744523 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 68/145] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:27 2022] POST /compute/v2.1/flavors/885865839/action => generated 21 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:27:27.760542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:27.761530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:27.775232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:27.775997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:27.777116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:27.778376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:27.989109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-314a06d6-f857-4023-8ae0-36c163822a41 req-1a1292c5-d369-48fa-be92-a76c631295d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23ed8c4-5c3e-4d9a-9208-018a061b793b", "name": "network-vif-plugged", "status": "completed", "tag": "501ae637-d93d-408c-bf75-aae3930eebbd"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:28.021199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-314a06d6-f857-4023-8ae0-36c163822a41 req-1a1292c5-d369-48fa-be92-a76c631295d2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:28.022260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-314a06d6-f857-4023-8ae0-36c163822a41 req-1a1292c5-d369-48fa-be92-a76c631295d2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:28.058222 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-314a06d6-f857-4023-8ae0-36c163822a41 req-1a1292c5-d369-48fa-be92-a76c631295d2 service nova] Creating event network-vif-plugged:501ae637-d93d-408c-bf75-aae3930eebbd for instance b23ed8c4-5c3e-4d9a-9208-018a061b793b on n-h2-846209-2 Jun 16 18:27:28.072251 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-314a06d6-f857-4023-8ae0-36c163822a41 req-1a1292c5-d369-48fa-be92-a76c631295d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333296 Jun 16 18:27:28.075226 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 78/146] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:28.338388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:28.373988 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f0af5f5-baf4-4c99-bee3-d2592f33e7a4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.627922 Jun 16 18:27:28.377823 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 69/147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:27 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:28.697278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c09cc453-77c5-40e3-81aa-7161ac5ad727 req-af4afe8d-6055-4325-b67b-5ed66b132859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41320455-8dd9-4ec2-9a09-b6cb9353b610", "tag": "fbdc1b22-e5a9-4b9a-a8dd-ad99deca1c50"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:28.714064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c09cc453-77c5-40e3-81aa-7161ac5ad727 req-af4afe8d-6055-4325-b67b-5ed66b132859 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:28.714642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c09cc453-77c5-40e3-81aa-7161ac5ad727 req-af4afe8d-6055-4325-b67b-5ed66b132859 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:28.733892 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c09cc453-77c5-40e3-81aa-7161ac5ad727 req-af4afe8d-6055-4325-b67b-5ed66b132859 service nova] Creating event network-changed:fbdc1b22-e5a9-4b9a-a8dd-ad99deca1c50 for instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 on n-h2-846209-2 Jun 16 18:27:28.744874 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c09cc453-77c5-40e3-81aa-7161ac5ad727 req-af4afe8d-6055-4325-b67b-5ed66b132859 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.664931 Jun 16 18:27:28.745769 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 79/148] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:28.755990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c45e8d75-dbea-41ad-821f-a8f180ed61f9 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:28.756958 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:28.756958 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:28.783662 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c45e8d75-dbea-41ad-821f-a8f180ed61f9 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/885865839" status: 202 len: 0 microversion: 2.1 time: 0.031512 Jun 16 18:27:28.784767 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 80/149] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:27:28 2022] DELETE /compute/v2.1/flavors/885865839 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:28.790912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:28.792568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:28.801768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:28.802737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:28.803995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:28.804713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:29.098061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35dbc991-a0bb-4ab3-9d2f-5ad10a7ecf32 tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] Action: 'create', calling method: .version_select at 0x7f86740d3820>, body: {"security_group": {"name": "tempest-securitygroup-885315496", "description": "tempest-description-1213371527"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:29.244318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:29.253847 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f63f61c6-2c82-4ef5-9ddb-c20e9665a1b5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.467596 Jun 16 18:27:29.258653 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 81/150] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:28 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:29.269894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92a751dc-b8e4-4977-9a2e-b748ccda3c69 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:29.324751 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92a751dc-b8e4-4977-9a2e-b748ccda3c69 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064035 Jun 16 18:27:29.326358 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 82/151] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:29.348346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d94cdc8-0bba-473d-be9d-1968c62a9757 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-896484306", "id": 447047114, "os-flavor-access:is_public": "False"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:29.350171 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:29.350171 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:29.384105 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d94cdc8-0bba-473d-be9d-1968c62a9757 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041609 Jun 16 18:27:29.386538 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 83/152] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:29 2022] POST /compute/v2.1/flavors => generated 435 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:29.406926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:29.410494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:29.417825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:29.429712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:29.431036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:29.432748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:29.433830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:29.822262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:29.838636 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-618c0f50-a8e1-45e7-8e9d-43319fed2b0b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.440873 Jun 16 18:27:29.839248 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 84/153] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:29 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:29.844402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-14dc69af-d5bf-4da8-a115-43171b3ee024 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9982055edfea43f592f60add719eb39e"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:29.855165 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:29.855165 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:30.036034 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-35dbc991-a0bb-4ab3-9d2f-5ad10a7ecf32 tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.654808 Jun 16 18:27:30.037367 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 70/154] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:27:28 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:30.058734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fdcdf538-9568-4a3c-8c9d-a17b031d971a tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] Action: 'create', calling method: .version_select at 0x7f866f7de670>, body: {"security_group": {"name": "tempest-securitygroup-1983502447", "description": "tempest-description-1117293529"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:30.416300 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-14dc69af-d5bf-4da8-a115-43171b3ee024 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] HTTP exception thrown: Flavor access not found for 24 / 9982055edfea43f592f60add719eb39e combination. Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-14dc69af-d5bf-4da8-a115-43171b3ee024 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Request method failure captured: Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/flavors/447047114/action HTTP/1.1 Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 70 Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YHNUho7FlmY9mEQ1hE1y1yEan3GKPZxA0IflQVlKyWX4j4lksocOUf2rBys5ERYNSxhT1MNmp6hskMiDL-QQizUgXFDj9_cduEFYe3F86yvf3RBYEP9HzygN93Iu3R7vrBIvqHrO9sYCshbkdnfJ0v2KQzobvjfSgVLNpX-m6QaZk Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: f1b37c005f7b41b5a63ceb42c02e5c59 Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:30.427027 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b37c005f7b41b5a63ceb42c02e5c59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b37c005f7b41b5a63ceb42c02e5c59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: f1b37c005f7b41b5a63ceb42c02e5c59 Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300 Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 120fd652d1be443db2f8cff6894dd6e3 Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: {"removeTenantAccess": {"tenant": "9982055edfea43f592f60add719eb39e"}} Jun 16 18:27:30.428462 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: exception: Flavor access not found for 24 / 9982055edfea43f592f60add719eb39e combination. Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '447047114', 'body': {'removeTenantAccess': {'tenant': '9982055edfea43f592f60add719eb39e'}}} Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 16 18:27:30.429204 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 9982055edfea43f592f60add719eb39e combination. Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 9982055edfea43f592f60add719eb39e combination. Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:30.430371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:30.431436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:30.431436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:30.431436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:30.431436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:30.431436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 9982055edfea43f592f60add719eb39e combination. Jun 16 18:27:30.431436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:30.433748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-14dc69af-d5bf-4da8-a115-43171b3ee024 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Returning 404 to user: Flavor access not found for 24 / 9982055edfea43f592f60add719eb39e combination. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:30.437001 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-14dc69af-d5bf-4da8-a115-43171b3ee024 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/447047114/action" status: 404 len: 124 microversion: 2.1 time: 0.596576 Jun 16 18:27:30.437773 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 85/155] 10.222.0.27 () {60 vars in 1196 bytes} [Thu Jun 16 18:27:29 2022] POST /compute/v2.1/flavors/447047114/action => generated 124 bytes in 598 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:30.449479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:30.455388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:30.476394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:30.479332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:30.484551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:30.485263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:30.653407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fdcdf538-9568-4a3c-8c9d-a17b031d971a tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.605515 Jun 16 18:27:30.655647 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 71/156] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:27:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:30.666778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f73830d-657c-4529-8c8a-eff5bfa3c8df tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:30.669723 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:30.669723 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:30.716181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f73830d-657c-4529-8c8a-eff5bfa3c8df tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/447047114" status: 202 len: 0 microversion: 2.1 time: 0.058883 Jun 16 18:27:30.717022 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 72/157] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:27:30 2022] DELETE /compute/v2.1/flavors/447047114 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:30.816949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:30.832510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7bb66d43-97ce-4bf2-88a5-20299094cbd5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.391165 Jun 16 18:27:30.834901 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 86/158] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:30 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:30.843239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91af4905-b6b4-48fc-8bf3-fb00b9902b78 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:30.890720 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91af4905-b6b4-48fc-8bf3-fb00b9902b78 tempest-FlavorsAccessNegativeTestJSON-1272846300 tempest-FlavorsAccessNegativeTestJSON-1272846300-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054583 Jun 16 18:27:30.896963 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 87/159] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:30.909480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:30.911184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:30.932424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:30.933991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:30.935030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:30.938011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:31.261000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:31.271604 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-02bc126f-6b86-479e-8deb-f55842d77cd4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1341 microversion: 2.1 time: 0.372676 Jun 16 18:27:31.273115 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 88/160] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:30 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1341 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:31.322512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5816914a-df6b-4777-818b-5f334fde1b66 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Action: 'create', calling method: .version_select at 0x7f866f7deaf0>, body: {"security_group": {"name": "tempest-securitygroup-2058402337", "description": "tempest-description-1240797254"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:31.858068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:31.858698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:31.872211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:31.874596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:31.877526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:31.878409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:31.935926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:32.124571 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5816914a-df6b-4777-818b-5f334fde1b66 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.405782 Jun 16 18:27:32.134716 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 73/161] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:27:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:32.140621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e475f12-48be-48e9-9665-30123d82e08d tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Action: 'create', calling method: .version_select at 0x7f86740d3160>, body: {"security_group": {"name": "tempest-securitygroup-1581962681", "description": "tempest-description-2002234241"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:32.271494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:32.285326 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1380dcde-3e12-44a2-9c2b-7a42f8d95f0a tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.430507 Jun 16 18:27:32.286960 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 89/162] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:31 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:32.300512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:32.301139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:32.334881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:32.335341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:32.336138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:32.336586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:32.468407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e475f12-48be-48e9-9665-30123d82e08d tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.332207 Jun 16 18:27:32.477183 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 74/163] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:27:32 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:32.765503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:32.787369 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-410c5013-a4f8-49a6-a7d1-8db90fcdf91b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1491 microversion: 2.1 time: 0.498742 Jun 16 18:27:32.790268 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 90/164] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:32 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1491 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:32.804963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Calling method '.version_select at 0x7f8674300ee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:33.147256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f91188f-6a57-4790-9b6f-5b62ffaad1c6 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f867403b550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:33.149199 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:33.149199 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:33.152321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f91188f-6a57-4790-9b6f-5b62ffaad1c6 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:33.153066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f91188f-6a57-4790-9b6f-5b62ffaad1c6 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:33.154528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f91188f-6a57-4790-9b6f-5b62ffaad1c6 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:33.159013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f91188f-6a57-4790-9b6f-5b62ffaad1c6 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:33.270453 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f91188f-6a57-4790-9b6f-5b62ffaad1c6 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.791839 Jun 16 18:27:33.271798 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 75/165] 10.222.0.27 () {58 vars in 1127 bytes} [Thu Jun 16 18:27:32 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:33.670149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:33.670822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:33.686804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:33.691417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:33.693382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:33.702356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:33.772473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=81 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:33.869417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:27:34.127574 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50b72f74-c55d-4cab-9eb9-e25952466903 tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 204 len: 0 microversion: 2.1 time: 0.854016 Jun 16 18:27:34.128468 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 76/166] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:27:33 2022] DELETE /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 0 bytes in 856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:27:34.145230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66fd9227-b289-48fa-993a-c914650d7a09 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f867403b280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:34.149556 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:34.149556 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:34.152154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66fd9227-b289-48fa-993a-c914650d7a09 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:34.152633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66fd9227-b289-48fa-993a-c914650d7a09 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:34.154786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66fd9227-b289-48fa-993a-c914650d7a09 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:34.155237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66fd9227-b289-48fa-993a-c914650d7a09 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:34.213617 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66fd9227-b289-48fa-993a-c914650d7a09 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.083745 Jun 16 18:27:34.215091 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 77/167] 10.222.0.27 () {58 vars in 1138 bytes} [Thu Jun 16 18:27:34 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:34.220934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:34.221878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:34.233885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:34.234921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:34.237811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:34.238459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:34.681184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cd3ab0a6-9c0e-49f9-bf70-f08bff490fdf does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:27:34.683624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Neutron security group cd3ab0a6-9c0e-49f9-bf70-f08bff490fdf not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:27:34.685338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.security_groups [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Security Group ID cd3ab0a6-9c0e-49f9-bf70-f08bff490fdf does not exist {{(pid=119207) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jun 16 18:27:34.735075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cd3ab0a6-9c0e-49f9-bf70-f08bff490fdf does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:27:34.738745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Neutron security group cd3ab0a6-9c0e-49f9-bf70-f08bff490fdf not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:27:34.739297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.security_groups [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Security Group ID cd3ab0a6-9c0e-49f9-bf70-f08bff490fdf does not exist {{(pid=119207) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jun 16 18:27:34.791817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:34.806715 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ee3cb39-0108-47b8-9680-15bbc12ce726 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.589778 Jun 16 18:27:34.811810 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 78/168] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:34 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:34.821581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:34.824720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:34.841313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:34.843802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:34.847869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:34.850215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.108283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:35.111861 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a0cb8e37-a829-429e-b15c-1b8132a8d597 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6490 microversion: 2.1 time: 2.320170 Jun 16 18:27:35.112499 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 91/169] 10.222.0.27 () {58 vars in 1190 bytes} [Thu Jun 16 18:27:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6490 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:35.119335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf3aa1c3-3251-4d7b-bf76-1da1d53d3ae5 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f8674273f70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:35.120105 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-70ef96bb-07d5-4089-a5c6-babdeba242f6 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1497 microversion: 2.1 time: 0.306878 Jun 16 18:27:35.129942 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 79/170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:34 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1497 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:35.130141 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:35.130141 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:35.130141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf3aa1c3-3251-4d7b-bf76-1da1d53d3ae5 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.130141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf3aa1c3-3251-4d7b-bf76-1da1d53d3ae5 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.130141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf3aa1c3-3251-4d7b-bf76-1da1d53d3ae5 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.130506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf3aa1c3-3251-4d7b-bf76-1da1d53d3ae5 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.165197 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bf3aa1c3-3251-4d7b-bf76-1da1d53d3ae5 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.050019 Jun 16 18:27:35.165826 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 92/171] 10.222.0.27 () {58 vars in 1144 bytes} [Thu Jun 16 18:27:35 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:27:35.428347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Calling method '.version_select at 0x7f8674662d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:35.430393 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:35.430393 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:35.432599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.433428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.449168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1037394887", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "608da02e-c32f-4a3c-bcd7-760fd8a6c9d5"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:35.464884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.465928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.527006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] validate_networks() for [('608da02e-c32f-4a3c-bcd7-760fd8a6c9d5', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:27:35.559606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.560093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.572828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.573290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.591378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.592007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.601498 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3c5a8fc-a54e-4cf7-8a38-d4c7108bc431 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.434564 Jun 16 18:27:35.602300 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 93/172] 10.222.0.27 () {60 vars in 1242 bytes} [Thu Jun 16 18:27:35 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:27:35.627172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2e5666f5-36b7-40a9-a67e-cf389813bb5f req-6fac83d9-2dfb-4499-ba79-59049f5d61ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41320455-8dd9-4ec2-9a09-b6cb9353b610", "name": "network-vif-plugged", "status": "completed", "tag": "fbdc1b22-e5a9-4b9a-a8dd-ad99deca1c50"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:35.643104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2e5666f5-36b7-40a9-a67e-cf389813bb5f req-6fac83d9-2dfb-4499-ba79-59049f5d61ab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:35.644017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2e5666f5-36b7-40a9-a67e-cf389813bb5f req-6fac83d9-2dfb-4499-ba79-59049f5d61ab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:35.660023 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2e5666f5-36b7-40a9-a67e-cf389813bb5f req-6fac83d9-2dfb-4499-ba79-59049f5d61ab service nova] Creating event network-vif-plugged:fbdc1b22-e5a9-4b9a-a8dd-ad99deca1c50 for instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 on n-h2-846209-2 Jun 16 18:27:35.666922 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2e5666f5-36b7-40a9-a67e-cf389813bb5f req-6fac83d9-2dfb-4499-ba79-59049f5d61ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062544 Jun 16 18:27:35.690046 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 94/173] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:35.701290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6def4c91-aced-416c-bf91-95d2f080ea50 tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] Calling method '.version_select at 0x7f8674351310>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:36.281720 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6def4c91-aced-416c-bf91-95d2f080ea50 tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.585915 Jun 16 18:27:36.282874 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 95/174] 10.222.0.27 () {58 vars in 1190 bytes} [Thu Jun 16 18:27:35 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:36.287979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Calling method '.version_select at 0x7f8674300f70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:36.289662 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:36.289662 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:36.294634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.295325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.326933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.329695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.361637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.362495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.379638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.380557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.418754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.419288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.444228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fbbcfd37-cf47-4e0b-abb9-02d74fa76d0d tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.160196 Jun 16 18:27:36.449863 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 96/175] 10.222.0.27 () {60 vars in 1221 bytes} [Thu Jun 16 18:27:36 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:36.456537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:36.457464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:36.467769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.468215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.469162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.470431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.764944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:36.779216 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-645e0581-3911-479d-96c8-e0410294906b tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1338 microversion: 2.1 time: 0.327379 Jun 16 18:27:36.795049 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 97/176] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:36 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1338 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:36.802986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:36.803857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:36.821822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.822302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.826133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.827075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.858757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:27:36.861096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:27:36.861866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:27:36.862493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:27:36.863603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:27:36.870953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.871415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.871902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lazy-loading 'fault' on Instance uuid b23ed8c4-5c3e-4d9a-9208-018a061b793b {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:27:36.875298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.877066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.878177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:36.878950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:36.901240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:27:36.906408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for user 33f458b13d494ef7bc8e7055be73fa42 and project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:27:36.920079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:27:36.923775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:27:36.945523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:36.956641 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2d99ccbc-5845-432a-b970-9f98d83c2779 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 200 len: 1331 microversion: 2.1 time: 0.159605 Jun 16 18:27:36.957435 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 98/177] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:36 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:36.963420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eac08250-4a9d-4f2f-baa9-dd89958f8e73 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Calling method '.version_select at 0x7f8674300c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:36.990788 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2e54eec5-8c82-4864-9c90-abcd9bfc135b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868224 Jun 16 18:27:36.993745 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 80/178] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:27:37.006353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-522872e9-65e3-482e-8b08-4a567d357f9c req-a15ad708-a07b-4289-99aa-c5a0ff95b698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23ed8c4-5c3e-4d9a-9208-018a061b793b", "name": "network-vif-deleted", "tag": "501ae637-d93d-408c-bf75-aae3930eebbd"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:37.058346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-522872e9-65e3-482e-8b08-4a567d357f9c req-a15ad708-a07b-4289-99aa-c5a0ff95b698 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:37.063961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-522872e9-65e3-482e-8b08-4a567d357f9c req-a15ad708-a07b-4289-99aa-c5a0ff95b698 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:37.125223 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-522872e9-65e3-482e-8b08-4a567d357f9c req-a15ad708-a07b-4289-99aa-c5a0ff95b698 service nova] Creating event network-vif-deleted:501ae637-d93d-408c-bf75-aae3930eebbd for instance b23ed8c4-5c3e-4d9a-9208-018a061b793b on n-h2-846209-2 Jun 16 18:27:37.138709 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-522872e9-65e3-482e-8b08-4a567d357f9c req-a15ad708-a07b-4289-99aa-c5a0ff95b698 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140142 Jun 16 18:27:37.140859 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 81/179] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:37.154212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8522d7f5-889a-44ec-8e4a-566e36e5abc8 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Calling method '.version_select at 0x7f866f7e8a60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:37.157376 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:37.157376 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:37.160150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8522d7f5-889a-44ec-8e4a-566e36e5abc8 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:37.161175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8522d7f5-889a-44ec-8e4a-566e36e5abc8 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:37.262161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8522d7f5-889a-44ec-8e4a-566e36e5abc8 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:37.262828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8522d7f5-889a-44ec-8e4a-566e36e5abc8 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:37.275772 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8522d7f5-889a-44ec-8e4a-566e36e5abc8 tempest-HypervisorAdminV253TestBase-1613723473 tempest-HypervisorAdminV253TestBase-1613723473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/d917d0f2-2755-4fa6-9af9-270883bb17f9" status: 200 len: 792 microversion: 2.53 time: 0.132399 Jun 16 18:27:37.280126 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 82/180] 10.222.0.27 () {60 vars in 1297 bytes} [Thu Jun 16 18:27:37 2022] GET /compute/v2.1/os-hypervisors/d917d0f2-2755-4fa6-9af9-270883bb17f9 => generated 792 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:37.285679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c394cfc9-176a-4c38-ac77-d926a1ede29d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:37.286847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c394cfc9-176a-4c38-ac77-d926a1ede29d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:37.523920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c394cfc9-176a-4c38-ac77-d926a1ede29d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:37.562398 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c394cfc9-176a-4c38-ac77-d926a1ede29d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1208 microversion: 2.1 time: 0.280516 Jun 16 18:27:37.577802 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 83/181] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:37 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1208 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:37.812542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:37.815041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:37.832067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eac08250-4a9d-4f2f-baa9-dd89958f8e73 tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/46613cdb-c3bc-429f-92ce-52c0a76105b2" status: 202 len: 0 microversion: 2.1 time: 0.873034 Jun 16 18:27:37.832593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:37.832715 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 99/182] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:27:36 2022] DELETE /compute/v2.1/os-security-groups/46613cdb-c3bc-429f-92ce-52c0a76105b2 => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:37.836602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:37.839910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:37.841323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:37.842404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2727f7a4-1cb2-4cc2-8f21-a192a00648cd tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] Calling method '.version_select at 0x7f867435fc10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:38.219803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:38.229486 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-79fff723-1a0e-4d73-a485-a56ddc2e71a5 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1487 microversion: 2.1 time: 0.423071 Jun 16 18:27:38.234629 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 84/183] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:37 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1487 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:38.244602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:38.245263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:38.261110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:38.261933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:38.265291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:38.265978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:38.299857 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] HTTP exception thrown: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Request method failure captured: Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b HTTP/1.1 Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X1E3dwa8dIYUnAW7YP6cOFLohBhr_3XJZTmHy1Kv7QUiplwXg7_i_DQM9XlckOFdgZBbDYw9cxisD0Dw8VlJFCxHQyuTV0XLyKnfrSMso0KTOUuJYKgUjyg2uUzl6MZGvZ0ztvHq2gelcpzO5AUNzVef_2epDeh_ZmCtTAXn8ngm8 Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:38.312452 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_870d5ffbd56d4cc7a6707953009a8355", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 40edf1dc85ef42b0a1e64655904f3d55 Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:27:38.314765 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b23ed8c4-5c3e-4d9a-9208-018a061b793b'} Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:38.315517 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:27:38.317099 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:38.319172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Returning 404 to user: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:38.323405 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d1ee806-7575-48e0-af14-d8d130fe1cbb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 404 len: 111 microversion: 2.1 time: 0.085748 Jun 16 18:27:38.334991 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 85/184] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:38 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:38.334991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14c31382-83b1-4c40-8597-ddd242e635f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:38.334991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14c31382-83b1-4c40-8597-ddd242e635f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:38.342634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2727f7a4-1cb2-4cc2-8f21-a192a00648cd tempest-SecurityGroupsTestAdminJSON-1569103876 tempest-SecurityGroupsTestAdminJSON-1569103876-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0afdd8d9-f265-43ec-89d1-bdab00685b4f" status: 202 len: 0 microversion: 2.1 time: 0.505201 Jun 16 18:27:38.343886 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 100/185] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:27:37 2022] DELETE /compute/v2.1/os-security-groups/0afdd8d9-f265-43ec-89d1-bdab00685b4f => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:27:38.352713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c54c6c5-84c7-433a-a6ae-9dca452942bf tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] Calling method '.version_select at 0x7f867428d8b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:38.356204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c31382-83b1-4c40-8597-ddd242e635f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:38.357777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c31382-83b1-4c40-8597-ddd242e635f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:38.358641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c31382-83b1-4c40-8597-ddd242e635f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:38.359079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c31382-83b1-4c40-8597-ddd242e635f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:38.904505 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3c54c6c5-84c7-433a-a6ae-9dca452942bf tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/fe370158-0f76-4bc2-934c-033d71a65f0b" status: 202 len: 0 microversion: 2.1 time: 0.555260 Jun 16 18:27:38.910995 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 101/186] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:27:38 2022] DELETE /compute/v2.1/os-security-groups/fe370158-0f76-4bc2-934c-033d71a65f0b => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:27:38.928011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1807017507", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:39.003487 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14c31382-83b1-4c40-8597-ddd242e635f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1638 microversion: 2.1 time: 0.677372 Jun 16 18:27:39.007558 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 86/187] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:38 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1638 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:39.021224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:39.023913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:39.037087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:39.037854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:39.039050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:39.039638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:39.141021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:27:39.195719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:39.206353 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6f75251c-bf01-4b6b-9e38-b8d380d1deb8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1268 microversion: 2.1 time: 0.197362 Jun 16 18:27:39.207316 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 87/188] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:39 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:39.215979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fcd8481a-33a3-47e7-9275-c35835a1b16d tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] Calling method '.version_select at 0x7f866f7354c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:39.596399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:27:39.597107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:27:39.597525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:27:39.598255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:27:39.598671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:27:39.651981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:39.652881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:39.653954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:39.654553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:39.725751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Getting quotas for project 870d5ffbd56d4cc7a6707953009a8355. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:27:39.753576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Getting quotas for user 40edf1dc85ef42b0a1e64655904f3d55 and project 870d5ffbd56d4cc7a6707953009a8355. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:27:39.794658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:27:39.798319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:27:39.806190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fcd8481a-33a3-47e7-9275-c35835a1b16d tempest-SecurityGroupsTestAdminJSON-465803507 tempest-SecurityGroupsTestAdminJSON-465803507-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0dffc4e6-91a7-4bd7-b05f-e8a207a0de62" status: 202 len: 0 microversion: 2.1 time: 0.594956 Jun 16 18:27:39.806758 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 88/189] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:27:39 2022] DELETE /compute/v2.1/os-security-groups/0dffc4e6-91a7-4bd7-b05f-e8a207a0de62 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:39.811823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:39.812410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:39.834596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:39.835050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:39.836080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:39.836857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:39.936355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:27:40.007698 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-be2c2519-7817-425e-8810-1e7fc36769d2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092651 Jun 16 18:27:40.014538 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 102/190] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:27:40.484150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Calling method '.version_select at 0x7f867423dc10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:40.484924 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:40.484924 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:40.486743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:40.487366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:40.499758 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-27dc4597-c2a8-452e-9422-72572d3bd5ef tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 204 len: 0 microversion: 2.1 time: 0.691154 Jun 16 18:27:40.507909 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 89/191] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:27:39 2022] DELETE /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:27:40.528479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-034535bb-be31-49aa-b795-58efa63b8ecb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:40.535621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-034535bb-be31-49aa-b795-58efa63b8ecb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:40.548563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:40.548999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:40.582642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:40.583100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:40.615303 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afd766e8-b666-49dd-b110-3b6f2e26bb8a tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.599146 Jun 16 18:27:40.624384 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 103/192] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:40.643935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:40.644755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:40.669997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:40.670469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:40.675146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:40.676245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:40.770128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-034535bb-be31-49aa-b795-58efa63b8ecb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:40.789292 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-034535bb-be31-49aa-b795-58efa63b8ecb tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1220 microversion: 2.1 time: 0.279694 Jun 16 18:27:40.793940 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 90/193] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:40 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1220 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:40.829574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:40.831115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:40.860204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:40.863465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:40.865662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:40.878068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:40.975381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:40.990250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca2bb8c0-1e80-4749-af23-fbaf43f3e0de tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1266 microversion: 2.1 time: 0.358849 Jun 16 18:27:41.010772 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 104/194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:40 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:41.018966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Calling method '.version_select at 0x7f86741b65e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:41.020232 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:41.020232 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:41.022749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.023531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.055256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.056141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.104669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.108188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.140160 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bab231b6-b1f2-4911-92c3-085f4b300aaf tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-846209-2/servers" status: 200 len: 196 microversion: 2.1 time: 0.127453 Jun 16 18:27:41.142193 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 105/195] 10.222.0.27 () {58 vars in 1211 bytes} [Thu Jun 16 18:27:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-846209-2/servers => generated 196 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:41.156557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Calling method '.version_select at 0x7f8674385280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:41.158561 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:41.158561 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:41.160275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.170744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.190203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.191051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.221324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.221324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.241882 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c3a3196-cfc9-44bd-b3e5-2838cbe2a79e tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092044 Jun 16 18:27:41.243501 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 106/196] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:27:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:27:41.265181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:41.279551 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f9fbbafd-02e7-44f5-8a25-2ea4b13261dd tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1493 microversion: 2.1 time: 0.481282 Jun 16 18:27:41.280122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee04199e-4ea9-4e87-a258-ee1d5e4e3512 tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Calling method '.version_select at 0x7f86741b6e50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:41.280477 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 91/197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:40 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1493 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:41.283246 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:41.283246 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:41.287188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee04199e-4ea9-4e87-a258-ee1d5e4e3512 tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.294179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee04199e-4ea9-4e87-a258-ee1d5e4e3512 tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.343413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee04199e-4ea9-4e87-a258-ee1d5e4e3512 tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.343866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee04199e-4ea9-4e87-a258-ee1d5e4e3512 tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.362857 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ee04199e-4ea9-4e87-a258-ee1d5e4e3512 tempest-HypervisorAdminUnderV252Test-908637225 tempest-HypervisorAdminUnderV252Test-908637225-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-846209-2/search" status: 200 len: 104 microversion: 2.1 time: 0.090901 Jun 16 18:27:41.364979 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 107/198] 10.222.0.27 () {58 vars in 1208 bytes} [Thu Jun 16 18:27:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-846209-2/search => generated 104 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:41.822664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:41.823518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:41.835777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.836297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.836580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:41.837015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:41.986170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:41.996598 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1a89a247-4db2-4c4a-924a-510f89ac7bb8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1237 microversion: 2.1 time: 0.188837 Jun 16 18:27:42.014054 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 92/199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:41 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1237 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:42.020096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:42.026731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:42.040564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:42.052260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:42.053694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:42.054559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:42.300018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:42.300929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:42.314000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:42.314857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:42.318879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:42.319528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:42.395521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:42.473665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd5d99cb-7a67-4520-86d4-169eeef6215c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.453050 Jun 16 18:27:42.475839 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 108/200] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:42 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:43.015164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:43.015800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:43.042350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:43.042847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:43.043586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:43.044020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:43.283165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:43.297982 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ad783f9-f701-4384-a1d3-fd06e1911a3c tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1299 microversion: 2.1 time: 0.287049 Jun 16 18:27:43.299432 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 109/201] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:43 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1299 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:43.304612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c743098f-92c4-47d6-b460-d8002a07cf23 req-7099e925-d01a-4786-88d7-28c2c8fde384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41320455-8dd9-4ec2-9a09-b6cb9353b610", "name": "network-vif-deleted", "tag": "fbdc1b22-e5a9-4b9a-a8dd-ad99deca1c50"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:43.329463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c743098f-92c4-47d6-b460-d8002a07cf23 req-7099e925-d01a-4786-88d7-28c2c8fde384 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:43.330616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c743098f-92c4-47d6-b460-d8002a07cf23 req-7099e925-d01a-4786-88d7-28c2c8fde384 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:43.361332 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c743098f-92c4-47d6-b460-d8002a07cf23 req-7099e925-d01a-4786-88d7-28c2c8fde384 service nova] Creating event network-vif-deleted:fbdc1b22-e5a9-4b9a-a8dd-ad99deca1c50 for instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 on n-h2-846209-2 Jun 16 18:27:43.377313 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c743098f-92c4-47d6-b460-d8002a07cf23 req-7099e925-d01a-4786-88d7-28c2c8fde384 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076236 Jun 16 18:27:43.391906 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 110/202] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:43.444190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22fe310ea65a428eb57dce5ebf917ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ef48c31ea74d87abed40ba2382065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:43.448467 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90a82eca-eefd-4487-bdba-918b5c1b0de4 tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 200 len: 1493 microversion: 2.1 time: 1.155115 Jun 16 18:27:43.460810 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 93/203] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:42 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 1493 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:43.493227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:43.493959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:43.506588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:43.507116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:43.507992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:43.508441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:43.758451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:44.026574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:44.038089 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-71359eb7-1cdf-4fda-964d-0fcfb2166e80 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.549355 Jun 16 18:27:44.039126 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 111/204] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:43 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:44.328437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:44.329861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:44.336991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:44.337821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:44.338873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:44.339697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:44.467089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:44.470340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:44.478260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:44.479595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:44.480670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:44.482770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:44.508817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] HTTP exception thrown: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Request method failure captured: Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 HTTP/1.1 Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X1mqn0fNVnxihqSEFxceGsZBO5YxEHg_xM-pxhy1Yv14I1vSuYd2zq2AMBl528DiDDRPU19D_PhLQjqeOFAnOTi-YGKwQj7JGJGBjT3PZiym_phgqf53wXlAMusTN7g6Klc1dUXVTHWcnU3JQvamaZ_BWkV_eE1cViOrZdapXfhfA Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 27ef48c31ea74d87abed40ba2382065a Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:44.512412 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27ef48c31ea74d87abed40ba2382065a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 27ef48c31ea74d87abed40ba2382065a Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminTestJSON-83691115-project Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 22fe310ea65a428eb57dce5ebf917ef7 Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminTestJSON-83691115-project Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:44.513660 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '41320455-8dd9-4ec2-9a09-b6cb9353b610'} Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:44.514623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:44.515672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:44.519848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Returning 404 to user: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:44.521129 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50be3a10-46ba-4826-8b07-eaea476d420e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 404 len: 111 microversion: 2.1 time: 0.058040 Jun 16 18:27:44.522452 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 112/205] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:44 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:44.534135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e77c050-9d2d-4e83-bc1f-488fa3c725bd tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:44.538029 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:44.538029 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:44.550330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e77c050-9d2d-4e83-bc1f-488fa3c725bd tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:44.551718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e77c050-9d2d-4e83-bc1f-488fa3c725bd tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:44.711139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:44.726923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90d26e91-3fbd-427e-919c-9a35e93252c4 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1341 microversion: 2.1 time: 0.406186 Jun 16 18:27:44.727975 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 94/206] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:44 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1341 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:44.768185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:44.794870 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e77c050-9d2d-4e83-bc1f-488fa3c725bd tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.1 time: 0.267117 Jun 16 18:27:44.799483 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 113/207] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:44 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:44.809194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88ecab42-ce67-4ae2-8769-70b071e1be14 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:44.810154 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:44.810154 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:44.862555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88ecab42-ce67-4ae2-8769-70b071e1be14 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.055008 Jun 16 18:27:44.864623 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 95/208] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:44 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:44.882910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80dbbc3b-83a7-4c50-b927-091055d1e1f6 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1359638289"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:44.885760 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:44.885760 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:44.887552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-80dbbc3b-83a7-4c50-b927-091055d1e1f6 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid b4f6428e-e765-458a-8506-ac359c869df2 for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:44.928189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-80dbbc3b-83a7-4c50-b927-091055d1e1f6 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050302 Jun 16 18:27:44.937100 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 114/209] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:44.941531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4b70579-e456-4953-92c8-be7139722885 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:44.943346 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:44.943346 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:44.964246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4b70579-e456-4953-92c8-be7139722885 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:44.964706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4b70579-e456-4953-92c8-be7139722885 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:45.014973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:45.058074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:45.058890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:45.069253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:45.070860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:45.071848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:45.072956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:45.130886 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4b70579-e456-4953-92c8-be7139722885 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.194349 Jun 16 18:27:45.132289 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 96/210] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:44 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:45.507651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:45.519784 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b5c124b3-ba8b-46fb-8695-12e371acc362 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.466007 Jun 16 18:27:45.524055 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 115/211] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:45 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:45.529569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-671d30bc-8f39-4a99-9311-aa4ca2962ab8 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:45.530646 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:45.530646 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:45.557978 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-671d30bc-8f39-4a99-9311-aa4ca2962ab8 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.031338 Jun 16 18:27:45.558492 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 116/212] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:27:45 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:45.580125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a18eea3b-ed1d-4a91-b818-d0b3e28daa89 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:45.585298 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:45.585298 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:45.597603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a18eea3b-ed1d-4a91-b818-d0b3e28daa89 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:45.598739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a18eea3b-ed1d-4a91-b818-d0b3e28daa89 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:45.813414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8f18097-6ba0-44ec-9c3e-6fc495767d60 tempest-NetworksTest-2038558873 tempest-NetworksTest-2038558873-project-admin] Calling method '.version_select at 0x7f866f6cbe50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:45.850179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a18eea3b-ed1d-4a91-b818-d0b3e28daa89 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.281402 Jun 16 18:27:45.859250 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 117/213] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jun 16 18:27:45 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:45.883332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1c06b34d-934e-44f9-987d-c886093ac9c0 req-03d48cae-46c2-4cc0-bdbe-5c9064ebf9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c262b9-2d5b-452c-8585-a92ff850144e", "tag": "187310e1-7b1a-4689-a87f-88889210c43b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:45.927403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1c06b34d-934e-44f9-987d-c886093ac9c0 req-03d48cae-46c2-4cc0-bdbe-5c9064ebf9b6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:45.927858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1c06b34d-934e-44f9-987d-c886093ac9c0 req-03d48cae-46c2-4cc0-bdbe-5c9064ebf9b6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:45.976002 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1c06b34d-934e-44f9-987d-c886093ac9c0 req-03d48cae-46c2-4cc0-bdbe-5c9064ebf9b6 service nova] Creating event network-changed:187310e1-7b1a-4689-a87f-88889210c43b for instance b1c262b9-2d5b-452c-8585-a92ff850144e on n-h2-846209-2 Jun 16 18:27:45.989321 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1c06b34d-934e-44f9-987d-c886093ac9c0 req-03d48cae-46c2-4cc0-bdbe-5c9064ebf9b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127180 Jun 16 18:27:45.990859 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 118/214] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:46.004098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:46.007218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:46.023601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:46.032383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:46.033568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:46.034141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:46.519462 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b8f18097-6ba0-44ec-9c3e-6fc495767d60 tempest-NetworksTest-2038558873 tempest-NetworksTest-2038558873-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 2614 microversion: 2.1 time: 1.385895 Jun 16 18:27:46.524178 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 97/215] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:27:45 2022] GET /compute/v2.1/os-networks => generated 2614 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:46.529619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c9da2f5-5ac0-4a76-8a44-17b4f26d1e48 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:46.530421 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:46.530421 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:46.541927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:46.610927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c9da2f5-5ac0-4a76-8a44-17b4f26d1e48 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.083755 Jun 16 18:27:46.613456 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 98/216] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:46 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:46.627724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:46.637338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a69ff3d3-14ff-40aa-962c-de1949800f52 req-71f99659-4635-48ff-b3e0-e5cd612eced8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e2a156-987a-4ecc-a83e-d5c84b21d291", "tag": "7b08401d-0478-4b2b-b87d-8c54b3a70e38"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:46.643156 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-265fda44-b0b6-421e-9fbc-a34034513909 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1320 microversion: 2.1 time: 0.649873 Jun 16 18:27:46.646912 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 119/217] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:45 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:46.657483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b4a82b98-ecdb-4544-a7d3-418b48ec8001 tempest-NetworksTest-2038558873 tempest-NetworksTest-2038558873-project-admin] Calling method '.version_select at 0x7f86757195e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:46.688791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a69ff3d3-14ff-40aa-962c-de1949800f52 req-71f99659-4635-48ff-b3e0-e5cd612eced8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:46.689891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a69ff3d3-14ff-40aa-962c-de1949800f52 req-71f99659-4635-48ff-b3e0-e5cd612eced8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:46.715726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a69ff3d3-14ff-40aa-962c-de1949800f52 req-71f99659-4635-48ff-b3e0-e5cd612eced8 service nova] Creating event network-changed:7b08401d-0478-4b2b-b87d-8c54b3a70e38 for instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 on n-h1-846209-2 Jun 16 18:27:46.725795 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a69ff3d3-14ff-40aa-962c-de1949800f52 req-71f99659-4635-48ff-b3e0-e5cd612eced8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109475 Jun 16 18:27:46.727773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 99/218] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:46.739769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:46.742367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:46.760064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:46.762878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:46.768751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:46.770633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:46.890425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:46.898971 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b4a82b98-ecdb-4544-a7d3-418b48ec8001 tempest-NetworksTest-2038558873 tempest-NetworksTest-2038558873-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/3ad5ca60-7a28-42cd-a61b-5c333cdc1258" status: 200 len: 652 microversion: 2.1 time: 0.247581 Jun 16 18:27:46.899808 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 120/219] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:27:46 2022] GET /compute/v2.1/os-networks/3ad5ca60-7a28-42cd-a61b-5c333cdc1258 => generated 652 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:46.909329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ef834409-6738-44f0-b416-85894c688d70 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1594579482"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:46.911780 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:46.911780 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:46.913364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-ef834409-6738-44f0-b416-85894c688d70 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid 99e9d74e-7a48-4aec-93d0-645c7c297a9b for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:46.952241 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ef834409-6738-44f0-b416-85894c688d70 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050652 Jun 16 18:27:46.954259 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 121/220] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:47.116605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:47.124194 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6017ceb-2985-45aa-bd94-e858825570a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.394386 Jun 16 18:27:47.125266 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 100/221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:46 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:47.130687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3cc1e19a-adc7-4c01-b2b2-25d1614fa676 tempest-NetworksTest-2038558873 tempest-NetworksTest-2038558873-project-admin] Calling method '.version_select at 0x7f866f6fb8b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:47.230885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1916624714", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:47.271633 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3cc1e19a-adc7-4c01-b2b2-25d1614fa676 tempest-NetworksTest-2038558873 tempest-NetworksTest-2038558873-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 2614 microversion: 2.1 time: 0.144509 Jun 16 18:27:47.272371 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 101/222] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:27:47 2022] GET /compute/v2.1/os-networks => generated 2614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:47.277243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89b87b59-cc02-4a8b-9076-86d62225df51 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:47.278601 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:47.278601 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:47.288842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89b87b59-cc02-4a8b-9076-86d62225df51 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:47.289044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89b87b59-cc02-4a8b-9076-86d62225df51 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:47.304268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:27:47.494564 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89b87b59-cc02-4a8b-9076-86d62225df51 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.220782 Jun 16 18:27:47.501520 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 102/223] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:47 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:47.507040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e5b093c6-a5fd-4743-9623-fa9b8ad2af51 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:47.508095 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:47.508095 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:47.522169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e5b093c6-a5fd-4743-9623-fa9b8ad2af51 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.018956 Jun 16 18:27:47.523031 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 103/224] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:27:47 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:47.534729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6516ecdd-f470-4ea2-91d7-15b71b5c124a tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:47.536685 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:47.536685 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:47.548524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6516ecdd-f470-4ea2-91d7-15b71b5c124a tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:47.549348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6516ecdd-f470-4ea2-91d7-15b71b5c124a tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:47.588717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:27:47.589143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:27:47.589615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:27:47.590049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:27:47.590464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:27:47.604368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:47.604814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:47.605814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:47.608026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:47.631241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Getting quotas for project 338cc25d24b94715a1d077ec18d6d8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:27:47.637330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Getting quotas for user 9f0727ea96c14338a3323eb0ed2f0cda and project 338cc25d24b94715a1d077ec18d6d8e6. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:27:47.652405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:27:47.657683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:27:47.710988 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6516ecdd-f470-4ea2-91d7-15b71b5c124a tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.180641 Jun 16 18:27:47.718020 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-705f4988-e7af-4550-ae9a-f82d2071030c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761635 Jun 16 18:27:47.719806 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 122/225] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:27:47.724893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:47.725940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:47.732148 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 104/226] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:47 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:47.736395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:47.736856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:47.737644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:47.738118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:47.739591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-569082e4-6b9c-46f5-bb38-7e316c4ee039 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:47.744089 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:47.744089 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:47.783646 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-569082e4-6b9c-46f5-bb38-7e316c4ee039 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053326 Jun 16 18:27:47.790700 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 105/227] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:47 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:47.802819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af462dd2-bf24-483f-8ea1-966d075738d5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:47.803627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af462dd2-bf24-483f-8ea1-966d075738d5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:47.934735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-af462dd2-bf24-483f-8ea1-966d075738d5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:47.944043 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af462dd2-bf24-483f-8ea1-966d075738d5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1223 microversion: 2.1 time: 0.151773 Jun 16 18:27:47.944866 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 106/228] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:47 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:47.955044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5606bb87-da19-4327-b497-558e6f774894 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1893409303"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:47.956704 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:47.956704 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:47.957764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-5606bb87-da19-4327-b497-558e6f774894 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid db0b7d73-e53c-429d-ba7c-155c89ea49d2 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:47.992372 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5606bb87-da19-4327-b497-558e6f774894 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046217 Jun 16 18:27:47.993559 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 107/229] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:48.006251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dec2ace7-c531-452f-bf01-d2648eb0706f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:48.008087 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.008087 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:48.022668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dec2ace7-c531-452f-bf01-d2648eb0706f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:48.023289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dec2ace7-c531-452f-bf01-d2648eb0706f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:48.029475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:48.043391 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b770f63-f1b5-43ff-9abe-f852b28f443a tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1320 microversion: 2.1 time: 0.322160 Jun 16 18:27:48.045722 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 123/230] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:47 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:48.216946 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dec2ace7-c531-452f-bf01-d2648eb0706f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.215436 Jun 16 18:27:48.217730 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 108/231] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:47 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:48.230496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:48.231489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:48.240618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:48.241069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:48.241841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:48.243477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:48.416292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-103e32bb-8152-4a5d-82fc-ba36b15d96b6 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:48.417133 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.417133 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:48.419752 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-103e32bb-8152-4a5d-82fc-ba36b15d96b6 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-103e32bb-8152-4a5d-82fc-ba36b15d96b6 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276-project-admin] Request method failure captured: Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YjHqH7DoLNgTEUj0bU6fowSPMmBtItCL1H_KinLecO7AbFmBXgUUg3YNTZoV1Kjn1gHtKxdhxiFOya6_9xiwu75-IETaHC9ppq0i8WMc0P40k-HXKGwuJXNyywR35tKkFGgq-Y4zzEU6uE-I_cO5COBaSNcGDBJFKsYqkxV9CTopo Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 48aedd08f26c4c2aaf9276c32a037bc8 Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:48.428089 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/48aedd08f26c4c2aaf9276c32a037bc8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/48aedd08f26c4c2aaf9276c32a037bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_48aedd08f26c4c2aaf9276c32a037bc8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/48aedd08f26c4c2aaf9276c32a037bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 48aedd08f26c4c2aaf9276c32a037bc8 Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-404490276-project-admin Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 4f3c9ebcd2dd4ceb9b92bb10479f7da7 Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404490276-project-admin Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid timestamp for date invalid_time Jun 16 18:27:48.429834 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'invalid_time'} Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:48.431799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 16 18:27:48.432942 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.439424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-103e32bb-8152-4a5d-82fc-ba36b15d96b6 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:48.440703 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-103e32bb-8152-4a5d-82fc-ba36b15d96b6 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276 tempest-InstanceUsageAuditLogNegativeTestJSON-404490276-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.393263 Jun 16 18:27:48.441810 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 124/232] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 18:27:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 395 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:27:48.449470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-627bc434-c593-4961-9488-cc8823a5dea4 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:48.451375 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.451375 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:48.464441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-627bc434-c593-4961-9488-cc8823a5dea4 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:48.464986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-627bc434-c593-4961-9488-cc8823a5dea4 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:48.643192 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-627bc434-c593-4961-9488-cc8823a5dea4 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.199865 Jun 16 18:27:48.643825 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 125/233] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:48 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:48.646968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:48.658030 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61884331-335b-4078-8511-eeb3594be9ca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.438003 Jun 16 18:27:48.661987 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 109/234] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:48 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:48.675153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-37d72189-c070-4930-8700-bced2dff9f7b tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:48.678267 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.678267 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:48.726533 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-37d72189-c070-4930-8700-bced2dff9f7b tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.065274 Jun 16 18:27:48.727574 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 110/235] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:48 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:48.754420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be29adf3-95c8-40c5-a041-d1aca8dae545 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1716739217"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:48.756493 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.756493 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:48.758185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-be29adf3-95c8-40c5-a041-d1aca8dae545 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid 03c5c2d7-f135-4a20-a7d1-bc6e8e8718d2 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:48.814621 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be29adf3-95c8-40c5-a041-d1aca8dae545 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072880 Jun 16 18:27:48.815239 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 111/236] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:48 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:48.825162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad79108f-1847-43e0-acd1-a723b7205302 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-427228955"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:48.826537 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.826537 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:48.827428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-ad79108f-1847-43e0-acd1-a723b7205302 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid b8ebfac5-171d-4c77-9cfb-9603719ef237 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:48.870400 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ad79108f-1847-43e0-acd1-a723b7205302 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049188 Jun 16 18:27:48.877127 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 112/237] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:48.884004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2e9e9f5-8252-44fd-b184-b1dfd08d7a41 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:48.891743 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.891743 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:48.907677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a3391fa-f78b-4652-a027-82f72c00827d tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:48.908417 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.908417 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:48.910067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a3391fa-f78b-4652-a027-82f72c00827d tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f3c3addbc9d643dd9e5f050882ddf710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415b8fabbf143d299a362e38c95bc62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a3391fa-f78b-4652-a027-82f72c00827d tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Request method failure captured: Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YiATdiaAqsuC_wP7OFUKPxE_WXorClHbeJioo6I7uwFo0QMCgFHjErhmZ1TEvkkk9e_mr4v_HCcWLu45ku5HtfSLSHeLQWQndAFFaKsJ5lpJlOh-JEMoS-wj2EOasJnS-RhwTHI1fTGQxtapdM-9SVB20OpXxcCpVHaL-IXUaA6Ik Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 1415b8fabbf143d299a362e38c95bc62 Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:48.911876 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1415b8fabbf143d299a362e38c95bc62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1415b8fabbf143d299a362e38c95bc62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1415b8fabbf143d299a362e38c95bc62", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1415b8fabbf143d299a362e38c95bc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 1415b8fabbf143d299a362e38c95bc62 Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: f3c3addbc9d643dd9e5f050882ddf710 Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:48.913159 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: action_args: {} Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:48.913785 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 16 18:27:48.915338 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.921757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a3391fa-f78b-4652-a027-82f72c00827d tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:48.923530 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a3391fa-f78b-4652-a027-82f72c00827d tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.278527 Jun 16 18:27:48.924258 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 126/238] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Jun 16 18:27:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 280 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:48.932912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-833157a1-8524-47d8-9774-a621ecff1680 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:48.937674 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.937674 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:48.939118 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2e9e9f5-8252-44fd-b184-b1dfd08d7a41 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.058047 Jun 16 18:27:48.939837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 113/239] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:48 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:48.951514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-833157a1-8524-47d8-9774-a621ecff1680 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:48.952335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-833157a1-8524-47d8-9774-a621ecff1680 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:48.955723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae7f016c-a65a-465a-90b6-69317d0b02d1 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:48.957672 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.957672 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:48.965449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae7f016c-a65a-465a-90b6-69317d0b02d1 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f3c3addbc9d643dd9e5f050882ddf710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1415b8fabbf143d299a362e38c95bc62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae7f016c-a65a-465a-90b6-69317d0b02d1 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Request method failure captured: Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16%2018:27:48 HTTP/1.1 Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YiATdiaAqsuC_wP7OFUKPxE_WXorClHbeJioo6I7uwFo0QMCgFHjErhmZ1TEvkkk9e_mr4v_HCcWLu45ku5HtfSLSHeLQWQndAFFaKsJ5lpJlOh-JEMoS-wj2EOasJnS-RhwTHI1fTGQxtapdM-9SVB20OpXxcCpVHaL-IXUaA6Ik Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1415b8fabbf143d299a362e38c95bc62 Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:48.971718 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1415b8fabbf143d299a362e38c95bc62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1415b8fabbf143d299a362e38c95bc62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1415b8fabbf143d299a362e38c95bc62", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1415b8fabbf143d299a362e38c95bc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1415b8fabbf143d299a362e38c95bc62 Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: f3c3addbc9d643dd9e5f050882ddf710 Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:48.972901 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2022-06-16 18:27:48'} Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:48.973696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 16 18:27:48.974777 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:48.977680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae7f016c-a65a-465a-90b6-69317d0b02d1 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:48.981391 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae7f016c-a65a-465a-90b6-69317d0b02d1 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878 tempest-InstanceUsageAuditLogNegativeTestJSON-1605757878-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16 18:27:48" status: 403 len: 128 microversion: 2.1 time: 0.040428 Jun 16 18:27:48.982277 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 114/240] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:27:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16%2018%3A27%3A48 => generated 128 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:48.996619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-074e74cc-f160-485c-a09d-a996e4134164 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:48.999948 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:48.999948 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.019293 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-074e74cc-f160-485c-a09d-a996e4134164 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-074e74cc-f160-485c-a09d-a996e4134164 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Request method failure captured: Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X3edM_ifKjVYijqEyumH9kMZFWQXjDJdDcq1ehDgFbyxCOC7wMO2qmcTThDHgXcIKSu6ZmAZg2NeJRGE_rRp-Uur4hnWgZECnqql1--Bu6MHNGDIWce8JNzJL2y_as_6Nls92okVm1HAp0Iqhh-O2vkglJpOw953KO-Z5w6y2vYyA Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:49.022545 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7a4d3e3f2aa487fb92493cefb110a69", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 3e7abf415f884ec2b1f81089341a3a58 Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: exception: Aggregate 12 could not be found. Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '12'} Jun 16 18:27:49.023759 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.024751 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jun 16 18:27:49.026104 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.042375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-074e74cc-f160-485c-a09d-a996e4134164 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:49.042375 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-074e74cc-f160-485c-a09d-a996e4134164 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.053241 Jun 16 18:27:49.046479 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 115/241] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:48 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:49.053198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.054205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:49.066225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.067390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.071080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.074326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.140404 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-833157a1-8524-47d8-9774-a621ecff1680 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.214144 Jun 16 18:27:49.141695 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 127/242] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:48 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:49.153598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62b9b4d3-89cc-4f57-a406-81d95a1795ef tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.154393 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.154393 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:49.184046 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-62b9b4d3-89cc-4f57-a406-81d95a1795ef tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62b9b4d3-89cc-4f57-a406-81d95a1795ef tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Request method failure captured: Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X3edM_ifKjVYijqEyumH9kMZFWQXjDJdDcq1ehDgFbyxCOC7wMO2qmcTThDHgXcIKSu6ZmAZg2NeJRGE_rRp-Uur4hnWgZECnqql1--Bu6MHNGDIWce8JNzJL2y_as_6Nls92okVm1HAp0Iqhh-O2vkglJpOw953KO-Z5w6y2vYyA Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:49.186377 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7a4d3e3f2aa487fb92493cefb110a69", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 3e7abf415f884ec2b1f81089341a3a58 Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: exception: Aggregate 12 could not be found. Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '12'} Jun 16 18:27:49.187706 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:49.189163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.191097 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.193622 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.193622 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:49.193622 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:49.193622 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jun 16 18:27:49.193622 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.195985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62b9b4d3-89cc-4f57-a406-81d95a1795ef tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:49.197049 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62b9b4d3-89cc-4f57-a406-81d95a1795ef tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.047172 Jun 16 18:27:49.202234 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 128/243] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:49 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:49.208946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.209764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:49.218787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.219872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.220763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.221306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.387619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:49.411756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-837c419e-f604-4719-abcd-05617469ddb5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1275 microversion: 2.1 time: 0.363107 Jun 16 18:27:49.413047 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 116/244] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:49 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:49.426311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-545fd5a2-4ac8-4aec-a820-8bd23d084d88 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:49.427994 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.427994 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.429615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-545fd5a2-4ac8-4aec-a820-8bd23d084d88 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '24d55a95f74b41b4aa70f4fc4db62f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ec4b54cd784767a8c95ff7a0effc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-545fd5a2-4ac8-4aec-a820-8bd23d084d88 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Request method failure captured: Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 42 Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X0T9OLVmXNeLCqLLszb3mmO44mcTFwb3puyHtGaoIigNJhqmGlRzZH2hY11lr725AK-chW-De_tOALWR-96FsdeTwMPnWEqryG8vGp3nnKn0izqlyF6JgCLlcip_YzJ7lPh3xucuAl-NjKX9deGhkHHGgps4ktKJhJmvQOkvrjVpM Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:27:49.432032 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50ec4b54cd784767a8c95ff7a0effc2e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50ec4b54cd784767a8c95ff7a0effc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 50ec4b54cd784767a8c95ff7a0effc2e Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258 Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 24d55a95f74b41b4aa70f4fc4db62f78 Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2068796258-project Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: {"remove_host": {"host": "n-h2-846209-2"}} Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:49.433409 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-846209-2'}}} Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:49.434206 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 16 18:27:49.435979 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.438119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-545fd5a2-4ac8-4aec-a820-8bd23d084d88 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:49.439039 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-545fd5a2-4ac8-4aec-a820-8bd23d084d88 tempest-AggregatesAdminNegativeTestJSON-2068796258 tempest-AggregatesAdminNegativeTestJSON-2068796258-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.024766 Jun 16 18:27:49.439945 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 117/245] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:49.444201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3062336-a070-4da6-a612-af518f66231f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-368720426", "name": "tempest-test_aggregate-1095453855"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:49.446190 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.446190 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.446574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-a3062336-a070-4da6-a612-af518f66231f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid 9be1b3f0-45d2-4b20-93d2-12b44659e301 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:49.499621 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3062336-a070-4da6-a612-af518f66231f tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.058583 Jun 16 18:27:49.501748 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 118/246] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Jun 16 18:27:49 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:49.515855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e2d928e6-871b-4ad5-8bfe-e4b5c7f63d1f tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:49.520010 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.520010 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.539466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2d928e6-871b-4ad5-8bfe-e4b5c7f63d1f tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.540245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2d928e6-871b-4ad5-8bfe-e4b5c7f63d1f tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.541666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:49.553858 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-73bf164e-043c-4981-89ca-b10fa7c70d15 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1320 microversion: 2.1 time: 0.346821 Jun 16 18:27:49.554544 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 129/247] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:49 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:49.559763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e73064e2-9b94-460a-9c03-03236b95e7d1 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.560568 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.560568 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:49.601399 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e73064e2-9b94-460a-9c03-03236b95e7d1 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.044822 Jun 16 18:27:49.602587 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 130/248] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:49.613873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9a0306f-53fa-4d9d-8db8-40774545cacb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.614953 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.614953 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:49.624657 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e9a0306f-53fa-4d9d-8db8-40774545cacb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9a0306f-53fa-4d9d-8db8-40774545cacb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Request method failure captured: Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X3edM_ifKjVYijqEyumH9kMZFWQXjDJdDcq1ehDgFbyxCOC7wMO2qmcTThDHgXcIKSu6ZmAZg2NeJRGE_rRp-Uur4hnWgZECnqql1--Bu6MHNGDIWce8JNzJL2y_as_6Nls92okVm1HAp0Iqhh-O2vkglJpOw953KO-Z5w6y2vYyA Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:49.627411 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7a4d3e3f2aa487fb92493cefb110a69", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 3e7abf415f884ec2b1f81089341a3a58 Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: exception: Aggregate 14 could not be found. Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '14'} Jun 16 18:27:49.629491 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.630605 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jun 16 18:27:49.632399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.637091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9a0306f-53fa-4d9d-8db8-40774545cacb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:49.637091 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e9a0306f-53fa-4d9d-8db8-40774545cacb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.021370 Jun 16 18:27:49.637091 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 131/249] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:49 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:27:49.640742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-debcb0db-6f51-4751-a165-6af6fd40dcb7 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.642692 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.642692 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:49.653372 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-debcb0db-6f51-4751-a165-6af6fd40dcb7 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-debcb0db-6f51-4751-a165-6af6fd40dcb7 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Request method failure captured: Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X3edM_ifKjVYijqEyumH9kMZFWQXjDJdDcq1ehDgFbyxCOC7wMO2qmcTThDHgXcIKSu6ZmAZg2NeJRGE_rRp-Uur4hnWgZECnqql1--Bu6MHNGDIWce8JNzJL2y_as_6Nls92okVm1HAp0Iqhh-O2vkglJpOw953KO-Z5w6y2vYyA Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:27:49.655111 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7a4d3e3f2aa487fb92493cefb110a69", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7a4d3e3f2aa487fb92493cefb110a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d7a4d3e3f2aa487fb92493cefb110a69 Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1825883597 Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 3e7abf415f884ec2b1f81089341a3a58 Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminTestJSON-1825883597-project-admin Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: exception: Aggregate 14 could not be found. Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '14'} Jun 16 18:27:49.656277 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:49.657750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:49.660427 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-debcb0db-6f51-4751-a165-6af6fd40dcb7 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-debcb0db-6f51-4751-a165-6af6fd40dcb7 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.022148 Jun 16 18:27:49.662436 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 132/250] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:27:49.670155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c4c3bb4a-6fee-416b-8239-a0d4b5611d91 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-115288622"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:49.671605 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.671605 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:49.673117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-c4c3bb4a-6fee-416b-8239-a0d4b5611d91 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid efc422b3-b67b-4b35-8b0d-57fe91b73325 for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:49.698312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c4c3bb4a-6fee-416b-8239-a0d4b5611d91 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034617 Jun 16 18:27:49.699330 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 133/251] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:49.705051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.705664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:49.717230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.718383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.720258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.721219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.734853 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e2d928e6-871b-4ad5-8bfe-e4b5c7f63d1f tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.230168 Jun 16 18:27:49.738367 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 119/252] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:49.754013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c91cec6-1f1a-4b5b-a33a-da838b93f037 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.755398 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.755398 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.770308 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c91cec6-1f1a-4b5b-a33a-da838b93f037 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.029800 Jun 16 18:27:49.773582 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 120/253] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:49 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:49.785095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1f5467cc-8e0e-4ea4-b514-ad50f3f51150 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.790424 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.790424 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.833493 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1f5467cc-8e0e-4ea4-b514-ad50f3f51150 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055490 Jun 16 18:27:49.834611 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 121/254] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:49 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:49.847125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f590794-8ae9-4afd-b456-b9fbb5485313 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:49.849315 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.849315 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.889284 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f590794-8ae9-4afd-b456-b9fbb5485313 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.052254 Jun 16 18:27:49.891289 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 122/255] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:49 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:49.900360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef8cccaf-7a01-4551-af52-b33ad70a7c23 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1275481721"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:49.902401 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.902401 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.903407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-ef8cccaf-7a01-4551-af52-b33ad70a7c23 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Generated uuid 388b3c50-e985-46a5-9426-be90947f7655 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:49.912677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:49.946937 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef8cccaf-7a01-4551-af52-b33ad70a7c23 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053519 Jun 16 18:27:49.948360 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 123/256] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:49.958323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-34a19b3b-4edf-4401-a44d-226677a33b66 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f866f6fb820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:49.960108 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:49.960108 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:49.961735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34a19b3b-4edf-4401-a44d-226677a33b66 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.962382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34a19b3b-4edf-4401-a44d-226677a33b66 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.963592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34a19b3b-4edf-4401-a44d-226677a33b66 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:49.964320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34a19b3b-4edf-4401-a44d-226677a33b66 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:49.982068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:49.998661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-47c0a7d5-3bef-4f12-99f9-afe7340c2c5e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.297781 Jun 16 18:27:49.999791 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 134/257] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:49 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:50.008692 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34a19b3b-4edf-4401-a44d-226677a33b66 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.058160 Jun 16 18:27:50.009962 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 124/258] 10.222.0.27 () {58 vars in 1127 bytes} [Thu Jun 16 18:27:49 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.010201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d5f177e-1984-4b83-84b0-49769bced3f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.012191 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.012191 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.021559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:50.024413 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.024413 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:50.025803 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d5f177e-1984-4b83-84b0-49769bced3f0 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.023172 Jun 16 18:27:50.026813 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 135/259] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.034743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fb3de09e-01e8-42c7-815d-01c39a3cb58a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f867418c700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.037080 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.037080 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.039145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.039372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb3de09e-01e8-42c7-815d-01c39a3cb58a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.039902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb3de09e-01e8-42c7-815d-01c39a3cb58a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.040518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.041339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb3de09e-01e8-42c7-815d-01c39a3cb58a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.042117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb3de09e-01e8-42c7-815d-01c39a3cb58a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.052636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.053737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.068309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.compute.aggregates [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 16 18:27:50.069144 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Request method failure captured: Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 42 Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X2077ScO0n49K28k6c2kUJ5YZDXzDOg7cOnmjT20SFWydrVkBKs5UgbDgqWN7IGqCkibMPTW37UWKHCr4x1uDSePJcWHbe0UkHMvX-EIMOvOhUsLMvJw_lmRvUxt4hRs40hSv1pNX7vLUI5mfRYJ07NR6kTSM8vVSK4iOvuU9-z8U Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:27:50.072933 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6bf7c4f8a7274016bb4698ff898d572d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6bf7c4f8a7274016bb4698ff898d572d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6bf7c4f8a7274016bb4698ff898d572d Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371703964 Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9f1aaafcbd0a4e8f8fb5f151126c46b9 Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: {"remove_host": {"host": "nonexist_host"}} Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:27:50.075616 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot remove host nonexist_host in aggregate 16 Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 16 18:27:50.077275 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 16 18:27:50.080636 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.086621 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.089178 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:50.089178 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:50.089178 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:50.089178 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:50.089178 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Jun 16 18:27:50.089178 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.089178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:50.090073 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fb3de09e-01e8-42c7-815d-01c39a3cb58a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.055990 Jun 16 18:27:50.090243 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89e7c03f-c80a-42b1-9b01-3a3fefca86d7 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.072967 Jun 16 18:27:50.090392 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 136/260] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.090872 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 125/261] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 18:27:50 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:27:50.097216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4562262-ec8a-4b5f-9019-0e13378edebb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.098201 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.098201 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.100911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68b0a306-94d1-4197-a606-61cf0a11d2ee tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f866f6fb790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.102196 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.102196 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:50.103433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68b0a306-94d1-4197-a606-61cf0a11d2ee tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.103893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68b0a306-94d1-4197-a606-61cf0a11d2ee tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.105354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68b0a306-94d1-4197-a606-61cf0a11d2ee tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.106045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68b0a306-94d1-4197-a606-61cf0a11d2ee tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.129823 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a4562262-ec8a-4b5f-9019-0e13378edebb tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.042762 Jun 16 18:27:50.130984 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 137/262] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:50.132056 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-68b0a306-94d1-4197-a606-61cf0a11d2ee tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.036047 Jun 16 18:27:50.132957 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 126/263] 10.222.0.27 () {58 vars in 1127 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.140559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fe612a33-ef79-4932-a30d-69666dd3e0da tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1659609198", "availability_zone": "tempest-test_az-1885304140"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:50.143172 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.143172 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:50.145456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-374b4cb3-9df7-41dc-85f5-83ed815d9c09 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.146880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-fe612a33-ef79-4932-a30d-69666dd3e0da tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid 5416cbde-1e31-4e72-802d-82818e8432d3 for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:50.148084 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.148084 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.164525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:50.183011 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-374b4cb3-9df7-41dc-85f5-83ed815d9c09 tempest-AggregatesAdminNegativeTestJSON-371703964 tempest-AggregatesAdminNegativeTestJSON-371703964-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.050393 Jun 16 18:27:50.184881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 138/264] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:50 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:50.193960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d47c025a-1322-4531-87aa-67e025b8cf3a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f8674401af0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.195107 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.195107 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.201860 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fe612a33-ef79-4932-a30d-69666dd3e0da tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.065420 Jun 16 18:27:50.202695 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 127/265] 10.222.0.27 () {60 vars in 1164 bytes} [Thu Jun 16 18:27:50 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.206497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d47c025a-1322-4531-87aa-67e025b8cf3a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.206982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d47c025a-1322-4531-87aa-67e025b8cf3a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.214218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4cfe851c-312a-44bc-ab2e-dce7eeef9928 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1659609198_new", "availability_zone": "tempest-test_az-1885304140_new"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:50.231122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d47c025a-1322-4531-87aa-67e025b8cf3a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.231587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d47c025a-1322-4531-87aa-67e025b8cf3a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.255733 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d47c025a-1322-4531-87aa-67e025b8cf3a tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-846209-2" status: 200 len: 467 microversion: 2.1 time: 0.069024 Jun 16 18:27:50.257005 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 139/266] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/os-hosts/n-h2-846209-2 => generated 467 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.267246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1a860d0-c6d8-4bcf-83fe-085c2bbf9510 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Calling method '.version_select at 0x7f8674401d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.269142 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.269142 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.282536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a860d0-c6d8-4bcf-83fe-085c2bbf9510 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.283238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a860d0-c6d8-4bcf-83fe-085c2bbf9510 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.303874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a860d0-c6d8-4bcf-83fe-085c2bbf9510 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.304545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a860d0-c6d8-4bcf-83fe-085c2bbf9510 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.308942 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.308942 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:50.361660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4cfe851c-312a-44bc-ab2e-dce7eeef9928 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.362302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4cfe851c-312a-44bc-ab2e-dce7eeef9928 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.373732 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1a860d0-c6d8-4bcf-83fe-085c2bbf9510 tempest-HostsAdminTestJSON-490127320 tempest-HostsAdminTestJSON-490127320-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-846209-2" status: 200 len: 598 microversion: 2.1 time: 0.111930 Jun 16 18:27:50.374921 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 140/267] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/os-hosts/n-h1-846209-2 => generated 598 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.437043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.437372 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4cfe851c-312a-44bc-ab2e-dce7eeef9928 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.227245 Jun 16 18:27:50.437706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:50.439821 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 128/268] 10.222.0.27 () {60 vars in 1172 bytes} [Thu Jun 16 18:27:50 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.450780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ee538fb-5e3d-4a50-a0c5-7dcf172d5275 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.451055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.451261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.452957 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.452957 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:50.453366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.454650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.483735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ee538fb-5e3d-4a50-a0c5-7dcf172d5275 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.036764 Jun 16 18:27:50.484345 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 129/269] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.502865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c8be62e7-3811-4c59-8021-efb58bd9dcf5 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.503812 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.503812 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:50.539103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c8be62e7-3811-4c59-8021-efb58bd9dcf5 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.047313 Jun 16 18:27:50.539911 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 130/270] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:50 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 18:27:50.557475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-744637d1-4f4c-40bf-9232-244c4c2e0e37 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2023871130"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:50.566990 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.566990 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:27:50.572832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.aggregate [None req-744637d1-4f4c-40bf-9232-244c4c2e0e37 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Generated uuid fe8bd6a3-009e-43c6-9676-99c6aa8e2c4e for aggregate {{(pid=119206) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 18:27:50.619431 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-744637d1-4f4c-40bf-9232-244c4c2e0e37 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071856 Jun 16 18:27:50.621345 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 131/271] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 18:27:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:27:50.631937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.633236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:50.643078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.643950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.644524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:50.645295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.646102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.659503 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3e40973-5a4f-447b-9b09-f6d92d7dcf58 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1281 microversion: 2.1 time: 0.231994 Jun 16 18:27:50.670023 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 141/272] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:50.675414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8b4ae2bb-ef1b-48ac-8160-cefc36ae6d38 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.678090 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.678090 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.709775 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8b4ae2bb-ef1b-48ac-8160-cefc36ae6d38 tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.037809 Jun 16 18:27:50.712427 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 142/273] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:50.734442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e5810bb4-6268-4969-afc0-a1067d858aad tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.737127 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:50.737127 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:50.778713 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e5810bb4-6268-4969-afc0-a1067d858aad tempest-AggregatesAdminTestJSON-1825883597 tempest-AggregatesAdminTestJSON-1825883597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.052372 Jun 16 18:27:50.783725 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 143/274] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:27:50 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 16 18:27:50.799324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.803815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:50.818473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.821925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.823191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.825970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.876524 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] HTTP exception thrown: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Request method failure captured: Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 HTTP/1.1 Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X1mqn0fNVnxihqSEFxceGsZBO5YxEHg_xM-pxhy1Yv14I1vSuYd2zq2AMBl528DiDDRPU19D_PhLQjqeOFAnOTi-YGKwQj7JGJGBjT3PZiym_phgqf53wXlAMusTN7g6Klc1dUXVTHWcnU3JQvamaZ_BWkV_eE1cViOrZdapXfhfA Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 27ef48c31ea74d87abed40ba2382065a Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:50.879485 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27ef48c31ea74d87abed40ba2382065a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 27ef48c31ea74d87abed40ba2382065a Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminTestJSON-83691115-project Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 22fe310ea65a428eb57dce5ebf917ef7 Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminTestJSON-83691115-project Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.880968 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '41320455-8dd9-4ec2-9a09-b6cb9353b610'} Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:50.881888 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.884665 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.896229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Returning 404 to user: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:50.900189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd33cfc8-dd96-4411-bbd1-66ff9088528e tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 404 len: 111 microversion: 2.1 time: 0.110827 Jun 16 18:27:50.901390 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 144/275] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:27:50 2022] DELETE /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:50.918071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:50.919230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] [instance: 41320455-8dd9-4ec2-9a09-b6cb9353b610] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:50.926493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.928212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.929116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:50.929719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:50.930778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:50.942428 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-038656b5-8a1a-481a-8dd0-67a2af1586ff tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1320 microversion: 2.1 time: 0.319563 Jun 16 18:27:50.952367 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 132/276] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:50.967249 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] HTTP exception thrown: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Request method failure captured: Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 HTTP/1.1 Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X1mqn0fNVnxihqSEFxceGsZBO5YxEHg_xM-pxhy1Yv14I1vSuYd2zq2AMBl528DiDDRPU19D_PhLQjqeOFAnOTi-YGKwQj7JGJGBjT3PZiym_phgqf53wXlAMusTN7g6Klc1dUXVTHWcnU3JQvamaZ_BWkV_eE1cViOrZdapXfhfA Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 27ef48c31ea74d87abed40ba2382065a Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:27:50.972648 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27ef48c31ea74d87abed40ba2382065a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27ef48c31ea74d87abed40ba2382065a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 27ef48c31ea74d87abed40ba2382065a Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-83691115 Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AggregatesAdminTestJSON-83691115-project Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 22fe310ea65a428eb57dce5ebf917ef7 Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AggregatesAdminTestJSON-83691115-project Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.975242 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '41320455-8dd9-4ec2-9a09-b6cb9353b610'} Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:27:50.975908 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. Jun 16 18:27:50.978319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:27:50.996137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] Returning 404 to user: Instance 41320455-8dd9-4ec2-9a09-b6cb9353b610 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:27:50.999746 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-320cd913-8fb9-4053-b8c4-a58929d9136d tempest-AggregatesAdminTestJSON-83691115 tempest-AggregatesAdminTestJSON-83691115-project] 10.222.0.27 "GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610" status: 404 len: 111 microversion: 2.1 time: 0.092949 Jun 16 18:27:51.001164 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 145/277] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:50 2022] GET /compute/v2.1/servers/41320455-8dd9-4ec2-9a09-b6cb9353b610 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:27:51.018241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:51.018870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:51.029267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:51.029729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:51.030529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:51.034478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:51.465583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:51.479078 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6e0530f-437d-49f2-9231-5511b7465b44 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.465701 Jun 16 18:27:51.479699 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 133/278] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:51 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:51.677139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:51.678133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:51.691247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:51.692185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:51.693941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:51.695826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:51.960099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:51.961649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:51.982855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:51.984218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:51.987778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:51.988242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:52.021967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:52.035150 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32189f18-bd2d-43cd-ac93-d34bf32ba9c0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1323 microversion: 2.1 time: 0.362435 Jun 16 18:27:52.037411 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 146/279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:51 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:52.501317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:52.502261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:52.517702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:52.523925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:52.525546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:52.526485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:52.643302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:52.662341 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-74bf684c-7232-49f0-a8ab-4284068035a8 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1320 microversion: 2.1 time: 0.697016 Jun 16 18:27:52.663327 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 134/280] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:51 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1320 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:52.894210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fde44a3a-c509-4914-9772-2a700d61094b req-f36cae6a-ee3f-4847-bfb5-132fd510c8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c262b9-2d5b-452c-8585-a92ff850144e", "name": "network-vif-plugged", "status": "completed", "tag": "187310e1-7b1a-4689-a87f-88889210c43b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:52.912867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fde44a3a-c509-4914-9772-2a700d61094b req-f36cae6a-ee3f-4847-bfb5-132fd510c8df service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:52.914135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fde44a3a-c509-4914-9772-2a700d61094b req-f36cae6a-ee3f-4847-bfb5-132fd510c8df service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:52.952155 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fde44a3a-c509-4914-9772-2a700d61094b req-f36cae6a-ee3f-4847-bfb5-132fd510c8df service nova] Creating event network-vif-plugged:187310e1-7b1a-4689-a87f-88889210c43b for instance b1c262b9-2d5b-452c-8585-a92ff850144e on n-h2-846209-2 Jun 16 18:27:52.964151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fde44a3a-c509-4914-9772-2a700d61094b req-f36cae6a-ee3f-4847-bfb5-132fd510c8df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074088 Jun 16 18:27:52.968233 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 135/281] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:27:53.057977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:53.061090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:53.080730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:53.082286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:53.085022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:53.085811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:53.339620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:53.355644 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26a515f3-de94-4374-b51e-5c5db4af4893 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.859958 Jun 16 18:27:53.371308 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 147/282] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:52 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:53.590585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:53.603643 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-400a5b5e-5f23-450c-8f27-6d412887c6f5 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1323 microversion: 2.1 time: 0.554210 Jun 16 18:27:53.606218 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 136/283] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:53 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1323 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:53.681695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:53.682974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:53.700810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:53.704520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:53.711253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:53.713387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:53.869790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-147cb78d-27d3-4f3b-aaa4-4f97ced76115 req-f2b17f12-61c4-449b-b2df-d889565f0b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e03fc3-fb69-406e-b4e7-fc7d86ebe059", "tag": "e163b6f8-7c01-42f7-8469-f0d6301abadc"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:53.908509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-147cb78d-27d3-4f3b-aaa4-4f97ced76115 req-f2b17f12-61c4-449b-b2df-d889565f0b7d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:53.909043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-147cb78d-27d3-4f3b-aaa4-4f97ced76115 req-f2b17f12-61c4-449b-b2df-d889565f0b7d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:53.953395 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-147cb78d-27d3-4f3b-aaa4-4f97ced76115 req-f2b17f12-61c4-449b-b2df-d889565f0b7d service nova] Creating event network-changed:e163b6f8-7c01-42f7-8469-f0d6301abadc for instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 on n-h1-846209-2 Jun 16 18:27:53.964516 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-147cb78d-27d3-4f3b-aaa4-4f97ced76115 req-f2b17f12-61c4-449b-b2df-d889565f0b7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098947 Jun 16 18:27:53.966069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 137/284] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:54.078739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:54.092013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ce8a952b-e18e-470e-8045-287f4d50c547 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1320 microversion: 2.1 time: 0.415828 Jun 16 18:27:54.093201 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 148/285] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:53 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1320 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:54.384055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:54.385268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:54.403800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:54.404254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:54.409219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:54.409694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:54.621933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:54.622635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:54.638506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:54.639486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:54.642065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:54.642937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:54.673104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:54.722786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:54.735625 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69b9aa4e-0f62-43bd-bdd9-e8f20c2f4f97 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.358466 Jun 16 18:27:54.747599 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 138/286] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:54 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:54.902068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:54.912526 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c05bbad4-593e-45c4-8a2f-87229f18157c tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1323 microversion: 2.1 time: 0.294986 Jun 16 18:27:54.913126 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 149/287] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:54 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:54.984747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b5a6d974-4214-4f5a-a88f-aeb310586d1d req-5c0b78fa-ec83-4f14-9211-24cd3f10fd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2a156-987a-4ecc-a83e-d5c84b21d291", "name": "network-vif-plugged", "status": "completed", "tag": "7b08401d-0478-4b2b-b87d-8c54b3a70e38"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:54.993754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b5a6d974-4214-4f5a-a88f-aeb310586d1d req-5c0b78fa-ec83-4f14-9211-24cd3f10fd2a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:54.994321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b5a6d974-4214-4f5a-a88f-aeb310586d1d req-5c0b78fa-ec83-4f14-9211-24cd3f10fd2a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.009398 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b5a6d974-4214-4f5a-a88f-aeb310586d1d req-5c0b78fa-ec83-4f14-9211-24cd3f10fd2a service nova] Creating event network-vif-plugged:7b08401d-0478-4b2b-b87d-8c54b3a70e38 for instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 on n-h1-846209-2 Jun 16 18:27:55.014868 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b5a6d974-4214-4f5a-a88f-aeb310586d1d req-5c0b78fa-ec83-4f14-9211-24cd3f10fd2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034271 Jun 16 18:27:55.016590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 139/288] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:55.110603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:55.111663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:55.118525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.119046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.119886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.120534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.286275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:55.295279 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bf27a486-af0c-40e8-9fe8-af525f820eb3 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1470 microversion: 2.1 time: 0.189464 Jun 16 18:27:55.295855 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 150/289] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:55 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:55.315092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-422c6534-725b-4799-ab40-c0fb350b5a4d tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:55.316597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-422c6534-725b-4799-ab40-c0fb350b5a4d tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:55.324142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-422c6534-725b-4799-ab40-c0fb350b5a4d tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.324826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-422c6534-725b-4799-ab40-c0fb350b5a4d tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.325791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-422c6534-725b-4799-ab40-c0fb350b5a4d tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.326268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-422c6534-725b-4799-ab40-c0fb350b5a4d tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.437344 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-422c6534-725b-4799-ab40-c0fb350b5a4d tempest-DeleteServersAdminTestJSON-842949797 tempest-DeleteServersAdminTestJSON-842949797-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e/action" status: 202 len: 0 microversion: 2.1 time: 0.128140 Jun 16 18:27:55.438391 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 140/290] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:27:55 2022] POST /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:55.446653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:55.447740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:55.455290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.455933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.456893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.457338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.490727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.491435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.492198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lazy-loading 'fault' on Instance uuid b1c262b9-2d5b-452c-8585-a92ff850144e {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:27:55.632835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:55.643212 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-946fd852-d45c-4a02-a5b5-790a35dfd8bc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1453 microversion: 2.1 time: 0.199651 Jun 16 18:27:55.655834 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 151/291] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:55 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1453 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:55.662594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:55.663091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:55.670413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.670871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.671694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.672103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.692190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:55.701565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:27:55.754922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:55.755769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:55.762566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.763194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.764371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.764955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.858733 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-18ffb926-d0c7-48fc-99e9-1786fd943104 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 204 len: 0 microversion: 2.1 time: 0.201756 Jun 16 18:27:55.860267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 141/292] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:27:55 2022] DELETE /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:27:55.868908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:55.869635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:55.883691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.885869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.888642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.892233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.958061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:55.958530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:55.959017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lazy-loading 'fault' on Instance uuid b1c262b9-2d5b-452c-8585-a92ff850144e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:27:55.981232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:55.991331 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f26e6e9-8e68-4175-b25d-de13ff5137df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.242259 Jun 16 18:27:55.991922 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 152/293] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:55 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:56.006299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:56.008348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:56.021402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:56.021863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:56.022701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:56.023127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:56.212734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:56.222365 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-95ff9909-8b63-48c2-81c6-89fc7279c8cd tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1459 microversion: 2.1 time: 0.357866 Jun 16 18:27:56.222954 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 142/294] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:55 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1459 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:56.258936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:56.270522 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-43eb8e5a-031c-470b-9e8b-9a0613cf9423 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1323 microversion: 2.1 time: 0.276733 Jun 16 18:27:56.271900 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 153/295] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:55 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:57.012701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:57.013416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:57.022937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:57.023593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:57.024669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:57.025443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:57.241743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:57.243147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:57.253118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:57.253938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:57.255982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:57.256589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:57.281173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:57.289849 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a24cd86f-ccde-45fe-a5b6-f0eed9b755a1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1308 microversion: 2.1 time: 0.284709 Jun 16 18:27:57.293129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 143/296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:57 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:57.304221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:57.305565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:57.307143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:57.307783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:57.308568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lazy-loading 'fault' on Instance uuid b1c262b9-2d5b-452c-8585-a92ff850144e {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:27:57.323040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:57.329544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:57.330836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:57.331503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:57.647764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:57.712248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:57.723864 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd0ddc10-8b2f-43ef-ab4e-1e7024ef6a34 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1459 microversion: 2.1 time: 0.485372 Jun 16 18:27:57.730256 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 154/297] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:57 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1459 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:57.745640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:57.759020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-42725cbf-c1b8-4ded-b650-c198f9592d60 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1323 microversion: 2.1 time: 0.463087 Jun 16 18:27:57.760703 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 144/298] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:57 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:58.244197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6487d95a-60c8-4193-a530-cfc67eecbfea tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Action: 'update', calling method: .version_select at 0x7f86741253a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:58.308569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:58.309442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:58.313807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:27:58.339666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:58.340125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:58.344866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:58.348941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:58.789875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:58.804530 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b71a15b-3d7c-4e70-a9ce-28bd31dfe1fa tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1489 microversion: 2.1 time: 0.499665 Jun 16 18:27:58.805675 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 145/299] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:58 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1489 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:27:58.818216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-589b9f9c-e571-4b88-ad6a-6755105c4240 req-37bd68e5-bfaa-47d3-9f4e-8278b9860145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c262b9-2d5b-452c-8585-a92ff850144e", "name": "network-vif-deleted", "tag": "187310e1-7b1a-4689-a87f-88889210c43b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:58.835993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-589b9f9c-e571-4b88-ad6a-6755105c4240 req-37bd68e5-bfaa-47d3-9f4e-8278b9860145 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:58.836712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-589b9f9c-e571-4b88-ad6a-6755105c4240 req-37bd68e5-bfaa-47d3-9f4e-8278b9860145 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:58.863467 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-589b9f9c-e571-4b88-ad6a-6755105c4240 req-37bd68e5-bfaa-47d3-9f4e-8278b9860145 service nova] Creating event network-vif-deleted:187310e1-7b1a-4689-a87f-88889210c43b for instance b1c262b9-2d5b-452c-8585-a92ff850144e on n-h2-846209-2 Jun 16 18:27:58.873144 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-589b9f9c-e571-4b88-ad6a-6755105c4240 req-37bd68e5-bfaa-47d3-9f4e-8278b9860145 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063666 Jun 16 18:27:58.875084 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 146/300] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:27:58.884476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:58.885532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:58.897690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:58.899576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:58.901427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:58.902270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:58.960427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:58.960864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:58.961320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lazy-loading 'fault' on Instance uuid b1c262b9-2d5b-452c-8585-a92ff850144e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:27:59.122480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40edf1dc85ef42b0a1e64655904f3d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870d5ffbd56d4cc7a6707953009a8355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:59.124728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6487d95a-60c8-4193-a530-cfc67eecbfea tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:59.129213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6487d95a-60c8-4193-a530-cfc67eecbfea tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:59.130277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6487d95a-60c8-4193-a530-cfc67eecbfea tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:59.130723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6487d95a-60c8-4193-a530-cfc67eecbfea tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:59.135669 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-881e80f4-8ba8-49f9-b349-41064378d47b tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 200 len: 1310 microversion: 2.1 time: 0.256490 Jun 16 18:27:59.136569 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 147/301] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:58 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 1310 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:59.141841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:59.147672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:59.167226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:59.168003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:59.171734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:59.172947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:59.253269 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6487d95a-60c8-4193-a530-cfc67eecbfea tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8" status: 200 len: 240 microversion: 2.36 time: 1.521250 Jun 16 18:27:59.255154 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 155/302] 10.222.0.27 () {62 vars in 1302 bytes} [Thu Jun 16 18:27:57 2022] PUT /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8 => generated 240 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:59.487955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:27:59.498189 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-282abcea-a643-4da7-b641-5b7461a091ff tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1323 microversion: 2.1 time: 0.360203 Jun 16 18:27:59.499048 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 148/303] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:27:59 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:27:59.513644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d1ed4f4d-f502-46cb-a6e2-58ab0778de57 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:59.514739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d1ed4f4d-f502-46cb-a6e2-58ab0778de57 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:27:59.534173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1ed4f4d-f502-46cb-a6e2-58ab0778de57 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:59.534870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1ed4f4d-f502-46cb-a6e2-58ab0778de57 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:59.535808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1ed4f4d-f502-46cb-a6e2-58ab0778de57 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:59.536391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1ed4f4d-f502-46cb-a6e2-58ab0778de57 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:59.650272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ff03392-94ff-4ad0-8010-37decb10c637 tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-187417309", "id": 1512475544, "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:27:59.653100 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:27:59.653100 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:27:59.681107 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d1ed4f4d-f502-46cb-a6e2-58ab0778de57 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291/action" status: 202 len: 0 microversion: 2.1 time: 0.178913 Jun 16 18:27:59.684647 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 149/304] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:27:59 2022] POST /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:27:59.696273 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ff03392-94ff-4ad0-8010-37decb10c637 tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.430192 Jun 16 18:27:59.700448 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 156/305] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:27:59 2022] POST /compute/v2.1/flavors => generated 448 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:27:59.713237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5d429f2d-b475-45e0-b582-0f5c01c422ab tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Calling method '.version_select at 0x7f867435f820>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:27:59.996326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1984763019", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:00.010425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:00.102120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:00.116371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:00.134817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d429f2d-b475-45e0-b582-0f5c01c422ab tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.136243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d429f2d-b475-45e0-b582-0f5c01c422ab tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.137140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d429f2d-b475-45e0-b582-0f5c01c422ab tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.137577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d429f2d-b475-45e0-b582-0f5c01c422ab tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.166560 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5d429f2d-b475-45e0-b582-0f5c01c422ab tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8/detail" status: 200 len: 672 microversion: 2.36 time: 0.464186 Jun 16 18:28:00.167870 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 157/306] 10.222.0.27 () {60 vars in 1303 bytes} [Thu Jun 16 18:27:59 2022] GET /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8/detail => generated 672 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:00.173997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:00.175176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:00.182869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.183805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.184858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.185436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.551399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:00.562677 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fb25815b-abd9-4ef1-98f8-208c2ea9a702 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 200 len: 1474 microversion: 2.1 time: 0.393407 Jun 16 18:28:00.563718 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 158/307] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:00 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:00.598987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:00.599469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:00.600252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:00.600844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:00.601724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:00.614791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.615654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.617106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.617592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.637855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:00.644281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for user 209d0e879aea45269c56a7c7d9869b23 and project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:00.659552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:00.664616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:00.710386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c752007-f4d4-49db-b252-01a447f99897 tempest-FlavorsV255TestJSON-993211571 tempest-FlavorsV255TestJSON-993211571-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:00.721436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c752007-f4d4-49db-b252-01a447f99897 tempest-FlavorsV255TestJSON-993211571 tempest-FlavorsV255TestJSON-993211571-project] 10.222.0.27 "GET /compute/v2.1/flavors/1512475544" status: 200 len: 448 microversion: 2.55 time: 0.156255 Jun 16 18:28:00.723209 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 159/308] 10.222.0.27 () {60 vars in 1198 bytes} [Thu Jun 16 18:28:00 2022] GET /compute/v2.1/flavors/1512475544 => generated 448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:00.736657 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8ab8b0fe-409b-4d62-b994-61b0770b8672 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035659 Jun 16 18:28:00.737517 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 150/309] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:27:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:00.746589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-99d478a4-1104-44d1-99a5-4c980e074f5a req-d5b953d0-0555-47c2-8ccc-9959f7dd8767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e03fc3-fb69-406e-b4e7-fc7d86ebe059", "name": "network-vif-plugged", "status": "completed", "tag": "e163b6f8-7c01-42f7-8469-f0d6301abadc"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:00.756178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-99d478a4-1104-44d1-99a5-4c980e074f5a req-d5b953d0-0555-47c2-8ccc-9959f7dd8767 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.756634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-99d478a4-1104-44d1-99a5-4c980e074f5a req-d5b953d0-0555-47c2-8ccc-9959f7dd8767 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.774738 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-99d478a4-1104-44d1-99a5-4c980e074f5a req-d5b953d0-0555-47c2-8ccc-9959f7dd8767 service nova] Creating event network-vif-plugged:e163b6f8-7c01-42f7-8469-f0d6301abadc for instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 on n-h1-846209-2 Jun 16 18:28:00.780815 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-99d478a4-1104-44d1-99a5-4c980e074f5a req-d5b953d0-0555-47c2-8ccc-9959f7dd8767 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039870 Jun 16 18:28:00.782708 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 151/310] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:00.790539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:00.791635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:00.799565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.800105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.800948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.801450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.810956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Calling method '.version_select at 0x7f86741d89d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:00.812655 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:00.812655 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:00.814903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.815756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.835265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] HTTP exception thrown: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:00.836641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Request method failure captured: Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e HTTP/1.1 Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X1E3dwa8dIYUnAW7YP6cOFLohBhr_3XJZTmHy1Kv7QUiplwXg7_i_DQM9XlckOFdgZBbDYw9cxisD0Dw8VlJFCxHQyuTV0XLyKnfrSMso0KTOUuJYKgUjyg2uUzl6MZGvZ0ztvHq2gelcpzO5AUNzVef_2epDeh_ZmCtTAXn8ngm8 Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:00.837010 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_870d5ffbd56d4cc7a6707953009a8355", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 40edf1dc85ef42b0a1e64655904f3d55 Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:00.838601 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b1c262b9-2d5b-452c-8585-a92ff850144e'} Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:00.847309 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:00.848766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:00.849753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Returning 404 to user: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:00.849753 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4fabaa0f-173d-4811-8ca3-b20a1fb1d072 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 404 len: 111 microversion: 2.1 time: 0.054460 Jun 16 18:28:00.849753 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 152/311] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:00 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:00.849753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Action: 'update', calling method: .version_select at 0x7f8674237d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:00.853945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.887133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.887590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.906813 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b63bb00f-d5e4-4e3a-a7af-2cf96188d21c tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.182373 Jun 16 18:28:00.917399 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 160/312] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:28:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:00.924288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:00.924915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:00.928439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.928896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.929704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.930167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.941651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.942141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:00.942937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:00.943376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.012304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.012892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.013683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.014668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.113602 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9e65605-57a4-4511-897c-e11e26947ca3 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8?user_id=3f7d0f833ab14e668f55128a1b486917" status: 200 len: 240 microversion: 2.36 time: 0.272129 Jun 16 18:28:01.114860 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 153/313] 10.222.0.27 () {62 vars in 1383 bytes} [Thu Jun 16 18:28:00 2022] PUT /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8?user_id=3f7d0f833ab14e668f55128a1b486917 => generated 240 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:01.121105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77ffcfc6-5b1b-4f99-9110-73ccae091903 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1451751522"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:01.123259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77ffcfc6-5b1b-4f99-9110-73ccae091903 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:01.135798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77ffcfc6-5b1b-4f99-9110-73ccae091903 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.136301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77ffcfc6-5b1b-4f99-9110-73ccae091903 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.137498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77ffcfc6-5b1b-4f99-9110-73ccae091903 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.137666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77ffcfc6-5b1b-4f99-9110-73ccae091903 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.537459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:01.550672 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f2c46c4a-809b-4d33-81e7-f9343ae22a76 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1323 microversion: 2.1 time: 0.632486 Jun 16 18:28:01.552244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 161/314] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:00 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:01.559750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4343b8a0-fcd7-4ea9-8670-8e471886e903 tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] Action: 'update', calling method: .version_select at 0x7f8675c69f70>, body: {"flavor": {"description": "new"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:01.593553 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:01.593553 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:01.648167 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4343b8a0-fcd7-4ea9-8670-8e471886e903 tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1512475544" status: 200 len: 449 microversion: 2.55 time: 0.093303 Jun 16 18:28:01.649035 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 162/315] 10.222.0.27 () {62 vars in 1218 bytes} [Thu Jun 16 18:28:01 2022] PUT /compute/v2.1/flavors/1512475544 => generated 449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:01.661276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:01.663693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:01.687407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.690514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.693602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.695339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.724387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77ffcfc6-5b1b-4f99-9110-73ccae091903 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291/action" status: 202 len: 0 microversion: 2.1 time: 0.608122 Jun 16 18:28:01.725725 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 154/316] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:28:01 2022] POST /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:28:01.738631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:01.739510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:01.751096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.751560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.752405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:01.752854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:01.776546 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] HTTP exception thrown: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Request method failure captured: Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e HTTP/1.1 Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X1E3dwa8dIYUnAW7YP6cOFLohBhr_3XJZTmHy1Kv7QUiplwXg7_i_DQM9XlckOFdgZBbDYw9cxisD0Dw8VlJFCxHQyuTV0XLyKnfrSMso0KTOUuJYKgUjyg2uUzl6MZGvZ0ztvHq2gelcpzO5AUNzVef_2epDeh_ZmCtTAXn8ngm8 Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:01.778499 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_870d5ffbd56d4cc7a6707953009a8355", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 40edf1dc85ef42b0a1e64655904f3d55 Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:01.780036 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b1c262b9-2d5b-452c-8585-a92ff850144e'} Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:01.780829 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:01.782794 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:01.784095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Returning 404 to user: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:01.784095 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a9bbd70-879c-43c3-9482-e23af771efc5 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 404 len: 111 microversion: 2.1 time: 0.052859 Jun 16 18:28:01.784095 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 155/317] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:28:01 2022] DELETE /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:01.851001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:01.863165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf37c292-c9a9-4f2d-8cef-cfa051a1e88e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1265 microversion: 2.1 time: 0.211387 Jun 16 18:28:01.864751 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 163/318] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:01 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:01.871427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b268a48a-1847-4e1d-b792-85ad11614384 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] Calling method '.version_select at 0x7f86744a5e50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.020748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:02.032632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-319abe46-57b4-4658-be0e-4a71d21b416b tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Calling method '.version_select at 0x7f866f5cb4c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.034629 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b268a48a-1847-4e1d-b792-85ad11614384 tempest-QuotasAdminTestV236-2033579288 tempest-QuotasAdminTestV236-2033579288-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8?user_id=3f7d0f833ab14e668f55128a1b486917" status: 200 len: 282 microversion: 2.36 time: 0.163648 Jun 16 18:28:02.036429 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:02.036429 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:02.038448 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 164/319] 10.222.0.27 () {60 vars in 1363 bytes} [Thu Jun 16 18:28:01 2022] GET /compute/v2.1/os-quota-sets/6e4ccd038afe4f88b73fcab0576b99e8?user_id=3f7d0f833ab14e668f55128a1b486917 => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:02.040187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-319abe46-57b4-4658-be0e-4a71d21b416b tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f03437cdfd2146ee900ef2168817ec84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb23f82fb94a4d56beb223a0dfaff75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-319abe46-57b4-4658-be0e-4a71d21b416b tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Request method failure captured: Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-hypervisors/n-h2-846209-2/search HTTP/1.1 Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Yt-Z8XjmuNh0nzd6iC0rj6oE7rE0V1sZHSfoLuG307mTWuUO1EOgSSgtRyAd_xD_EX15tRmOPoeJ2jvbMDM6eKhv_U2rhKSJZA_V4bx5xIKAR044w7CzkXk3Wz-hdc8hn7PNsaev1EW6H_CpAFAi7NyzbVFZb_aoT74YlBl06QM98 Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: cb23f82fb94a4d56beb223a0dfaff75f Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-643530087 Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:02.047578 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb23f82fb94a4d56beb223a0dfaff75f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb23f82fb94a4d56beb223a0dfaff75f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb23f82fb94a4d56beb223a0dfaff75f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb23f82fb94a4d56beb223a0dfaff75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-643530087 Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: cb23f82fb94a4d56beb223a0dfaff75f Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-643530087 Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-643530087-project Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: f03437cdfd2146ee900ef2168817ec84 Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-643530087-project Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 16 18:28:02.049200 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'n-h2-846209-2'} Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:02.050084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 16 18:28:02.051809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.054351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-319abe46-57b4-4658-be0e-4a71d21b416b tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:02.056826 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-319abe46-57b4-4658-be0e-4a71d21b416b tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-846209-2/search" status: 403 len: 117 microversion: 2.1 time: 0.273893 Jun 16 18:28:02.057446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52d8e2bb-ca6a-4589-bca4-07a7efda413b tempest-FlavorsV255TestJSON-993211571 tempest-FlavorsV255TestJSON-993211571-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.059573 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 156/320] 10.222.0.27 () {58 vars in 1208 bytes} [Thu Jun 16 18:28:01 2022] GET /compute/v2.1/os-hypervisors/n-h2-846209-2/search => generated 117 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:02.075429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35eb3106-3ac8-46ac-a34e-af29db2d9d53 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f55c040>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.137295 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52d8e2bb-ca6a-4589-bca4-07a7efda413b tempest-FlavorsV255TestJSON-993211571 tempest-FlavorsV255TestJSON-993211571-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.085349 Jun 16 18:28:02.139769 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 165/321] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:02.171661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-35eb3106-3ac8-46ac-a34e-af29db2d9d53 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.110706 Jun 16 18:28:02.179463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.180145 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 157/322] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:02.180265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b1c262b9-2d5b-452c-8585-a92ff850144e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:02.198618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9c5b31b3-c1eb-4a98-b38d-80b60b85a328 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Calling method '.version_select at 0x7f866f5cb4c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.203113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c5b31b3-c1eb-4a98-b38d-80b60b85a328 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.205212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c5b31b3-c1eb-4a98-b38d-80b60b85a328 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.211602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.212060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.214001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.214450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.248082 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-9c5b31b3-c1eb-4a98-b38d-80b60b85a328 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9c5b31b3-c1eb-4a98-b38d-80b60b85a328 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Request method failure captured: Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Yv-FvyKjSGCtTOE_x9Nw9X4eSpD19KGv9S_iod37EnlPTNOCLMK2w01F69dJxiMNs0VF3fbqy5hf1pFpOv9JqMTGBSOYMOMjOWmqU9gFybhXZOqWELY-w9CzqRcP-EklrXJ7X7gtSwSBYOjeoElexDkirqfIk_dl2OjbhdI4ulrgg Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1a30d892466548ef953c16197049227e Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2028997374 Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:28:02.254428 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a30d892466548ef953c16197049227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a30d892466548ef953c16197049227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a30d892466548ef953c16197049227e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a30d892466548ef953c16197049227e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2028997374 Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1a30d892466548ef953c16197049227e Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2028997374 Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: a536d21814304c9692828783ff63af01 Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 18:28:02.255848 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.256779 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.258180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.258180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:02.258180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:02.258180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 18:28:02.258180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.260879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9c5b31b3-c1eb-4a98-b38d-80b60b85a328 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:02.261282 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] HTTP exception thrown: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:02.264686 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9c5b31b3-c1eb-4a98-b38d-80b60b85a328 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.082865 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Request method failure captured: Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e HTTP/1.1 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3X1E3dwa8dIYUnAW7YP6cOFLohBhr_3XJZTmHy1Kv7QUiplwXg7_i_DQM9XlckOFdgZBbDYw9cxisD0Dw8VlJFCxHQyuTV0XLyKnfrSMso0KTOUuJYKgUjyg2uUzl6MZGvZ0ztvHq2gelcpzO5AUNzVef_2epDeh_ZmCtTAXn8ngm8 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:02.266174 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_870d5ffbd56d4cc7a6707953009a8355", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 40edf1dc85ef42b0a1e64655904f3d55 Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:02.267612 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'b1c262b9-2d5b-452c-8585-a92ff850144e'} Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:02.268437 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. Jun 16 18:28:02.269781 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.271415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Returning 404 to user: Instance b1c262b9-2d5b-452c-8585-a92ff850144e could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:02.271415 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8713af25-c04a-4b5c-beb2-5787a29270f2 tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e" status: 404 len: 111 microversion: 2.1 time: 0.126361 Jun 16 18:28:02.271415 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 166/323] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/servers/b1c262b9-2d5b-452c-8585-a92ff850144e => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:02.274216 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 158/324] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:02.286164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c49e3d76-9d25-4f68-8750-ccc745c563f6 tempest-FlavorsV255TestJSON-993211571 tempest-FlavorsV255TestJSON-993211571-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.291286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.294141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:02.319104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.320948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.322005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.322456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.335001 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c49e3d76-9d25-4f68-8750-ccc745c563f6 tempest-FlavorsV255TestJSON-993211571 tempest-FlavorsV255TestJSON-993211571-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.062636 Jun 16 18:28:02.337026 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 167/325] 10.222.0.27 () {60 vars in 1165 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:02.345867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Calling method '.version_select at 0x7f86744c8820>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.347087 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:02.347087 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:02.348900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.349689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.376794 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] HTTP exception thrown: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Request method failure captured: Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b HTTP/1.1 Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X1E3dwa8dIYUnAW7YP6cOFLohBhr_3XJZTmHy1Kv7QUiplwXg7_i_DQM9XlckOFdgZBbDYw9cxisD0Dw8VlJFCxHQyuTV0XLyKnfrSMso0KTOUuJYKgUjyg2uUzl6MZGvZ0ztvHq2gelcpzO5AUNzVef_2epDeh_ZmCtTAXn8ngm8 Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:02.380912 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_870d5ffbd56d4cc7a6707953009a8355", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 40edf1dc85ef42b0a1e64655904f3d55 Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.382403 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b23ed8c4-5c3e-4d9a-9208-018a061b793b'} Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:02.383237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.384426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.387526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Returning 404 to user: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:02.388751 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5af403e0-87af-41df-85fb-86de06fc249d tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 404 len: 111 microversion: 2.1 time: 0.113325 Jun 16 18:28:02.392745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.393199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.394133 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 159/326] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:28:02 2022] DELETE /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:02.400153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-57f584b1-a23a-487e-ad66-ef8f77b4c42a tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.401267 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:02.401267 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:02.434397 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-57f584b1-a23a-487e-ad66-ef8f77b4c42a tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1512475544" status: 202 len: 0 microversion: 2.55 time: 0.037139 Jun 16 18:28:02.435183 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 160/327] 10.222.0.27 () {60 vars in 1201 bytes} [Thu Jun 16 18:28:02 2022] DELETE /compute/v2.1/flavors/1512475544 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:28:02.439974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.440417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.445377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.448390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] [instance: b23ed8c4-5c3e-4d9a-9208-018a061b793b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:02.463177 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e3e3034-1333-48db-9bd0-9a0f67dd1667 tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.124485 Jun 16 18:28:02.467991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.469747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.471609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.472643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 168/328] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:02.473010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.477457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d36a7317-571f-4712-8cc2-dca6745ac7de tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.512767 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d36a7317-571f-4712-8cc2-dca6745ac7de tempest-FlavorsV255TestJSON-1689389960 tempest-FlavorsV255TestJSON-1689389960-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.038927 Jun 16 18:28:02.513783 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] HTTP exception thrown: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Request method failure captured: Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b HTTP/1.1 Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3X1E3dwa8dIYUnAW7YP6cOFLohBhr_3XJZTmHy1Kv7QUiplwXg7_i_DQM9XlckOFdgZBbDYw9cxisD0Dw8VlJFCxHQyuTV0XLyKnfrSMso0KTOUuJYKgUjyg2uUzl6MZGvZ0ztvHq2gelcpzO5AUNzVef_2epDeh_ZmCtTAXn8ngm8 Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:02.520130 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_870d5ffbd56d4cc7a6707953009a8355", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/870d5ffbd56d4cc7a6707953009a8355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 870d5ffbd56d4cc7a6707953009a8355 Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-530953972 Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 40edf1dc85ef42b0a1e64655904f3d55 Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersAdminTestJSON-530953972-project Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.524154 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b23ed8c4-5c3e-4d9a-9208-018a061b793b'} Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:02.527413 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. Jun 16 18:28:02.533230 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.539283 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 169/329] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:02.539283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a735980-4348-4474-9732-603a3ff2d97f tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Calling method '.version_select at 0x7f86741d8670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.539283 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:02.539283 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:02.539283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a735980-4348-4474-9732-603a3ff2d97f tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f03437cdfd2146ee900ef2168817ec84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb23f82fb94a4d56beb223a0dfaff75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:02.540527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] Returning 404 to user: Instance b23ed8c4-5c3e-4d9a-9208-018a061b793b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:02.542420 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a52460d0-0151-4d28-9314-ad5d15325acc tempest-DeleteServersAdminTestJSON-530953972 tempest-DeleteServersAdminTestJSON-530953972-project] 10.222.0.27 "GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b" status: 404 len: 111 microversion: 2.1 time: 0.105378 Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a735980-4348-4474-9732-603a3ff2d97f tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Request method failure captured: Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Yt-Z8XjmuNh0nzd6iC0rj6oE7rE0V1sZHSfoLuG307mTWuUO1EOgSSgtRyAd_xD_EX15tRmOPoeJ2jvbMDM6eKhv_U2rhKSJZA_V4bx5xIKAR044w7CzkXk3Wz-hdc8hn7PNsaev1EW6H_CpAFAi7NyzbVFZb_aoT74YlBl06QM98 Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: cb23f82fb94a4d56beb223a0dfaff75f Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-643530087 Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:02.542584 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb23f82fb94a4d56beb223a0dfaff75f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb23f82fb94a4d56beb223a0dfaff75f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb23f82fb94a4d56beb223a0dfaff75f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb23f82fb94a4d56beb223a0dfaff75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-643530087 Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: cb23f82fb94a4d56beb223a0dfaff75f Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-643530087 Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-643530087-project Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: f03437cdfd2146ee900ef2168817ec84 Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-643530087-project Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '1'} Jun 16 18:28:02.544724 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:02.546138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 16 18:28:02.548661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.558072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a735980-4348-4474-9732-603a3ff2d97f tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:02.558072 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a735980-4348-4474-9732-603a3ff2d97f tempest-HypervisorAdminNegativeUnderV252Test-643530087 tempest-HypervisorAdminNegativeUnderV252Test-643530087-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017805 Jun 16 18:28:02.558072 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 170/330] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:02.558721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffde889b-44df-4a3a-920d-c81bd116846e tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Calling method '.version_select at 0x7f8674150280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.562483 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 161/331] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/servers/b23ed8c4-5c3e-4d9a-9208-018a061b793b => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:02.578293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffde889b-44df-4a3a-920d-c81bd116846e tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.578912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffde889b-44df-4a3a-920d-c81bd116846e tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.580221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.583974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:02.585894 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ffde889b-44df-4a3a-920d-c81bd116846e tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] HTTP exception thrown: No hypervisor matching '0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed' could be found. Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffde889b-44df-4a3a-920d-c81bd116846e tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Request method failure captured: Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hypervisors/0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed/servers HTTP/1.1 Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Yv-FvyKjSGCtTOE_x9Nw9X4eSpD19KGv9S_iod37EnlPTNOCLMK2w01F69dJxiMNs0VF3fbqy5hf1pFpOv9JqMTGBSOYMOMjOWmqU9gFybhXZOqWELY-w9CzqRcP-EklrXJ7X7gtSwSBYOjeoElexDkirqfIk_dl2OjbhdI4ulrgg Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 1a30d892466548ef953c16197049227e Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2028997374 Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:02.587290 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a30d892466548ef953c16197049227e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a30d892466548ef953c16197049227e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a30d892466548ef953c16197049227e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a30d892466548ef953c16197049227e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2028997374 Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 1a30d892466548ef953c16197049227e Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2028997374 Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a536d21814304c9692828783ff63af01 Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: exception: No hypervisor matching '0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed' could be found. Jun 16 18:28:02.589526 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed'} Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed' could be found. Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.590767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed' could be found. Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffde889b-44df-4a3a-920d-c81bd116846e tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] Returning 404 to user: No hypervisor matching '0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed' could be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ffde889b-44df-4a3a-920d-c81bd116846e tempest-HypervisorAdminNegativeUnderV252Test-2028997374 tempest-HypervisorAdminNegativeUnderV252Test-2028997374-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed/servers" status: 404 len: 123 microversion: 2.1 time: 0.034294 Jun 16 18:28:02.592634 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 171/332] 10.222.0.27 () {58 vars in 1280 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/os-hypervisors/0f20db6a-5e59-4da1-bc1f-8aff9ec0ebed/servers => generated 123 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:02.613667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.615672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.617942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.619767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.633120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:02.885995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:02.899361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:02.922986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.923819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:02.925280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:02.926374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:03.208346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:03.239321 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fb2ea10c-0cf8-4ef5-8fa2-d09d0fb2b984 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1271 microversion: 2.1 time: 0.361115 Jun 16 18:28:03.250272 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 172/333] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:03.274335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4b3db65-7469-4dd5-9b56-76e0ab034eca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86741d88b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:03.397675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:03.414044 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd8af24e-6e42-4bb7-88d3-ae612bff9a89 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1472 microversion: 2.1 time: 0.845175 Jun 16 18:28:03.414814 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a4b3db65-7469-4dd5-9b56-76e0ab034eca tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.162547 Jun 16 18:28:03.419820 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 173/334] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:03 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:03.437033 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 162/335] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:02 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1472 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:03.443672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:03.447100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:03.480362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:03.481752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:03.483565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:03.484396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:03.599613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Request method failure captured: Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059/diagnostics HTTP/1.1 Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YhmI1xzi7NfVeStBo7eYarRxru-38ZQd65jCwmPMwssDS6AjHsyhcTCXHyad2Hyvgeyhi2DmbdrNnTCmoq0eKgfAqOmmqzy1IAIAfJdEiyeO5PEaG-PE_uueJ0kV2N0yDWhXGXGy7Uc0XlH3fE_W_Sdpe-3cfymUOirU694CbyJxE Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 338cc25d24b94715a1d077ec18d6d8e6 Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-271730242 Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:03.603565 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/338cc25d24b94715a1d077ec18d6d8e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/338cc25d24b94715a1d077ec18d6d8e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_338cc25d24b94715a1d077ec18d6d8e6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/338cc25d24b94715a1d077ec18d6d8e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-271730242 Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 338cc25d24b94715a1d077ec18d6d8e6 Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-271730242 Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerDiagnosticsNegativeTest-271730242-project Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9f0727ea96c14338a3323eb0ed2f0cda Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-271730242-project Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:28:03.605572 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': 'a3e03fc3-fb69-406e-b4e7-fc7d86ebe059'} Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:03.606985 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 16 18:28:03.608786 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:03.613100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:03.614366 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf97f02e-9cf9-43bb-8106-ebf03217733a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.177198 Jun 16 18:28:03.615609 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 174/336] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:28:03 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059/diagnostics => generated 117 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:28:03.627655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:03.628173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:03.642899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:03.643466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:03.647135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:03.647866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:03.707702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:28:03.915304 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88778548-8293-480a-8e9c-bb324bcdc976 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 204 len: 0 microversion: 2.1 time: 0.292084 Jun 16 18:28:03.916027 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 163/337] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:28:03 2022] DELETE /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:28:03.937235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:03.940213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:03.959609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:03.961657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:03.963327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:03.967129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:04.267937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:04.268803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:04.288007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:04.288892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:04.290386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:04.295861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:04.883613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:04.903176 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6b65fe4f-c7c8-417b-be1b-e70b1ae1438a tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1478 microversion: 2.1 time: 0.978258 Jun 16 18:28:04.918812 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 175/338] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:03 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1478 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:04.927213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-336a6964-495c-49b3-9533-b450b0e46048 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f8674150160>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:05.020061 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-336a6964-495c-49b3-9533-b450b0e46048 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.097824 Jun 16 18:28:05.021486 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 176/339] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:04 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:05.033591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:05.042730 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6bfb41a4-e0f6-41fc-818f-906b293e4b64 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 0.780543 Jun 16 18:28:05.043068 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 164/340] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:04 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:05.926774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:05.928210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:05.953352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:05.956342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:05.957436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:05.965713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:06.035363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-74cff93b-d6d6-4422-b61b-2ee057a330f1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4c7940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:06.165465 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-74cff93b-d6d6-4422-b61b-2ee057a330f1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.134772 Jun 16 18:28:06.166301 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 165/341] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:06 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:06.176743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:06.177361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:06.208396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:06.220872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:06.222590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:06.223263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:07.480293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:07.513594 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91f1bd2e-0ce4-4b3a-bbc5-5a0475fd87e0 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1478 microversion: 2.1 time: 1.589643 Jun 16 18:28:07.514945 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 177/342] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:05 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1478 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:07.549233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0d4d186-38c3-4a87-970f-fdaa6cabd65b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f867435f4c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:07.636701 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b0d4d186-38c3-4a87-970f-fdaa6cabd65b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.097244 Jun 16 18:28:07.641100 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 178/343] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:07 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:07.711778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:07.733790 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1fa9f5e8-a3d2-4d7a-8879-eef2e91a4543 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 1.566325 Jun 16 18:28:07.740944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 166/344] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:06 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:08.038029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-38a90f54-b605-42ac-b85b-2366eb14e623 req-8bee629e-8c6c-44ca-a717-8c860b37b6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2a156-987a-4ecc-a83e-d5c84b21d291", "name": "network-vif-plugged", "status": "completed", "tag": "7b08401d-0478-4b2b-b87d-8c54b3a70e38"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:08.066193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-38a90f54-b605-42ac-b85b-2366eb14e623 req-8bee629e-8c6c-44ca-a717-8c860b37b6b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:08.066799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-38a90f54-b605-42ac-b85b-2366eb14e623 req-8bee629e-8c6c-44ca-a717-8c860b37b6b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:08.113569 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-38a90f54-b605-42ac-b85b-2366eb14e623 req-8bee629e-8c6c-44ca-a717-8c860b37b6b2 service nova] Creating event network-vif-plugged:7b08401d-0478-4b2b-b87d-8c54b3a70e38 for instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 on n-h1-846209-2 Jun 16 18:28:08.144542 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-38a90f54-b605-42ac-b85b-2366eb14e623 req-8bee629e-8c6c-44ca-a717-8c860b37b6b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114466 Jun 16 18:28:08.151429 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 179/345] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:28:08.393962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-75b47052-9d0e-4b32-849e-dd45c3460d55 req-254eb045-55a2-486a-a606-a3eb20c495ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf781a8-6d20-42d8-8a48-4c62f18f815a", "tag": "28aa9ab0-5760-41d2-8199-2de4e727f2e6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:08.441650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75b47052-9d0e-4b32-849e-dd45c3460d55 req-254eb045-55a2-486a-a606-a3eb20c495ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:08.445534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75b47052-9d0e-4b32-849e-dd45c3460d55 req-254eb045-55a2-486a-a606-a3eb20c495ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:08.507141 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-75b47052-9d0e-4b32-849e-dd45c3460d55 req-254eb045-55a2-486a-a606-a3eb20c495ee service nova] Creating event network-changed:28aa9ab0-5760-41d2-8199-2de4e727f2e6 for instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a on n-h2-846209-2 Jun 16 18:28:08.530697 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-75b47052-9d0e-4b32-849e-dd45c3460d55 req-254eb045-55a2-486a-a606-a3eb20c495ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141431 Jun 16 18:28:08.533326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 167/346] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:08.541194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:08.541977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:08.564033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:08.565118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:08.580321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:08.581622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:08.589755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:08.607284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-99ce3a1b-e25c-4d3a-a38f-29e08aeb75eb req-53d5f09a-442b-4316-8787-b2682ed10a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e03fc3-fb69-406e-b4e7-fc7d86ebe059", "name": "network-vif-deleted", "tag": "e163b6f8-7c01-42f7-8469-f0d6301abadc"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:08.634351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-99ce3a1b-e25c-4d3a-a38f-29e08aeb75eb req-53d5f09a-442b-4316-8787-b2682ed10a92 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:08.634805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-99ce3a1b-e25c-4d3a-a38f-29e08aeb75eb req-53d5f09a-442b-4316-8787-b2682ed10a92 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:08.685709 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-99ce3a1b-e25c-4d3a-a38f-29e08aeb75eb req-53d5f09a-442b-4316-8787-b2682ed10a92 service nova] Creating event network-vif-deleted:e163b6f8-7c01-42f7-8469-f0d6301abadc for instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 on n-h1-846209-2 Jun 16 18:28:08.703160 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-99ce3a1b-e25c-4d3a-a38f-29e08aeb75eb req-53d5f09a-442b-4316-8787-b2682ed10a92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101138 Jun 16 18:28:08.714357 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 168/347] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:28:08.732511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bccede54-bfda-4042-acce-b9f579ea04af tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f62b430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:08.879478 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bccede54-bfda-4042-acce-b9f579ea04af tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.163739 Jun 16 18:28:08.880697 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 169/348] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:08 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:08.886470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:08.901579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:08.927994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:08.932193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:08.933189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:08.940395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:09.028334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0727ea96c14338a3323eb0ed2f0cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338cc25d24b94715a1d077ec18d6d8e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:09.037555 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bf33cfee-a050-45fa-b15d-95303b1f83ac tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 200 len: 1436 microversion: 2.1 time: 0.500698 Jun 16 18:28:09.043147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 180/349] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:08 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 1436 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:09.896868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:09.900912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-66c4f857-a298-4601-a87d-f5235fd5c425 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86741580d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:09.909116 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bde310e9-a17d-400a-a186-246de806b764 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 1.026881 Jun 16 18:28:09.909559 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 170/350] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:08 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:10.025666 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-66c4f857-a298-4601-a87d-f5235fd5c425 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.134186 Jun 16 18:28:10.031955 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 181/351] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:09 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:10.061417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:10.063861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] [instance: a3e03fc3-fb69-406e-b4e7-fc7d86ebe059] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:10.086650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:10.092338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:10.095558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:10.100714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:10.171472 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] HTTP exception thrown: Instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 could not be found. Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Request method failure captured: Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 HTTP/1.1 Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YhmI1xzi7NfVeStBo7eYarRxru-38ZQd65jCwmPMwssDS6AjHsyhcTCXHyad2Hyvgeyhi2DmbdrNnTCmoq0eKgfAqOmmqzy1IAIAfJdEiyeO5PEaG-PE_uueJ0kV2N0yDWhXGXGy7Uc0XlH3fE_W_Sdpe-3cfymUOirU694CbyJxE Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 338cc25d24b94715a1d077ec18d6d8e6 Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-271730242 Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:10.173408 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/338cc25d24b94715a1d077ec18d6d8e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/338cc25d24b94715a1d077ec18d6d8e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_338cc25d24b94715a1d077ec18d6d8e6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/338cc25d24b94715a1d077ec18d6d8e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-271730242 Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 338cc25d24b94715a1d077ec18d6d8e6 Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-271730242 Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerDiagnosticsNegativeTest-271730242-project Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9f0727ea96c14338a3323eb0ed2f0cda Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-271730242-project Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 could not be found. Jun 16 18:28:10.174729 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a3e03fc3-fb69-406e-b4e7-fc7d86ebe059'} Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 could not be found. Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:10.175437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 could not be found. Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 could not be found. Jun 16 18:28:10.177269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:10.179138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] Returning 404 to user: Instance a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:10.179138 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a046e60-f812-4aa2-bbff-33cffbfa1d19 tempest-ServerDiagnosticsNegativeTest-271730242 tempest-ServerDiagnosticsNegativeTest-271730242-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059" status: 404 len: 111 microversion: 2.1 time: 0.117450 Jun 16 18:28:10.185820 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 171/352] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:10 2022] GET /compute/v2.1/servers/a3e03fc3-fb69-406e-b4e7-fc7d86ebe059 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:10.923923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:10.931367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:10.932016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:10.942779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:10.947638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:10.948846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:10.949460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:11.048543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-107d88ed-2972-4c92-a4ca-9076ff400dd8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4dcca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:11.064639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:11.107028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=18 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:11.146057 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-107d88ed-2972-4c92-a4ca-9076ff400dd8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.101641 Jun 16 18:28:11.154230 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 172/353] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:11 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:11.608173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:11.625254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ee1d6759-458d-45a0-9e58-ae2a4458f93b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 0.702483 Jun 16 18:28:11.630897 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 182/354] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:10 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:12.166653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c70abaa9-b9b2-4e09-9959-b4b97a35b7cb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4c7670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:12.270859 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c70abaa9-b9b2-4e09-9959-b4b97a35b7cb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.111856 Jun 16 18:28:12.278254 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 173/355] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:12 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:12.651409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:12.655523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:12.665649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:12.669050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:12.670129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:12.671406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:12.673074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:12.962660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:12.973431 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a2d37e8-fd8b-4ead-b233-b7e535cfddb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 0.328104 Jun 16 18:28:12.981420 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 183/356] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:12 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:13.285793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-47f1cb13-b0ce-484a-af8c-20b9b50bb451 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f673ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:13.356149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-47f1cb13-b0ce-484a-af8c-20b9b50bb451 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.075429 Jun 16 18:28:13.360560 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 174/357] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:13 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:13.998782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:14.001820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:14.024088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:14.024786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:14.026505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:14.027358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:14.332999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:14.353377 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-698c1640-6cdd-4a2a-84e1-04ed5a96e999 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 0.360004 Jun 16 18:28:14.367630 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 184/358] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:13 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:14.382845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-edfd4d57-366a-4997-8efe-35fef268bc30 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86740d34c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:14.480259 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-edfd4d57-366a-4997-8efe-35fef268bc30 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.103576 Jun 16 18:28:14.481015 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 175/359] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:14 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:15.375592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:15.377165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:15.391211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:15.392110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:15.393359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:15.396098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:15.506828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d5c767ec-499a-46a1-bb73-aa0a0777fc3b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f527d30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:15.718867 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d5c767ec-499a-46a1-bb73-aa0a0777fc3b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.223241 Jun 16 18:28:15.733509 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 176/360] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:15 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:16.568859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:16.606972 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-332c001a-0144-4912-b3b6-94a5ab8d280b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 1.236939 Jun 16 18:28:16.610495 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 185/361] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:15 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:16.747748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9236459-66e1-46dc-b716-ae6557ce2409 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4c7f70>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:16.899835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9236459-66e1-46dc-b716-ae6557ce2409 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.160759 Jun 16 18:28:16.911723 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 177/362] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:16 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:17.628402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:17.628980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:17.648305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:17.648762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:17.649566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:17.650082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:18.641191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:18.712562 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b90a955f-96a8-4130-8de0-8d59476b7b06 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 1.089154 Jun 16 18:28:18.715602 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 178/363] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:17 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:18.759362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f48b81d-cf0f-4e03-80da-ca341169ac30 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4dc790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:18.830987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7a99dc99-3e9e-4f77-8ac8-5d721e1ba4f9 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Calling method '.version_select at 0x7f86757195e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:18.832362 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:18.832362 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:18.833576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a99dc99-3e9e-4f77-8ac8-5d721e1ba4f9 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:18.840839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a99dc99-3e9e-4f77-8ac8-5d721e1ba4f9 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:18.841927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a99dc99-3e9e-4f77-8ac8-5d721e1ba4f9 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:18.842449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a99dc99-3e9e-4f77-8ac8-5d721e1ba4f9 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:18.868035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3f48b81d-cf0f-4e03-80da-ca341169ac30 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.141513 Jun 16 18:28:18.868629 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 179/364] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:18 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:19.019398 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7a99dc99-3e9e-4f77-8ac8-5d721e1ba4f9 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.433379 Jun 16 18:28:19.020564 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 186/365] 10.222.0.27 () {58 vars in 1127 bytes} [Thu Jun 16 18:28:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:19.312803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-43130885", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:19.535384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:19.755235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf9bd2ad-f0e8-4f7f-84aa-1eb27907bc8e tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Calling method '.version_select at 0x7f8674536d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:19.756511 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:19.756511 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:19.758150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bf9bd2ad-f0e8-4f7f-84aa-1eb27907bc8e tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b1bcfbac014c4f078602568d100c279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff887f5087074b2d9534b42fe5da104b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf9bd2ad-f0e8-4f7f-84aa-1eb27907bc8e tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Request method failure captured: Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y8QBgUMkJKkYKTsDUXKKiUDtfTQbdALBAt_yG5m9tw_nEm86tvCvi55Wsu7oM8hiOd2dYHL_zBrayT2GwFs8KOPsxaiF8z3kzxVSclwM1FyeMW1x0_SPxqVAL6pmhEh8oyyAnM-eMDycmJ6JrRwoL8cEgd8BiNep4VX6e-cklzU68 Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:19.762936 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff887f5087074b2d9534b42fe5da104b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b1bcfbac014c4f078602568d100c279e Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: action_args: {} Jun 16 18:28:19.765578 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:19.767030 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 16 18:28:19.769014 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:19.776699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf9bd2ad-f0e8-4f7f-84aa-1eb27907bc8e tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:19.776699 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bf9bd2ad-f0e8-4f7f-84aa-1eb27907bc8e tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.738744 Jun 16 18:28:19.776699 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 187/366] 10.222.0.27 () {58 vars in 1127 bytes} [Thu Jun 16 18:28:19 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 744 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:19.787561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:19.788096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:19.817862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:19.818360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:19.819162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:19.819605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:20.583526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:20.627996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72314fb7-676f-45f1-9f60-d14abf9d1516 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 0.852517 Jun 16 18:28:20.644756 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 188/367] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:19 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:20.668634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-658512b8-2107-4eb1-949d-bfe8c74946f6 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Calling method '.version_select at 0x7f86744a5e50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:20.678501 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:20.678501 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:20.706816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-658512b8-2107-4eb1-949d-bfe8c74946f6 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b1bcfbac014c4f078602568d100c279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff887f5087074b2d9534b42fe5da104b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-658512b8-2107-4eb1-949d-bfe8c74946f6 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Request method failure captured: Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/n-d-846209-2/reboot HTTP/1.1 Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y8QBgUMkJKkYKTsDUXKKiUDtfTQbdALBAt_yG5m9tw_nEm86tvCvi55Wsu7oM8hiOd2dYHL_zBrayT2GwFs8KOPsxaiF8z3kzxVSclwM1FyeMW1x0_SPxqVAL6pmhEh8oyyAnM-eMDycmJ6JrRwoL8cEgd8BiNep4VX6e-cklzU68 Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:20.713236 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff887f5087074b2d9534b42fe5da104b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b1bcfbac014c4f078602568d100c279e Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'n-d-846209-2'} Jun 16 18:28:20.716091 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:20.717492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 16 18:28:20.723361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:20.725285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-658512b8-2107-4eb1-949d-bfe8c74946f6 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:20.725285 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-658512b8-2107-4eb1-949d-bfe8c74946f6 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-846209-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.068212 Jun 16 18:28:20.727789 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 189/368] 10.222.0.27 () {58 vars in 1187 bytes} [Thu Jun 16 18:28:20 2022] GET /compute/v2.1/os-hosts/n-d-846209-2/reboot => generated 111 bytes in 79 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:20.746375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8bfe05aa-b98c-46f0-b423-cbce29519d8f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f8674150280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:20.911275 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8bfe05aa-b98c-46f0-b423-cbce29519d8f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.183297 Jun 16 18:28:20.921968 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 190/369] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:20 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:20.934348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8bfe05aa-b98c-46f0-b423-cbce29519d8f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:20.958067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8bfe05aa-b98c-46f0-b423-cbce29519d8f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.027773 Jun 16 18:28:20.958554 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 191/370] 10.222.0.27 () {56 vars in 885 bytes} [Thu Jun 16 18:28:20 2022] GET /compute/ => generated 377 bytes in 33 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 16 18:28:20.993557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e4ce6b2-891e-4e63-9d00-95c1ac27796d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Calling method '.version_select at 0x7f867435f820>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.024809 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1e4ce6b2-891e-4e63-9d00-95c1ac27796d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e4ce6b2-891e-4e63-9d00-95c1ac27796d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:21.035320 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'nonexistent_hostname'} Jun 16 18:28:21.036837 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:28:21.037624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 16 18:28:21.038774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.040250 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.043754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e4ce6b2-891e-4e63-9d00-95c1ac27796d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.045124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e4ce6b2-891e-4e63-9d00-95c1ac27796d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.075081 Jun 16 18:28:21.047381 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 192/371] 10.222.0.27 () {58 vars in 1211 bytes} [Thu Jun 16 18:28:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:28:21.062398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b1ea15f-3abc-440a-8045-84bd27ca0570 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Calling method '.version_select at 0x7f86740f63a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.065683 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:21.065683 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:21.067389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2b1ea15f-3abc-440a-8045-84bd27ca0570 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b1bcfbac014c4f078602568d100c279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff887f5087074b2d9534b42fe5da104b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b1ea15f-3abc-440a-8045-84bd27ca0570 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Request method failure captured: Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/n-d-846209-2 HTTP/1.1 Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y8QBgUMkJKkYKTsDUXKKiUDtfTQbdALBAt_yG5m9tw_nEm86tvCvi55Wsu7oM8hiOd2dYHL_zBrayT2GwFs8KOPsxaiF8z3kzxVSclwM1FyeMW1x0_SPxqVAL6pmhEh8oyyAnM-eMDycmJ6JrRwoL8cEgd8BiNep4VX6e-cklzU68 Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:21.070405 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff887f5087074b2d9534b42fe5da104b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b1bcfbac014c4f078602568d100c279e Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'n-d-846209-2'} Jun 16 18:28:21.071752 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:21.072559 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 16 18:28:21.073757 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.077166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b1ea15f-3abc-440a-8045-84bd27ca0570 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.078986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2b1ea15f-3abc-440a-8045-84bd27ca0570 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-846209-2" status: 403 len: 109 microversion: 2.1 time: 0.024738 Jun 16 18:28:21.080234 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 193/372] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/os-hosts/n-d-846209-2 => generated 109 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:21.092754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7f2c439a-1f08-4b6b-846f-5388aeeb03bb tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Calling method '.version_select at 0x7f86741d8b80>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.107297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-7f2c439a-1f08-4b6b-846f-5388aeeb03bb tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7f2c439a-1f08-4b6b-846f-5388aeeb03bb tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:21.111930 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'nonexistent_hostname'} Jun 16 18:28:21.114255 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.115629 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.117728 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.123956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7f2c439a-1f08-4b6b-846f-5388aeeb03bb tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.127102 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7f2c439a-1f08-4b6b-846f-5388aeeb03bb tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039746 Jun 16 18:28:21.128973 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 194/373] 10.222.0.27 () {58 vars in 1190 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:28:21.146887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e54e8cf8-a1d5-448f-8884-25fb0f64fa0f tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Calling method '.version_select at 0x7f86740f68b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.154633 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:21.154633 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:21.159123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e54e8cf8-a1d5-448f-8884-25fb0f64fa0f tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b1bcfbac014c4f078602568d100c279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff887f5087074b2d9534b42fe5da104b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e54e8cf8-a1d5-448f-8884-25fb0f64fa0f tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Request method failure captured: Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/n-d-846209-2/shutdown HTTP/1.1 Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y8QBgUMkJKkYKTsDUXKKiUDtfTQbdALBAt_yG5m9tw_nEm86tvCvi55Wsu7oM8hiOd2dYHL_zBrayT2GwFs8KOPsxaiF8z3kzxVSclwM1FyeMW1x0_SPxqVAL6pmhEh8oyyAnM-eMDycmJ6JrRwoL8cEgd8BiNep4VX6e-cklzU68 Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:21.170291 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff887f5087074b2d9534b42fe5da104b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b1bcfbac014c4f078602568d100c279e Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'n-d-846209-2'} Jun 16 18:28:21.172128 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:21.172875 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 16 18:28:21.173967 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.178974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e54e8cf8-a1d5-448f-8884-25fb0f64fa0f tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.181869 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e54e8cf8-a1d5-448f-8884-25fb0f64fa0f tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-846209-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.043198 Jun 16 18:28:21.183492 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 195/374] 10.222.0.27 () {58 vars in 1193 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/os-hosts/n-d-846209-2/shutdown => generated 113 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:21.207857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c941a46b-2c5f-43ff-b914-80e21132fff0 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Calling method '.version_select at 0x7f8674273c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.225131 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-c941a46b-2c5f-43ff-b914-80e21132fff0 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c941a46b-2c5f-43ff-b914-80e21132fff0 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:21.227977 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'nonexistent_hostname'} Jun 16 18:28:21.229245 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:28:21.231227 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 16 18:28:21.233077 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.235242 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.241773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:21.243449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:21.246366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:21.247147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:21.247806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:21.255454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c941a46b-2c5f-43ff-b914-80e21132fff0 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.263642 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c941a46b-2c5f-43ff-b914-80e21132fff0 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.070208 Jun 16 18:28:21.272138 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 196/375] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:28:21.293133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:21.294474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:21.298251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c96391af-61ea-4c1d-9733-81ea134593e9 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Calling method '.version_select at 0x7f86740f6160>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.304173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:21.304648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:21.305598 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:21.305598 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:21.307955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c96391af-61ea-4c1d-9733-81ea134593e9 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b1bcfbac014c4f078602568d100c279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff887f5087074b2d9534b42fe5da104b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c96391af-61ea-4c1d-9733-81ea134593e9 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Request method failure captured: Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/n-d-846209-2/startup HTTP/1.1 Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y8QBgUMkJKkYKTsDUXKKiUDtfTQbdALBAt_yG5m9tw_nEm86tvCvi55Wsu7oM8hiOd2dYHL_zBrayT2GwFs8KOPsxaiF8z3kzxVSclwM1FyeMW1x0_SPxqVAL6pmhEh8oyyAnM-eMDycmJ6JrRwoL8cEgd8BiNep4VX6e-cklzU68 Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:21.318816 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff887f5087074b2d9534b42fe5da104b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b1bcfbac014c4f078602568d100c279e Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'n-d-846209-2'} Jun 16 18:28:21.321260 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:21.322753 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 16 18:28:21.324844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.333048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c96391af-61ea-4c1d-9733-81ea134593e9 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.334925 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c96391af-61ea-4c1d-9733-81ea134593e9 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-846209-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.061021 Jun 16 18:28:21.336743 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 197/376] 10.222.0.27 () {58 vars in 1190 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/os-hosts/n-d-846209-2/startup => generated 110 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:21.351093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a507e2c3-417a-41ee-b829-5d386ea2b5ff tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Calling method '.version_select at 0x7f8674150d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.373238 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a507e2c3-417a-41ee-b829-5d386ea2b5ff tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.384473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Getting quotas for project 0f0fb2bcbf6f455a8f4f741a476ba81c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a507e2c3-417a-41ee-b829-5d386ea2b5ff tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:21.392423 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'nonexistent_hostname'} Jun 16 18:28:21.394738 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:28:21.398487 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 16 18:28:21.401709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:21.412201 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.415681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Getting quotas for user 37f5daa365b34a63a78ea4fb99ea9961 and project 0f0fb2bcbf6f455a8f4f741a476ba81c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:21.417312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a507e2c3-417a-41ee-b829-5d386ea2b5ff tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.422277 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a507e2c3-417a-41ee-b829-5d386ea2b5ff tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.077938 Jun 16 18:28:21.429270 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 198/377] 10.222.0.27 () {58 vars in 1214 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:28:21.455516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:21.459160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:21.471989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a806d956-86e7-427b-b485-b7c4de35e416 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Action: 'update', calling method: .version_select at 0x7f86740f6280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a806d956-86e7-427b-b485-b7c4de35e416 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/os-hosts/n-d-846209-2 HTTP/1.1 Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 51 Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:21.500423 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: {"status": "enable", "maintenance_mode": "invalid"} Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.503823 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'n-d-846209-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'disable', Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'Enable', Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'Disable', Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance: Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'invalid' Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.505379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.508161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.520488 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.520488 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:28:21.520488 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:28:21.520488 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.520488 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.523676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a806d956-86e7-427b-b485-b7c4de35e416 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.528246 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a806d956-86e7-427b-b485-b7c4de35e416 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-846209-2" status: 400 len: 199 microversion: 2.1 time: 0.091345 Jun 16 18:28:21.536769 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 199/378] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:28:21 2022] PUT /compute/v2.1/os-hosts/n-d-846209-2 => generated 199 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:28:21.571681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b854c5d-175d-48e9-85ab-8c349270048d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Action: 'update', calling method: .version_select at 0x7f867435f310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b854c5d-175d-48e9-85ab-8c349270048d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/os-hosts/n-d-846209-2 HTTP/1.1 Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 51 Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:21.583997 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: {"status": "invalid", "maintenance_mode": "enable"} Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:21.587347 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'n-d-846209-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'disable', Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'Enable', Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'Disable', Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance: Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'invalid' Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.589179 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.592303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b854c5d-175d-48e9-85ab-8c349270048d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b854c5d-175d-48e9-85ab-8c349270048d tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-846209-2" status: 400 len: 189 microversion: 2.1 time: 0.053910 Jun 16 18:28:21.610145 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 200/379] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:28:21 2022] PUT /compute/v2.1/os-hosts/n-d-846209-2 => generated 189 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:28:21.615093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-51f3adf1-931d-4e2b-a2ee-fd030b53dfab req-ecf792d6-f96f-4bde-9190-4b6c71772aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf781a8-6d20-42d8-8a48-4c62f18f815a", "name": "network-vif-plugged", "status": "completed", "tag": "28aa9ab0-5760-41d2-8199-2de4e727f2e6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:21.676486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-51f3adf1-931d-4e2b-a2ee-fd030b53dfab req-ecf792d6-f96f-4bde-9190-4b6c71772aed service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:21.676960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-51f3adf1-931d-4e2b-a2ee-fd030b53dfab req-ecf792d6-f96f-4bde-9190-4b6c71772aed service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:21.684767 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33f87077-00ec-4ed7-a08a-2941749e10b6 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.804975 Jun 16 18:28:21.690192 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 180/380] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:21.709137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d949059-d9e7-4d79-9291-4bd78496e343 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Action: 'update', calling method: .version_select at 0x7f866f527a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:21.720399 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-51f3adf1-931d-4e2b-a2ee-fd030b53dfab req-ecf792d6-f96f-4bde-9190-4b6c71772aed service nova] Creating event network-vif-plugged:28aa9ab0-5760-41d2-8199-2de4e727f2e6 for instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a on n-h2-846209-2 Jun 16 18:28:21.720769 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:21.720769 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:21.722143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2d949059-d9e7-4d79-9291-4bd78496e343 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b1bcfbac014c4f078602568d100c279e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff887f5087074b2d9534b42fe5da104b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d949059-d9e7-4d79-9291-4bd78496e343 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Request method failure captured: Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/os-hosts/n-d-846209-2 HTTP/1.1 Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 50 Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Y8QBgUMkJKkYKTsDUXKKiUDtfTQbdALBAt_yG5m9tw_nEm86tvCvi55Wsu7oM8hiOd2dYHL_zBrayT2GwFs8KOPsxaiF8z3kzxVSclwM1FyeMW1x0_SPxqVAL6pmhEh8oyyAnM-eMDycmJ6JrRwoL8cEgd8BiNep4VX6e-cklzU68 Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:21.724127 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff887f5087074b2d9534b42fe5da104b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff887f5087074b2d9534b42fe5da104b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: ff887f5087074b2d9534b42fe5da104b Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1569349000 Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b1bcfbac014c4f078602568d100c279e Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1569349000-project Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: {"status": "enable", "maintenance_mode": "enable"} Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 16 18:28:21.725352 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'n-d-846209-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:21.726199 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 16 18:28:21.727358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:21.728893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d949059-d9e7-4d79-9291-4bd78496e343 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:21.728893 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2d949059-d9e7-4d79-9291-4bd78496e343 tempest-HostsAdminNegativeTestJSON-1569349000 tempest-HostsAdminNegativeTestJSON-1569349000-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-846209-2" status: 403 len: 111 microversion: 2.1 time: 0.031506 Jun 16 18:28:21.728893 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 181/381] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:28:21 2022] PUT /compute/v2.1/os-hosts/n-d-846209-2 => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:21.746236 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-51f3adf1-931d-4e2b-a2ee-fd030b53dfab req-ecf792d6-f96f-4bde-9190-4b6c71772aed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135576 Jun 16 18:28:21.748606 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 201/382] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:21.785144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2982e8bf-08a9-4985-9944-ccf33f43e31d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.787331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:21.788011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:21.793553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2982e8bf-08a9-4985-9944-ccf33f43e31d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:21.824517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:21.824977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:21.836008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:21.839296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:22.321478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2982e8bf-08a9-4985-9944-ccf33f43e31d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:22.344365 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2982e8bf-08a9-4985-9944-ccf33f43e31d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1220 microversion: 2.1 time: 0.592130 Jun 16 18:28:22.358203 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 202/383] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1220 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:22.389666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfde051d-a2fe-4f9b-8275-66c681e40e96 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Action: 'update', calling method: .version_select at 0x7f8674150160>, body: {"status": null, "maintenance_mode": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfde051d-a2fe-4f9b-8275-66c681e40e96 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/os-hosts/n-d-846209-2 HTTP/1.1 Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 42 Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:22.409096 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: {"status": null, "maintenance_mode": null} Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 16 18:28:22.411532 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'n-d-846209-2', 'body': {'status': None, 'maintenance_mode': None}} Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'disable', Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'Enable', Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'Disable', Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance: Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi None Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:22.413088 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:22.416172 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:22.426501 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:28:22.426501 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:28:22.426501 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 16 18:28:22.426501 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.443291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfde051d-a2fe-4f9b-8275-66c681e40e96 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:22.460976 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bfde051d-a2fe-4f9b-8275-66c681e40e96 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-846209-2" status: 400 len: 127 microversion: 2.1 time: 0.097085 Jun 16 18:28:22.462596 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 203/384] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:28:22 2022] PUT /compute/v2.1/os-hosts/n-d-846209-2 => generated 127 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:28:22.486961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:22.500506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8371e026-c768-4100-9e9f-dbc25b183691 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86741d8d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:22.508877 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e32fda02-38c7-40cb-ba64-7b64a498b8c2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 0.773246 Jun 16 18:28:22.511135 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 182/385] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:21 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:22.517263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81739c36-66ae-4899-8faa-21df545e1d25 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Action: 'update', calling method: .version_select at 0x7f866f5700d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:22.550351 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:22.550351 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:22.551568 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.hosts [None req-81739c36-66ae-4899-8faa-21df545e1d25 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Enabling host nonexistent_hostname. Jun 16 18:28:22.576744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:22.587602 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-81739c36-66ae-4899-8faa-21df545e1d25 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81739c36-66ae-4899-8faa-21df545e1d25 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Request method failure captured: Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 50 Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ZBYcCfoBmNZk00OsF1A0b91d2nE5TDt_xTWbwKe8bc8pyH_UW6mxGlH6-WIeL2jFNmjJzQJELs2T8Qd_Yztzg_8lCCvbtQDGwOHEzZwcNBMwNocgS3dVjxqjSfqb8VATxHlCCAhXOWFhvCsaNCVyLMVWETp9X2LpFr19tM_DkXS0w Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:28:22.591667 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d6cde10762844ff99254858903002bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d6cde10762844ff99254858903002bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d6cde10762844ff99254858903002bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6d6cde10762844ff99254858903002bb Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-924875693 Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: a0530806ee364feca2b79a79fe9733f1 Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-HostsAdminNegativeTestJSON-924875693-project-admin Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: {"status": "enable", "maintenance_mode": "enable"} Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:22.593079 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 18:28:22.596346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:28:22.597401 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 18:28:22.598723 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.605133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81739c36-66ae-4899-8faa-21df545e1d25 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:22.606375 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81739c36-66ae-4899-8faa-21df545e1d25 tempest-HostsAdminNegativeTestJSON-924875693 tempest-HostsAdminNegativeTestJSON-924875693-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.093912 Jun 16 18:28:22.615531 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 183/386] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:28:22 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:28:22.683200 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8371e026-c768-4100-9e9f-dbc25b183691 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.213638 Jun 16 18:28:22.693267 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 204/387] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:22 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:23.383240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:23.384481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:23.431160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:23.434315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:23.444448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:23.454380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:23.541314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:23.542763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:23.572203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:23.578477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:23.582891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:23.586452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:23.822426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:23.832444 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-584173c0-b9af-4502-ad10-b48d35a5b24a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1224 microversion: 2.1 time: 0.460182 Jun 16 18:28:23.832676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 184/388] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:23 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1224 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:23.853613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a327bb0f-e60c-4457-9c3c-e805b446481b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4dcca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:24.162121 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a327bb0f-e60c-4457-9c3c-e805b446481b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.301556 Jun 16 18:28:24.163733 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 185/389] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:23 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:24.599874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:24.632594 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-13dd7ae7-b019-4ece-89ec-bd93730565e0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1313 microversion: 2.1 time: 1.100046 Jun 16 18:28:24.650389 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 205/390] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:23 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1313 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:24.865385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:24.866686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:24.876995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:24.877457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:24.878306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:24.878756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:25.259027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:25.282008 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-276098cf-aa9a-49a3-b024-83882016e95d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1280 microversion: 2.1 time: 0.417995 Jun 16 18:28:25.286727 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 206/391] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:24 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1280 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:25.305678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-970587594", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": "none"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:25.323469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5c75a4c-3bf4-4dab-8aa9-8a9993ebb0b7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86741583a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:25.560838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:25.563021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:25.564011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:25.564643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:25.565768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:25.567337 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5c75a4c-3bf4-4dab-8aa9-8a9993ebb0b7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.278869 Jun 16 18:28:25.575328 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 207/392] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:25 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:25.601042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:25.603452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:25.606891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:25.610077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:25.663609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:25.664248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:25.690032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:25.692919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:25.695717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:25.697211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:25.702184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Getting quotas for project 6407b9ce1734422fbaae081073e94cae. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:25.721428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Getting quotas for user 62925ce1fb6f4271995ae99fe83dd105 and project 6407b9ce1734422fbaae081073e94cae. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:25.766577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:25.772952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:25.985478 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31ce69a6-f9b0-45cb-ba92-9cadf1163460 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.167660 Jun 16 18:28:25.991877 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 186/393] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:28:26.029696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3290e6ef-0145-4946-9be7-4368aae6dbfc tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:26.035540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3290e6ef-0145-4946-9be7-4368aae6dbfc tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:26.560153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3290e6ef-0145-4946-9be7-4368aae6dbfc tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:26.580403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3290e6ef-0145-4946-9be7-4368aae6dbfc tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:26.588844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3290e6ef-0145-4946-9be7-4368aae6dbfc tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:26.631719 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3290e6ef-0145-4946-9be7-4368aae6dbfc tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "PUT /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1358 microversion: 2.75 time: 0.637492 Jun 16 18:28:26.638427 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 187/394] 10.222.0.27 () {62 vars in 1296 bytes} [Thu Jun 16 18:28:25 2022] PUT /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1358 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:26.662980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:26.664538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:26.738644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:26.744531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:26.756674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:26.757723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:27.179577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:27.196204 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-26ce2bcb-9f0d-48a4-a0ae-076004328ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1278 microversion: 2.1 time: 0.556050 Jun 16 18:28:27.203056 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 188/395] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:26 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1278 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:27.232889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0baf5b8b-f2fb-42b2-889a-6e91652a1dc1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f511820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:27.486273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:27.502601 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c72f8cf7-359b-407e-991d-cab1a26538f3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1463 microversion: 2.1 time: 1.844011 Jun 16 18:28:27.518407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0baf5b8b-f2fb-42b2-889a-6e91652a1dc1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.308993 Jun 16 18:28:27.524488 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 189/397] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:27 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:27.524816 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 208/397] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:25 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1463 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:27.550915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90a84fe3-e096-4e92-8acf-6dc12cc54e1d tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:27.561278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90a84fe3-e096-4e92-8acf-6dc12cc54e1d tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:28.207086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6d4f3240-a8ce-486f-b05a-b95a34e0b26e tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:28.207815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6d4f3240-a8ce-486f-b05a-b95a34e0b26e tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:28.228100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d4f3240-a8ce-486f-b05a-b95a34e0b26e tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:28.236799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d4f3240-a8ce-486f-b05a-b95a34e0b26e tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:28.240996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d4f3240-a8ce-486f-b05a-b95a34e0b26e tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:28.241544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d4f3240-a8ce-486f-b05a-b95a34e0b26e tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:28.426386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90a84fe3-e096-4e92-8acf-6dc12cc54e1d tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:28.447177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90a84fe3-e096-4e92-8acf-6dc12cc54e1d tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:28.457851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90a84fe3-e096-4e92-8acf-6dc12cc54e1d tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:28.497402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90a84fe3-e096-4e92-8acf-6dc12cc54e1d tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1358 microversion: 2.75 time: 0.970934 Jun 16 18:28:28.498560 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 190/398] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:27 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1358 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:28.520179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:28.521255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:28.538731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:28.539528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:28.542769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:28.545093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:28.893430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:30.208359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:30.249821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e87196db-0388-41ba-82a7-c4f53b7eda9c tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1278 microversion: 2.1 time: 1.737552 Jun 16 18:28:30.250723 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 191/399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:28 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1278 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:30.265170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af92319f-e2f7-486f-8823-3b67aa62697d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f50e550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:30.455776 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af92319f-e2f7-486f-8823-3b67aa62697d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.199969 Jun 16 18:28:30.463153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 192/400] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:30 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:30.478209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:30.479257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:30.500124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:30.500934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:30.501987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:30.502607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:31.340213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:31.377288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:31.379144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:31.404384 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dcb01c6d-1ef5-42cf-afa7-867f84ac67ed tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1416 microversion: 2.75 time: 0.936715 Jun 16 18:28:31.406753 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 193/401] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:30 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1416 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:31.665015 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6d4f3240-a8ce-486f-b05a-b95a34e0b26e tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1614 microversion: 2.1 time: 4.120351 Jun 16 18:28:31.674271 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 209/402] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:27 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1614 bytes in 4130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:31.689826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:31.695738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:31.735721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:31.737515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:31.739163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:31.740254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:32.281808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8611ba4-1873-47f4-86d4-43095cc57b57 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:32.333506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:32.376080 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8611ba4-1873-47f4-86d4-43095cc57b57 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.967723 Jun 16 18:28:32.391084 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 194/403] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:28:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:32.419436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5e57e2ad-7117-4b43-abbf-e47330e59fa0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4dc940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:32.716301 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5e57e2ad-7117-4b43-abbf-e47330e59fa0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.323004 Jun 16 18:28:32.738527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 195/404] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:32 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:32.758441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:32.772174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:32.816909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:32.834404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:32.835379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:32.844089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:32.857668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:33.315774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:33.341731 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7ac58770-e11a-49c9-838e-650ba2b798ba tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 1.661808 Jun 16 18:28:33.370936 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 210/405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:31 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:33.420036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '76023de61b274299a5e3b4815ab67990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa27497c68a47608861797aaf3efe6c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:33.422519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] flavor_id is None. Assuming migration. {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 16 18:28:33.423618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 18:28:34.736609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ea79f5b-98a1-41d3-816c-a20a13a1044f tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-543576058", "id": 2099322847, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:34.739683 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:34.739683 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:34.774469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=63 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:34.841549 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8ea79f5b-98a1-41d3-816c-a20a13a1044f tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 1.467957 Jun 16 18:28:34.843756 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 211/406] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:33 2022] POST /compute/v2.1/flavors => generated 424 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:34.868656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:34.869800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:34.951257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:34.952110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:34.953594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:34.971423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:35.643524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:35.684787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:35.727846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:35.746028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:35.789172 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-88195f1f-e4c5-4016-9eb2-e88b52aa51ba tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1437 microversion: 2.75 time: 0.941394 Jun 16 18:28:35.791972 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 212/407] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:34 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1437 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:35.818440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94348699-b941-45e1-97d5-b9fcd574debc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f8674150280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:36.066193 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94348699-b941-45e1-97d5-b9fcd574debc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.270965 Jun 16 18:28:36.070257 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 213/408] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:35 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:36.081203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:36.083062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:36.100084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:36.101706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:36.103830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:36.105045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:37.045025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0acbede5-2157-47fb-ba3f-2dc3d23a2063 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a/action" status: 202 len: 0 microversion: 2.1 time: 4.300862 Jun 16 18:28:37.049150 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 196/409] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:28:32 2022] POST /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a/action => generated 0 bytes in 4310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:28:37.064784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-19475823-079c-4965-ae19-577a1c5de594 req-228dd320-9ef6-49a5-9c91-c07ed5af5f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948cd76e-b18a-4f7b-8bf5-c5060f8b9d58", "tag": "1179feea-b5ba-47b2-8b8f-26cb4cba148c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:37.103197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-19475823-079c-4965-ae19-577a1c5de594 req-228dd320-9ef6-49a5-9c91-c07ed5af5f88 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:37.104234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-19475823-079c-4965-ae19-577a1c5de594 req-228dd320-9ef6-49a5-9c91-c07ed5af5f88 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:37.141216 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-19475823-079c-4965-ae19-577a1c5de594 req-228dd320-9ef6-49a5-9c91-c07ed5af5f88 service nova] Creating event network-changed:1179feea-b5ba-47b2-8b8f-26cb4cba148c for instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 on n-h2-846209-2 Jun 16 18:28:37.159048 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-19475823-079c-4965-ae19-577a1c5de594 req-228dd320-9ef6-49a5-9c91-c07ed5af5f88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106794 Jun 16 18:28:37.160806 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 197/410] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:37.196645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc7a5b68-97f2-45bc-ad4f-f44deea9c8ad tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:37.244590 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fc7a5b68-97f2-45bc-ad4f-f44deea9c8ad tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.077649 Jun 16 18:28:37.246027 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 198/411] 10.222.0.27 () {58 vars in 1181 bytes} [Thu Jun 16 18:28:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:28:37.247036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:37.261406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:37.267182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:37.288601 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-783153aa-dcad-4266-a754-818936762ab2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 1.206468 Jun 16 18:28:37.291605 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 214/412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:36 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:37.301435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:37.303273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:37.317469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:37.323366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:37.323680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:37.324829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:37.325894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:37.327235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:37.328076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:37.329496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:37.824337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:37.828701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:37.841741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:37.848138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:37.850857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:37.858065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:37.875596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78d52cc7-82e5-48bb-85b5-eb3d1a716016 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1472 microversion: 2.1 time: 0.581701 Jun 16 18:28:37.890269 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 215/413] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:37 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1472 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:37.915534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d01844c-1a12-4379-8dad-0b9ace3a9290 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86740c24c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:38.087256 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d01844c-1a12-4379-8dad-0b9ace3a9290 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.191480 Jun 16 18:28:38.089519 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 216/414] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:37 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:38.107040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1c1819f-623e-4752-b541-12f2ccdc52d1 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1270542535", "id": 48325405, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:38.113422 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:38.113422 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:38.144634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:38.177178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:38.179243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:38.182054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:38.189571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:38.192357 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1c1819f-623e-4752-b541-12f2ccdc52d1 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.097841 Jun 16 18:28:38.195668 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 217/415] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:38 2022] POST /compute/v2.1/flavors => generated 419 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:38.232838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78cf90b5-e904-40ec-91ad-e97f020dea9a tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:38.296633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78cf90b5-e904-40ec-91ad-e97f020dea9a tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.082424 Jun 16 18:28:38.298673 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 218/416] 10.222.0.27 () {58 vars in 1181 bytes} [Thu Jun 16 18:28:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:28:38.325041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:38.339339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:38.383056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:38.387295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:38.398273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:38.402132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:38.440476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:38.643852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:38.692032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:38.700669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:38.758472 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-82b4034e-a2b3-4728-ab41-ade91fd5779b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "POST /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1/action" status: 202 len: 1494 microversion: 2.75 time: 1.507840 Jun 16 18:28:38.779173 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 199/417] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:28:37 2022] POST /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1/action => generated 1494 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 16 18:28:38.805387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-409fdcdf-0778-4673-a0fe-28c24a54ffd6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Action: 'create', calling method: .version_select at 0x7f866f395af0>, body: {"keypair": {"name": "tempest-keypair-204874955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPO0qxFim80BRXc5wEysX1iqe2zyWAjRm9R2nBKXfYtNDfoTuNJ3EP9/hZ/wuYbURTglOUkVnYkPThPAeqMhhcYlR23X/zRAVnTJXAxCIaEzk3u42/cfsfHXLRt4ylRT9w=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:38.923721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-409fdcdf-0778-4673-a0fe-28c24a54ffd6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Getting quotas for project 5eb148860ba84601a7ff43b94223d7e5. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:38.956390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-409fdcdf-0778-4673-a0fe-28c24a54ffd6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Getting quotas for user f947f4cdaa0949d1894a458a1c84bbc8 and project 5eb148860ba84601a7ff43b94223d7e5. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:39.094949 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-409fdcdf-0778-4673-a0fe-28c24a54ffd6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.310774 Jun 16 18:28:39.099533 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 200/418] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:28:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:39.116737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:39.123718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:39.148408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:39.164215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:39.172014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:39.176479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:39.575654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:39.581874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=91 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:39.585885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:39.612113 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c02664a0-8c46-438b-ac70-a5e6ab5565f2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 1.303290 Jun 16 18:28:39.614111 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 219/419] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:38 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:39.616711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:39.632121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:39.634397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:39.635150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:39.648169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:39.649884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:39.653899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:39.655150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:39.677358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e5023306-5689-433e-862d-71b2f2f4e317 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1446 microversion: 2.75 time: 0.573641 Jun 16 18:28:39.678497 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 201/420] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:39 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1446 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:39.705557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2bf3898c-b4f2-4aee-b9eb-0b587db5cd21 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f3955e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:39.886756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2bf3898c-b4f2-4aee-b9eb-0b587db5cd21 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.203118 Jun 16 18:28:39.887718 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 202/421] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:39 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:40.632878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:40.634410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:40.647992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:40.654529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:40.657613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:40.658812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:40.817051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:40.841038 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0cd1cba5-48e7-4669-95c5-61b48edf6558 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1472 microversion: 2.1 time: 1.225210 Jun 16 18:28:40.844673 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 220/422] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:39 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1472 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:40.858880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:40.864762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:40.883628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:40.887929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:40.892843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:40.896166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:41.437510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:41.470408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:41.485253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:41.518056 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-750a168c-c821-46b7-99b2-ccfcef15f949 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1446 microversion: 2.75 time: 0.666651 Jun 16 18:28:41.521395 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 221/423] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:40 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1446 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:41.555846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d5a0f909-5e72-4550-8494-d190fc7a43ed tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86740f6a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:41.650267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:41.674822 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d5a0f909-5e72-4550-8494-d190fc7a43ed tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.151285 Jun 16 18:28:41.678297 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 222/424] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:41 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:41.697951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-791e7070-722b-4c02-8877-2c0e092c2a74 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 1.059793 Jun 16 18:28:41.719131 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 203/425] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:40 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:41.861176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:41.861884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:41.879660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:41.880261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:41.885982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:41.886520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:42.604048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:42.633432 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3583b7b2-9580-4519-9856-b61722dfdb5c tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1472 microversion: 2.1 time: 0.777883 Jun 16 18:28:42.635560 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 223/426] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:41 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1472 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:42.650456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:42.658158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:42.682334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:42.684313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:42.685375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:42.690322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:42.842483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:42.853601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:42.860681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:42.877739 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c1278434-8e01-4f02-910f-be076e966bda tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1446 microversion: 2.75 time: 0.236261 Jun 16 18:28:42.883097 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 224/427] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:42 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1446 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:43.123512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bf91218-9c8f-4d6e-a2d8-514414e90523 tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] Calling method '.version_select at 0x7f867435f820>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:43.131784 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:43.131784 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:43.236151 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bf91218-9c8f-4d6e-a2d8-514414e90523 tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.351115 Jun 16 18:28:43.240528 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 225/428] 10.222.0.27 () {60 vars in 1225 bytes} [Thu Jun 16 18:28:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:43.274045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae11b38d-0683-4137-a51c-45f73741f488 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f8674158310>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:43.307567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-478dde39-a9f0-4597-a950-9dc16d1c1b58 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Calling method '.version_select at 0x7f866f361ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:43.309302 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:43.309302 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:43.311164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-478dde39-a9f0-4597-a950-9dc16d1c1b58 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '4c38134b9d354d05b0760c27ae3c1ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76028242bd54cdfb39741d044a71ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-478dde39-a9f0-4597-a950-9dc16d1c1b58 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Request method failure captured: Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ZVGFtiGa_rBcSpNyFIKvFmiquKUqE8uOtoIc1aWxN2aZjeLbU_6WXEDFTlOmjkBKVU0S9FhM_MF1fFiZZ5GS0RwglXA3xMUeCiZhhNsHJb2ZS8H4acIA2ieaEIEEAwoZ1lboGhd6RIQ5W3nXHWIe0cvYiHFA74faeQ3vKzKii1tjY Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:43.335717 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c76028242bd54cdfb39741d044a71ad3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 4c38134b9d354d05b0760c27ae3c1ac5 Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: action_args: {} Jun 16 18:28:43.337165 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:43.338276 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 16 18:28:43.339410 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:43.340622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-478dde39-a9f0-4597-a950-9dc16d1c1b58 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:43.340622 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-478dde39-a9f0-4597-a950-9dc16d1c1b58 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.273881 Jun 16 18:28:43.360146 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 204/429] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jun 16 18:28:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:43.378385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:43.395577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:43.450536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:43.469476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:43.475417 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae11b38d-0683-4137-a51c-45f73741f488 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.224141 Jun 16 18:28:43.476336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:43.477241 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 226/430] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:43 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:43.479050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:43.502548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0168881d-01ae-4401-9244-cb0347671b9a tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] Action: 'update', calling method: .version_select at 0x7f86740c24c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:43.504241 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:43.504241 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:44.086319 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0168881d-01ae-4401-9244-cb0347671b9a tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.605199 Jun 16 18:28:44.090748 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 227/431] 10.222.0.27 () {62 vars in 1246 bytes} [Thu Jun 16 18:28:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:44.102040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54d5d337-4b06-4563-af1d-b553d555cf04 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Calling method '.version_select at 0x7f8674067940>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:44.105027 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:44.105027 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:44.110389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-54d5d337-4b06-4563-af1d-b553d555cf04 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '4c38134b9d354d05b0760c27ae3c1ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76028242bd54cdfb39741d044a71ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54d5d337-4b06-4563-af1d-b553d555cf04 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Request method failure captured: Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZVGFtiGa_rBcSpNyFIKvFmiquKUqE8uOtoIc1aWxN2aZjeLbU_6WXEDFTlOmjkBKVU0S9FhM_MF1fFiZZ5GS0RwglXA3xMUeCiZhhNsHJb2ZS8H4acIA2ieaEIEEAwoZ1lboGhd6RIQ5W3nXHWIe0cvYiHFA74faeQ3vKzKii1tjY Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:44.114490 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c76028242bd54cdfb39741d044a71ad3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 4c38134b9d354d05b0760c27ae3c1ac5 Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: action_args: {} Jun 16 18:28:44.116944 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:44.118289 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 16 18:28:44.120566 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:44.130058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54d5d337-4b06-4563-af1d-b553d555cf04 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:44.132184 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-54d5d337-4b06-4563-af1d-b553d555cf04 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.038248 Jun 16 18:28:44.133941 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 228/432] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:28:44 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:44.147230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:44.149014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:44.163476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:44.164647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:44.166426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:44.167641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:44.895781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:44.916789 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-60661813-bc5b-4d7f-b49d-396a284b6fa5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 1.551604 Jun 16 18:28:44.921625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:44.928616 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 205/433] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:43 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:44.934975 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eeb4f71f-1d32-47cb-9c71-87b064d431ca tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1472 microversion: 2.1 time: 0.799147 Jun 16 18:28:44.941759 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 229/434] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:44 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1472 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:44.958759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:44.960628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:44.966921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-05e23451-554e-4bb3-a50f-4f1bbe52ea92 tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] Calling method '.version_select at 0x7f867415daf0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:44.972627 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:44.972627 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:44.999811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:45.000624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:45.004682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:45.012568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:45.029295 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-05e23451-554e-4bb3-a50f-4f1bbe52ea92 tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.081664 Jun 16 18:28:45.045967 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 230/435] 10.222.0.27 () {60 vars in 1225 bytes} [Thu Jun 16 18:28:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:45.056984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1d417c0-6cbb-4b22-9c00-b69948f53fd8 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Calling method '.version_select at 0x7f866f7cf3a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:45.057894 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:45.057894 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:45.070819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c1d417c0-6cbb-4b22-9c00-b69948f53fd8 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '4c38134b9d354d05b0760c27ae3c1ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76028242bd54cdfb39741d044a71ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1d417c0-6cbb-4b22-9c00-b69948f53fd8 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Request method failure captured: Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZVGFtiGa_rBcSpNyFIKvFmiquKUqE8uOtoIc1aWxN2aZjeLbU_6WXEDFTlOmjkBKVU0S9FhM_MF1fFiZZ5GS0RwglXA3xMUeCiZhhNsHJb2ZS8H4acIA2ieaEIEEAwoZ1lboGhd6RIQ5W3nXHWIe0cvYiHFA74faeQ3vKzKii1tjY Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:28:45.081252 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c76028242bd54cdfb39741d044a71ad3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 4c38134b9d354d05b0760c27ae3c1ac5 Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: action_args: {} Jun 16 18:28:45.084041 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:45.085684 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 16 18:28:45.090003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:45.092617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1d417c0-6cbb-4b22-9c00-b69948f53fd8 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:45.092617 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c1d417c0-6cbb-4b22-9c00-b69948f53fd8 tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.035587 Jun 16 18:28:45.092617 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 231/436] 10.222.0.27 () {58 vars in 1178 bytes} [Thu Jun 16 18:28:45 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:45.103576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8cc1038-9d44-4044-bc2c-cd4776f70132 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f752e50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:45.214559 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8cc1038-9d44-4044-bc2c-cd4776f70132 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1412 microversion: 2.1 time: 0.125730 Jun 16 18:28:45.215588 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 232/437] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:45 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:45.230938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1d7bf09-fb8c-4cf8-b9e7-efe49e05cf17 tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] Action: 'update', calling method: .version_select at 0x7f867458aca0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:45.238707 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:45.238707 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:45.388071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f1d7bf09-fb8c-4cf8-b9e7-efe49e05cf17 tempest-QuotaClassesAdmin257Test-1948008001 tempest-QuotaClassesAdmin257Test-1948008001-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.171145 Jun 16 18:28:45.398836 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 233/438] 10.222.0.27 () {62 vars in 1246 bytes} [Thu Jun 16 18:28:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:28:45.435531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:45.485991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:45.493217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:45.550856 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-721fd976-b61c-4633-96c0-a73fb02d9ff8 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1446 microversion: 2.75 time: 0.620721 Jun 16 18:28:45.552748 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 206/439] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:44 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1446 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:45.960382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:45.968985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:45.969676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Calling method '.version_select at 0x7f8674067310>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:45.974665 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:45.974665 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:45.976564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:45.984633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:46.006813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:46.010602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:46.022102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:46.025101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:46.059584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:46.073455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:46.118283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:46.120384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:46.133074 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-453da036-97db-4bf3-8943-a6c7d68365e0 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.733417 Jun 16 18:28:46.134280 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 234/440] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:28:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:46.147044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:46.148238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:46.169429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:46.173571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:46.178295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:46.179361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:47.164551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:47.207964 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d90aad1a-698d-47a2-9464-a662bff421e0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 1.253848 Jun 16 18:28:47.220708 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 207/441] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:45 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:28:47.259520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c81fc5e1-339b-4a0f-b26b-e8820558edaa tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Calling method '.version_select at 0x7f866f329550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:47.270252 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:47.270252 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:47.272784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c81fc5e1-339b-4a0f-b26b-e8820558edaa tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '4c38134b9d354d05b0760c27ae3c1ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76028242bd54cdfb39741d044a71ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c81fc5e1-339b-4a0f-b26b-e8820558edaa tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Request method failure captured: Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ZVGFtiGa_rBcSpNyFIKvFmiquKUqE8uOtoIc1aWxN2aZjeLbU_6WXEDFTlOmjkBKVU0S9FhM_MF1fFiZZ5GS0RwglXA3xMUeCiZhhNsHJb2ZS8H4acIA2ieaEIEEAwoZ1lboGhd6RIQ5W3nXHWIe0cvYiHFA74faeQ3vKzKii1tjY Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:47.276018 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c76028242bd54cdfb39741d044a71ad3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 4c38134b9d354d05b0760c27ae3c1ac5 Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '1'} Jun 16 18:28:47.278646 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:47.280292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 16 18:28:47.282576 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.284421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c81fc5e1-339b-4a0f-b26b-e8820558edaa tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:47.284421 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c81fc5e1-339b-4a0f-b26b-e8820558edaa tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.056264 Jun 16 18:28:47.289377 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 208/442] 10.222.0.27 () {58 vars in 1172 bytes} [Thu Jun 16 18:28:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:47.305238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66bf04e0-c3ca-4195-9360-8b4078266f8a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f361160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:47.478266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66bf04e0-c3ca-4195-9360-8b4078266f8a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1421 microversion: 2.1 time: 0.191495 Jun 16 18:28:47.479841 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 209/443] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:47 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1421 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:47.489400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:47.490738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:47.511073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:47.516336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:47.521836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:47.523191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:47.648796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:47.677301 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff94194f-ea7a-4aaa-b176-786f2fb30df0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1472 microversion: 2.1 time: 1.541084 Jun 16 18:28:47.678616 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 235/444] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:46 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1472 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:47.692601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f41352ba-e570-4f62-b81f-5b382299f6f5 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Calling method '.version_select at 0x7f8674158c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:47.705251 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:47.705251 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:47.707266 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f41352ba-e570-4f62-b81f-5b382299f6f5 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] HTTP exception thrown: Hypervisor with ID '79423c53-5c71-4fb2-a85f-9b9802af5769' could not be found. Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f41352ba-e570-4f62-b81f-5b382299f6f5 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Request method failure captured: Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hypervisors/79423c53-5c71-4fb2-a85f-9b9802af5769/uptime HTTP/1.1 Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZZceydJ90klxlHMQfTmOi05F-cFCzVyiMlX_5buxpQXm4WDx_O4v9_srZwU5VolwFUn7zwubgemr3udRzZERaW94XqY9fOltycBrs4vL4iGOJuPZ7J3W9ZGphbCXk9kGqk1HHXjAL03FD56x5eJxnw78hE2yRCFqZTKjvp4PszcAc Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d4706c022d75492f9beccc9a4d41dad2 Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1740883854 Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:47.717631 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4706c022d75492f9beccc9a4d41dad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4706c022d75492f9beccc9a4d41dad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4706c022d75492f9beccc9a4d41dad2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4706c022d75492f9beccc9a4d41dad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1740883854 Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d4706c022d75492f9beccc9a4d41dad2 Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1740883854 Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: acf42f93c7574c97babfe6d6fd5bef45 Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: exception: Hypervisor with ID '79423c53-5c71-4fb2-a85f-9b9802af5769' could not be found. Jun 16 18:28:47.720358 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '79423c53-5c71-4fb2-a85f-9b9802af5769'} Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '79423c53-5c71-4fb2-a85f-9b9802af5769' Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 16 18:28:47.721766 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '79423c53-5c71-4fb2-a85f-9b9802af5769' could not be found. Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:47.736164 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '79423c53-5c71-4fb2-a85f-9b9802af5769' could not be found. Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f41352ba-e570-4f62-b81f-5b382299f6f5 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Returning 404 to user: Hypervisor with ID '79423c53-5c71-4fb2-a85f-9b9802af5769' could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f41352ba-e570-4f62-b81f-5b382299f6f5 tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/79423c53-5c71-4fb2-a85f-9b9802af5769/uptime" status: 404 len: 123 microversion: 2.1 time: 0.040904 Jun 16 18:28:47.743839 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 236/445] 10.222.0.27 () {58 vars in 1277 bytes} [Thu Jun 16 18:28:47 2022] GET /compute/v2.1/os-hypervisors/79423c53-5c71-4fb2-a85f-9b9802af5769/uptime => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:47.756368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59bcc4b7-11eb-4eb7-8bd3-4b8054943bbe tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f7ac5e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:47.953871 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-59bcc4b7-11eb-4eb7-8bd3-4b8054943bbe tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 200 len: 1421 microversion: 2.1 time: 0.229494 Jun 16 18:28:47.978246 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 237/446] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:28:47 2022] GET /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 1421 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:47.996782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Calling method '.version_select at 0x7f8674158c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:48.008769 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:48.008769 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:48.011530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:48.018592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:48.080857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:48.113878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:48.123008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:48.124925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:48.146270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:48.204189 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6cb7738a-54a9-4e3a-a13b-f69254cb28cb tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1446 microversion: 2.75 time: 0.712218 Jun 16 18:28:48.211470 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 210/447] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:47 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1446 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:48.233980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=77,nova_api:UPDATE=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:48.237173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:48.243805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:48.258106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1565769969", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "48325405", "adminPass": "***", "networks": [{"uuid": "3ed6b235-5ca9-45dd-b1c4-58fe3ed672de"}], "security_groups": [{"name": "tempest-securitygroup--1366285722"}], "key_name": "tempest-keypair-204874955", "user_data": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:48.285518 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-589d08ce-cb39-47d4-aa0a-488a3e4d531c tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.305054 Jun 16 18:28:48.303576 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 238/448] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:28:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:48.337421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfc8d447-59a3-4709-8538-e2cd9737d443 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f867435f4c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:49.006206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:49.066821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] validate_networks() for [('3ed6b235-5ca9-45dd-b1c4-58fe3ed672de', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:51.406047 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfc8d447-59a3-4709-8538-e2cd9737d443 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 204 len: 0 microversion: 2.1 time: 3.098660 Jun 16 18:28:51.409193 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 239/449] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:48 2022] DELETE /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 0 bytes in 3104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:28:51.418976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:51.420278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:51.447499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:51.449159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:51.455677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:51.457435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:51.644409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:51.646505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:51.647389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:51.648636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:51.649774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:51.715397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:51.731853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:51.739973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:51.741531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:51.817591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Getting quotas for project 5eb148860ba84601a7ff43b94223d7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:51.828950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:51.831319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Getting quotas for user f947f4cdaa0949d1894a458a1c84bbc8 and project 5eb148860ba84601a7ff43b94223d7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:51.873966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:51.880964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:51.993123 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-546e5bca-c828-42d3-b6f5-0fa93ad3daa1 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.769679 Jun 16 18:28:51.994622 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 211/450] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:52.009561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9379f81d-6e6f-4480-bbdb-af244a18e65c tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Calling method '.version_select at 0x7f866f31cb80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:52.011225 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:52.011225 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:52.013560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9379f81d-6e6f-4480-bbdb-af244a18e65c tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '4c38134b9d354d05b0760c27ae3c1ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76028242bd54cdfb39741d044a71ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9379f81d-6e6f-4480-bbdb-af244a18e65c tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Request method failure captured: Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ZVGFtiGa_rBcSpNyFIKvFmiquKUqE8uOtoIc1aWxN2aZjeLbU_6WXEDFTlOmjkBKVU0S9FhM_MF1fFiZZ5GS0RwglXA3xMUeCiZhhNsHJb2ZS8H4acIA2ieaEIEEAwoZ1lboGhd6RIQ5W3nXHWIe0cvYiHFA74faeQ3vKzKii1tjY Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:28:52.017646 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c76028242bd54cdfb39741d044a71ad3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c76028242bd54cdfb39741d044a71ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c76028242bd54cdfb39741d044a71ad3 Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765 Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 4c38134b9d354d05b0760c27ae3c1ac5 Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1723952765-project Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '1'} Jun 16 18:28:52.019421 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:28:52.020328 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 16 18:28:52.021633 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:28:52.024936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9379f81d-6e6f-4480-bbdb-af244a18e65c tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:52.027097 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9379f81d-6e6f-4480-bbdb-af244a18e65c tempest-HypervisorAdminNegativeTestJSON-1723952765 tempest-HypervisorAdminNegativeTestJSON-1723952765-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.031065 Jun 16 18:28:52.028809 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 212/451] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:28:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:52.039892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:52.040795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:52.052052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:52.052843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:52.054036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:52.055112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:52.241539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:52.255915 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-df8b5679-4387-4ccc-bc0d-5ef8822238f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 0.844018 Jun 16 18:28:52.277400 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 240/452] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:51 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:52.323926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:52.325208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:52.358617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:52.359543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:52.362836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:52.363298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:52.851204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:52.888847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:52.899531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:52.939277 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d52e7d9-f1eb-4709-bfa6-ebd82bd0fd06 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1446 microversion: 2.75 time: 0.659524 Jun 16 18:28:52.950872 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 241/453] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:52 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1446 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:52.991625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-545ef298-7ba3-4c6f-8d37-97a08b55bcd8 req-0858002c-44eb-4df7-ad75-41d5f37737dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948cd76e-b18a-4f7b-8bf5-c5060f8b9d58", "name": "network-vif-plugged", "status": "completed", "tag": "1179feea-b5ba-47b2-8b8f-26cb4cba148c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:53.051054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-545ef298-7ba3-4c6f-8d37-97a08b55bcd8 req-0858002c-44eb-4df7-ad75-41d5f37737dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:53.059125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-545ef298-7ba3-4c6f-8d37-97a08b55bcd8 req-0858002c-44eb-4df7-ad75-41d5f37737dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:53.125186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-545ef298-7ba3-4c6f-8d37-97a08b55bcd8 req-0858002c-44eb-4df7-ad75-41d5f37737dc service nova] Creating event network-vif-plugged:1179feea-b5ba-47b2-8b8f-26cb4cba148c for instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 on n-h2-846209-2 Jun 16 18:28:53.154142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-545ef298-7ba3-4c6f-8d37-97a08b55bcd8 req-0858002c-44eb-4df7-ad75-41d5f37737dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199938 Jun 16 18:28:53.165664 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 242/454] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:53.210377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:53.214607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:53.247733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:53.254135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:53.255826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:53.256657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:53.391850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:28:53.796087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:53.810586 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8c233a8-91cc-474c-8d0b-3dc007f126b9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 1.780276 Jun 16 18:28:53.819503 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 213/455] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:52 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:53.838392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:53.839620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:53.866261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:53.869533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:53.875239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:53.878612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:53.878952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-790b8052-191b-456d-804d-9cbc4a06b6db tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 204 len: 0 microversion: 2.1 time: 0.707641 Jun 16 18:28:53.881201 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 243/456] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:28:53 2022] DELETE /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:28:53.892966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-239db9d2-0b80-4bf7-bbe6-07c5adf6ba7a tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Calling method '.version_select at 0x7f867435f4c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:53.895250 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:53.895250 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:28:53.905416 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-239db9d2-0b80-4bf7-bbe6-07c5adf6ba7a tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] HTTP exception thrown: Hypervisor with ID '11fd58eb-2eea-4e11-bc34-55644809456d' could not be found. Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-239db9d2-0b80-4bf7-bbe6-07c5adf6ba7a tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Request method failure captured: Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-hypervisors/11fd58eb-2eea-4e11-bc34-55644809456d HTTP/1.1 Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZZceydJ90klxlHMQfTmOi05F-cFCzVyiMlX_5buxpQXm4WDx_O4v9_srZwU5VolwFUn7zwubgemr3udRzZERaW94XqY9fOltycBrs4vL4iGOJuPZ7J3W9ZGphbCXk9kGqk1HHXjAL03FD56x5eJxnw78hE2yRCFqZTKjvp4PszcAc Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d4706c022d75492f9beccc9a4d41dad2 Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1740883854 Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:53.910077 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4706c022d75492f9beccc9a4d41dad2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4706c022d75492f9beccc9a4d41dad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4706c022d75492f9beccc9a4d41dad2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4706c022d75492f9beccc9a4d41dad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1740883854 Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d4706c022d75492f9beccc9a4d41dad2 Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1740883854 Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: acf42f93c7574c97babfe6d6fd5bef45 Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: exception: Hypervisor with ID '11fd58eb-2eea-4e11-bc34-55644809456d' could not be found. Jun 16 18:28:53.912187 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '11fd58eb-2eea-4e11-bc34-55644809456d'} Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '11fd58eb-2eea-4e11-bc34-55644809456d' Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 16 18:28:53.913222 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:28:53.915758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '11fd58eb-2eea-4e11-bc34-55644809456d' could not be found. Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '11fd58eb-2eea-4e11-bc34-55644809456d' could not be found. Jun 16 18:28:53.917215 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:53.919016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-239db9d2-0b80-4bf7-bbe6-07c5adf6ba7a tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] Returning 404 to user: Hypervisor with ID '11fd58eb-2eea-4e11-bc34-55644809456d' could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:53.920799 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-239db9d2-0b80-4bf7-bbe6-07c5adf6ba7a tempest-HypervisorAdminNegativeTestJSON-1740883854 tempest-HypervisorAdminNegativeTestJSON-1740883854-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/11fd58eb-2eea-4e11-bc34-55644809456d" status: 404 len: 123 microversion: 2.1 time: 0.036802 Jun 16 18:28:53.921571 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 244/457] 10.222.0.27 () {58 vars in 1256 bytes} [Thu Jun 16 18:28:53 2022] GET /compute/v2.1/os-hypervisors/11fd58eb-2eea-4e11-bc34-55644809456d => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:53.930501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:53.931636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:53.942797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:53.943578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:53.944994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:53.945678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.342316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:54.372588 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-60ba3d4a-57c1-47e0-b24b-35a829c2801c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1256 microversion: 2.1 time: 0.551085 Jun 16 18:28:54.383437 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 214/458] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:53 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1256 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:54.396682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:54.398478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:54.412269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.413362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.415191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.416588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.574108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:54.586608 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e330951b-e25d-4b5e-a14d-2f31832d55f1 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1320 microversion: 2.1 time: 0.663156 Jun 16 18:28:54.593170 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 245/459] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:53 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1320 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:54.600016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1053260464", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "608da02e-c32f-4a3c-bcd7-760fd8a6c9d5"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:54.662854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:54.681940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:54.699795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:54.714769 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a0722d64-28e0-4f60-93c5-2176a9b4513b tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1446 microversion: 2.75 time: 0.328460 Jun 16 18:28:54.716598 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 215/460] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:54 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1446 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:54.731760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] validate_networks() for [('608da02e-c32f-4a3c-bcd7-760fd8a6c9d5', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:54.846411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:54.856212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:54.887767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.891958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.899614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.900725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:55.389571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=7 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:56.341499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:56.353513 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d829aa5a-aaa0-4229-b510-185ef6969860 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 1.517166 Jun 16 18:28:56.355182 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 216/461] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:54 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:56.361045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-27103d69-793d-4fa9-9068-a494c6e5645e req-a00529b8-a4b1-4d35-9d2b-c26104652520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2a156-987a-4ecc-a83e-d5c84b21d291", "name": "network-vif-unplugged", "status": "completed", "tag": "7b08401d-0478-4b2b-b87d-8c54b3a70e38"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:56.401840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-27103d69-793d-4fa9-9068-a494c6e5645e req-a00529b8-a4b1-4d35-9d2b-c26104652520 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.403949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-27103d69-793d-4fa9-9068-a494c6e5645e req-a00529b8-a4b1-4d35-9d2b-c26104652520 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:56.422444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:56.472387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-27103d69-793d-4fa9-9068-a494c6e5645e req-a00529b8-a4b1-4d35-9d2b-c26104652520 service nova] Creating event network-vif-unplugged:7b08401d-0478-4b2b-b87d-8c54b3a70e38 for instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 on n-h1-846209-2 Jun 16 18:28:56.486180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-27103d69-793d-4fa9-9068-a494c6e5645e req-a00529b8-a4b1-4d35-9d2b-c26104652520 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128292 Jun 16 18:28:56.488864 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 217/462] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:56.503130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:56.506953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:56.548325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.552247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:56.558618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.562964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:56.908404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:56.952489 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33106901-cd8c-4412-bb2f-4461fc9f2b04 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1318 microversion: 2.1 time: 0.459720 Jun 16 18:28:56.955053 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 218/463] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:56 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:56.978103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:56.978922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:56.989225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.990529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:56.991634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.992344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.504144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.524594 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8747b905-bad1-448a-9a39-cadb481623e8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1469 microversion: 2.1 time: 0.558618 Jun 16 18:28:57.526076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 219/464] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:56 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:57.533056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:57.535178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:57.557157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.558122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.559150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.559769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.889749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.900342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.902056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.922710 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69c4c3a8-cba2-44e9-aea4-1d8df3a42dbf tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1452 microversion: 2.75 time: 0.391032 Jun 16 18:28:57.923741 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 220/465] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:57 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1452 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:57.928880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:57.929528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:57.940332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.940923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.941844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.942439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.025960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:58.026744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:58.027276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:58.027797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:58.028523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:58.052979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.055831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.058889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.065208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.164853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:58.198575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for user 33f458b13d494ef7bc8e7055be73fa42 and project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:58.248595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:58.256858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:58.385014 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ebff712-5990-4ff0-83d2-6af0c443b5a7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.787480 Jun 16 18:28:58.387428 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 246/466] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:58.575509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:58.617575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90b60469-875b-489b-a73a-0bbd6fbfe2d6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 0.688080 Jun 16 18:28:58.636982 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 221/467] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:57 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:58.679489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:58.680945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:58.704553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.705199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.706331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.708106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.897012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:58.911884 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d86a055b-f521-482f-b207-6b682a6d374f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1318 microversion: 2.1 time: 0.272633 Jun 16 18:28:58.915464 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 222/468] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:58 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:59.324836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9adbd2c6-e00e-4354-b599-b671ec6f813f tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:59.325465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9adbd2c6-e00e-4354-b599-b671ec6f813f tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] [instance: cc57456e-7700-40f6-8f8a-5192fbcbcca3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.339558 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-9adbd2c6-e00e-4354-b599-b671ec6f813f tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] HTTP exception thrown: Instance cc57456e-7700-40f6-8f8a-5192fbcbcca3 could not be found. Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9adbd2c6-e00e-4354-b599-b671ec6f813f tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Request method failure captured: Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/cc57456e-7700-40f6-8f8a-5192fbcbcca3/action HTTP/1.1 Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 15 Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZCCVY3ZzTEMXFygWOaH3CpRKRXZtHlrdPyZBSBpCz8v_ufKbv0aTboD9uVUkOdQ8m6A3aHwk5fbOTm6O_YH96T4PXI9JWu5GEJAMfsp8PyCAaCMI2sxP197TwKzXsE7_iI-PYgsSpIvFoasNUmpDuRuh7xF5QXrNDmS8S4_x4Z2cw Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:28:59.351209 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50159c8a82854a948d4cb91a85338286"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50159c8a82854a948d4cb91a85338286", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ff6ac60428ee4e67ba4bc7e65c135f76 Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: {"migrate": {}} Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:28:59.352712 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance cc57456e-7700-40f6-8f8a-5192fbcbcca3 could not be found. Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'cc57456e-7700-40f6-8f8a-5192fbcbcca3', 'body': {'migrate': {}}} Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc57456e-7700-40f6-8f8a-5192fbcbcca3 could not be found. Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:59.353661 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc57456e-7700-40f6-8f8a-5192fbcbcca3 could not be found. Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc57456e-7700-40f6-8f8a-5192fbcbcca3 could not be found. Jun 16 18:28:59.355416 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:28:59.360876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9adbd2c6-e00e-4354-b599-b671ec6f813f tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Returning 404 to user: Instance cc57456e-7700-40f6-8f8a-5192fbcbcca3 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:59.363015 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9adbd2c6-e00e-4354-b599-b671ec6f813f tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cc57456e-7700-40f6-8f8a-5192fbcbcca3/action" status: 404 len: 111 microversion: 2.1 time: 0.962107 Jun 16 18:28:59.367147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 247/469] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:28:58 2022] POST /compute/v2.1/servers/cc57456e-7700-40f6-8f8a-5192fbcbcca3/action => generated 111 bytes in 968 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:59.384692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f4114873-7ce7-4a1e-b927-7e272da949ac tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.386471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f4114873-7ce7-4a1e-b927-7e272da949ac tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.599525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca25affa-8b70-4c46-87fd-34c559e67395 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.601109 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:28:59.601109 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:28:59.603252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca25affa-8b70-4c46-87fd-34c559e67395 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.603821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca25affa-8b70-4c46-87fd-34c559e67395 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.604670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca25affa-8b70-4c46-87fd-34c559e67395 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.605110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca25affa-8b70-4c46-87fd-34c559e67395 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.652207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f4114873-7ce7-4a1e-b927-7e272da949ac tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:59.674825 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f4114873-7ce7-4a1e-b927-7e272da949ac tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1208 microversion: 2.1 time: 0.305073 Jun 16 18:28:59.679557 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 248/470] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:59 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1208 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:59.701886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.713474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.741684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.749456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca25affa-8b70-4c46-87fd-34c559e67395 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.832581 Jun 16 18:28:59.752095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.754014 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 223/471] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:28:58 2022] GET /compute/v2.1/os-services => generated 944 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:59.767006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.767672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.771285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.778876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.804257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.805260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.806904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.819080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.440417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.487988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.495865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.536623 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67ae06fc-610f-4705-9f8f-b4f2ab7b76c6 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1452 microversion: 2.75 time: 0.851498 Jun 16 18:29:00.538262 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 249/472] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:59 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1452 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:00.564526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f22c810-1372-4040-8f7d-208d7dfedcea tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:00.578435 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:29:00.578435 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:29:00.584056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f22c810-1372-4040-8f7d-208d7dfedcea tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.587732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f22c810-1372-4040-8f7d-208d7dfedcea tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.596471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f22c810-1372-4040-8f7d-208d7dfedcea tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.598484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f22c810-1372-4040-8f7d-208d7dfedcea tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.712714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.744954 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-242d9d8d-c5dd-4667-a9b7-7a414b7d52f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 0.987838 Jun 16 18:29:00.754902 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 224/473] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:59 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:00.787684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:00.789740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:00.790949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f22c810-1372-4040-8f7d-208d7dfedcea tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-846209-2" status: 200 len: 578 microversion: 2.1 time: 0.242007 Jun 16 18:29:00.794949 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 250/474] 10.222.0.27 () {58 vars in 1171 bytes} [Thu Jun 16 18:29:00 2022] GET /compute/v2.1/os-services?host=n-d-846209-2 => generated 578 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:00.827610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-109694440", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:00.834402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.835802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.837679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.838717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.059467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:29:01.465552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:01.481738 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92e6f63a-db98-4d81-bc94-8fe149b721cd tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.722372 Jun 16 18:29:01.484411 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 225/475] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:00 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:01.496023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:01.501646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:01.526890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.532201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.539975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.547700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.834947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:01.858595 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-afab500a-2974-4fb3-b5eb-cda9c270932f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1278 microversion: 2.1 time: 0.369616 Jun 16 18:29:01.866497 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 226/476] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:01 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1278 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:01.869241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:01.906525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eccc0279-5a38-4efb-b839-43fc5401fefd tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:01.908246 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:29:01.908246 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:29:01.909656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccc0279-5a38-4efb-b839-43fc5401fefd tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.910145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccc0279-5a38-4efb-b839-43fc5401fefd tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.910969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccc0279-5a38-4efb-b839-43fc5401fefd tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.925164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccc0279-5a38-4efb-b839-43fc5401fefd tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.019007 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eccc0279-5a38-4efb-b839-43fc5401fefd tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.150429 Jun 16 18:29:02.022353 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 227/477] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:29:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:02.041521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:02.049964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:02.065566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.066418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.067599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.075541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.249391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:29:02.250598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:29:02.251267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:29:02.252045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:29:02.252629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:29:02.270555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.271303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.272430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:02.273708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.274228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.302756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Getting quotas for project 0f0fb2bcbf6f455a8f4f741a476ba81c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:02.308791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:02.311606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Getting quotas for user 37f5daa365b34a63a78ea4fb99ea9961 and project 0f0fb2bcbf6f455a8f4f741a476ba81c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:02.314236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:02.331129 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-43cc3352-6418-464c-b4cc-bd568c055720 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1437 microversion: 2.75 time: 0.307215 Jun 16 18:29:02.334696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 228/478] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:02 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1437 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:02.344619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:29:02.350653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:02.351608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:02.361118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:29:02.366958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.374511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.384323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.385771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.500611 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf37b59a-bba3-42a8-a16f-f0e69e569ec9 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.700634 Jun 16 18:29:02.505511 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 251/479] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:29:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:29:02.517850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-de4547c4-c1c4-4be9-bf6c-43702b063cf8 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:02.527659 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:29:02.527659 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:29:02.531108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4547c4-c1c4-4be9-bf6c-43702b063cf8 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.532107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4547c4-c1c4-4be9-bf6c-43702b063cf8 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.533276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4547c4-c1c4-4be9-bf6c-43702b063cf8 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.535419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4547c4-c1c4-4be9-bf6c-43702b063cf8 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.622341 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-de4547c4-c1c4-4be9-bf6c-43702b063cf8 tempest-ServicesAdminTestJSON-193280395 tempest-ServicesAdminTestJSON-193280395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.115023 Jun 16 18:29:02.624163 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 252/480] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:29:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:02.630996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-fd9d9e32-7f01-4cfa-98f2-f0dcc347785e req-82aba82f-7bad-4651-835c-acc769c97479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e2a156-987a-4ecc-a83e-d5c84b21d291", "name": "network-vif-deleted", "tag": "7b08401d-0478-4b2b-b87d-8c54b3a70e38"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:02.670601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fd9d9e32-7f01-4cfa-98f2-f0dcc347785e req-82aba82f-7bad-4651-835c-acc769c97479 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.688382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fd9d9e32-7f01-4cfa-98f2-f0dcc347785e req-82aba82f-7bad-4651-835c-acc769c97479 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.702072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:02.767824 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-fd9d9e32-7f01-4cfa-98f2-f0dcc347785e req-82aba82f-7bad-4651-835c-acc769c97479 service nova] Creating event network-vif-deleted:7b08401d-0478-4b2b-b87d-8c54b3a70e38 for instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 on n-h1-846209-2 Jun 16 18:29:02.782713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:02.788245 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-fd9d9e32-7f01-4cfa-98f2-f0dcc347785e req-82aba82f-7bad-4651-835c-acc769c97479 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161844 Jun 16 18:29:02.789359 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 253/481] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:02.817767 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d3c93f25-ff2e-413c-a003-ff85038cefd6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 0.463990 Jun 16 18:29:02.818870 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 229/482] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:02 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:02.847370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:02.853057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:02.935809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.943323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.945991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.955686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.327738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:03.362535 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46bdf3a8-20eb-4d11-931e-fe45cd59e1f5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.541752 Jun 16 18:29:03.378783 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 230/483] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:02 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:03.398705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ee9fff1d-ea58-47f2-a424-2b34c42d3ec4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:03.409899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ee9fff1d-ea58-47f2-a424-2b34c42d3ec4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:03.678018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ee9fff1d-ea58-47f2-a424-2b34c42d3ec4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:03.682872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:03.684915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:03.688760 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ee9fff1d-ea58-47f2-a424-2b34c42d3ec4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1221 microversion: 2.1 time: 0.307840 Jun 16 18:29:03.703436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.704048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.704610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.705930 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 231/484] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:03 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1221 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:03.709099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.711242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:03.711952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:03.728490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.729766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.731825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.733419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.881468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:03.932217 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf0985ab-a2bc-4f3f-ba4f-1fd7df18b2e6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1266 microversion: 2.1 time: 0.224645 Jun 16 18:29:03.937234 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 232/485] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:03 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:03.951672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:03.953520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:03.962713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.963919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.965289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.966955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.006055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:29:04.006855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:29:04.007639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:29:04.008294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:29:04.008939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:29:04.240318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:04.248906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.249367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.251555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.252085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.559809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:04.622703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:04.654846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d731d35-3f02-4429-afaa-c32166ee26bf tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 0.712898 Jun 16 18:29:04.659664 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 233/486] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:03 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:04.677624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:04.682527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:04.703007 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c2dca6a5-1ece-4811-b559-86bab2c07534 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1/action" status: 202 len: 1940 microversion: 2.75 time: 1.901011 Jun 16 18:29:04.703007 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 254/487] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:29:02 2022] POST /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1/action => generated 1940 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 16 18:29:04.721110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:04.722886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:04.723544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.726855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.729880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.734158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.768761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.769254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.774560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.796978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.985541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:05.010664 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-865319fc-0176-4c09-83a5-db54e1e83834 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1273 microversion: 2.1 time: 0.299243 Jun 16 18:29:05.012822 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 255/488] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:04 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:05.383410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3ed71f71-9af2-4512-a2e8-c979b82cec6c tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Action: 'create', calling method: .version_select at 0x7f866f7f0670>, body: {"keypair": {"name": "tempest-keypair-472718868", "type": "ssh", "user_id": "326d7344e89c476bafe2ea209101e87e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/FF9LvzrMLV8UbsGgJO97fJKZ2nuYLZ3VDAPtK2XSUkadR7tBcAF57fiCZ2TpLNOP2rZRMGwwj2jg6hGKDgyPP6czBD1xbwLJulSJgAxFcCF/vq/quDOgGykVkWkaZDg=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:05.432714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:05.448739 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6039cf2-278a-424b-ae16-b94632d1047b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.785415 Jun 16 18:29:05.449773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 234/489] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:04 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:05.484349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:05.486669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:05.501969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3ed71f71-9af2-4512-a2e8-c979b82cec6c tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Getting quotas for project f29835f8aacb4f378f4e6bf20e884fb8. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:05.510811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.511424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:05.512292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.512743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:05.535904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3ed71f71-9af2-4512-a2e8-c979b82cec6c tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Getting quotas for user dc2049167b054a88a438bbe60b9473e1 and project f29835f8aacb4f378f4e6bf20e884fb8. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:05.584335 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3ed71f71-9af2-4512-a2e8-c979b82cec6c tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.566904 Jun 16 18:29:05.585447 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 256/490] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:29:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 571 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:29:05.609890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:05.610762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:05.628461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.628756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:05.629802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.634977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:05.873813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:06.014578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:06.037500 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b506804-fe3c-4490-ba23-ac9be91b1756 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.584783 Jun 16 18:29:06.054172 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 235/491] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:05 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:06.070525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0b58d23c-95a6-4fdc-b7fe-1ff78203d70b tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Action: 'create', calling method: .version_select at 0x7f866f4dc8b0>, body: {"keypair": {"name": "tempest-keypair-68547278", "type": "ssh", "user_id": "326d7344e89c476bafe2ea209101e87e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQlYXuR+twF+dn1gMt4ZYa48bE7nQpka0uce0WZXSzVN9iNa1hqSPg/4Sn6XO/9rxv971WIpdoEHXyYiZ7MMODWcmdQptrFosrTvMF3FtnQPlEwG0u4ljNk0tDGvN3yKA=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:06.074619 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e79b70f6-bb4c-4ad2-81b9-e33a2d2d4782 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.478070 Jun 16 18:29:06.076304 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 257/492] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:05 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:06.092170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-0b58d23c-95a6-4fdc-b7fe-1ff78203d70b tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Getting quotas for project f29835f8aacb4f378f4e6bf20e884fb8. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:06.099195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-0b58d23c-95a6-4fdc-b7fe-1ff78203d70b tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Getting quotas for user dc2049167b054a88a438bbe60b9473e1 and project f29835f8aacb4f378f4e6bf20e884fb8. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:06.119241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:06.120532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:06.152710 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0b58d23c-95a6-4fdc-b7fe-1ff78203d70b tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.096204 Jun 16 18:29:06.162431 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 236/493] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:29:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:29:06.183738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:06.184760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:06.186342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.187197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:06.188620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.189432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:06.195245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.196178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:06.199296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.200092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:06.245670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:06.897236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:06.927305 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3cd7371a-5831-4e89-81cb-bc7a77a13930 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1279 microversion: 2.1 time: 0.762556 Jun 16 18:29:06.928267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 237/494] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:06 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1279 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:06.941249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-624158d7-bb09-43f5-bc5f-800fe4c1f306 tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Calling method '.version_select at 0x7f866f2d1940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:06.956444 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-624158d7-bb09-43f5-bc5f-800fe4c1f306 tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-472718868?user_id=326d7344e89c476bafe2ea209101e87e" status: 200 len: 511 microversion: 2.10 time: 0.025536 Jun 16 18:29:06.958463 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 238/495] 10.222.0.27 () {60 vars in 1336 bytes} [Thu Jun 16 18:29:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-472718868?user_id=326d7344e89c476bafe2ea209101e87e => generated 511 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:29:06.971910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:06.972572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:06.979537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.979998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:06.980815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.981482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.223310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:07.236940 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-db508ab3-b6c5-42d8-8d34-3db437dd4cd5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 1.137356 Jun 16 18:29:07.237807 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 258/496] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:06 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:07.252734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ed8198d8-ad7c-4ce1-8690-0aca0c1ba07c req-13512d65-e6d1-4ece-8a81-5add4c994b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0c26f5-b935-4e31-b1d5-853ceef1469a", "tag": "d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:07.264324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ed8198d8-ad7c-4ce1-8690-0aca0c1ba07c req-13512d65-e6d1-4ece-8a81-5add4c994b5f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.264970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ed8198d8-ad7c-4ce1-8690-0aca0c1ba07c req-13512d65-e6d1-4ece-8a81-5add4c994b5f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.280385 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ed8198d8-ad7c-4ce1-8690-0aca0c1ba07c req-13512d65-e6d1-4ece-8a81-5add4c994b5f service nova] Creating event network-changed:d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5 for instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a on n-h2-846209-2 Jun 16 18:29:07.286651 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ed8198d8-ad7c-4ce1-8690-0aca0c1ba07c req-13512d65-e6d1-4ece-8a81-5add4c994b5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046681 Jun 16 18:29:07.287765 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 259/497] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:07.295837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22e7fae5-93fc-4ac7-b727-7023882a32cc tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Action: 'create', calling method: .version_select at 0x7f866f5d61f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1127914167", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBNIst+4Td8ajILbnI6jvjgVetY5poHbYTVLFDdcVYM93zewsaFnNRa1Euxqpy3rGdV8v3pirXlxz+p77vBfR0ZhAKvpaWXjrejRgJbylD3/uZk5Sd7tVnLvjyAzuPq8w=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:07.303288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:07.321786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-22e7fae5-93fc-4ac7-b727-7023882a32cc tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Getting quotas for project f29835f8aacb4f378f4e6bf20e884fb8. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:07.331634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-22e7fae5-93fc-4ac7-b727-7023882a32cc tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Getting quotas for user dc2049167b054a88a438bbe60b9473e1 and project f29835f8aacb4f378f4e6bf20e884fb8. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:07.384558 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22e7fae5-93fc-4ac7-b727-7023882a32cc tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.093300 Jun 16 18:29:07.392130 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 260/498] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:29:07 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:29:07.399820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.401850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:07.423328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.434199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.437644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.438587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.490614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:07.514734 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cee880c1-7848-47c7-aea6-093ae19cbac6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.552459 Jun 16 18:29:07.542057 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 239/499] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:06 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:07.573029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.577140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:07.584346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:07.595129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.596630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.604460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.608405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.674832 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc6c69eb-1637-4aaa-9aef-de443a103cd9 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.286814 Jun 16 18:29:07.677490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 261/500] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:07 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:07.690700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f0f9e633-9cdf-4a11-8374-32a2ebc4b2dc tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Calling method '.version_select at 0x7f866f5aeee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.695750 n-d-846209-2 devstack@n-api.service[119207]: WARNING oslo_db.sqlalchemy.utils [None req-f0f9e633-9cdf-4a11-8374-32a2ebc4b2dc tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 18:29:07.708978 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f0f9e633-9cdf-4a11-8374-32a2ebc4b2dc tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=326d7344e89c476bafe2ea209101e87e" status: 200 len: 723 microversion: 2.10 time: 0.025887 Jun 16 18:29:07.710287 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 262/501] 10.222.0.27 () {60 vars in 1258 bytes} [Thu Jun 16 18:29:07 2022] GET /compute/v2.1/os-keypairs?user_id=326d7344e89c476bafe2ea209101e87e => generated 723 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:29:07.721072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-25a25d79-335e-4a99-b4a5-2fdbef05062e tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Calling method '.version_select at 0x7f867435f820>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.745799 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-25a25d79-335e-4a99-b4a5-2fdbef05062e tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1127914167" status: 204 len: 0 microversion: 2.10 time: 0.028453 Jun 16 18:29:07.750226 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 263/502] 10.222.0.27 () {60 vars in 1324 bytes} [Thu Jun 16 18:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1127914167 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 18:29:07.757077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fff0434b-6063-471e-b5d0-94b74b3d2026 tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Calling method '.version_select at 0x7f866f584d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.786194 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fff0434b-6063-471e-b5d0-94b74b3d2026 tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-68547278?user_id=326d7344e89c476bafe2ea209101e87e" status: 204 len: 0 microversion: 2.10 time: 0.034250 Jun 16 18:29:07.787383 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 264/503] 10.222.0.27 () {60 vars in 1336 bytes} [Thu Jun 16 18:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-68547278?user_id=326d7344e89c476bafe2ea209101e87e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:29:07.816308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6db1de4a-c1a2-468c-a43c-81625b9a8d46 tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] Calling method '.version_select at 0x7f866f5aeca0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.868234 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6db1de4a-c1a2-468c-a43c-81625b9a8d46 tempest-KeyPairsV210TestJSON-928667000 tempest-KeyPairsV210TestJSON-928667000-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472718868?user_id=326d7344e89c476bafe2ea209101e87e" status: 204 len: 0 microversion: 2.10 time: 0.073875 Jun 16 18:29:07.884879 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 265/504] 10.222.0.27 () {60 vars in 1339 bytes} [Thu Jun 16 18:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472718868?user_id=326d7344e89c476bafe2ea209101e87e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:29:07.956456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.957232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:07.985948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.986694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.988059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.988540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:08.340751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:08.357517 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-288f0dad-23cb-410e-b187-d59e27a0f390 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.801584 Jun 16 18:29:08.369439 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 240/505] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:07 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:08.377361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:08.378399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:08.386264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:08.387332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:08.389545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:08.390862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.096646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:09.114940 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af56f2c8-bb92-485e-8e9c-431ff4f16240 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 1.170555 Jun 16 18:29:09.115789 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 266/506] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:07 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:09.120960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:09.121981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:09.146610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.147454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.148778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.149861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.197094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:09.207441 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-faa47fda-8d0a-4ac8-b2b4-5ef863fd026d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1477 microversion: 2.1 time: 0.836437 Jun 16 18:29:09.229372 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 241/507] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:08 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1477 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:09.243954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:09.253123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:09.277789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.278429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.279960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.280423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.437818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:09.477516 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bb5b88c6-5ea7-41bf-896e-d4bc2dacd10b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.246465 Jun 16 18:29:09.478859 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 242/508] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:09 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:09.492852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:09.495802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:09.505576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.506557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.507740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.508456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.587799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:09.620303 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-956ad923-64b8-4f47-b21b-782c6c774659 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.501484 Jun 16 18:29:09.623709 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 267/509] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:09 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:09.663305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-df909d77-7f62-45e4-83dd-11f93b8acd6a req-d230c75c-816f-42a7-8ef8-ea03494f4fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a485eb4a-1ede-45ad-86b0-2b290fcef08e", "tag": "678519fa-e046-4180-b534-f4379e0029d6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:09.686208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-df909d77-7f62-45e4-83dd-11f93b8acd6a req-d230c75c-816f-42a7-8ef8-ea03494f4fa0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.688431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-df909d77-7f62-45e4-83dd-11f93b8acd6a req-d230c75c-816f-42a7-8ef8-ea03494f4fa0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.731442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-df909d77-7f62-45e4-83dd-11f93b8acd6a req-d230c75c-816f-42a7-8ef8-ea03494f4fa0 service nova] Creating event network-changed:678519fa-e046-4180-b534-f4379e0029d6 for instance a485eb4a-1ede-45ad-86b0-2b290fcef08e on n-h1-846209-2 Jun 16 18:29:09.749992 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-df909d77-7f62-45e4-83dd-11f93b8acd6a req-d230c75c-816f-42a7-8ef8-ea03494f4fa0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122931 Jun 16 18:29:09.751863 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 268/510] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:09.967666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:09.987970 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5aeb902b-12e1-4367-b4bc-f237a41d4a48 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.498624 Jun 16 18:29:09.989928 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 243/511] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:09 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:10.145894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:10.149436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:10.170829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.172849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.174285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.175085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.237234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:10.239407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:10.264290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.264980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.265660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.266399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.591717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:10.603459 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9c29810-d033-4e62-9b70-ffbbc1be4cde tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 0.465868 Jun 16 18:29:10.604914 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 269/512] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:10 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:10.623274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:10.624539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:10.632881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.633451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.634388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.635256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.650674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:10.664793 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15f8fece-5eb6-4280-937a-f0ef41dc55ff tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1476 microversion: 2.1 time: 0.436240 Jun 16 18:29:10.665333 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 244/513] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:10 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:10.674646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:10.675286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:10.683010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:10.690115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.690959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.691983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.692705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.962424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:11.021061 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-176b0062-f9f7-45a5-a937-e3f05b0d1356 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.413778 Jun 16 18:29:11.022145 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 270/514] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:10 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:11.039260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-31306639-272b-4574-a2ae-8b84490dfab7 req-cea5d127-e46e-4787-bde4-e0661a3e1ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf781a8-6d20-42d8-8a48-4c62f18f815a", "name": "network-vif-unplugged", "status": "completed", "tag": "28aa9ab0-5760-41d2-8199-2de4e727f2e6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:11.054998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-31306639-272b-4574-a2ae-8b84490dfab7 req-cea5d127-e46e-4787-bde4-e0661a3e1ee9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:11.055734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-31306639-272b-4574-a2ae-8b84490dfab7 req-cea5d127-e46e-4787-bde4-e0661a3e1ee9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:11.078189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-31306639-272b-4574-a2ae-8b84490dfab7 req-cea5d127-e46e-4787-bde4-e0661a3e1ee9 service nova] Creating event network-vif-unplugged:28aa9ab0-5760-41d2-8199-2de4e727f2e6 for instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a on n-h1-846209-2 Jun 16 18:29:11.111319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-31306639-272b-4574-a2ae-8b84490dfab7 req-cea5d127-e46e-4787-bde4-e0661a3e1ee9 service nova] Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:29:11.146977 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-31306639-272b-4574-a2ae-8b84490dfab7 req-cea5d127-e46e-4787-bde4-e0661a3e1ee9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121817 Jun 16 18:29:11.151313 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 271/515] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:11.170228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:11.171851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:11.193323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:11.194283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:11.195457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:11.196092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:11.375506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:11.388823 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0442ad0e-03d9-4dfd-bd79-5b02983f7c21 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.721031 Jun 16 18:29:11.391655 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 245/516] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:10 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:11.398806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-49233ecd-028a-4786-b9a6-90786f488268 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f866f2c29d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:11.494424 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-49233ecd-028a-4786-b9a6-90786f488268 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657" status: 200 len: 637 microversion: 2.1 time: 0.100487 Jun 16 18:29:11.496212 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 246/517] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:29:11 2022] GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657 => generated 637 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:11.519238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5003bb78-3834-4049-a5f3-cf1602cfb120 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update_all', calling method: .version_select at 0x7f866f2d1280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:11.647011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5003bb78-3834-4049-a5f3-cf1602cfb120 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:11.660266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5003bb78-3834-4049-a5f3-cf1602cfb120 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:11.965416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:11.998880 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e35bc67c-031b-4905-bfb9-171475557b4f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.844394 Jun 16 18:29:12.000099 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 272/518] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:11 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:12.009157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:12.019385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:12.043132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.049598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.051812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.059514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.277510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:12.567046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:12.583464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:12.597425 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-77ca0b79-ac69-451a-8b84-dc0e13795251 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 0.595384 Jun 16 18:29:12.598075 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 273/519] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:12 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:12.611626 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5003bb78-3834-4049-a5f3-cf1602cfb120 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 61 microversion: 2.1 time: 1.103314 Jun 16 18:29:12.613266 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 247/520] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:11 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 61 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:12.614129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:12.616090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:12.624268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:12.625931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:12.631652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.631652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.635299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.635781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.643859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.645965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.648053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.650428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.895412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:12.938540 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-530ec2ad-abff-4f4f-989f-515f296d3290 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.323024 Jun 16 18:29:12.943015 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 248/521] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:12 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:12.949353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:12.950575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:12.975323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.976229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.977663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.978471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:13.375026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:13.379086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:13.400265 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1c036f6-c0eb-4931-8ac3-2b79393853a3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1476 microversion: 2.1 time: 0.801054 Jun 16 18:29:13.406735 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 274/522] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:12 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1476 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:13.422194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9cc86a36-d0ab-4459-9b84-89faa4aeaffd tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f86740f6d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:14.016163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:14.027816 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0422bea-9ee9-4f07-a34c-84f69c398608 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 1.083081 Jun 16 18:29:14.036914 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 249/523] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:12 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:14.046357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:14.048002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:14.069725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.071741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.073565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.079142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.405714 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9cc86a36-d0ab-4459-9b84-89faa4aeaffd tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "DELETE /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.997016 Jun 16 18:29:14.408691 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 275/524] 10.222.0.27 () {58 vars in 1295 bytes} [Thu Jun 16 18:29:13 2022] DELETE /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata/os_version => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:29:14.418919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3ae0e423-1f74-4534-9abe-eca46996bb6e req-3f0621d6-1da6-4b82-9ee9-7764ce1f17eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebd5662-211a-4190-a06c-995fd1975f80", "tag": "a75ce07e-707d-4021-9b43-4ef6293429c2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:14.441766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3ae0e423-1f74-4534-9abe-eca46996bb6e req-3f0621d6-1da6-4b82-9ee9-7764ce1f17eb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.443674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3ae0e423-1f74-4534-9abe-eca46996bb6e req-3f0621d6-1da6-4b82-9ee9-7764ce1f17eb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.485085 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3ae0e423-1f74-4534-9abe-eca46996bb6e req-3f0621d6-1da6-4b82-9ee9-7764ce1f17eb service nova] Creating event network-changed:a75ce07e-707d-4021-9b43-4ef6293429c2 for instance 8ebd5662-211a-4190-a06c-995fd1975f80 on n-h1-846209-2 Jun 16 18:29:14.509382 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3ae0e423-1f74-4534-9abe-eca46996bb6e req-3f0621d6-1da6-4b82-9ee9-7764ce1f17eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097907 Jun 16 18:29:14.520796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 276/525] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:14.540653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-dcd9a6c0-78d0-4ae8-8a68-a6a5e9823a54 req-62f0d355-d71c-44b0-a398-a9043bcd327a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf781a8-6d20-42d8-8a48-4c62f18f815a", "tag": "28aa9ab0-5760-41d2-8199-2de4e727f2e6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:14.566464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dcd9a6c0-78d0-4ae8-8a68-a6a5e9823a54 req-62f0d355-d71c-44b0-a398-a9043bcd327a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.567392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dcd9a6c0-78d0-4ae8-8a68-a6a5e9823a54 req-62f0d355-d71c-44b0-a398-a9043bcd327a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.592947 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-dcd9a6c0-78d0-4ae8-8a68-a6a5e9823a54 req-62f0d355-d71c-44b0-a398-a9043bcd327a service nova] Creating event network-changed:28aa9ab0-5760-41d2-8199-2de4e727f2e6 for instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a on n-h1-846209-2 Jun 16 18:29:14.609136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-dcd9a6c0-78d0-4ae8-8a68-a6a5e9823a54 req-62f0d355-d71c-44b0-a398-a9043bcd327a service nova] Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:29:14.633780 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-dcd9a6c0-78d0-4ae8-8a68-a6a5e9823a54 req-62f0d355-d71c-44b0-a398-a9043bcd327a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109387 Jun 16 18:29:14.635868 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 277/526] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:14.648395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:14.650924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:14.669444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.671491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.674294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.675820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.892498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:14.906155 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-689b712d-dbef-4bb5-8c21-cef823f0084a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.866792 Jun 16 18:29:14.907153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 250/527] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:14 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:14.922644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:14.923688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:14.931320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.932118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.933192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.933834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:15.124665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:15.166112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:15.180714 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-110c330c-52be-4231-8b88-1e0eb1c8507b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.261919 Jun 16 18:29:15.182088 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 251/528] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:14 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:15.188964 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-96f1c0b1-5d70-4f14-9cf4-4aa474fc3c27 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 0.549124 Jun 16 18:29:15.201949 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 278/529] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:14 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:15.208826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3036acb6-6507-4c1b-a6c4-c9c5396275af tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f866f395dc0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:15.214089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:15.215166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:15.275303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:15.275890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:15.277375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:15.279460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:15.335226 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3036acb6-6507-4c1b-a6c4-c9c5396275af tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 37 microversion: 2.1 time: 0.151058 Jun 16 18:29:15.346077 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 252/530] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:29:15 2022] GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 37 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:15.385468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:15.392480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:15.424532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:15.425201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:15.430420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:15.436537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:15.900291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:15.915903 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-422e5dc0-f237-40af-84bd-09c6a5cf342b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1476 microversion: 2.1 time: 0.723668 Jun 16 18:29:15.923355 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 279/531] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:15 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1476 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:15.928252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:15.940649 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2324ae17-f13a-4fb5-ae1b-f12785e81558 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.592758 Jun 16 18:29:15.956611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3b4d2f7-65bd-4197-86ab-b593faaab4a9 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update_all', calling method: .version_select at 0x7f866f769280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:15.959172 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 253/532] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:15 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:15.964661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-556dd35b-d783-463a-a2ba-b23ba90d7f03 req-3487cdea-b59c-4a9e-a25e-3cc1ad5475e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0c26f5-b935-4e31-b1d5-853ceef1469a", "name": "network-vif-plugged", "status": "completed", "tag": "d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:15.989035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-556dd35b-d783-463a-a2ba-b23ba90d7f03 req-3487cdea-b59c-4a9e-a25e-3cc1ad5475e7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:15.989522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-556dd35b-d783-463a-a2ba-b23ba90d7f03 req-3487cdea-b59c-4a9e-a25e-3cc1ad5475e7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.015580 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-556dd35b-d783-463a-a2ba-b23ba90d7f03 req-3487cdea-b59c-4a9e-a25e-3cc1ad5475e7 service nova] Creating event network-vif-plugged:d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5 for instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a on n-h2-846209-2 Jun 16 18:29:16.023920 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-556dd35b-d783-463a-a2ba-b23ba90d7f03 req-3487cdea-b59c-4a9e-a25e-3cc1ad5475e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062794 Jun 16 18:29:16.025289 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 254/533] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:16.033565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:16.034586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:16.043753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.044641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.046568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.048343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.081711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f3b4d2f7-65bd-4197-86ab-b593faaab4a9 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:16.093491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f3b4d2f7-65bd-4197-86ab-b593faaab4a9 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:16.514681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:16.539517 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c6d5e19c-8375-435f-87f9-0ca83b4d3fb4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.512170 Jun 16 18:29:16.542993 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 255/534] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:16 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:16.559465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:16.560360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:16.568992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.569748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.570948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.572383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.760945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:16.771430 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3b4d2f7-65bd-4197-86ab-b593faaab4a9 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.846572 Jun 16 18:29:16.772123 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 280/535] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:15 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 61 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:16.779460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:16.780682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:16.788777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.789549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.790628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.791080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.798358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c4ffc56-77f0-4af2-997a-a9229e4432b4 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.243254 Jun 16 18:29:16.812659 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 256/536] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:16 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:16.812659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d73bbe58-7ca8-4a1c-bc9f-46b251699c9a tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f866f361160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:16.896062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d73bbe58-7ca8-4a1c-bc9f-46b251699c9a tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.094862 Jun 16 18:29:16.897147 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 257/537] 10.222.0.27 () {58 vars in 1289 bytes} [Thu Jun 16 18:29:16 2022] GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata/os_distro => generated 33 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:16.909564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-023e2a7f-5fa9-4929-8ef1-5487a1e1c817 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update_all', calling method: .version_select at 0x7f866f2d1670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:17.023876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-023e2a7f-5fa9-4929-8ef1-5487a1e1c817 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:17.030989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-023e2a7f-5fa9-4929-8ef1-5487a1e1c817 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:17.068955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:17.083060 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a70182a-e46a-479a-9081-ebbcc199a325 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 0.309195 Jun 16 18:29:17.094206 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 281/538] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:16 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:17.103934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:17.104640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:17.112928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.113389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.114431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.114880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.354577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:17.378319 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c1456a6-789a-4bbf-9b24-ad30165e63bd tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1474 microversion: 2.1 time: 0.282348 Jun 16 18:29:17.380240 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 282/539] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:17 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1474 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:17.390899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:17.391760 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-023e2a7f-5fa9-4929-8ef1-5487a1e1c817 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.485639 Jun 16 18:29:17.392202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:17.393961 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 258/540] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:16 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:17.404517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.405406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.406790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.407549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.413416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-73eddc4f-792a-4fc7-8f23-6982694236e0 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f866f329b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:17.498659 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-73eddc4f-792a-4fc7-8f23-6982694236e0 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.096730 Jun 16 18:29:17.507017 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 259/541] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:29:17 2022] GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 61 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:29:17.515405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b5fed4ab-9cf3-4812-a0c5-d9bc31e8d6c1 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update_all', calling method: .version_select at 0x7f866f21eca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:17.595578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5fed4ab-9cf3-4812-a0c5-d9bc31e8d6c1 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:17.601368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5fed4ab-9cf3-4812-a0c5-d9bc31e8d6c1 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:17.702543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:17.721051 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e0cc20a5-6e0b-4cca-970f-c090526e2c5f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1386 microversion: 2.1 time: 0.338373 Jun 16 18:29:17.732861 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 283/542] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:17 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1386 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:17.746596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:17.748341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:17.755695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.756145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.757145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.757589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.014811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:18.038252 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e476493b-ff20-4d90-8519-7ca199b18c28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.302930 Jun 16 18:29:18.039920 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 284/543] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:17 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:18.052810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:18.054519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:18.068474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.069699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.072246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.073565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.150748 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b5fed4ab-9cf3-4812-a0c5-d9bc31e8d6c1 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.640457 Jun 16 18:29:18.152460 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 260/544] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:17 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 61 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:29:18.166143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-20dc71df-050a-4c38-b814-423266782602 req-35c17998-9a79-4317-b98a-f317631d1c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a485eb4a-1ede-45ad-86b0-2b290fcef08e", "name": "network-vif-plugged", "status": "completed", "tag": "678519fa-e046-4180-b534-f4379e0029d6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:18.189575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20dc71df-050a-4c38-b814-423266782602 req-35c17998-9a79-4317-b98a-f317631d1c8c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.191770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20dc71df-050a-4c38-b814-423266782602 req-35c17998-9a79-4317-b98a-f317631d1c8c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.216424 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-20dc71df-050a-4c38-b814-423266782602 req-35c17998-9a79-4317-b98a-f317631d1c8c service nova] Creating event network-vif-plugged:678519fa-e046-4180-b534-f4379e0029d6 for instance a485eb4a-1ede-45ad-86b0-2b290fcef08e on n-h1-846209-2 Jun 16 18:29:18.227590 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-20dc71df-050a-4c38-b814-423266782602 req-35c17998-9a79-4317-b98a-f317631d1c8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072281 Jun 16 18:29:18.229790 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 261/545] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:18.233714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:18.244401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:18.249789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:18.258996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-34b5ed33-188f-40cb-9e95-73e54591d2c1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.216810 Jun 16 18:29:18.259980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.260167 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 285/546] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:18 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:18.260402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.271292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.272014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.275495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:18.290296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a019dce-3cf3-471a-aa2a-15e41c57fff4 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update_all', calling method: .version_select at 0x7f866f7ac160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:18.414211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1a019dce-3cf3-471a-aa2a-15e41c57fff4 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:18.440172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1a019dce-3cf3-471a-aa2a-15e41c57fff4 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:18.571962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:18.584922 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-005f3a42-3364-40d8-9492-dc5906a8e7a8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 0.351361 Jun 16 18:29:18.585756 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 262/547] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:18 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:18.594615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:18.596093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:18.616958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.620057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.621754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.622679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.926855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:18.947781 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9727811-df18-40cd-8bda-a183e0faffa6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1471 microversion: 2.1 time: 0.360222 Jun 16 18:29:18.949120 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 263/548] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:18 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:18.959259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:18.960558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:18.988644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.989586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.995072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.996743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.087858 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a019dce-3cf3-471a-aa2a-15e41c57fff4 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 64 microversion: 2.1 time: 0.825868 Jun 16 18:29:19.091538 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 286/549] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:18 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 64 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:19.105302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e1236a37-c393-4e15-8d2d-5db9f61ae085 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:19.107238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e1236a37-c393-4e15-8d2d-5db9f61ae085 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:19.124541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1236a37-c393-4e15-8d2d-5db9f61ae085 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.125854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1236a37-c393-4e15-8d2d-5db9f61ae085 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.127664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1236a37-c393-4e15-8d2d-5db9f61ae085 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.129518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1236a37-c393-4e15-8d2d-5db9f61ae085 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.324408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:19.326852 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e1236a37-c393-4e15-8d2d-5db9f61ae085 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a/action" status: 204 len: 0 microversion: 2.1 time: 0.231937 Jun 16 18:29:19.328383 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 287/550] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:19 2022] POST /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a/action => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:29:19.346239 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-47accad2-0a00-4043-89f2-48937134ecec tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1584 microversion: 2.1 time: 0.395429 Jun 16 18:29:19.347128 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 264/551] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:18 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1584 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:19.355080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-574bbe1f-639e-4c46-b9d1-c9ef62ca559d tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f866f2c23a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:19.362998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:19.381092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:19.395919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.397530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.399348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.400384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.424703 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-574bbe1f-639e-4c46-b9d1-c9ef62ca559d tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 64 microversion: 2.1 time: 0.075398 Jun 16 18:29:19.426195 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 265/552] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:29:19 2022] GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 64 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:19.434271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:19.435987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:19.446443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.447322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.449122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.449996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.622030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:19.649723 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-64504ad4-7b02-42b4-90f7-9ee1fc2a78d1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.220978 Jun 16 18:29:19.663111 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 266/553] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:19 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:19.664745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:19.669590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:19.685627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.686368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.689061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.689828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.811601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:19.819926 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b05c3d0-2c50-4779-b55d-77a6299104eb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1308 microversion: 2.1 time: 0.488192 Jun 16 18:29:19.835551 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 288/554] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:19 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:19.835551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ceed74e-eedd-4b18-8734-60c7594a7ca0 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:19.835551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5ceed74e-eedd-4b18-8734-60c7594a7ca0 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:19.835551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ceed74e-eedd-4b18-8734-60c7594a7ca0 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.836097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ceed74e-eedd-4b18-8734-60c7594a7ca0 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.836097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ceed74e-eedd-4b18-8734-60c7594a7ca0 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.836097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ceed74e-eedd-4b18-8734-60c7594a7ca0 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.062894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:20.084395 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2fe5951-ed9a-4912-98d7-63af6e354e90 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1471 microversion: 2.1 time: 0.429355 Jun 16 18:29:20.086036 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 267/555] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:19 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:20.093304 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ceed74e-eedd-4b18-8734-60c7594a7ca0 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.270916 Jun 16 18:29:20.095029 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 289/556] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:29:19 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:20.110375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-171bc30c-40cc-48d8-abe2-8b1d328c0fd2 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update_all', calling method: .version_select at 0x7f866f21e5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:20.110965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:20.112136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:20.154243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.155024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.156432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.157243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.287806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-171bc30c-40cc-48d8-abe2-8b1d328c0fd2 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:20.301778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-171bc30c-40cc-48d8-abe2-8b1d328c0fd2 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:20.905603 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-171bc30c-40cc-48d8-abe2-8b1d328c0fd2 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.813033 Jun 16 18:29:20.913355 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 268/557] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:20 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 61 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:20.921336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:20.923735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:20.937317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.938210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.939272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.939996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.245828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:21.258295 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-74817aa6-23d5-41f6-a4f6-83cdb939047a tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 1.161307 Jun 16 18:29:21.259604 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 290/558] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:20 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:21.267682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:21.269060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:21.278209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.279224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.280256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.281734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.355852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:21.404112 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d4d12981-4269-477d-a56f-106705c5c426 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.481083 Jun 16 18:29:21.406471 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 269/559] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:20 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:21.412872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c57cd42-f952-4d3b-a3aa-98bed782bdd3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update', calling method: .version_select at 0x7f866f2d1af0>, body: {"meta": {"os_version": "alt"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:21.479879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7c57cd42-f952-4d3b-a3aa-98bed782bdd3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:21.487725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7c57cd42-f952-4d3b-a3aa-98bed782bdd3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:21.804264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:21.818324 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a66bb18-fdab-44cc-a4c4-61ebdfba0941 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1489 microversion: 2.1 time: 0.557331 Jun 16 18:29:21.821656 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 291/560] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:21 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1489 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:21.838926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:21.840187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:21.864648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.865391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.867020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.871241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.009031 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c57cd42-f952-4d3b-a3aa-98bed782bdd3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.600462 Jun 16 18:29:22.009853 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 270/561] 10.222.0.27 () {60 vars in 1312 bytes} [Thu Jun 16 18:29:21 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata/os_version => generated 31 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:22.016978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-13b2e65a-210c-4fd3-aaec-6dac912ffdae req-6ecfce52-934b-4170-935a-5a4c25da66b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf781a8-6d20-42d8-8a48-4c62f18f815a", "name": "network-vif-plugged", "status": "completed", "tag": "28aa9ab0-5760-41d2-8199-2de4e727f2e6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:22.041441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-13b2e65a-210c-4fd3-aaec-6dac912ffdae req-6ecfce52-934b-4170-935a-5a4c25da66b3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.042799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-13b2e65a-210c-4fd3-aaec-6dac912ffdae req-6ecfce52-934b-4170-935a-5a4c25da66b3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.066486 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-13b2e65a-210c-4fd3-aaec-6dac912ffdae req-6ecfce52-934b-4170-935a-5a4c25da66b3 service nova] Creating event network-vif-plugged:28aa9ab0-5760-41d2-8199-2de4e727f2e6 for instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a on n-h1-846209-2 Jun 16 18:29:22.091657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-13b2e65a-210c-4fd3-aaec-6dac912ffdae req-6ecfce52-934b-4170-935a-5a4c25da66b3 service nova] Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:29:22.116183 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-13b2e65a-210c-4fd3-aaec-6dac912ffdae req-6ecfce52-934b-4170-935a-5a4c25da66b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104664 Jun 16 18:29:22.118686 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 271/562] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:22.126381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-077b0733-8240-4719-b388-bc7e73a45bf2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:22.141861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-077b0733-8240-4719-b388-bc7e73a45bf2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.142516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-077b0733-8240-4719-b388-bc7e73a45bf2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.331944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-077b0733-8240-4719-b388-bc7e73a45bf2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Going to try to stop instance {{(pid=119206) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:29:22.458132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:22.471992 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d3f966a-0e55-4c46-9964-54c389d2a85a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1471 microversion: 2.1 time: 0.648959 Jun 16 18:29:22.476804 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 292/563] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:21 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1471 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:22.508315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aec99364-0015-4db9-bca4-5896ac6255de tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f866f5b95e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:22.520467 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-077b0733-8240-4719-b388-bc7e73a45bf2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e/action" status: 202 len: 0 microversion: 2.1 time: 0.396638 Jun 16 18:29:22.526245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 272/564] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:22 2022] POST /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:29:22.546552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:22.547543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:22.554950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.555450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.556359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.556799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.632449 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aec99364-0015-4db9-bca4-5896ac6255de tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 58 microversion: 2.1 time: 0.151188 Jun 16 18:29:22.633053 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 293/565] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:29:22 2022] GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 58 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:22.638240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:22.639126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:22.665159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.665611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.666482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.666902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.917039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:22.932254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:22.946714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:22.949123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-971f2704-cfab-4da0-b3b6-84c70f968cd5 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.314909 Jun 16 18:29:22.951696 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 294/566] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:22 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:22.966065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:22.971380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:22.989571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.990429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.991555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.992244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.608413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:23.635418 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b3d897b6-e1f4-42e7-b5a7-464952c63a80 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 1.101959 Jun 16 18:29:23.640300 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 273/567] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:22 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:23.659510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3dfa3c1f-9270-43a1-a2ca-6df691dc86c3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'update_all', calling method: .version_select at 0x7f866f233af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:23.833628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3dfa3c1f-9270-43a1-a2ca-6df691dc86c3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:23.839460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3dfa3c1f-9270-43a1-a2ca-6df691dc86c3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:23.898317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:23.911665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b08b35f-c052-4917-be60-0228ac8efcea tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.957420 Jun 16 18:29:23.913992 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 295/568] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:22 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:23.929657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:23.930789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:23.955287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.955524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.956318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.958810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.492713 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3dfa3c1f-9270-43a1-a2ca-6df691dc86c3 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.849019 Jun 16 18:29:24.493327 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 274/569] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:23 2022] PUT /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 61 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:24.499121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:24.499775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:24.515743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.516336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.517429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.517966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.645019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:24.645693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.656062 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c2d7bbaa-0a50-42a0-b2f7-ad1d9bdb3a00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1463 microversion: 2.1 time: 0.739855 Jun 16 18:29:24.670930 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 296/570] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:23 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1463 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:24.678283 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3bab3a93-c2b4-4262-8c06-ae6310823f77 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.180885 Jun 16 18:29:24.679718 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 275/571] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:24 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:24.688689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:24.689797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:24.694516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:24.703147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.703931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.704214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4e45295-96e3-487a-97fc-db0458aae4c8 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Action: 'create', calling method: .version_select at 0x7f866f5d65e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:24.705506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.706180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.834935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a4e45295-96e3-487a-97fc-db0458aae4c8 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:24.854836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a4e45295-96e3-487a-97fc-db0458aae4c8 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Getting quotas for user de6e6571a82948aaa11f159863b9f438 and project ad76e92b2e654080a86221788560ece2. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:25.401927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:25.422572 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-93edcb4b-de68-481c-ab3e-e61e7a2bbdc0 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 0.740588 Jun 16 18:29:25.424973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 276/572] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:24 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:25.439528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-67857cb1-65cf-4a76-baf9-ab6ca787cbaf tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:25.440304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-67857cb1-65cf-4a76-baf9-ab6ca787cbaf tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:25.448126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67857cb1-65cf-4a76-baf9-ab6ca787cbaf tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.449148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67857cb1-65cf-4a76-baf9-ab6ca787cbaf tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.451208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67857cb1-65cf-4a76-baf9-ab6ca787cbaf tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.451895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67857cb1-65cf-4a76-baf9-ab6ca787cbaf tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.735939 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a4e45295-96e3-487a-97fc-db0458aae4c8 tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "POST /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 85 microversion: 2.1 time: 1.059536 Jun 16 18:29:25.736518 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 297/573] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Jun 16 18:29:24 2022] POST /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 85 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:25.743341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:25.743974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:25.761545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.763002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.766248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.767016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.952360 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-67857cb1-65cf-4a76-baf9-ab6ca787cbaf tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1614 microversion: 2.1 time: 0.522734 Jun 16 18:29:25.953879 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 277/574] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1614 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:25.959749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2f9720d3-c144-45d0-bdf2-37409f8fe422 req-fa0e3950-5248-4b65-bc4d-962ec86746e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebd5662-211a-4190-a06c-995fd1975f80", "name": "network-vif-plugged", "status": "completed", "tag": "a75ce07e-707d-4021-9b43-4ef6293429c2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:25.970369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2f9720d3-c144-45d0-bdf2-37409f8fe422 req-fa0e3950-5248-4b65-bc4d-962ec86746e2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.971096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2f9720d3-c144-45d0-bdf2-37409f8fe422 req-fa0e3950-5248-4b65-bc4d-962ec86746e2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.985520 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2f9720d3-c144-45d0-bdf2-37409f8fe422 req-fa0e3950-5248-4b65-bc4d-962ec86746e2 service nova] Creating event network-vif-plugged:a75ce07e-707d-4021-9b43-4ef6293429c2 for instance 8ebd5662-211a-4190-a06c-995fd1975f80 on n-h1-846209-2 Jun 16 18:29:25.991946 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2f9720d3-c144-45d0-bdf2-37409f8fe422 req-fa0e3950-5248-4b65-bc4d-962ec86746e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036536 Jun 16 18:29:25.993379 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 278/575] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:25.999369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.001206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:26.010134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.010947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.011904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.012557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.309927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:26.354883 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-13197338-7d97-4532-86ef-1c0c742f310b tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.359825 Jun 16 18:29:26.355711 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 279/576] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:26.368424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-39ef57a7-960b-4fc7-b092-830dd0382d6d tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] Calling method '.version_select at 0x7f866f2d1670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.463462 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-39ef57a7-960b-4fc7-b092-830dd0382d6d tempest-ImagesMetadataTestJSON-731287278 tempest-ImagesMetadataTestJSON-731287278-project] 10.222.0.27 "GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata" status: 200 len: 85 microversion: 2.1 time: 0.106372 Jun 16 18:29:26.470471 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 280/577] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:29:26 2022] GET /compute/v2.1/images/03bf2012-2df1-491f-b382-68992b680657/metadata => generated 85 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:29:26.485283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.486289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:26.509372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.512198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.514413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.515230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.579348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.596407 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b19a6733-3864-458e-86c7-fc94e2a48822 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.858716 Jun 16 18:29:26.597003 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 298/578] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:26.608829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-40b3709f-70bc-4c87-8c6b-a026c2042b12 req-9c689e8e-2ca6-4503-baec-80645918def6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0c26f5-b935-4e31-b1d5-853ceef1469a", "tag": "d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:26.626690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-40b3709f-70bc-4c87-8c6b-a026c2042b12 req-9c689e8e-2ca6-4503-baec-80645918def6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.627405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-40b3709f-70bc-4c87-8c6b-a026c2042b12 req-9c689e8e-2ca6-4503-baec-80645918def6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.659904 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-40b3709f-70bc-4c87-8c6b-a026c2042b12 req-9c689e8e-2ca6-4503-baec-80645918def6 service nova] Creating event network-changed:d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5 for instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a on n-h2-846209-2 Jun 16 18:29:26.672592 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-40b3709f-70bc-4c87-8c6b-a026c2042b12 req-9c689e8e-2ca6-4503-baec-80645918def6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074088 Jun 16 18:29:26.673957 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 299/579] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:26.679273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0630f60-6ae1-4fd8-bba4-285cbfde5c0b tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '.version_select at 0x7f866f7ac160>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.692295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0630f60-6ae1-4fd8-bba4-285cbfde5c0b tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.693728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0630f60-6ae1-4fd8-bba4-285cbfde5c0b tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.714686 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b0630f60-6ae1-4fd8-bba4-285cbfde5c0b tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.039264 Jun 16 18:29:26.716452 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 300/580] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:29:26 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:26.729192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.730245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:26.753737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.754371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.755013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.755441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.449097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.461847 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-07b1456b-b9bd-41ae-a7a1-7a9f3b09aee8 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 200 len: 1584 microversion: 2.1 time: 0.990192 Jun 16 18:29:27.466118 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 281/581] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:26 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 1584 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:27.477845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-773015570", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:27.590157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:29:27.769714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.785381 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78645789-69d8-4ea9-8c4e-8be4a7e051f5 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1321 microversion: 2.1 time: 1.065720 Jun 16 18:29:27.786055 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 301/582] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:26 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1321 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:27.799864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:27.804792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:27.817510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.818014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.821538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.822099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.177901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:28.220225 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-edb6917b-0693-40fd-8f68-c2bfd4d8d949 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.428528 Jun 16 18:29:28.221318 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 302/583] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:27 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:28.238656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:28.240187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:28.258667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.264228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.266465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.269950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.490746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:29:28.491280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:29:28.491737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:29:28.492120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:29:28.492544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:29:28.525707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.527159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.532144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.534289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.585716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:28.593648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for user 209d0e879aea45269c56a7c7d9869b23 and project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:28.611728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:29:28.615584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:29:28.646048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:28.663201 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4f1b0433-fedc-4eaa-bf2f-938665408757 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.440622 Jun 16 18:29:28.663862 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 303/584] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:28 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:28.721002 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b5f0569c-8565-4a21-9ce5-e5ebb8dfff50 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253280 Jun 16 18:29:28.724099 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 282/585] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:29:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:29:28.745457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53c9d5e3-6b4d-4089-b2a2-32d9f727ad2d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:28.746434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53c9d5e3-6b4d-4089-b2a2-32d9f727ad2d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:28.804952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:28.805584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:28.835874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.837872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.843398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.846379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.906482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:28.933048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53c9d5e3-6b4d-4089-b2a2-32d9f727ad2d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:28.944062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=35 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:28.949174 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53c9d5e3-6b4d-4089-b2a2-32d9f727ad2d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1212 microversion: 2.1 time: 0.217729 Jun 16 18:29:28.952609 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 304/586] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:28 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1212 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:29.189818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.205432 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-428ec212-025d-48a7-bda4-124c8f3ace20 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1471 microversion: 2.1 time: 0.405259 Jun 16 18:29:29.206703 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 283/587] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:28 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1471 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:29.241603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:29.242587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:29.252602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:29.253633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:29.271720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.274420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.274702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.275479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.282279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.284211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.285088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.287825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.391556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lazy-loading 'flavor' on Instance uuid 8ebd5662-211a-4190-a06c-995fd1975f80 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:29.648613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:29.672671 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-07892280-652a-4984-9a23-64f4412e7b61 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80/action" status: 202 len: 0 microversion: 2.1 time: 0.432424 Jun 16 18:29:29.677299 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 305/588] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:29 2022] POST /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:29:29.698633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2579ec77-8305-478c-834d-fb245dafdb05 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:29.702456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2579ec77-8305-478c-834d-fb245dafdb05 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:29.718431 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d5c966c8-853b-479c-ae72-8003b55d5ec7 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.472214 Jun 16 18:29:29.738894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2579ec77-8305-478c-834d-fb245dafdb05 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.738894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2579ec77-8305-478c-834d-fb245dafdb05 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.738894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2579ec77-8305-478c-834d-fb245dafdb05 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.739560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2579ec77-8305-478c-834d-fb245dafdb05 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.739729 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 284/589] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:29 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:29.740070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:29.741848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:29.766228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.775270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.776458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.777102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:30.530893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:30.562601 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb3c28bc-4c53-4b6d-9739-7b9b38e4220a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.831201 Jun 16 18:29:30.596056 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 285/590] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:29 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:30.618076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:30.620584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:30.652302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:30.654601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:30.656590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:30.658019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:30.925895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:31.004265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a0d9558e-7588-4e55-9c18-742a50f5c827 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1272 microversion: 2.1 time: 0.405518 Jun 16 18:29:31.071085 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 286/591] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:30 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1272 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:31.088991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:31.091321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:31.107672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.108305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.109235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.109793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.563749 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2579ec77-8305-478c-834d-fb245dafdb05 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1630 microversion: 2.1 time: 1.883927 Jun 16 18:29:31.570699 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 306/592] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:29 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1630 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:31.602924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:31.603612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:31.622243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.626380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.627492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.632792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.825618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:31.877048 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9edbe71c-30d2-4720-9da4-bbc6e823edc1 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.804103 Jun 16 18:29:31.877946 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 287/593] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:31 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:32.069424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:32.070098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:32.087944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.088423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.089221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.089889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.249560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:32.258928 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b59c5c27-dc50-4d08-b99f-4b94da19193b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1270 microversion: 2.1 time: 0.193328 Jun 16 18:29:32.270951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 288/594] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:32 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:32.297122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:32.315024 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3093343a-85dd-4615-81bd-1b90db7a91df tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.716024 Jun 16 18:29:32.316063 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 307/595] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:31 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:32.602131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69864ee9-afef-4dde-bbd5-13761636ee87 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:32.602820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69864ee9-afef-4dde-bbd5-13761636ee87 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:32.617472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69864ee9-afef-4dde-bbd5-13761636ee87 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.622779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69864ee9-afef-4dde-bbd5-13761636ee87 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.624428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69864ee9-afef-4dde-bbd5-13761636ee87 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.625088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69864ee9-afef-4dde-bbd5-13761636ee87 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.924476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:32.929045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:32.955154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.955724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.957033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.957588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.202142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:33.247384 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69864ee9-afef-4dde-bbd5-13761636ee87 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1613 microversion: 2.1 time: 0.649500 Jun 16 18:29:33.256326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 289/596] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:32 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1613 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:33.273712 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a318dca1-abbc-4d91-b047-4bd499b86937 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.372727 Jun 16 18:29:33.285965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:33.285965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:33.288055 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 308/597] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:32 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:33.302385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.302948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.303869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.304322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.319697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:33.320446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:33.341424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.341882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.355439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.356942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.764078 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] HTTP exception thrown: Cannot 'migrate' instance 8ebd5662-211a-4190-a06c-995fd1975f80 while it is in vm_state suspended Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Request method failure captured: Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80/action HTTP/1.1 Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 15 Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZCCVY3ZzTEMXFygWOaH3CpRKRXZtHlrdPyZBSBpCz8v_ufKbv0aTboD9uVUkOdQ8m6A3aHwk5fbOTm6O_YH96T4PXI9JWu5GEJAMfsp8PyCAaCMI2sxP197TwKzXsE7_iI-PYgsSpIvFoasNUmpDuRuh7xF5QXrNDmS8S4_x4Z2cw Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:29:33.771491 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50159c8a82854a948d4cb91a85338286"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50159c8a82854a948d4cb91a85338286", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ff6ac60428ee4e67ba4bc7e65c135f76 Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: {"migrate": {}} Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:29:33.774561 n-d-846209-2 devstack@n-api.service[119207]: exception: Cannot 'migrate' instance 8ebd5662-211a-4190-a06c-995fd1975f80 while it is in vm_state suspended Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '8ebd5662-211a-4190-a06c-995fd1975f80', 'body': {'migrate': {}}} Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8ebd5662-211a-4190-a06c-995fd1975f80 in vm_state suspended. Cannot resize while the instance is in this state. Jun 16 18:29:33.780104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 8ebd5662-211a-4190-a06c-995fd1975f80 while it is in vm_state suspended Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:33.782680 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:33.788274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:33.788274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:33.788274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:29:33.788274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:29:33.788274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 8ebd5662-211a-4190-a06c-995fd1975f80 while it is in vm_state suspended Jun 16 18:29:33.788274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:33.799413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Returning 409 to user: Cannot 'migrate' instance 8ebd5662-211a-4190-a06c-995fd1975f80 while it is in vm_state suspended {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:33.807755 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69ec6ed2-fbb9-4a2e-8d9a-215f2e337702 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80/action" status: 409 len: 148 microversion: 2.1 time: 0.517634 Jun 16 18:29:33.822674 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 309/598] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:33 2022] POST /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80/action => generated 148 bytes in 534 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:29:33.838465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:33.840352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:33.858034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.861391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.864490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.867920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.420297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.445750 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f2d4728-9964-4210-92ee-e40c108ae7cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 1.161206 Jun 16 18:29:34.463324 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 290/599] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:33 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:34.478515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17e1c606-e26e-4085-9669-c3ac6506c9a6 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17e1c606-e26e-4085-9669-c3ac6506c9a6 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Request method failure captured: Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58/action HTTP/1.1 Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 39 Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ZCCVY3ZzTEMXFygWOaH3CpRKRXZtHlrdPyZBSBpCz8v_ufKbv0aTboD9uVUkOdQ8m6A3aHwk5fbOTm6O_YH96T4PXI9JWu5GEJAMfsp8PyCAaCMI2sxP197TwKzXsE7_iI-PYgsSpIvFoasNUmpDuRuh7xF5QXrNDmS8S4_x4Z2cw Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:29:34.488617 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50159c8a82854a948d4cb91a85338286"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50159c8a82854a948d4cb91a85338286", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: ff6ac60428ee4e67ba4bc7e65c135f76 Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: {"os-resetState": {"state": "invalid"}} Jun 16 18:29:34.491097 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '948cd76e-b18a-4f7b-8bf5-c5060f8b9d58', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'invalid' Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:34.492484 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:29:34.498740 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 16 18:29:34.506482 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.506482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17e1c606-e26e-4085-9669-c3ac6506c9a6 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:34.509326 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-17e1c606-e26e-4085-9669-c3ac6506c9a6 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58/action" status: 400 len: 144 microversion: 2.1 time: 0.042971 Jun 16 18:29:34.520529 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 291/600] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:34 2022] POST /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58/action => generated 144 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:29:34.530596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:34.533408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:34.572822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.573422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.578983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.579450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.748369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.760891 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ec5fe81f-8a5e-4211-a3cc-20b568d0ba6f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.936062 Jun 16 18:29:34.772933 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 310/601] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:33 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:34.779313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daa43942-8cb6-440e-aa8d-06d3b42eea55 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daa43942-8cb6-440e-aa8d-06d3b42eea55 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Request method failure captured: Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58/action HTTP/1.1 Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 31 Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZCCVY3ZzTEMXFygWOaH3CpRKRXZtHlrdPyZBSBpCz8v_ufKbv0aTboD9uVUkOdQ8m6A3aHwk5fbOTm6O_YH96T4PXI9JWu5GEJAMfsp8PyCAaCMI2sxP197TwKzXsE7_iI-PYgsSpIvFoasNUmpDuRuh7xF5QXrNDmS8S4_x4Z2cw Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:29:34.781826 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50159c8a82854a948d4cb91a85338286"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50159c8a82854a948d4cb91a85338286", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ff6ac60428ee4e67ba4bc7e65c135f76 Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: {"os-resetState": {"state": 1}} Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:29:34.783429 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '948cd76e-b18a-4f7b-8bf5-c5060f8b9d58', 'body': {'os-resetState': {'state': 1}}} Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 1 Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:34.784399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 16 18:29:34.785720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.786867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daa43942-8cb6-440e-aa8d-06d3b42eea55 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:34.786867 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-daa43942-8cb6-440e-aa8d-06d3b42eea55 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58/action" status: 400 len: 120 microversion: 2.1 time: 0.009721 Jun 16 18:29:34.792137 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 311/602] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:34 2022] POST /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:29:34.800679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e67ba117-7626-4760-ad17-783782bef4f9 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:34.801805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e67ba117-7626-4760-ad17-783782bef4f9 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Failed to fetch instance by id 999 {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 18:29:34.805145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:34.806618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e67ba117-7626-4760-ad17-783782bef4f9 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e67ba117-7626-4760-ad17-783782bef4f9 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Request method failure captured: Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 37 Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZCCVY3ZzTEMXFygWOaH3CpRKRXZtHlrdPyZBSBpCz8v_ufKbv0aTboD9uVUkOdQ8m6A3aHwk5fbOTm6O_YH96T4PXI9JWu5GEJAMfsp8PyCAaCMI2sxP197TwKzXsE7_iI-PYgsSpIvFoasNUmpDuRuh7xF5QXrNDmS8S4_x4Z2cw Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:29:34.827035 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50159c8a82854a948d4cb91a85338286"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50159c8a82854a948d4cb91a85338286", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50159c8a82854a948d4cb91a85338286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 50159c8a82854a948d4cb91a85338286 Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1941264474 Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ff6ac60428ee4e67ba4bc7e65c135f76 Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1941264474-project-admin Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: {"os-resetState": {"state": "error"}} Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:29:34.828481 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 999 could not be found. Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:29:34.829266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 16 18:29:34.830570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:34.832343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e67ba117-7626-4760-ad17-783782bef4f9 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:34.833372 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e67ba117-7626-4760-ad17-783782bef4f9 tempest-ServersAdminNegativeTestJSON-1941264474 tempest-ServersAdminNegativeTestJSON-1941264474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.036961 Jun 16 18:29:34.834146 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 312/603] 10.222.0.27 () {60 vars in 1178 bytes} [Thu Jun 16 18:29:34 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:29:34.845284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:34.849066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:34.878024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.890242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.891244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.891706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.924784 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-454e26a0-52ca-4a85-afd8-112e749fb944 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.402004 Jun 16 18:29:34.926215 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 292/604] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:34 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:34.967587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-41897176-a15e-474b-a200-c6fa19949d8e req-d5dd97ac-7781-42fe-94ba-81b93ae2b3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e9024f-4e2b-4f1c-a71e-1390992cad98", "tag": "fcb637ef-3933-4d14-be52-088ea331e952"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:35.002233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:29:35.051922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-41897176-a15e-474b-a200-c6fa19949d8e req-d5dd97ac-7781-42fe-94ba-81b93ae2b3f0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.053304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-41897176-a15e-474b-a200-c6fa19949d8e req-d5dd97ac-7781-42fe-94ba-81b93ae2b3f0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.107785 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-41897176-a15e-474b-a200-c6fa19949d8e req-d5dd97ac-7781-42fe-94ba-81b93ae2b3f0 service nova] Creating event network-changed:fcb637ef-3933-4d14-be52-088ea331e952 for instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 on n-h2-846209-2 Jun 16 18:29:35.120136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:35.126395 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-41897176-a15e-474b-a200-c6fa19949d8e req-d5dd97ac-7781-42fe-94ba-81b93ae2b3f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171946 Jun 16 18:29:35.127866 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 293/605] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:35.196675 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8c69ea5e-5455-4a60-8a73-eae3f5f05558 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 204 len: 0 microversion: 2.1 time: 0.355798 Jun 16 18:29:35.198072 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 313/606] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:29:34 2022] DELETE /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:29:35.209082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:35.209814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:35.217649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.218158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.218956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.219406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.473430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:35.474187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:35.494128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.495264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.496249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.496737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.861556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:35.875768 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f99acca-dad8-496a-bb9e-36f0ff1908de tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1468 microversion: 2.1 time: 0.672598 Jun 16 18:29:35.884716 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 294/607] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:35 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1468 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:35.893892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:35.904754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:35.916354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.925793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.926967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.927601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.504774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:36.519754 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0b648e97-f0f1-4b97-b7a9-429c8ab39868 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 1.052661 Jun 16 18:29:36.521300 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 314/608] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:35 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:36.534642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:36.536597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:36.549401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.551219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.552358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.552805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.726691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:36.740347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:36.774488 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0f7942b-0c08-4b64-a337-7f24e0263cb7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.888487 Jun 16 18:29:36.795610 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 295/609] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:35 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:36.810921 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-86631fd5-4e0f-4088-81f6-6367aeea80e2 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1927 microversion: 2.75 time: 0.284191 Jun 16 18:29:36.825769 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 315/610] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:36 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1927 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:36.895509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:36.896267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:36.907568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.911393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.911393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.911689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.389266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:37.428825 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-643ec228-17ce-4218-8676-461351069646 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1468 microversion: 2.1 time: 0.538024 Jun 16 18:29:37.443681 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 296/611] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:36 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1468 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:37.553768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:37.555977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:37.587314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.587847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.588953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.589669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.801158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:37.801891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:37.814204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.814695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.815487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.816102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.160531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:38.171147 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e5a9b09-016b-4708-af8b-870bfb22b064 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.624772 Jun 16 18:29:38.177811 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 316/612] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:37 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:38.185045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:38.185955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:38.195631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.196482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.197717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.202546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.508835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:38.556448 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f6ab9044-062a-4ddb-8742-8877532a4ba3 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1933 microversion: 2.75 time: 0.376143 Jun 16 18:29:38.559111 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 317/613] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:38 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1933 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:38.567650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:38.583410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:38.586160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:38.587329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:38.595175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b246740-a0f7-4e7d-beb5-5aea7e3ca32f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.798260 Jun 16 18:29:38.611562 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 297/614] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:37 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:38.624853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.635331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.637847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.643344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.191817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:39.192118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:39.202713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=36 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:39.205509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.206246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.211114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.211886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.300845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:39.377998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:39.394895 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af318f68-240d-4e1b-95aa-0057f6e88d01 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1468 microversion: 2.1 time: 0.828984 Jun 16 18:29:39.395490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 318/615] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:38 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1468 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:39.580922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:39.581705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:39.595977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.596436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.597248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.597698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.675996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:39.691405 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6c780520-4b77-48a2-9e45-f29311640cc0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.503814 Jun 16 18:29:39.691995 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 298/616] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:39 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:39.700234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:39.714774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:39.728882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.732462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.734701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.736424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.868228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:39.918053 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca98f628-fe47-49f7-8e53-64d110e03c91 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1933 microversion: 2.75 time: 0.339435 Jun 16 18:29:39.920842 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 319/617] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:39 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1933 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:40.109779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1e5fc049-7a4e-4763-b813-197b510f0044 req-43e18a61-23c5-4e31-a5a0-a426571d89bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebd5662-211a-4190-a06c-995fd1975f80", "name": "network-vif-deleted", "tag": "a75ce07e-707d-4021-9b43-4ef6293429c2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:40.127777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1e5fc049-7a4e-4763-b813-197b510f0044 req-43e18a61-23c5-4e31-a5a0-a426571d89bd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.129114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1e5fc049-7a4e-4763-b813-197b510f0044 req-43e18a61-23c5-4e31-a5a0-a426571d89bd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.162635 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1e5fc049-7a4e-4763-b813-197b510f0044 req-43e18a61-23c5-4e31-a5a0-a426571d89bd service nova] Creating event network-vif-deleted:a75ce07e-707d-4021-9b43-4ef6293429c2 for instance 8ebd5662-211a-4190-a06c-995fd1975f80 on n-h1-846209-2 Jun 16 18:29:40.178349 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1e5fc049-7a4e-4763-b813-197b510f0044 req-43e18a61-23c5-4e31-a5a0-a426571d89bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070369 Jun 16 18:29:40.180205 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 320/618] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:29:40.424634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:40.426371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:40.455486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.456975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.458187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.461533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.489771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.500146 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88d959c6-8d66-4d9a-b76d-50efeb599d1c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.804691 Jun 16 18:29:40.506674 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 299/619] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:39 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:40.710561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:40.711892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:40.727824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.728716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.733481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.734397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.805666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.831432 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-be1cbdfc-ac41-4f0a-a51a-21cb889a4b8f tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 200 len: 1297 microversion: 2.1 time: 0.411892 Jun 16 18:29:40.832481 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 321/620] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:40 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 1297 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:40.834611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:40.943518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:40.944472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:40.957824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.962957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.966222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.966993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.252087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:41.326210 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e92eda1-5513-4bf4-ac9f-8074283b7aa6 tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1933 microversion: 2.75 time: 0.387785 Jun 16 18:29:41.333763 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 322/621] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:40 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1933 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:41.588877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:41.592547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:41.600164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:41.618958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e698d538-28cb-4bfe-8317-30e65750afa8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.912462 Jun 16 18:29:41.623123 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 300/622] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:40 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:41.646447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.654956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.656331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.674135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.854626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:41.856442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 8ebd5662-211a-4190-a06c-995fd1975f80] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:41.889352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.894752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.901044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.907562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.974739 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] HTTP exception thrown: Instance 8ebd5662-211a-4190-a06c-995fd1975f80 could not be found. Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Request method failure captured: Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 HTTP/1.1 Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Y-Xx_RTWkxrWKmpwyeI-6vkWX-Vsx12L21g4KupWIxg58Aszxqm9Oa1vTOzDeWGW-Tm1ze8TxCMKbCbukxc_ALPqqH8Arky_5_8QQojs1r9hfUI4sTPQIboQErMHuBc32VmoIJqIhPFacbg83HaTph7lPefLm3fYJFUUIcB44DldQ Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 0f0fb2bcbf6f455a8f4f741a476ba81c Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1229250444 Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:29:41.978136 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f0fb2bcbf6f455a8f4f741a476ba81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f0fb2bcbf6f455a8f4f741a476ba81c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f0fb2bcbf6f455a8f4f741a476ba81c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f0fb2bcbf6f455a8f4f741a476ba81c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1229250444 Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 0f0fb2bcbf6f455a8f4f741a476ba81c Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1229250444 Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAdminNegativeTestJSON-1229250444-project Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 37f5daa365b34a63a78ea4fb99ea9961 Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1229250444-project Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 8ebd5662-211a-4190-a06c-995fd1975f80 could not be found. Jun 16 18:29:41.981521 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '8ebd5662-211a-4190-a06c-995fd1975f80'} Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebd5662-211a-4190-a06c-995fd1975f80 could not be found. Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:41.983156 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebd5662-211a-4190-a06c-995fd1975f80 could not be found. Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebd5662-211a-4190-a06c-995fd1975f80 could not be found. Jun 16 18:29:41.986566 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:41.994561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Returning 404 to user: Instance 8ebd5662-211a-4190-a06c-995fd1975f80 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:41.994561 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa27baa1-8c39-4c2c-af39-ee6a3d4856c8 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80" status: 404 len: 111 microversion: 2.1 time: 0.137961 Jun 16 18:29:41.994561 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 301/623] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:41 2022] GET /compute/v2.1/servers/8ebd5662-211a-4190-a06c-995fd1975f80 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:29:42.004589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:42.005008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:42.025754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.028976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.038595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.040087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.068582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:42.082955 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92e61176-4cb3-49c1-bb18-090411989def tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.547894 Jun 16 18:29:42.084243 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 323/624] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:41 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:42.112797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:29:42.299206 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77eda5b2-640b-4672-92b8-091b438b9bb2 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "DELETE /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 204 len: 0 microversion: 2.1 time: 0.298600 Jun 16 18:29:42.304009 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 302/625] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:29:41 2022] DELETE /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:29:42.310417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:42.311928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:42.325102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.347812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.349331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.350236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.389229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:42.390762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:42.418858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.419785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.434317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.435740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.788463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] Lazy-loading 'services' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:42.834894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:42.874409 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-593abdde-a055-49c6-88b8-68d90ab91bfe tempest-ServersAdmin275Test-401932378 tempest-ServersAdmin275Test-401932378-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1918 microversion: 2.75 time: 0.501998 Jun 16 18:29:42.893963 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 303/626] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:42 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1918 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:42.893963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:42.893963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:42.918604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.918604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.918604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.924727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.925394 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4df3a85a-e89e-4c39-874a-981dcb97ddac tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1475 microversion: 2.1 time: 0.619301 Jun 16 18:29:42.936324 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 324/627] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:42 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:42.967135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:42.970750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:43.008703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.010491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.017577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.018830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.091736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:29:43.279775 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-507390cf-d9e0-4084-a64e-342bfe86a981 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 204 len: 0 microversion: 2.75 time: 0.324454 Jun 16 18:29:43.288485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 325/628] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:29:42 2022] DELETE /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:29:43.315300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:43.316822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:43.333582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.334834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.335050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.337017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.338222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.345696 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c941bc3a-331c-4afb-aadf-896d6bb9133b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.463780 Jun 16 18:29:43.356675 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 304/629] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:42 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:43.362662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:43.364449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:43.372410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.375597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.376824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.377520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.463727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.477654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.479513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.488342 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2fecaf2-3588-4954-bdec-a64221deb376 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1443 microversion: 2.75 time: 0.129602 Jun 16 18:29:43.489502 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 305/630] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:43 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1443 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:43.612737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.622061 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16b80fcb-b52a-4780-9865-e0bf75d9dee2 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.318405 Jun 16 18:29:43.632647 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 326/631] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:43 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:43.971084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:43.976659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:44.014308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.015369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.017145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.018206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.366686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.372086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:44.375414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:44.406076 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c02cb2ef-854a-4191-9da0-ad316132504b tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1475 microversion: 2.1 time: 0.438500 Jun 16 18:29:44.408242 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 306/632] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:43 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1475 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:44.409201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.411002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.412866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.414074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.447694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:44.521445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:44.524537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:44.547674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.548417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.549826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.551092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.894818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.908040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.917122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.918369 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-70da3952-e119-41f8-a09e-5de4c4ba0af6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.557038 Jun 16 18:29:44.918982 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 327/633] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:44 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:44.930522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.934540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:44.935163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:44.942293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.942769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.943573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.943995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.966464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04954cf7-65c9-48bf-90fc-8b2741feff22 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1443 microversion: 2.75 time: 0.460069 Jun 16 18:29:44.973826 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 307/634] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:44 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1443 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:45.236433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:45.248165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ed1e732-5035-45eb-9841-f6f76b1ac6d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.317118 Jun 16 18:29:45.248992 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 328/635] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:44 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:45.439768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:45.440854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:45.487119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.496032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:45.498857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.502903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:45.809363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:45.845023 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-56e12a9a-19ec-43bd-aaef-69896f5ea29d tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1475 microversion: 2.1 time: 0.412907 Jun 16 18:29:45.859079 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 308/636] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:45 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1475 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:45.940367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:45.941154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:45.963928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.967244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:45.968794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.969638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.007950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:46.008541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:46.046223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.047433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.055258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.056634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.183002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.187361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.189606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lazy-loading 'fault' on Instance uuid e8923619-7389-47c8-843b-6d656f22e8c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:46.310670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.328516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.340478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62925ce1fb6f4271995ae99fe83dd105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6407b9ce1734422fbaae081073e94cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.348781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:46.359596 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9055175d-a5bf-4890-afd4-03711fd4ffd1 tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 200 len: 1448 microversion: 2.75 time: 0.357882 Jun 16 18:29:46.366982 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 309/637] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:46 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 1448 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:46.378219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:46.379238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:46.392695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.395828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.397068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.400518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.446725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.491037 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5c400fa2-5f4b-4d87-bd55-7b4289a42f4b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.558097 Jun 16 18:29:46.503724 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 329/638] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:45 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:46.878603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:46.878603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:46.894395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.895764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.896190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.896734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.970249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.991731 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66a69d8c-9cb1-4497-b134-26bd23f56508 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.621635 Jun 16 18:29:46.992737 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 310/639] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:46 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:47.091280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5daa365b34a63a78ea4fb99ea9961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0fb2bcbf6f455a8f4f741a476ba81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:47.107344 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dbe6b87f-08cc-4d07-ae98-d1239d566da4 tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 200 len: 1433 microversion: 2.1 time: 0.234073 Jun 16 18:29:47.114949 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 330/640] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:46 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 1433 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:47.340964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-18513148-cb1c-488b-8a3d-cc744473dd35 req-045a01dc-1c0f-450b-a542-a5927cdb2bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948cd76e-b18a-4f7b-8bf5-c5060f8b9d58", "name": "network-vif-deleted", "tag": "1179feea-b5ba-47b2-8b8f-26cb4cba148c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:47.389630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-18513148-cb1c-488b-8a3d-cc744473dd35 req-045a01dc-1c0f-450b-a542-a5927cdb2bc6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.402006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:47.403623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] [instance: e8923619-7389-47c8-843b-6d656f22e8c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:47.406258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-18513148-cb1c-488b-8a3d-cc744473dd35 req-045a01dc-1c0f-450b-a542-a5927cdb2bc6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.406993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:47.443805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.446827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.448263 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-18513148-cb1c-488b-8a3d-cc744473dd35 req-045a01dc-1c0f-450b-a542-a5927cdb2bc6 service nova] Creating event network-vif-deleted:1179feea-b5ba-47b2-8b8f-26cb4cba148c for instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 on n-h2-846209-2 Jun 16 18:29:47.452797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.453293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.473061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-18513148-cb1c-488b-8a3d-cc744473dd35 req-045a01dc-1c0f-450b-a542-a5927cdb2bc6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167576 Jun 16 18:29:47.475730 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 311/641] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:47.503702 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] HTTP exception thrown: Instance e8923619-7389-47c8-843b-6d656f22e8c1 could not be found. Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Request method failure captured: Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 HTTP/1.1 Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ZF9eKnH8QYjWU0m9CNvpI-KuJaxeHdVJLMesNHFkT5qxW3-nwa7roNkiTq-m05rQD8A5B4ryCVqFWQ4VmiWiW6Yms4M5Cs1NCD5JIQM-EFp0rlOsRwxwkkbmDeuc-LH4Y_yq0anqa2rXwGMWC_sXILBrKTUXLktFCcNcrjXwHd-2E Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.75 Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6407b9ce1734422fbaae081073e94cae Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersAdmin275Test-1702666348 Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:29:47.506492 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6407b9ce1734422fbaae081073e94cae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6407b9ce1734422fbaae081073e94cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6407b9ce1734422fbaae081073e94cae", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6407b9ce1734422fbaae081073e94cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersAdmin275Test-1702666348 Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6407b9ce1734422fbaae081073e94cae Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersAdmin275Test-1702666348 Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersAdmin275Test-1702666348-project Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 62925ce1fb6f4271995ae99fe83dd105 Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersAdmin275Test-1702666348-project Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance e8923619-7389-47c8-843b-6d656f22e8c1 could not be found. Jun 16 18:29:47.508246 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e8923619-7389-47c8-843b-6d656f22e8c1'} Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8923619-7389-47c8-843b-6d656f22e8c1 could not be found. Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:47.509300 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8923619-7389-47c8-843b-6d656f22e8c1 could not be found. Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8923619-7389-47c8-843b-6d656f22e8c1 could not be found. Jun 16 18:29:47.510917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:29:47.516111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] Returning 404 to user: Instance e8923619-7389-47c8-843b-6d656f22e8c1 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:47.517323 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-370eda93-3503-42d7-a3d8-9147ea98a2ab tempest-ServersAdmin275Test-1702666348 tempest-ServersAdmin275Test-1702666348-project] 10.222.0.27 "GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1" status: 404 len: 111 microversion: 2.75 time: 0.120687 Jun 16 18:29:47.518179 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 331/642] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:47 2022] GET /compute/v2.1/servers/e8923619-7389-47c8-843b-6d656f22e8c1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:29:47.543824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a8aa7837-e4e4-45f4-92f9-807b99db7a27 req-7ce2e6d2-c7b0-4eb2-a90b-40c9de75b3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e9024f-4e2b-4f1c-a71e-1390992cad98", "name": "network-vif-plugged", "status": "completed", "tag": "fcb637ef-3933-4d14-be52-088ea331e952"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:47.547036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:47.548282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:47.564203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.564809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.570000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.573125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.579030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a8aa7837-e4e4-45f4-92f9-807b99db7a27 req-7ce2e6d2-c7b0-4eb2-a90b-40c9de75b3b1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.579732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a8aa7837-e4e4-45f4-92f9-807b99db7a27 req-7ce2e6d2-c7b0-4eb2-a90b-40c9de75b3b1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.602946 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a8aa7837-e4e4-45f4-92f9-807b99db7a27 req-7ce2e6d2-c7b0-4eb2-a90b-40c9de75b3b1 service nova] Creating event network-vif-plugged:fcb637ef-3933-4d14-be52-088ea331e952 for instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 on n-h2-846209-2 Jun 16 18:29:47.610213 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a8aa7837-e4e4-45f4-92f9-807b99db7a27 req-7ce2e6d2-c7b0-4eb2-a90b-40c9de75b3b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071726 Jun 16 18:29:47.611478 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 332/643] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:47.852120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:47.863370 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72026462-7b8e-440c-af0b-367cb604f8f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.333950 Jun 16 18:29:47.864800 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 312/644] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:47 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:48.024351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:48.029301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:48.044844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.046781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.049286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.050351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.143694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:48.144402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] [instance: 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:48.162612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.163074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.163914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.164356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.198863 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] HTTP exception thrown: Instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 could not be found. Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Request method failure captured: Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 HTTP/1.1 Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Y-Xx_RTWkxrWKmpwyeI-6vkWX-Vsx12L21g4KupWIxg58Aszxqm9Oa1vTOzDeWGW-Tm1ze8TxCMKbCbukxc_ALPqqH8Arky_5_8QQojs1r9hfUI4sTPQIboQErMHuBc32VmoIJqIhPFacbg83HaTph7lPefLm3fYJFUUIcB44DldQ Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 0f0fb2bcbf6f455a8f4f741a476ba81c Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1229250444 Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:29:48.207490 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f0fb2bcbf6f455a8f4f741a476ba81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f0fb2bcbf6f455a8f4f741a476ba81c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f0fb2bcbf6f455a8f4f741a476ba81c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f0fb2bcbf6f455a8f4f741a476ba81c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1229250444 Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 0f0fb2bcbf6f455a8f4f741a476ba81c Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1229250444 Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAdminNegativeTestJSON-1229250444-project Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 37f5daa365b34a63a78ea4fb99ea9961 Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1229250444-project Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 could not be found. Jun 16 18:29:48.209194 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '948cd76e-b18a-4f7b-8bf5-c5060f8b9d58'} Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 could not be found. Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:48.210026 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 could not be found. Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 could not be found. Jun 16 18:29:48.211368 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:29:48.212649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] Returning 404 to user: Instance 948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:48.212649 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-03111f57-239b-414f-a318-c6e3db1f6dcc tempest-ServersAdminNegativeTestJSON-1229250444 tempest-ServersAdminNegativeTestJSON-1229250444-project] 10.222.0.27 "GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58" status: 404 len: 111 microversion: 2.1 time: 0.074008 Jun 16 18:29:48.217756 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 313/645] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:48 2022] GET /compute/v2.1/servers/948cd76e-b18a-4f7b-8bf5-c5060f8b9d58 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:29:48.391734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:48.407109 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-772f7ec8-65af-451f-b206-23a9e1ef0778 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.395311 Jun 16 18:29:48.408896 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 333/646] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:48 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:48.901852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:48.903995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:48.943826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.944637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.952095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.955002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.438784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:49.440828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:49.463231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.463940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.467855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.473149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.537273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:49.550941 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15eb4af5-98b7-4760-9f1f-909eff7aa4d1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1312 microversion: 2.1 time: 0.660302 Jun 16 18:29:49.565596 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 314/647] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:48 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1312 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:49.826809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:49.849270 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0fe58f63-3946-4d32-bdd6-1039f40631b3 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.419261 Jun 16 18:29:49.861873 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 334/648] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:49 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:50.580732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:50.591639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:50.610684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.613295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.623682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.624736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.877020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:50.880426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:50.899432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.901545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.906220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:50.908538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.909823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.921776 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-463b838b-933c-45a0-b72b-f33c5c4d86d2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1461 microversion: 2.1 time: 0.352095 Jun 16 18:29:50.926263 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 315/649] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:50 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1461 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:50.957474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:50.964171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:50.977971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.979412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.982169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.983335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.195270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:51.222065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Old instance type m1.heat2, new instance type m1.heat {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 18:29:51.228354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:51.239596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:29:51.240720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:29:51.241877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:29:51.242904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:29:51.243881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:29:51.250665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:51.263546 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-caa30118-fa1c-4abb-9bbe-08a3e1f75555 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 0.396257 Jun 16 18:29:51.284777 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 335/650] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:50 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:51.949685 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-600a2b56-c1c5-486f-8c61-a44e9b05dd8f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98/action" status: 202 len: 0 microversion: 2.1 time: 1.000102 Jun 16 18:29:51.953837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 316/651] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:50 2022] POST /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98/action => generated 0 bytes in 1005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:29:51.967919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:51.969607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:52.000440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:52.000896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:52.014679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:52.015258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:52.290454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:52.295535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:52.332618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:52.334733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:52.336382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:52.337175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:52.534432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:52.552459 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-43bf38ed-b700-4439-9841-a9b927596a51 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1470 microversion: 2.1 time: 0.596984 Jun 16 18:29:52.559216 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 336/652] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:51 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1470 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:53.422756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:53.462236 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7e54e52-d1c1-4169-bf9c-3426ccb1c1b1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1499 microversion: 2.1 time: 1.180997 Jun 16 18:29:53.467988 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 317/653] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:52 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1499 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:53.574787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:53.575885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:53.592154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:53.593812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:53.600622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:53.601832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:53.642951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:53.643468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:53.680571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:53.682014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:53.687108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:53.688320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:53.816463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:29:54.113361 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e139ac28-869f-4476-8087-57bb2bdc5d51 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 204 len: 0 microversion: 2.1 time: 0.480632 Jun 16 18:29:54.116699 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 318/654] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:29:53 2022] DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:29:54.401168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1108264941", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "2099322847", "adminPass": "***", "networks": [{"uuid": "3ed6b235-5ca9-45dd-b1c4-58fe3ed672de"}], "security_groups": [{"name": "tempest-securitygroup--1366285722"}], "key_name": "tempest-keypair-204874955", "user_data": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:54.409388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:54.424484 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c82cb28e-01de-4248-83dd-0ecddd7c3da0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1470 microversion: 2.1 time: 0.854501 Jun 16 18:29:54.427183 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 337/655] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:53 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1470 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:54.485501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:54.486521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:54.505403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:54.510828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:54.514360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:54.515896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.248484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:55.317070 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00a20a60-4e24-40d2-9122-46de0954f4ee tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 200 len: 1476 microversion: 2.1 time: 0.832293 Jun 16 18:29:55.323446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 338/656] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:54 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 1476 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:55.325051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] validate_networks() for [('3ed6b235-5ca9-45dd-b1c4-58fe3ed672de', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:29:55.364420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c18535c1-c730-4630-bee8-5f1328c82022 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1461611156"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:55.377425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c18535c1-c730-4630-bee8-5f1328c82022 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:55.410305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c18535c1-c730-4630-bee8-5f1328c82022 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:55.410765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c18535c1-c730-4630-bee8-5f1328c82022 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.411610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c18535c1-c730-4630-bee8-5f1328c82022 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:55.412059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c18535c1-c730-4630-bee8-5f1328c82022 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:56.800657 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c18535c1-c730-4630-bee8-5f1328c82022 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e/action" status: 202 len: 0 microversion: 2.1 time: 1.441100 Jun 16 18:29:56.805850 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 339/657] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:55 2022] POST /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e/action => generated 0 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:29:56.864307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:56.869717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:56.912545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:56.920169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:56.926202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:56.934894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:58.167771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:58.177190 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd898f3b-ee4a-48a1-85b3-59ad76afedf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1470 microversion: 2.1 time: 1.362887 Jun 16 18:29:58.177842 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 340/658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:56 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1470 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:58.293528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:29:58.294755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:29:58.295453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:29:58.296094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:29:58.297249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:29:58.327365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:58.329356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:58.339032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:58.340591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:58.438334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Getting quotas for project 5eb148860ba84601a7ff43b94223d7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:29:58.456684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Getting quotas for user f947f4cdaa0949d1894a458a1c84bbc8 and project 5eb148860ba84601a7ff43b94223d7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:29:58.512485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:29:58.522700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:29:58.751857 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-344760a9-bbf5-4616-af23-eb157f226ad5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.358002 Jun 16 18:29:58.759527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 319/659] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:29:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 4364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:29:58.773396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6621cfd8-8e23-4e24-844e-e4fea1ccc0f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f300b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:58.868467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-304381", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "02050194-15bb-475f-8e51-c895317b0755"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:58.899323 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6621cfd8-8e23-4e24-844e-e4fea1ccc0f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.138053 Jun 16 18:29:58.906642 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 320/660] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:29:58 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:58.929078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b57c806b-a852-45ca-bbd5-9827b8618fa3 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:58.935747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b57c806b-a852-45ca-bbd5-9827b8618fa3 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:59.028061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] validate_networks() for [('02050194-15bb-475f-8e51-c895317b0755', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:29:59.538251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b57c806b-a852-45ca-bbd5-9827b8618fa3 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:59.557397 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b57c806b-a852-45ca-bbd5-9827b8618fa3 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1264 microversion: 2.1 time: 0.644383 Jun 16 18:29:59.560677 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 321/661] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:58 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1264 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:59.588085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:59.592683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:59.615838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.624597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:59.626065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.634335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:01.139534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:01.174326 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4432ae63-a841-4703-8f38-7a6706bf4b2f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1470 microversion: 2.1 time: 1.607952 Jun 16 18:30:01.182398 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 322/662] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:59 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1470 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:01.225267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-befa4606-86ba-412f-86b1-aa7b519e5e27 req-eb0ca27d-9d5a-4d34-9a4e-b942fd844dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0c26f5-b935-4e31-b1d5-853ceef1469a", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:01.263994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-befa4606-86ba-412f-86b1-aa7b519e5e27 req-eb0ca27d-9d5a-4d34-9a4e-b942fd844dde service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:01.266102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-befa4606-86ba-412f-86b1-aa7b519e5e27 req-eb0ca27d-9d5a-4d34-9a4e-b942fd844dde service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:01.346657 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-befa4606-86ba-412f-86b1-aa7b519e5e27 req-eb0ca27d-9d5a-4d34-9a4e-b942fd844dde service nova] Creating event network-vif-unplugged:d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5 for instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a on n-h2-846209-2 Jun 16 18:30:01.358017 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-befa4606-86ba-412f-86b1-aa7b519e5e27 req-eb0ca27d-9d5a-4d34-9a4e-b942fd844dde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167685 Jun 16 18:30:01.359539 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 323/663] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:01.377064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef4a9ff2-ecba-4698-a678-a4176a2bef9d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f329550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:01.608799 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef4a9ff2-ecba-4698-a678-a4176a2bef9d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.246764 Jun 16 18:30:01.612485 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 324/664] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:01 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:01.636901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:01.639564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:01.682164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:01.682401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:01.695376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:01.706637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.115402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:03.136843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:30:03.140441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:30:03.141167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:30:03.142087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:30:03.142781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:30:03.170509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.171277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.172606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.173262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.194673 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-78efe2f1-36e6-4987-b3fb-291ccfcf828b tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1316 microversion: 2.1 time: 1.572461 Jun 16 18:30:03.205008 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 325/665] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:01 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1316 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:03.235669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for project 14cf8ec8d4954e45857af05dc373a244. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:30:03.247383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for user 25c692d1c95b4844812f6d3511268a45 and project 14cf8ec8d4954e45857af05dc373a244. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:30:03.288965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:30:03.305003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:30:03.481760 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd564d89-0f2e-4588-a5c3-1cb12d9a6d76 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.294393 Jun 16 18:30:03.499227 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 341/666] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 5316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:30:03.507809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:03.522310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:03.562848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.568887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.582520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.583338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.823226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Action: 'update', calling method: .version_select at 0x7f866f4c7790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:03.837880 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:03.837880 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:30:03.848964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.858279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.941981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.954773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.999839 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] HTTP exception thrown: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Request method failure captured: Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2 HTTP/1.1 Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 56 Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3aoKHcxgnfWYuFdsL1FjFnGqyWv_AR6UjxCY5gsWgfR14IQWBcap1v3LxTjNvtdv8n-bGGmz3Yn088kd6tmui_WmiqB-KoSSEE45CLQo5NUBRElzbTvRPjVpCKFIIjhKeET-9lpbUfYniQNJSfu2jgAh_HuJ3PbzK2sRCyFdjttKhQ Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 75ae949f98de41e2b43da48267419f0a Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:30:04.028488 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75ae949f98de41e2b43da48267419f0a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 75ae949f98de41e2b43da48267419f0a Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 2ed0e4ed54c04103917991277410ee65 Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:30:04.030313 n-d-846209-2 devstack@n-api.service[119206]: exception: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '10e5b00b-590d-4239-b308-e86d37be87e2', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.031324 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:04.032639 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:04.034591 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:04.034591 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.034591 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.034591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Returning 404 to user: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:04.035083 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ecd4769a-c6f2-4e3f-b6c9-1f61a432b6ac tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2" status: 404 len: 110 microversion: 2.53 time: 0.822866 Jun 16 18:30:04.037294 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 326/667] 10.222.0.27 () {62 vars in 1308 bytes} [Thu Jun 16 18:30:03 2022] PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2 => generated 110 bytes in 832 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:30:04.094040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33af4b20-1fc2-4d0c-9a31-358d7552fa1a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f395040>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:04.331347 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33af4b20-1fc2-4d0c-9a31-358d7552fa1a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.277779 Jun 16 18:30:04.335208 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 327/668] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:04 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:04.391027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-56a03fd8-d6b9-468b-91b5-a1cb12478c4f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:04.394824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-56a03fd8-d6b9-468b-91b5-a1cb12478c4f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:04.714980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56a03fd8-d6b9-468b-91b5-a1cb12478c4f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:04.722705 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-56a03fd8-d6b9-468b-91b5-a1cb12478c4f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1221 microversion: 2.1 time: 0.385607 Jun 16 18:30:04.723293 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 328/669] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:04 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1221 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:04.739765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Action: 'update', calling method: .version_select at 0x7f866f4f3e50>, body: {"status": "disabled"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:04.741562 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:04.741562 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:30:04.743165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:04.743941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:04.751958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:04.752770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:04.759285 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] HTTP exception thrown: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Request method failure captured: Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2 HTTP/1.1 Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 22 Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3aoKHcxgnfWYuFdsL1FjFnGqyWv_AR6UjxCY5gsWgfR14IQWBcap1v3LxTjNvtdv8n-bGGmz3Yn088kd6tmui_WmiqB-KoSSEE45CLQo5NUBRElzbTvRPjVpCKFIIjhKeET-9lpbUfYniQNJSfu2jgAh_HuJ3PbzK2sRCyFdjttKhQ Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 75ae949f98de41e2b43da48267419f0a Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:30:04.761338 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75ae949f98de41e2b43da48267419f0a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 75ae949f98de41e2b43da48267419f0a Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 2ed0e4ed54c04103917991277410ee65 Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: {"status": "disabled"} Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: exception: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.762934 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '10e5b00b-590d-4239-b308-e86d37be87e2', 'body': {'status': 'disabled'}} Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.764023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:04.765213 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:04.766415 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:04.766415 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:04.767459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Returning 404 to user: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:04.768694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6cb3622-2e18-44ce-8c20-15fb583395a8 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2" status: 404 len: 110 microversion: 2.53 time: 0.033573 Jun 16 18:30:04.769466 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 329/670] 10.222.0.27 () {62 vars in 1308 bytes} [Thu Jun 16 18:30:04 2022] PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2 => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:30:04.775573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:04.777570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:04.790112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:04.790936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:04.791935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:04.793440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:04.950132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:04.965431 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9bed4ff-46c3-4e69-ac6e-6f88fdbbcfe6 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1322 microversion: 2.1 time: 0.193433 Jun 16 18:30:04.966257 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 330/671] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:04 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:04.981012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Action: 'update', calling method: .version_select at 0x7f866f2d1160>, body: {"status": "enabled"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:04.986893 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:04.986893 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:30:04.988649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:04.989309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.003479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.004248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.025178 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] HTTP exception thrown: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Request method failure captured: Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2 HTTP/1.1 Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 21 Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3aoKHcxgnfWYuFdsL1FjFnGqyWv_AR6UjxCY5gsWgfR14IQWBcap1v3LxTjNvtdv8n-bGGmz3Yn088kd6tmui_WmiqB-KoSSEE45CLQo5NUBRElzbTvRPjVpCKFIIjhKeET-9lpbUfYniQNJSfu2jgAh_HuJ3PbzK2sRCyFdjttKhQ Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 75ae949f98de41e2b43da48267419f0a Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:30:05.027338 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75ae949f98de41e2b43da48267419f0a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75ae949f98de41e2b43da48267419f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 75ae949f98de41e2b43da48267419f0a Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751 Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 2ed0e4ed54c04103917991277410ee65 Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: {"status": "enabled"} Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: exception: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:05.028959 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '10e5b00b-590d-4239-b308-e86d37be87e2', 'body': {'status': 'enabled'}} Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.029809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:05.031076 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:05.032290 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. Jun 16 18:30:05.032290 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.033944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Returning 404 to user: Service 10e5b00b-590d-4239-b308-e86d37be87e2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:05.035537 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4085c3db-e834-4a9e-b01c-4fe018b7ee5f tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2" status: 404 len: 110 microversion: 2.53 time: 0.066040 Jun 16 18:30:05.036739 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 331/672] 10.222.0.27 () {62 vars in 1308 bytes} [Thu Jun 16 18:30:04 2022] PUT /compute/v2.1/os-services/10e5b00b-590d-4239-b308-e86d37be87e2 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:30:05.051175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-10fa217f-c17c-479f-b6ec-c51739fc7f39 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.055466 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:05.055466 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:30:05.062503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10fa217f-c17c-479f-b6ec-c51739fc7f39 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.063177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10fa217f-c17c-479f-b6ec-c51739fc7f39 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.064203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10fa217f-c17c-479f-b6ec-c51739fc7f39 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.064859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10fa217f-c17c-479f-b6ec-c51739fc7f39 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.142754 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-10fa217f-c17c-479f-b6ec-c51739fc7f39 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.098471 Jun 16 18:30:05.147745 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 332/673] 10.222.0.27 () {60 vars in 1177 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:30:05.158977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-806765e4-58f0-4005-ac74-ba96708cc88a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.160345 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:05.160345 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:30:05.169152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-806765e4-58f0-4005-ac74-ba96708cc88a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.169938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-806765e4-58f0-4005-ac74-ba96708cc88a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.179924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-806765e4-58f0-4005-ac74-ba96708cc88a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.191205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-806765e4-58f0-4005-ac74-ba96708cc88a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.283414 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-806765e4-58f0-4005-ac74-ba96708cc88a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.128315 Jun 16 18:30:05.302840 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 333/674] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:30:05.318393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1377825a-333f-40cb-949f-d774dc60851a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.319654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:05.323059 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:05.323059 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:30:05.336996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1377825a-333f-40cb-949f-d774dc60851a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.338716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1377825a-333f-40cb-949f-d774dc60851a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.340850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1377825a-333f-40cb-949f-d774dc60851a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.346785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1377825a-333f-40cb-949f-d774dc60851a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.359827 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03204543-8e3d-48f6-b859-d2d6eb1b7c3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1470 microversion: 2.1 time: 1.858718 Jun 16 18:30:05.360425 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 342/675] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:03 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1470 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:05.374135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97af2270-fdfc-4e1a-84b7-40fcc5c40eff tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f7690d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.497621 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1377825a-333f-40cb-949f-d774dc60851a tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.193089 Jun 16 18:30:05.499765 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97af2270-fdfc-4e1a-84b7-40fcc5c40eff tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.133479 Jun 16 18:30:05.502060 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 343/676] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:05.514188 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 334/677] 10.222.0.27 () {60 vars in 1177 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:05.538709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-66983e87-e648-4615-952f-4578ec9a78a9 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.541056 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:05.541056 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:30:05.548690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66983e87-e648-4615-952f-4578ec9a78a9 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.549608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66983e87-e648-4615-952f-4578ec9a78a9 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.551077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66983e87-e648-4615-952f-4578ec9a78a9 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.551756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66983e87-e648-4615-952f-4578ec9a78a9 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.627578 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-66983e87-e648-4615-952f-4578ec9a78a9 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-846209-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.101722 Jun 16 18:30:05.634888 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 344/678] 10.222.0.27 () {60 vars in 1234 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/os-services?host=n-d-846209-2&binary=xxx => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:05.649594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a4cbe814-acc7-4823-a741-4ba636a2dec0 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.651261 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:05.651261 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:30:05.653476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a4cbe814-acc7-4823-a741-4ba636a2dec0 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.654281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a4cbe814-acc7-4823-a741-4ba636a2dec0 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.657879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a4cbe814-acc7-4823-a741-4ba636a2dec0 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.661438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a4cbe814-acc7-4823-a741-4ba636a2dec0 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.710196 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a4cbe814-acc7-4823-a741-4ba636a2dec0 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063852 Jun 16 18:30:05.711516 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 335/679] 10.222.0.27 () {60 vars in 1177 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:05.725830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a26fc664-034d-4072-a06d-f38f88fbca18 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.727832 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:05.727832 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:30:05.729638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26fc664-034d-4072-a06d-f38f88fbca18 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.733091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26fc664-034d-4072-a06d-f38f88fbca18 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.734448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26fc664-034d-4072-a06d-f38f88fbca18 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.741119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.743279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26fc664-034d-4072-a06d-f38f88fbca18 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.749384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:05.771827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.776387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.786842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.787721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.805717 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a26fc664-034d-4072-a06d-f38f88fbca18 tempest-ServicesAdminNegativeV253TestJSON-1863403751 tempest-ServicesAdminNegativeV253TestJSON-1863403751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.086622 Jun 16 18:30:05.814913 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 345/680] 10.222.0.27 () {60 vars in 1238 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:05.966106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:05.988222 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa814c54-ba15-4009-87d2-5629f87b21b1 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1217 microversion: 2.1 time: 0.251264 Jun 16 18:30:05.997572 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 336/681] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:06.024817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:06.028577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:06.068409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:06.069784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:06.078279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:06.081938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:06.268734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd97c88b-c5c9-4e07-88c7-29ca32248085 tempest-ServicesAdminNegativeV253TestJSON-421239930 tempest-ServicesAdminNegativeV253TestJSON-421239930-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:06.270909 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:06.270909 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:30:06.272393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd97c88b-c5c9-4e07-88c7-29ca32248085 tempest-ServicesAdminNegativeV253TestJSON-421239930 tempest-ServicesAdminNegativeV253TestJSON-421239930-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '918478d8708e47ef9f98d0f548cce24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0309cfdb6f8944c6ab7be6deeb630a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd97c88b-c5c9-4e07-88c7-29ca32248085 tempest-ServicesAdminNegativeV253TestJSON-421239930 tempest-ServicesAdminNegativeV253TestJSON-421239930-project] Request method failure captured: Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3amYVGZkEMHhMC6iHjDKUIzo9kMOKIbET7DYjFTlJAsQ3-dvnsPJwoyDtJi6xsrVpmuC9TqCEGuImh9E2YK6pFpI5eb_adE97XxYcRkeXhiB1flAGnYprUiJiRxL2GGvvxIBWW3bSoP2z1Fm0n6zt9Fa4cnILGrROEHHSvKruAJCr0 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 0309cfdb6f8944c6ab7be6deeb630a96 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-421239930 Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:30:06.275749 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0309cfdb6f8944c6ab7be6deeb630a96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0309cfdb6f8944c6ab7be6deeb630a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0309cfdb6f8944c6ab7be6deeb630a96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0309cfdb6f8944c6ab7be6deeb630a96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-421239930 Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 0309cfdb6f8944c6ab7be6deeb630a96 Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-421239930 Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServicesAdminNegativeV253TestJSON-421239930-project Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 918478d8708e47ef9f98d0f548cce24b Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-421239930-project Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 18:30:06.278449 n-d-846209-2 devstack@n-api.service[119207]: action_args: {} Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:30:06.279534 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 18:30:06.280897 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:06.286766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd97c88b-c5c9-4e07-88c7-29ca32248085 tempest-ServicesAdminNegativeV253TestJSON-421239930 tempest-ServicesAdminNegativeV253TestJSON-421239930-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:06.290020 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd97c88b-c5c9-4e07-88c7-29ca32248085 tempest-ServicesAdminNegativeV253TestJSON-421239930 tempest-ServicesAdminNegativeV253TestJSON-421239930-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.461378 Jun 16 18:30:06.295796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 346/682] 10.222.0.27 () {60 vars in 1177 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/os-services => generated 112 bytes in 468 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:30:06.314016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:06.345210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4432e5c3-a7a1-49f6-b395-977a283155a5 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1322 microversion: 2.1 time: 0.345585 Jun 16 18:30:06.347866 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 337/683] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:06.390877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:06.391696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:06.423904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:06.425504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:06.431126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:06.432555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:06.520832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54a2e00b-bf8f-44eb-bc39-f48e8ff45f2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f300b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:06.852539 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54a2e00b-bf8f-44eb-bc39-f48e8ff45f2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.342976 Jun 16 18:30:06.853999 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 338/684] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:06 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:07.071605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1604519615", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "71375809-7321-4c5f-9d11-1e2aadbe705f"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:07.391099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] validate_networks() for [('71375809-7321-4c5f-9d11-1e2aadbe705f', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:30:08.050430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:08.067402 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-55270c01-4224-4529-b6ef-3f406bdbbbe1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1475 microversion: 2.1 time: 1.685517 Jun 16 18:30:08.078793 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 347/685] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:06 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1475 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:08.095002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:08.096639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:08.128654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:08.129481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:08.131822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:08.143204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:08.148459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:09.352768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:09.396467 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8076c696-fc00-4ae9-afc8-90ad39aab130 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1279 microversion: 2.1 time: 1.315307 Jun 16 18:30:09.414530 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 348/686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:08 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1279 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:09.444547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:09.460830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:09.501632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:09.502964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:09.505475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:09.506653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.376628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:30:11.377310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:30:11.377893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:30:11.378525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:30:11.379134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:30:11.414523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.414988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.415892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.416345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.507452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:30:11.514445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for user 4060431577d14c5198872173d8375e26 and project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:30:11.534888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:30:11.538318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:30:11.643493 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2162ce1-2609-4d68-8b2b-8a3f98872dff tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.786085 Jun 16 18:30:11.647434 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 339/687] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4792 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:30:11.659043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-057b647c-3fdd-4d31-bd49-083523e97e5f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f329820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:11.777222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:11.862636 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd791b2d-44e3-4769-b128-7dc84ff77108 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1390 microversion: 2.1 time: 2.445594 Jun 16 18:30:11.864082 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 349/688] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:09 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1390 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:11.869382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2eed26b0-34c4-4629-b218-a457ff50ed06 req-f84fe346-a1ff-4414-8f7f-ce2d7f94f451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0c26f5-b935-4e31-b1d5-853ceef1469a", "name": "network-vif-deleted", "tag": "d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:11.881574 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-057b647c-3fdd-4d31-bd49-083523e97e5f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.232732 Jun 16 18:30:11.889867 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 340/689] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:11 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:11.893495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2eed26b0-34c4-4629-b218-a457ff50ed06 req-f84fe346-a1ff-4414-8f7f-ce2d7f94f451 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.894632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2eed26b0-34c4-4629-b218-a457ff50ed06 req-f84fe346-a1ff-4414-8f7f-ce2d7f94f451 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.913619 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2eed26b0-34c4-4629-b218-a457ff50ed06 req-f84fe346-a1ff-4414-8f7f-ce2d7f94f451 service nova] Creating event network-vif-deleted:d1d1f380-ea10-42e0-a8a3-196c1b3f9ea5 for instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a on n-h2-846209-2 Jun 16 18:30:11.918711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:11.922718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:11.930979 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2eed26b0-34c4-4629-b218-a457ff50ed06 req-f84fe346-a1ff-4414-8f7f-ce2d7f94f451 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065140 Jun 16 18:30:11.935262 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 350/690] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:11.943111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:11.949056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:11.949422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:11.972127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.973693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.975508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.978790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.983126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.983860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.985087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.987877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:12.590791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:12.655486 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f54ca77-3bf7-45c7-8fd6-5fd5d3eb1f5d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1279 microversion: 2.1 time: 0.718108 Jun 16 18:30:12.663280 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 351/691] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:11 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1279 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:12.675820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9595069e-5e1f-471f-8920-0c35b9a06646 req-edacb690-8509-483a-8a74-d9ca6095a837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a485eb4a-1ede-45ad-86b0-2b290fcef08e", "name": "network-vif-plugged", "status": "completed", "tag": "678519fa-e046-4180-b534-f4379e0029d6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:12.712265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9595069e-5e1f-471f-8920-0c35b9a06646 req-edacb690-8509-483a-8a74-d9ca6095a837 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:12.712826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9595069e-5e1f-471f-8920-0c35b9a06646 req-edacb690-8509-483a-8a74-d9ca6095a837 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:12.779071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9595069e-5e1f-471f-8920-0c35b9a06646 req-edacb690-8509-483a-8a74-d9ca6095a837 service nova] Creating event network-vif-plugged:678519fa-e046-4180-b534-f4379e0029d6 for instance a485eb4a-1ede-45ad-86b0-2b290fcef08e on n-h1-846209-2 Jun 16 18:30:12.799170 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9595069e-5e1f-471f-8920-0c35b9a06646 req-edacb690-8509-483a-8a74-d9ca6095a837 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131869 Jun 16 18:30:12.801468 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 352/692] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:12.831567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3e0be672-853a-49ae-9643-8041d56778d6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:12.835625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3e0be672-853a-49ae-9643-8041d56778d6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:13.277269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:13.320207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3e0be672-853a-49ae-9643-8041d56778d6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:13.328971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3e0be672-853a-49ae-9643-8041d56778d6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:13.339889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3e0be672-853a-49ae-9643-8041d56778d6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:13.351537 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3e0be672-853a-49ae-9643-8041d56778d6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1262 microversion: 2.25 time: 0.547758 Jun 16 18:30:13.352289 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 353/693] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:12 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1262 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:13.386778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:13.388735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:13.422312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:13.424807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:13.435300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:13.436162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:13.640212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:13.673306 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-089b2e25-9d5f-4bab-8c2d-aca7a3596779 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1475 microversion: 2.1 time: 1.775748 Jun 16 18:30:13.675077 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 341/694] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:11 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1475 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:13.698637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24b0e0fc-8c23-4908-9fa1-9f6796c05be1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f3295e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:13.800111 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24b0e0fc-8c23-4908-9fa1-9f6796c05be1 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.119154 Jun 16 18:30:13.811210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 342/695] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:13 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:13.826610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:13.834505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:13.877284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:13.877284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:13.878693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:13.879428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:14.574360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:14.622938 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e855c787-ad6b-4f7c-bbc4-e993fcd2d227 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1390 microversion: 2.1 time: 1.254503 Jun 16 18:30:14.629285 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 354/696] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:13 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1390 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:14.637329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:14.650937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:14.675213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:14.675830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:14.676761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:14.677319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:15.573929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:15.612806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:15.627935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:15.636064 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-31e34b19-c2c9-4af5-9efa-d5dfa868df6e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1322 microversion: 2.25 time: 1.002306 Jun 16 18:30:15.643469 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 355/697] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:14 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1322 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:15.691465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:15.692931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:15.716427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:15.719135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:15.724382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:15.741621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:15.768315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:15.799182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:15.824457 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0dc3d962-e6ad-4ad4-b4a9-f4bbc89dc108 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1321 microversion: 2.1 time: 2.011857 Jun 16 18:30:15.827853 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 343/698] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:13 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1321 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:15.837636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-642b513a-86f1-4cfd-b7c9-7fbd25d32996 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f3299d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:16.050707 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-642b513a-86f1-4cfd-b7c9-7fbd25d32996 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.220175 Jun 16 18:30:16.051659 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 344/699] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:15 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:16.098346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:16.100030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:16.143052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:16.146333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:16.147821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:16.155738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:18.664251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:18.727508 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-053ee0db-3d22-49fa-827c-80f2e4b842b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1474 microversion: 2.1 time: 3.080573 Jun 16 18:30:18.732096 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 356/700] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:15 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1474 bytes in 3088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:18.764685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:18.785810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:18.809716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:18.820060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:18.821144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:18.827514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:18.834183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:20.386599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:20.427615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:20.431584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:20.435036 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3e75df7-84da-4179-a8a7-3886cc3f6f92 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1320 microversion: 2.25 time: 1.700766 Jun 16 18:30:20.442151 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 357/701] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:18 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1320 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:20.469827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:20.483379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:20.506848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:20.511036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:20.512827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:20.519064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:20.556570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:20.589025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-edbdd177-adbe-4511-8ec4-b275c22d10c2 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1390 microversion: 2.1 time: 4.517981 Jun 16 18:30:20.596281 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 345/702] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:16 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1390 bytes in 4533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:20.610101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d87ab66-780c-4a6d-83d1-7f2df6aa1c01 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f14c280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:20.866897 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d87ab66-780c-4a6d-83d1-7f2df6aa1c01 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.268890 Jun 16 18:30:20.867876 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 346/703] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:20 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:20.887011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5615dddd-cf70-44dd-bc2b-e64736b91c3c req-3edf3e1d-6d41-4171-8360-8e486829755f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5b8207-d6e0-4a7a-a371-09ef84e6df0d", "tag": "8ee551b5-4eaf-466d-abf1-9999158dc897"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:20.922059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5615dddd-cf70-44dd-bc2b-e64736b91c3c req-3edf3e1d-6d41-4171-8360-8e486829755f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:20.922517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5615dddd-cf70-44dd-bc2b-e64736b91c3c req-3edf3e1d-6d41-4171-8360-8e486829755f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:20.971748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:20.977321 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5615dddd-cf70-44dd-bc2b-e64736b91c3c req-3edf3e1d-6d41-4171-8360-8e486829755f service nova] Creating event network-changed:8ee551b5-4eaf-466d-abf1-9999158dc897 for instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d on n-h1-846209-2 Jun 16 18:30:21.021934 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5615dddd-cf70-44dd-bc2b-e64736b91c3c req-3edf3e1d-6d41-4171-8360-8e486829755f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152065 Jun 16 18:30:21.065305 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 347/704] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:21.096872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:21.098715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:21.121687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:21.125307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:21.130658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:21.138200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:21.497612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=18 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:21.529270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:23.328290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:23.856381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:23.882115 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ed115efd-550d-4dae-9fdb-b761df3bbf24 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1321 microversion: 2.1 time: 3.437565 Jun 16 18:30:23.883110 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 358/705] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:20 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1321 bytes in 3440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:23.934363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:23.936719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:23.986205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:23.996134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:23.997252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:23.997868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:24.696148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:24.737072 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1a215a9a-10d3-435c-be99-94c002a3fa5f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1474 microversion: 2.1 time: 3.660783 Jun 16 18:30:24.738613 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 348/706] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:21 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1474 bytes in 3672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:24.773563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:24.777291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:24.795097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:24.796521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:24.797597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:24.801063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:25.368678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:25.402526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:25.419394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:25.427979 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4907896c-6e56-4a6c-b4e4-7b8cc7c56401 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 1.542769 Jun 16 18:30:25.429701 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 359/707] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:23 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:25.452006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1edac45a-0c2e-47cb-b506-225ad6cc1aff tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f5aef70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:25.622504 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1edac45a-0c2e-47cb-b506-225ad6cc1aff tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.189486 Jun 16 18:30:25.631369 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 360/708] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:25 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:25.665517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-89aaa64a-294f-4759-a5db-50e5d42dd07d req-8a2b6d40-7d5d-401a-83b0-aea41e039444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea640aa-c5ff-4c21-bbcf-b4cc4f343eec", "tag": "09c19a30-faf6-4963-973a-94992ff717ae"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:25.699769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-89aaa64a-294f-4759-a5db-50e5d42dd07d req-8a2b6d40-7d5d-401a-83b0-aea41e039444 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:25.701190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-89aaa64a-294f-4759-a5db-50e5d42dd07d req-8a2b6d40-7d5d-401a-83b0-aea41e039444 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:25.708891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:25.728000 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24550a63-5caa-4f54-9419-fe62b56c596f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1390 microversion: 2.1 time: 0.981787 Jun 16 18:30:25.739187 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 349/709] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:24 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1390 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:25.756797 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-89aaa64a-294f-4759-a5db-50e5d42dd07d req-8a2b6d40-7d5d-401a-83b0-aea41e039444 service nova] Creating event network-changed:09c19a30-faf6-4963-973a-94992ff717ae for instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec on n-h2-846209-2 Jun 16 18:30:25.769858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-603243ec-c739-46c7-a886-615651daf1a0 req-e93b247e-11d0-411e-88e9-203edcdd2da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e9024f-4e2b-4f1c-a71e-1390992cad98", "name": "network-vif-unplugged", "status": "completed", "tag": "fcb637ef-3933-4d14-be52-088ea331e952"}, {"name": "network-changed", "server_uuid": "f7e9024f-4e2b-4f1c-a71e-1390992cad98", "tag": "fcb637ef-3933-4d14-be52-088ea331e952"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:25.789074 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-89aaa64a-294f-4759-a5db-50e5d42dd07d req-8a2b6d40-7d5d-401a-83b0-aea41e039444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155076 Jun 16 18:30:25.792395 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 361/710] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:25.819007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:25.820246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:25.827286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-603243ec-c739-46c7-a886-615651daf1a0 req-e93b247e-11d0-411e-88e9-203edcdd2da3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:25.834356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-603243ec-c739-46c7-a886-615651daf1a0 req-e93b247e-11d0-411e-88e9-203edcdd2da3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:25.865585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:25.872508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:25.873814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:25.874469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:25.894111 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-603243ec-c739-46c7-a886-615651daf1a0 req-e93b247e-11d0-411e-88e9-203edcdd2da3 service nova] Creating event network-vif-unplugged:fcb637ef-3933-4d14-be52-088ea331e952 for instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 on n-h1-846209-2 Jun 16 18:30:25.894958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-603243ec-c739-46c7-a886-615651daf1a0 req-e93b247e-11d0-411e-88e9-203edcdd2da3 service nova] Creating event network-changed:fcb637ef-3933-4d14-be52-088ea331e952 for instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 on n-h1-846209-2 Jun 16 18:30:25.912256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-603243ec-c739-46c7-a886-615651daf1a0 req-e93b247e-11d0-411e-88e9-203edcdd2da3 service nova] Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:30:25.941063 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-603243ec-c739-46c7-a886-615651daf1a0 req-e93b247e-11d0-411e-88e9-203edcdd2da3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.199857 Jun 16 18:30:25.944507 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 350/711] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:25.960400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:25.963388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:25.975870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:25.979400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:25.980653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:25.981278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:27.263794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:27.352356 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc48c83c-ff33-4e5c-b14d-db7ddf2190ad tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1321 microversion: 2.1 time: 1.542861 Jun 16 18:30:27.353453 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 362/712] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:25 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1321 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:27.430096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:27.448755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:27.455925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:27.472381 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-47354142-f85e-4170-99c3-f535d495e398 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1474 microversion: 2.1 time: 1.526275 Jun 16 18:30:27.484137 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 351/713] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:25 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1474 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:27.486157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:27.486827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:27.487854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:27.488311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:27.497934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1f29763a-4e1c-4c55-8710-29630106757f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f511dc0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:27.586800 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1f29763a-4e1c-4c55-8710-29630106757f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.100495 Jun 16 18:30:27.593400 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 352/714] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:27 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:27.611611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:27.612179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:27.633543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:27.634373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:27.636404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:27.637427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:28.897830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:28.942063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:28.957466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:28.963868 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f8a9c642-f424-4043-af53-be6ccd84fc71 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 1.583892 Jun 16 18:30:28.986887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:28.996794 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 363/715] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:27 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:29.046163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:29.046989 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c52e5092-2763-4033-a1d1-f21c18806e65 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1390 microversion: 2.1 time: 1.415905 Jun 16 18:30:29.050062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:29.083041 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 353/716] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:27 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1390 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:29.093735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:29.101166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:29.103417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:29.115313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:29.122816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:29.127266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:29.171437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:29.186703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:29.188595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:29.190884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:31.671800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:31.681463 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-51beaf09-8125-4539-967a-dcbf5a0746ce tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1321 microversion: 2.1 time: 2.682275 Jun 16 18:30:31.695878 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 364/717] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:28 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1321 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:31.711305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ab6971d-43ef-4ea3-8043-9db984c70dfb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f40bf70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:31.777180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:31.790274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2d3e3d7-a8a0-4afa-839c-8c6758f07c10 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1472 microversion: 2.1 time: 2.700684 Jun 16 18:30:31.808673 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ab6971d-43ef-4ea3-8043-9db984c70dfb tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.111301 Jun 16 18:30:31.810910 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 365/718] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:31 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:31.820738 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 354/719] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:29 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1472 bytes in 2737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:31.841831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:31.842487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:31.879917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:31.880458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:31.882302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:31.882302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:32.595562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-160331298", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "652e1c69-530a-4824-b271-fd75e40c3e31"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:32.713839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] validate_networks() for [('652e1c69-530a-4824-b271-fd75e40c3e31', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:30:33.309235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:33.392133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:33.395945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:33.401542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e4bc4c1c-65f2-4ccf-885f-b47ade6ff35f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 1.576123 Jun 16 18:30:33.405323 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 355/720] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:31 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:33.429402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:33.441258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:33.493233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:33.496520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:33.502844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:33.510348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:35.281844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:35.367199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b90f11d5-062e-462b-b22a-7f53283b413d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1390 microversion: 2.1 time: 1.939675 Jun 16 18:30:35.376790 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 356/721] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:33 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1390 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:35.399812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d3e5418b-ba26-4ba4-a83b-7603a7a57941 req-36614180-4a7f-417c-92d1-c05609288146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5b8207-d6e0-4a7a-a371-09ef84e6df0d", "name": "network-vif-plugged", "status": "completed", "tag": "8ee551b5-4eaf-466d-abf1-9999158dc897"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:35.471107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d3e5418b-ba26-4ba4-a83b-7603a7a57941 req-36614180-4a7f-417c-92d1-c05609288146 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:35.477849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d3e5418b-ba26-4ba4-a83b-7603a7a57941 req-36614180-4a7f-417c-92d1-c05609288146 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:35.547654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d3e5418b-ba26-4ba4-a83b-7603a7a57941 req-36614180-4a7f-417c-92d1-c05609288146 service nova] Creating event network-vif-plugged:8ee551b5-4eaf-466d-abf1-9999158dc897 for instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d on n-h1-846209-2 Jun 16 18:30:35.577066 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d3e5418b-ba26-4ba4-a83b-7603a7a57941 req-36614180-4a7f-417c-92d1-c05609288146 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197637 Jun 16 18:30:35.591361 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 357/722] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:35.616823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f75d80ec-dafb-44ef-a233-0e0393847372 req-ad89539d-56fa-4e9b-a55a-447116f5272f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a8542d7-28dd-4d92-9478-29f75115d971", "tag": "48a523f8-07e1-4b76-94e5-113d1c400297"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:35.645347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f75d80ec-dafb-44ef-a233-0e0393847372 req-ad89539d-56fa-4e9b-a55a-447116f5272f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:35.654835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f75d80ec-dafb-44ef-a233-0e0393847372 req-ad89539d-56fa-4e9b-a55a-447116f5272f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:35.681964 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f75d80ec-dafb-44ef-a233-0e0393847372 req-ad89539d-56fa-4e9b-a55a-447116f5272f service nova] Creating event network-changed:48a523f8-07e1-4b76-94e5-113d1c400297 for instance 8a8542d7-28dd-4d92-9478-29f75115d971 on n-h1-846209-2 Jun 16 18:30:35.696294 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f75d80ec-dafb-44ef-a233-0e0393847372 req-ad89539d-56fa-4e9b-a55a-447116f5272f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102254 Jun 16 18:30:35.702843 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 358/723] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:35.709020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:35.718987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:35.741540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:35.742192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:35.743183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:35.744008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:37.411572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:30:37.413361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:30:37.414616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:30:37.415597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:30:37.416656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:30:37.492291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:37.493090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:37.504317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:37.506782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:37.510998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:37.565805 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8ebc087f-bc71-4430-bf5d-2ed2d2495646 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1321 microversion: 2.1 time: 1.860848 Jun 16 18:30:37.577665 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 359/724] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:35 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1321 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:37.587589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:30:37.599588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d477644c-70a9-4ed6-b2ce-44f10abfb7c4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f50e820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:37.612955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for user 6483600a33ef407d9071cd24d84f6ee6 and project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:30:37.683401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:30:37.699022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:30:37.736628 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d477644c-70a9-4ed6-b2ce-44f10abfb7c4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.148295 Jun 16 18:30:37.745348 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 360/725] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:37 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:37.769582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:37.770489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:37.785425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:37.786991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:37.786991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:37.787645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:37.910550 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c0639423-a0a3-4c2d-be03-532c68716347 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.094812 Jun 16 18:30:37.915259 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 366/726] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 6103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:30:37.948630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:37.960078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:38.003889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:38.004887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:38.005896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:38.018349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:38.797480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:38.827079 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bdf3fbde-2d6f-49a2-8049-a8867a99c62d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1469 microversion: 2.1 time: 1.064334 Jun 16 18:30:38.856928 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 361/727] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:37 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1469 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:38.878373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:38.882562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:38.919239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:38.920185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:38.927088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:38.935460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:39.032211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:39.035441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=83 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:39.087699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:39.090477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:39.092086 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ead8fac-d98b-4fa4-a591-e8ad674be0d4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 1.175564 Jun 16 18:30:39.101387 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 367/728] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:37 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:39.108301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfc6cbac-d63e-4248-ac12-38bbcc54dae5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:39.115130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfc6cbac-d63e-4248-ac12-38bbcc54dae5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:39.656905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cfc6cbac-d63e-4248-ac12-38bbcc54dae5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:39.708421 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfc6cbac-d63e-4248-ac12-38bbcc54dae5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1210 microversion: 2.1 time: 0.596082 Jun 16 18:30:39.710924 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 368/729] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:39 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1210 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:39.996544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab25ef51-3073-4c2f-be3b-dd8a66fe4c25 tempest-FloatingIPDetailsNegativeTestJSON-1896945839 tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project] Calling method '.version_select at 0x7f866f40bee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:40.497369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:40.514629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0f7e3dc-da5c-4c1a-b296-a79c89cd8935 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1588 microversion: 2.1 time: 1.653786 Jun 16 18:30:40.537381 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 362/730] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:38 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1588 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:40.575740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:40.584753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:40.629276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:40.630147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:40.631323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:40.633880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:40.644552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-ab25ef51-3073-4c2f-be3b-dd8a66fe4c25 tempest-FloatingIPDetailsNegativeTestJSON-1896945839 tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 49fa4803-1b53-4f28-a134-cb71e1acb45e could not be found", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:30:40.647090 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ab25ef51-3073-4c2f-be3b-dd8a66fe4c25 tempest-FloatingIPDetailsNegativeTestJSON-1896945839 tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project] HTTP exception thrown: Floating IP not found for ID 49fa4803-1b53-4f28-a134-cb71e1acb45e Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab25ef51-3073-4c2f-be3b-dd8a66fe4c25 tempest-FloatingIPDetailsNegativeTestJSON-1896945839 tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project] Request method failure captured: Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-floating-ips/49fa4803-1b53-4f28-a134-cb71e1acb45e HTTP/1.1 Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3bNXA6DBYn3xt0Lt0-t9L1Spms2RPGh_O05wUg2SWwgcO7h4egVgSBMs_0gci4YTEQ3ljLIWrALNj9YKWp1-RRHolwj0w6wWCBvGjceno6wNUF4rJZ7W7eUpv-wKKWzQgtPWaI7hWx_KREg6BAjRtLc7X8VE7AzVtUf0ERpBV0AjFw Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8fb514dd29e8484c91de7c06d5dcab8a Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1896945839 Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:30:40.662492 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb514dd29e8484c91de7c06d5dcab8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb514dd29e8484c91de7c06d5dcab8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb514dd29e8484c91de7c06d5dcab8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb514dd29e8484c91de7c06d5dcab8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1896945839 Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8fb514dd29e8484c91de7c06d5dcab8a Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1896945839 Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 94f6e3c9d43e40559d66ff958936dfec Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: exception: Floating IP not found for ID 49fa4803-1b53-4f28-a134-cb71e1acb45e Jun 16 18:30:40.665371 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '49fa4803-1b53-4f28-a134-cb71e1acb45e'} Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:30:40.667621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 49fa4803-1b53-4f28-a134-cb71e1acb45e could not be found Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89079ae8-8b93-4395-bb9a-018753daa103'] Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 49fa4803-1b53-4f28-a134-cb71e1acb45e. Jun 16 18:30:40.670278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 49fa4803-1b53-4f28-a134-cb71e1acb45e Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:40.672819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:40.679017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:40.679017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 49fa4803-1b53-4f28-a134-cb71e1acb45e Jun 16 18:30:40.679017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:40.680030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab25ef51-3073-4c2f-be3b-dd8a66fe4c25 tempest-FloatingIPDetailsNegativeTestJSON-1896945839 tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project] Returning 404 to user: Floating IP not found for ID 49fa4803-1b53-4f28-a134-cb71e1acb45e {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:40.683158 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab25ef51-3073-4c2f-be3b-dd8a66fe4c25 tempest-FloatingIPDetailsNegativeTestJSON-1896945839 tempest-FloatingIPDetailsNegativeTestJSON-1896945839-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/49fa4803-1b53-4f28-a134-cb71e1acb45e" status: 404 len: 111 microversion: 2.1 time: 0.963568 Jun 16 18:30:40.690821 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 369/731] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:30:39 2022] GET /compute/v2.1/os-floating-ips/49fa4803-1b53-4f28-a134-cb71e1acb45e => generated 111 bytes in 977 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:30:40.733133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78ee62a2-3875-46d6-9d66-a3d622407e28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f86740c2af0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:40.854564 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78ee62a2-3875-46d6-9d66-a3d622407e28 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1412 microversion: 2.1 time: 0.161195 Jun 16 18:30:40.856521 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 370/732] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:40 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:40.874591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-495f4157-2d69-46af-a81e-07f1c817caf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:40.886929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-495f4157-2d69-46af-a81e-07f1c817caf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:40.933380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-495f4157-2d69-46af-a81e-07f1c817caf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:40.934542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-495f4157-2d69-46af-a81e-07f1c817caf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:40.936651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-495f4157-2d69-46af-a81e-07f1c817caf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:40.941391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-495f4157-2d69-46af-a81e-07f1c817caf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:41.240444 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-495f4157-2d69-46af-a81e-07f1c817caf6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98/action" status: 204 len: 0 microversion: 2.1 time: 0.381964 Jun 16 18:30:41.257208 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 371/733] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:30:40 2022] POST /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98/action => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:30:41.286519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b1c0fa2c-7f4c-43b2-8128-6c717c680f84 req-2ea9ba00-ba4e-459c-9548-cf7152d69d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e9024f-4e2b-4f1c-a71e-1390992cad98", "name": "network-vif-plugged", "status": "completed", "tag": "fcb637ef-3933-4d14-be52-088ea331e952"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:41.307065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b1c0fa2c-7f4c-43b2-8128-6c717c680f84 req-2ea9ba00-ba4e-459c-9548-cf7152d69d6b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:41.307666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b1c0fa2c-7f4c-43b2-8128-6c717c680f84 req-2ea9ba00-ba4e-459c-9548-cf7152d69d6b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:41.361035 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b1c0fa2c-7f4c-43b2-8128-6c717c680f84 req-2ea9ba00-ba4e-459c-9548-cf7152d69d6b service nova] Creating event network-vif-plugged:fcb637ef-3933-4d14-be52-088ea331e952 for instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 on n-h1-846209-2 Jun 16 18:30:41.400853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-b1c0fa2c-7f4c-43b2-8128-6c717c680f84 req-2ea9ba00-ba4e-459c-9548-cf7152d69d6b service nova] Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:30:41.454744 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b1c0fa2c-7f4c-43b2-8128-6c717c680f84 req-2ea9ba00-ba4e-459c-9548-cf7152d69d6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187161 Jun 16 18:30:41.461315 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 372/734] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:41.499240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:41.500141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:41.529411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:41.535229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:41.536308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:41.536902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:42.553259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:42.597034 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c28281d5-ec6f-4bb0-9740-d35ad77fb467 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1321 microversion: 2.1 time: 2.057107 Jun 16 18:30:42.622169 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 363/735] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:40 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1321 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:42.651049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b18e05a7-f221-4ce5-83e6-ee7aaf6f8934 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:42.652323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b18e05a7-f221-4ce5-83e6-ee7aaf6f8934 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:42.664176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=35 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:42.689546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18e05a7-f221-4ce5-83e6-ee7aaf6f8934 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:42.696527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18e05a7-f221-4ce5-83e6-ee7aaf6f8934 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:42.699604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18e05a7-f221-4ce5-83e6-ee7aaf6f8934 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:42.704183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18e05a7-f221-4ce5-83e6-ee7aaf6f8934 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:43.763323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:43.778133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:43.780147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:43.784478 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f939538-daf4-496d-abe1-5a20e3514295 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 2.318263 Jun 16 18:30:43.804507 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 373/736] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:41 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:43.804780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b18e05a7-f221-4ce5-83e6-ee7aaf6f8934 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.168619 Jun 16 18:30:43.804780 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 364/737] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:30:42 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d/os-interface => generated 284 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:43.813048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:43.814017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:43.826941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:43.829320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:43.842533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:43.843655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:43.848443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:43.848912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:43.867967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:43.868436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:43.879510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:43.880108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:44.163215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:44.184228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-243fb6f9-9c66-4c64-9726-4f5d324316ed tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1268 microversion: 2.1 time: 0.386618 Jun 16 18:30:44.190248 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 374/738] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:43 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1268 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:44.204464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-902c48a3-a1a9-4b36-a7dd-82d72a045435 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f579c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:44.355732 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-902c48a3-a1a9-4b36-a7dd-82d72a045435 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1421 microversion: 2.1 time: 0.161324 Jun 16 18:30:44.366069 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 375/739] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:44 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1421 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:44.389688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6c97f398-ea65-45c4-ac2f-c9bcad79706e req-3db5009a-7526-4ff1-8b5e-9557439c9a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea640aa-c5ff-4c21-bbcf-b4cc4f343eec", "name": "network-vif-plugged", "status": "completed", "tag": "09c19a30-faf6-4963-973a-94992ff717ae"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:44.411727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6c97f398-ea65-45c4-ac2f-c9bcad79706e req-3db5009a-7526-4ff1-8b5e-9557439c9a19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:44.412605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6c97f398-ea65-45c4-ac2f-c9bcad79706e req-3db5009a-7526-4ff1-8b5e-9557439c9a19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:44.445057 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6c97f398-ea65-45c4-ac2f-c9bcad79706e req-3db5009a-7526-4ff1-8b5e-9557439c9a19 service nova] Creating event network-vif-plugged:09c19a30-faf6-4963-973a-94992ff717ae for instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec on n-h2-846209-2 Jun 16 18:30:44.459106 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6c97f398-ea65-45c4-ac2f-c9bcad79706e req-3db5009a-7526-4ff1-8b5e-9557439c9a19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091141 Jun 16 18:30:44.460246 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 376/740] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:44.468487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:44.471371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:44.479513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:44.480317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:44.482180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:44.482839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:45.054641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:45.062235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:45.095809 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2be767b1-5a22-4f31-8ecd-d63b589c569b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1469 microversion: 2.1 time: 1.289082 Jun 16 18:30:45.096157 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5aecf8e-f1c9-4315-97c3-cd957dc8380a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1321 microversion: 2.1 time: 0.629091 Jun 16 18:30:45.097499 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 365/741] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:43 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1469 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:45.110558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b15cae4-1362-44db-a595-eddb015a435e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4fa430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:45.113286 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 377/742] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:44 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1321 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:45.143363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:45.146152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:45.170598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:45.172179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:45.176394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:45.177254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:45.241895 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b15cae4-1362-44db-a595-eddb015a435e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 200 len: 1421 microversion: 2.1 time: 0.130853 Jun 16 18:30:45.244788 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 366/743] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:30:45 2022] GET /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 1421 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:45.260556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:45.266828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:45.305157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:45.306142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:45.321421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:45.324339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:45.640131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:45.692405 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-018a418c-e845-49fe-b0c2-1bf3b1f6db48 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1268 microversion: 2.1 time: 0.427999 Jun 16 18:30:45.698193 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 367/744] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:45 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1268 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:45.747262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-60a9f4b9-4013-4d5a-b755-1eb6b70ed47e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f3295e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:46.413010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:46.433991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:46.437087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:46.438439 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b30412df-ac46-4823-858b-223ce0c7d026 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 1.314529 Jun 16 18:30:46.439346 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 378/745] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:45 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:46.453356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:46.457928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:46.484269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:46.484893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:46.485764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:46.488661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:47.051611 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-60a9f4b9-4013-4d5a-b755-1eb6b70ed47e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 204 len: 0 microversion: 2.1 time: 1.347678 Jun 16 18:30:47.052910 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 368/746] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:45 2022] DELETE /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 0 bytes in 1354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:30:47.064499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:47.065703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:47.076529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:47.077408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:47.078921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:47.079684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:47.552797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:48.222286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:48.238488 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41b13c7e-cb55-48da-82ad-6e2e4bf5420d tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 1.182112 Jun 16 18:30:48.239698 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 369/747] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:47 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:48.257737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:48.258639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:48.268339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.269170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.271144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.272359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.311668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:48.313576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:48.358973 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5aa9e1d2-b0cf-456a-a196-bf958fa16418 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1461 microversion: 2.1 time: 1.916135 Jun 16 18:30:48.360965 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 379/748] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:46 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1461 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:48.380321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:48.381721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:48.399193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.400547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.404888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.405799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.435285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:48.455587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d58a3779-0f2c-45d7-a969-578a3f01b134 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1268 microversion: 2.1 time: 0.213968 Jun 16 18:30:48.471238 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 370/749] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:48 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1268 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:48.482309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:48.484330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:48.510048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.523121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.525008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.526152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.527006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:30:48.702538 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afe75356-3c2b-45dc-a81d-c1688fbac500 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 204 len: 0 microversion: 2.1 time: 0.339185 Jun 16 18:30:48.710504 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 380/750] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:30:48 2022] DELETE /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:30:48.717948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0dcee268-5e1d-4822-9366-9d4063df4cd1 req-f3fd106d-38c8-4d89-b7a8-a23b72dbd552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5b8207-d6e0-4a7a-a371-09ef84e6df0d", "tag": "8ee551b5-4eaf-466d-abf1-9999158dc897"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:48.732803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0dcee268-5e1d-4822-9366-9d4063df4cd1 req-f3fd106d-38c8-4d89-b7a8-a23b72dbd552 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.733536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0dcee268-5e1d-4822-9366-9d4063df4cd1 req-f3fd106d-38c8-4d89-b7a8-a23b72dbd552 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.763590 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0dcee268-5e1d-4822-9366-9d4063df4cd1 req-f3fd106d-38c8-4d89-b7a8-a23b72dbd552 service nova] Creating event network-changed:8ee551b5-4eaf-466d-abf1-9999158dc897 for instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d on n-h1-846209-2 Jun 16 18:30:48.770611 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0dcee268-5e1d-4822-9366-9d4063df4cd1 req-f3fd106d-38c8-4d89-b7a8-a23b72dbd552 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057733 Jun 16 18:30:48.772956 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 381/751] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:48.783894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:48.784906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:48.796534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.797275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.798504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.801500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:49.483814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:49.493076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:49.514237 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ce17c384-533b-4f7a-8a8b-c58c1d79ebae tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1588 microversion: 2.1 time: 1.040826 Jun 16 18:30:49.515195 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 371/752] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:48 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1588 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:49.535190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9165156b-7e17-4d83-a978-835eed8a93f1 req-a28224fd-3e5a-4c65-9dba-27d3d56f5532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8542d7-28dd-4d92-9478-29f75115d971", "name": "network-vif-plugged", "status": "completed", "tag": "48a523f8-07e1-4b76-94e5-113d1c400297"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:49.545070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:49.553227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9165156b-7e17-4d83-a978-835eed8a93f1 req-a28224fd-3e5a-4c65-9dba-27d3d56f5532 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:49.553492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:49.558510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00ce87aa-c040-443e-b184-77ea3fdfca79 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 0.783252 Jun 16 18:30:49.565068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9165156b-7e17-4d83-a978-835eed8a93f1 req-a28224fd-3e5a-4c65-9dba-27d3d56f5532 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:49.571063 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 382/753] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:48 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:49.581971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:49.594838 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9165156b-7e17-4d83-a978-835eed8a93f1 req-a28224fd-3e5a-4c65-9dba-27d3d56f5532 service nova] Creating event network-vif-plugged:48a523f8-07e1-4b76-94e5-113d1c400297 for instance 8a8542d7-28dd-4d92-9478-29f75115d971 on n-h1-846209-2 Jun 16 18:30:49.596501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:49.611895 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9165156b-7e17-4d83-a978-835eed8a93f1 req-a28224fd-3e5a-4c65-9dba-27d3d56f5532 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091799 Jun 16 18:30:49.614111 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 372/754] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:49.625000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:49.625731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:49.629532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:49.636945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:49.638136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:49.643556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:49.651000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:49.654072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:49.662511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:49.664022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:49.664717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:49.751817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:50.217467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:50.248702 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-86ec6457-01d9-446b-9f12-28c60a3bff35 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 0.673395 Jun 16 18:30:50.252485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 383/755] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:49 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:50.294897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:50.312494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-216972050", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "608da02e-c32f-4a3c-bcd7-760fd8a6c9d5"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:50.351297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-84b6810a-316c-48dc-9dcd-798d94002813 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1461 microversion: 2.1 time: 0.735414 Jun 16 18:30:50.359586 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 373/756] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:49 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1461 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:50.401503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:50.404101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:50.435105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:50.439022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:50.442089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:50.443266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:50.586257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] validate_networks() for [('608da02e-c32f-4a3c-bcd7-760fd8a6c9d5', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:30:52.136736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:52.147514 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-792af8c9-481c-4ac4-8147-654a24d15474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1310 microversion: 2.1 time: 1.785864 Jun 16 18:30:52.148508 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 374/757] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:50 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1310 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:52.172057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7f08e32-3473-4e3d-ac55-0b19d0e140f0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2144237593", "metadata": {"": ""}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7f08e32-3473-4e3d-ac55-0b19d0e140f0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action HTTP/1.1 Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 107 Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:30:52.176632 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2144237593", "metadata": {"": ""}}} Jun 16 18:30:52.178369 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'bea640aa-c5ff-4c21-bbcf-b4cc4f343eec', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2144237593', 'metadata': {'': ''}}}} Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'': ''} Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:52.179134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:52.180405 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:52.182231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:52.182231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:52.182231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:30:52.182231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:30:52.182231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:52.182231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:30:52.184841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7f08e32-3473-4e3d-ac55-0b19d0e140f0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:52.185965 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e7f08e32-3473-4e3d-ac55-0b19d0e140f0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action" status: 400 len: 170 microversion: 2.1 time: 0.018286 Jun 16 18:30:52.187295 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 375/758] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Jun 16 18:30:52 2022] POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:30:52.192486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-035deebc-ca7c-4758-ad10-7a7658d204d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'create', calling method: .version_select at 0x7f866f4dc310>, body: {"keypair": {"name": "tempest-keypair-1748357638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgjgSpCb50jmODGqrFmXvJvxyZ/qZQ02kQhb4DOhH2uKiwc0hYXBDnsJfJpbiIwBr2XU9+OvAWU+UvM9ubLxpnDYdsMSWakXmOySiZQamb5mCGQDQIMkZiWM5E/nC3krw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:52.214275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-035deebc-ca7c-4758-ad10-7a7658d204d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for project 2978681eacda4da685a087c0b1025df3. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:30:52.220393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-035deebc-ca7c-4758-ad10-7a7658d204d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for user 209d0e879aea45269c56a7c7d9869b23 and project 2978681eacda4da685a087c0b1025df3. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:30:52.278399 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-035deebc-ca7c-4758-ad10-7a7658d204d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088263 Jun 16 18:30:52.280441 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 376/759] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:30:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:52.299184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:52.300710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:52.336428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.341940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.348939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.349671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.407387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:30:52.408833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:30:52.409969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:30:52.411243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:30:52.412001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:30:52.458579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.459347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.461065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.461864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.549523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:30:52.565464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for user 33f458b13d494ef7bc8e7055be73fa42 and project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:30:52.602630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:30:52.608722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:30:52.682153 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a3c90b5b-016b-4a4c-870d-e1119f4e7659 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.413120 Jun 16 18:30:52.684038 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 384/760] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:30:52.690051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5c9061c5-796a-42d9-b078-40f814e26132 req-56f337b0-3307-4f0a-9de8-cb462da4f578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a485eb4a-1ede-45ad-86b0-2b290fcef08e", "name": "network-vif-unplugged", "status": "completed", "tag": "678519fa-e046-4180-b534-f4379e0029d6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:52.707792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5c9061c5-796a-42d9-b078-40f814e26132 req-56f337b0-3307-4f0a-9de8-cb462da4f578 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.708722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5c9061c5-796a-42d9-b078-40f814e26132 req-56f337b0-3307-4f0a-9de8-cb462da4f578 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.727301 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5c9061c5-796a-42d9-b078-40f814e26132 req-56f337b0-3307-4f0a-9de8-cb462da4f578 service nova] Creating event network-vif-unplugged:678519fa-e046-4180-b534-f4379e0029d6 for instance a485eb4a-1ede-45ad-86b0-2b290fcef08e on n-h1-846209-2 Jun 16 18:30:52.735329 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5c9061c5-796a-42d9-b078-40f814e26132 req-56f337b0-3307-4f0a-9de8-cb462da4f578 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049782 Jun 16 18:30:52.742809 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 385/761] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:52.756036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:52.757063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:52.767143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.768536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.769630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.771072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:53.904302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:53.928666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:53.930874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:53.935092 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa8bc119-18af-42dc-9014-4a09d0cb90b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1362 microversion: 2.25 time: 1.652627 Jun 16 18:30:53.935595 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 377/762] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:52 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1362 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:53.951111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:53.952029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:53.959216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:53.959971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:53.960966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:53.961586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:54.275633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:54.287802 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d745163e-cdce-4b6d-95bb-be24b6647765 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 1.540691 Jun 16 18:30:54.307308 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 386/763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:52 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:54.314941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:54.315595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:54.354923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:54.354923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:54.356436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:54.357254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:54.372838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:54.405483 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9795b0ab-e2d6-4f1f-b3d8-3066ea570314 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1211 microversion: 2.1 time: 0.458764 Jun 16 18:30:54.406235 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 378/764] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:53 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1211 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:54.435779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0fa5f999-d43c-48f2-b64f-0908df36e517 req-c261caae-59d1-4a7a-a51e-a7e82caafb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a485eb4a-1ede-45ad-86b0-2b290fcef08e", "name": "network-vif-deleted", "tag": "678519fa-e046-4180-b534-f4379e0029d6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:54.488111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0fa5f999-d43c-48f2-b64f-0908df36e517 req-c261caae-59d1-4a7a-a51e-a7e82caafb69 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:54.491902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0fa5f999-d43c-48f2-b64f-0908df36e517 req-c261caae-59d1-4a7a-a51e-a7e82caafb69 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:54.571123 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0fa5f999-d43c-48f2-b64f-0908df36e517 req-c261caae-59d1-4a7a-a51e-a7e82caafb69 service nova] Creating event network-vif-deleted:678519fa-e046-4180-b534-f4379e0029d6 for instance a485eb4a-1ede-45ad-86b0-2b290fcef08e on n-h1-846209-2 Jun 16 18:30:54.582018 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0fa5f999-d43c-48f2-b64f-0908df36e517 req-c261caae-59d1-4a7a-a51e-a7e82caafb69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162770 Jun 16 18:30:54.584517 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 379/765] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:54.598049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:54.599717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:54.614506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:54.616852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:54.619457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:54.620341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:54.905858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:54.918944 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87d0d108-b5dd-4c46-a06a-df9773403e62 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1310 microversion: 2.1 time: 0.607733 Jun 16 18:30:54.932954 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 387/766] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:54 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1310 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:54.954258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:54.954925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:54.971759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:54.972586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:54.973628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:54.974331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.010562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:55.489970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:55.544168 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d576f9a-3709-4f89-9926-50fb14cf5581 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 0.954192 Jun 16 18:30:55.550183 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 380/767] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:54 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:55.573421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:55.577444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:55.595517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.596445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.597506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.598262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.996287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:56.013839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:56.017564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:56.021476 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c6eb6905-db95-4019-b6fe-33afa888c48d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1557 microversion: 2.25 time: 1.070737 Jun 16 18:30:56.039290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:56.041009 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 388/768] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:54 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1557 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:30:56.065047 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66616896-ef6e-4091-8763-7f3b5647b1c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1265 microversion: 2.1 time: 0.511690 Jun 16 18:30:56.065667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8ee86f3-1cf7-4f0f-b38d-f8f298507f01 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2086558067", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:56.083541 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 381/769] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:55 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1265 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:56.086364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:56.090432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8ee86f3-1cf7-4f0f-b38d-f8f298507f01 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action HTTP/1.1 Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 619 Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:30:56.096143 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:30:56.097804 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:30:56.098687 n-d-846209-2 devstack@n-api.service[119207]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2086558067", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jun 16 18:30:56.098687 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:30:56.098687 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'bea640aa-c5ff-4c21-bbcf-b4cc4f343eec', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2086558067', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 16 18:30:56.099035 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:56.099975 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:56.101165 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:56.104655 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:56.104655 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:56.104655 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:30:56.104655 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:30:56.104655 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:30:56.104655 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:56.105183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8ee86f3-1cf7-4f0f-b38d-f8f298507f01 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:56.105183 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8ee86f3-1cf7-4f0f-b38d-f8f298507f01 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action" status: 400 len: 938 microversion: 2.1 time: 0.054878 Jun 16 18:30:56.105183 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 389/770] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Jun 16 18:30:56 2022] POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action => generated 938 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:30:56.119299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:56.120088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:56.122908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:56.126965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:56.378418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:56.379472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:56.390172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:56.391193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:56.392700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:56.393408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.043708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:57.062269 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca8c3e22-c80d-4663-b7da-9605ca19a765 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1310 microversion: 2.1 time: 0.991109 Jun 16 18:30:57.063832 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 382/771] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:56 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1310 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:57.070847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:57.072649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:57.081012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.082373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.083654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.084339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.200911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 8a8542d7-28dd-4d92-9478-29f75115d971 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:30:57.233186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-423b5a51-faa0-43c8-a91f-bae66ab14c29 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 2050 microversion: 2.25 time: 1.131189 Jun 16 18:30:57.234873 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 390/772] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:56 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 2050 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:57.243294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f067d01d-5cf6-4a4b-8bb8-44c03c47f97e req-30534e0c-a93b-4032-acac-95df451679bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f015f4-9f00-4880-9173-03b674d03c95", "tag": "431965cc-38d3-4de3-a2d6-2aa176d81509"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:57.257083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f067d01d-5cf6-4a4b-8bb8-44c03c47f97e req-30534e0c-a93b-4032-acac-95df451679bc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.258712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f067d01d-5cf6-4a4b-8bb8-44c03c47f97e req-30534e0c-a93b-4032-acac-95df451679bc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.283817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f067d01d-5cf6-4a4b-8bb8-44c03c47f97e req-30534e0c-a93b-4032-acac-95df451679bc service nova] Creating event network-changed:431965cc-38d3-4de3-a2d6-2aa176d81509 for instance f4f015f4-9f00-4880-9173-03b674d03c95 on n-h2-846209-2 Jun 16 18:30:57.293187 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f067d01d-5cf6-4a4b-8bb8-44c03c47f97e req-30534e0c-a93b-4032-acac-95df451679bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056407 Jun 16 18:30:57.295067 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 391/773] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:57.306611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:57.308581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:57.326481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.328795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.331470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.333403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.585195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:57.597464 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2ad3135a-4a56-473d-a9f4-b85eebeb79cd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1265 microversion: 2.1 time: 0.300356 Jun 16 18:30:57.600015 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 392/774] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:57 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:57.600741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:57.610808 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3e8cf209-64a1-4f3c-8f97-99f6c27c239a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 0.544900 Jun 16 18:30:57.614256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:57.615132 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 383/775] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:57 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:57.617596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:57.633761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.637152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.640442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.642565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.643176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:57.643899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:57.661522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.662379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.663398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.664058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:58.187676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:58.209473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 8a8542d7-28dd-4d92-9478-29f75115d971 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:30:58.226826 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2437a04c-ab71-424f-9fe6-0508ed2f2e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 0.590213 Jun 16 18:30:58.231970 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 384/776] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:57 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:30:58.256890 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97fa14d1-e99e-42ff-83ae-e061ca2802ec tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 2050 microversion: 2.25 time: 0.652661 Jun 16 18:30:58.263880 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 393/777] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:57 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 2050 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:58.269457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:58.282311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:58.291387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:58.292143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:58.293384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:58.294048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:58.515619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1769486531", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:58.678681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] validate_networks() for [('4212a0cd-cfb7-48a1-8db8-d3f563e64c9d', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:30:58.910015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:58.940767 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f738f385-d411-4af0-bd11-1ae16966e000 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1310 microversion: 2.1 time: 0.675159 Jun 16 18:30:58.944115 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 394/778] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:58 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1310 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:58.957866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c447a749-119a-4748-a587-6d22363739c9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c447a749-119a-4748-a587-6d22363739c9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action HTTP/1.1 Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 285 Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:30:58.972564 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:30:58.975246 n-d-846209-2 devstack@n-api.service[119207]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'bea640aa-c5ff-4c21-bbcf-b4cc4f343eec', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:30:58.976571 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:30:58.977783 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:30:58.980874 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:30:58.986999 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:30:58.986999 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:30:58.986999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c447a749-119a-4748-a587-6d22363739c9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:58.989879 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c447a749-119a-4748-a587-6d22363739c9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action" status: 400 len: 619 microversion: 2.1 time: 0.040028 Jun 16 18:30:58.991971 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 395/779] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Jun 16 18:30:58 2022] POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action => generated 619 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:30:59.006094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-760a970a-5eb7-4ef7-935b-c63550de5bde tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:59.011530 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:30:59.011530 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:30:59.021549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-760a970a-5eb7-4ef7-935b-c63550de5bde tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.023139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-760a970a-5eb7-4ef7-935b-c63550de5bde tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.026285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-760a970a-5eb7-4ef7-935b-c63550de5bde tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.027685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-760a970a-5eb7-4ef7-935b-c63550de5bde tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.089357 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-760a970a-5eb7-4ef7-935b-c63550de5bde tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.092273 Jun 16 18:30:59.098184 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 396/780] 10.222.0.27 () {60 vars in 1216 bytes} [Thu Jun 16 18:30:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:30:59.109758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:59.111356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:59.125415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.127006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.129028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.130256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:00.069289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:00.078296 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c8e4c0a8-37f8-488c-8df0-8cb73c86c330 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1307 microversion: 2.1 time: 0.978033 Jun 16 18:31:00.090116 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 397/781] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:59 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1307 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:00.096999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:00.097628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:00.115446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:00.115976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:00.116964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:00.117454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:01.171053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:01.217034 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c06dc28e-4263-4dc8-ad3c-cafc74631429 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 1.118304 Jun 16 18:31:01.221940 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 398/782] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:00 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:01.250167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846209-2", "block_migration": "auto"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:01.258617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:01.297480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:01.298290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:01.300085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:01.303597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:01.449361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:01.450521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:01.451153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:01.451718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:01.452293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:01.481390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:01.487822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:01.495906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:01.496364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:01.505322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'flavor' on Instance uuid 8a8542d7-28dd-4d92-9478-29f75115d971 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:31:01.536278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Going to try to live migrate instance to n-h2-846209-2 {{(pid=119207) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:31:01.587830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Getting quotas for project 295e1cc58e82459ab321439379b227ea. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:01.603976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Getting quotas for user 7eee236345ec40729015a74ba7f05a82 and project 295e1cc58e82459ab321439379b227ea. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:01.698738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:01.705278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:01.977238 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92bf37f1-45b6-48d1-85e6-3bbd4dd4d3b6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.737046 Jun 16 18:31:01.979488 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 385/783] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:01.990569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:01.992193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:02.044405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.046839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.051598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.055096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.583588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:02.626649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:02.667362 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fe65da8b-60ba-46ef-a10a-70fc84335061 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1310 microversion: 2.1 time: 0.672728 Jun 16 18:31:02.668533 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 386/784] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:01 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1310 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:02.690891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-82ce33b2-7276-4cbc-9a68-6e281bb49aef tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '.version_select at 0x7f866f4fa820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:02.701730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82ce33b2-7276-4cbc-9a68-6e281bb49aef tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.706328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82ce33b2-7276-4cbc-9a68-6e281bb49aef tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.759985 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-82ce33b2-7276-4cbc-9a68-6e281bb49aef tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1139 microversion: 2.1 time: 0.089487 Jun 16 18:31:02.761950 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 387/785] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:31:02 2022] GET /compute/v2.1/os-migrations => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:02.771595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:02.773109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:02.813280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.820912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.823414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.826695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.287800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:03.307440 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c1838a6-dda8-4e35-b1ea-7c824cc4b658 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1307 microversion: 2.1 time: 0.542899 Jun 16 18:31:03.308520 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 388/786] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:02 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1307 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:03.331225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:03.332429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:03.371170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.376133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.377635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.378493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.830898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:03.856977 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c8db4c9d-c6f2-4a18-bf38-940152b7c148 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 0.544002 Jun 16 18:31:03.859323 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 389/787] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:03 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:03.870143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:03.871628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:03.885948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.887367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.889566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.892046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:04.032592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:04.044085 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b3d2e01-6df9-446f-9a40-14aa47277223 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1276 microversion: 2.1 time: 0.182778 Jun 16 18:31:04.045032 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 390/788] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:03 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:04.054426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-025fde0c-2143-4170-9f34-ff15323c5e42 req-ef54f7f7-d095-4c7e-9162-c993567adad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05292bf7-3482-4a42-9f81-5759b17357aa", "tag": "952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:04.069253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-025fde0c-2143-4170-9f34-ff15323c5e42 req-ef54f7f7-d095-4c7e-9162-c993567adad1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:04.069979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-025fde0c-2143-4170-9f34-ff15323c5e42 req-ef54f7f7-d095-4c7e-9162-c993567adad1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:04.088126 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-025fde0c-2143-4170-9f34-ff15323c5e42 req-ef54f7f7-d095-4c7e-9162-c993567adad1 service nova] Creating event network-changed:952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5 for instance 05292bf7-3482-4a42-9f81-5759b17357aa on n-h2-846209-2 Jun 16 18:31:04.094812 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-025fde0c-2143-4170-9f34-ff15323c5e42 req-ef54f7f7-d095-4c7e-9162-c993567adad1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047544 Jun 16 18:31:04.095746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 391/789] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:04.105528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-288c8e44-aea3-4710-9a9b-c1cf793b85e8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:04.114407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-288c8e44-aea3-4710-9a9b-c1cf793b85e8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017321 Jun 16 18:31:04.125130 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 392/790] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:31:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:04.125130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:04.125130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:04.139006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:04.139006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:04.139476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:04.139856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:04.159160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:04.415961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:04.439434 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb449fdf-4a0d-4ff1-9ef7-0482f468cb70 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1310 microversion: 2.1 time: 0.318332 Jun 16 18:31:04.445076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 393/791] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:04 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1310 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:04.463190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0fa97b3f-aa61-4c8d-9970-d675923e046b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-514138353"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:04.466446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0fa97b3f-aa61-4c8d-9970-d675923e046b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:04.483086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fa97b3f-aa61-4c8d-9970-d675923e046b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:04.484468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fa97b3f-aa61-4c8d-9970-d675923e046b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:04.487430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fa97b3f-aa61-4c8d-9970-d675923e046b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:04.488753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fa97b3f-aa61-4c8d-9970-d675923e046b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.042206 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0fa97b3f-aa61-4c8d-9970-d675923e046b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action" status: 202 len: 0 microversion: 2.1 time: 0.592889 Jun 16 18:31:05.042920 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 394/792] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:04 2022] POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:31:05.060806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a8425303-c276-43b8-bbb3-1f37ff3fb8f8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1956994194", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:05.069087 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:31:05.069087 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:31:05.105689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a8425303-c276-43b8-bbb3-1f37ff3fb8f8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.061424 Jun 16 18:31:05.109594 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 395/793] 10.222.0.27 () {60 vars in 1145 bytes} [Thu Jun 16 18:31:05 2022] POST /compute/v2.1/flavors => generated 499 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:05.117326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:05.121723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:05.143920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.144589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.145439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.150579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.507446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:05.515907 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a6ba7bcc-fd72-45dd-87e8-7893b3a595d4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1307 microversion: 2.1 time: 0.403148 Jun 16 18:31:05.516514 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 396/794] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:05 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:05.526472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7f21e936-9173-41a7-8b53-834160e2bb14 req-013d7c83-4de4-4595-b097-c0f90a35c92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f015f4-9f00-4880-9173-03b674d03c95", "name": "network-vif-plugged", "status": "completed", "tag": "431965cc-38d3-4de3-a2d6-2aa176d81509"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:05.557981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7f21e936-9173-41a7-8b53-834160e2bb14 req-013d7c83-4de4-4595-b097-c0f90a35c92a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.558663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7f21e936-9173-41a7-8b53-834160e2bb14 req-013d7c83-4de4-4595-b097-c0f90a35c92a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.585390 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7f21e936-9173-41a7-8b53-834160e2bb14 req-013d7c83-4de4-4595-b097-c0f90a35c92a service nova] Creating event network-vif-plugged:431965cc-38d3-4de3-a2d6-2aa176d81509 for instance f4f015f4-9f00-4880-9173-03b674d03c95 on n-h2-846209-2 Jun 16 18:31:05.598148 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7f21e936-9173-41a7-8b53-834160e2bb14 req-013d7c83-4de4-4595-b097-c0f90a35c92a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080226 Jun 16 18:31:05.617165 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 397/795] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:05.631513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1345931596"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:05.637876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:05.645744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.646514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.647510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.648364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.717952 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Cannot 'createImage' instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec while it is in task_state image_snapshot Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action HTTP/1.1 Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 85 Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:31:05.720779 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1345931596"}} Jun 16 18:31:05.722448 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'createImage' instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec while it is in task_state image_snapshot Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'bea640aa-c5ff-4c21-bbcf-b4cc4f343eec', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1345931596'}}} Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:05.723426 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec while it is in task_state image_snapshot Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec while it is in task_state image_snapshot Jun 16 18:31:05.724965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:05.726419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 409 to user: Cannot 'createImage' instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec while it is in task_state image_snapshot {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:05.726419 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-197d56d7-ad11-45fa-9cd2-a4fb79adeac6 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action" status: 409 len: 159 microversion: 2.1 time: 0.102406 Jun 16 18:31:05.726419 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 398/796] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:05 2022] POST /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec/action => generated 159 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:31:05.731639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:05.732825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:05.745057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.745802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.747181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.748213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.924098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:05.935593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f74d737-c0b4-45dd-b6f9-051a3ead5bbe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1282 microversion: 2.1 time: 0.211065 Jun 16 18:31:05.936678 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 399/797] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:05 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:05.951571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-330e2071-b962-40dc-add8-ea7e4236a8c1 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:05.969445 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-330e2071-b962-40dc-add8-ea7e4236a8c1 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030708 Jun 16 18:31:05.985942 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 400/798] 10.222.0.27 () {58 vars in 1181 bytes} [Thu Jun 16 18:31:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:31:05.994838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:05.995725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:06.012373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.013688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:06.014829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.015286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:06.455749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:06.488150 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bd4d2e80-1d7e-4c19-b2e3-30ebd534b0f6 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1310 microversion: 2.1 time: 0.501307 Jun 16 18:31:06.489258 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 401/799] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:05 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1310 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:06.500094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f53cbda3-e3c1-4863-b606-1e8a5d64efae tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '.version_select at 0x7f866f511af0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:06.838479 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f53cbda3-e3c1-4863-b606-1e8a5d64efae tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/images/729ee2fd-ad98-460c-82ba-2979cd038645" status: 204 len: 0 microversion: 2.1 time: 0.347605 Jun 16 18:31:06.840593 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 402/800] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:06 2022] DELETE /compute/v2.1/images/729ee2fd-ad98-460c-82ba-2979cd038645 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:06.848383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1983155238", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "61c99f29-2703-45f8-8ddc-b1a402ff3352"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:06.926991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:07.301357 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0da9ea44-84ae-46fd-af7f-02fcea23c43e tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971/action" status: 202 len: 0 microversion: 2.25 time: 6.077360 Jun 16 18:31:07.303111 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 399/801] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:31:01 2022] POST /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971/action => generated 0 bytes in 6081 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:07.315882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:07.317396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:07.334348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.336051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.338544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.340193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.754581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:07.755656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:07.756296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:07.756839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:07.757266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:07.774847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.776004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.777560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.778410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.807224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:07.809969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:07.819657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for user 209d0e879aea45269c56a7c7d9869b23 and project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:07.842376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:07.845960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:07.907591 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ddb5a343-5a37-4007-a1ec-82791b78bd9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064631 Jun 16 18:31:07.917393 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 403/802] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:07.919516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:07.920499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:07.924064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:07.931809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.932613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.933778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.934548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.965898 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dbdf4bcd-3787-42de-a407-26f8a47fc9fc tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1307 microversion: 2.1 time: 0.644796 Jun 16 18:31:07.967514 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 400/803] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:07 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1307 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:07.977014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:07.978178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:07.994955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.995849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.997524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.998385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.583112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:08.610532 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e3b53321-3912-42c7-b1fb-b9cd4933c061 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1535 microversion: 2.1 time: 0.699374 Jun 16 18:31:08.611642 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 404/804] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:07 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1535 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:08.629730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:08.630527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:08.659537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:08.660913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:08.663754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.668579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:08.669132 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7b628894-f047-4b50-ad92-7fdcad80a117 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1324 microversion: 2.1 time: 0.700073 Jun 16 18:31:08.671941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.682727 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 401/805] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:07 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1324 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:08.688373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:08.689010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:08.695736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:08.696614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.697430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:08.697874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.975852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:08.993842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:08.995575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:09.006110 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6829fde-39ff-4fa3-86ad-a4d6fa4a6add tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.392686 Jun 16 18:31:09.006936 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 405/806] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:08 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:09.019817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:09.023188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:09.037850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.038686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.039768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.040431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:09.041806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.518522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:09.546846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-79be25ce-5dcb-4709-b21b-d998e499bff6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1275 microversion: 2.1 time: 0.538107 Jun 16 18:31:09.549639 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 406/807] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:09 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1275 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:09.570892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:09.578774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:09.597828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.598389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.599227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.599807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.685176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:09.755804 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd714e71-7695-47f0-82d6-4fbf237e2271 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1493 microversion: 2.1 time: 1.068008 Jun 16 18:31:09.765446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 402/808] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:08 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1493 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:09.831082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:09.840224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:09.868258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.870345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.872721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.874415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.741065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:10.767242 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-762b0150-bd19-4dab-a12b-5a31da3efb34 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1307 microversion: 2.1 time: 1.205241 Jun 16 18:31:10.769354 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 407/809] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:09 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1307 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:10.792300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ae64abac-a933-404d-bc67-76c3816e0208 req-5ab81ac8-d748-44b3-95cf-fbe105ad2c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05292bf7-3482-4a42-9f81-5759b17357aa", "name": "network-vif-plugged", "status": "completed", "tag": "952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:10.822928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:10.838203 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa21a39c-2fa1-4d33-a12f-5a989109bfd4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1517 microversion: 2.1 time: 1.063668 Jun 16 18:31:10.839539 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 403/810] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:09 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1517 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:10.844768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:10.847360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ae64abac-a933-404d-bc67-76c3816e0208 req-5ab81ac8-d748-44b3-95cf-fbe105ad2c6d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.848503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:10.849597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ae64abac-a933-404d-bc67-76c3816e0208 req-5ab81ac8-d748-44b3-95cf-fbe105ad2c6d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.883155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.885699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.889252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.889960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.955913 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ae64abac-a933-404d-bc67-76c3816e0208 req-5ab81ac8-d748-44b3-95cf-fbe105ad2c6d service nova] Creating event network-vif-plugged:952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5 for instance 05292bf7-3482-4a42-9f81-5759b17357aa on n-h2-846209-2 Jun 16 18:31:10.978248 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ae64abac-a933-404d-bc67-76c3816e0208 req-5ab81ac8-d748-44b3-95cf-fbe105ad2c6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205242 Jun 16 18:31:10.988803 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 408/811] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:11.208952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-311af232-9a05-4b39-b65a-925e32064eee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:11.209710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-311af232-9a05-4b39-b65a-925e32064eee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:11.222045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311af232-9a05-4b39-b65a-925e32064eee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:11.222504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311af232-9a05-4b39-b65a-925e32064eee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:11.224601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311af232-9a05-4b39-b65a-925e32064eee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:11.225074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311af232-9a05-4b39-b65a-925e32064eee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.015332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.037442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e500bc55-6284-4f2c-875e-f7bfec810675 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1324 microversion: 2.1 time: 1.196314 Jun 16 18:31:12.063825 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 404/812] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:10 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1324 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:12.075591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:12.079002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:12.098063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.101045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.123235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.124381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.140680 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-311af232-9a05-4b39-b65a-925e32064eee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1644 microversion: 2.1 time: 1.149121 Jun 16 18:31:12.143124 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 409/813] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:10 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1644 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:12.163997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2594fdc1-f18c-4c18-8a64-c81593ad574e req-8a05675f-bb50-4211-bdb0-ecbfd0c3f45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5487e1c8-2792-405c-91ef-5c4b4c4acdc4", "tag": "614ced4d-0258-4800-8fd5-e223c2331b5e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:12.188025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2594fdc1-f18c-4c18-8a64-c81593ad574e req-8a05675f-bb50-4211-bdb0-ecbfd0c3f45b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.188583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2594fdc1-f18c-4c18-8a64-c81593ad574e req-8a05675f-bb50-4211-bdb0-ecbfd0c3f45b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.214713 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2594fdc1-f18c-4c18-8a64-c81593ad574e req-8a05675f-bb50-4211-bdb0-ecbfd0c3f45b service nova] Creating event network-changed:614ced4d-0258-4800-8fd5-e223c2331b5e for instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 on n-h1-846209-2 Jun 16 18:31:12.231760 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2594fdc1-f18c-4c18-8a64-c81593ad574e req-8a05675f-bb50-4211-bdb0-ecbfd0c3f45b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085072 Jun 16 18:31:12.232383 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 410/814] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:12.246852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:12.247715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:12.261523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.262013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.263058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.263496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.551138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.554818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:12.567194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.574912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.576229 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-baa3102d-c69e-4ab9-9590-78b5f2fef253 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.510213 Jun 16 18:31:12.594450 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 405/815] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:12 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:12.612308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:12.613117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:12.637006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.638338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.639547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.642750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.718676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:31:12.843148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.887398 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-abf6e77d-809b-4194-9617-2f96494be7f3 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 204 len: 0 microversion: 2.1 time: 0.291108 Jun 16 18:31:12.892348 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 406/816] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:12 2022] DELETE /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:12.892710 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-acde4e41-62be-4f1b-825e-c43b51d89b08 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 0.654144 Jun 16 18:31:12.895140 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 411/817] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:12 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:12.909493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:12.910729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebd70baa-c65c-4ff4-b594-a84cea74ebef tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:12.911172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:12.916774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ebd70baa-c65c-4ff4-b594-a84cea74ebef tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:12.925297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.925949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.926950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.927663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.951960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd70baa-c65c-4ff4-b594-a84cea74ebef tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.952343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd70baa-c65c-4ff4-b594-a84cea74ebef tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.953424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd70baa-c65c-4ff4-b594-a84cea74ebef tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.954144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd70baa-c65c-4ff4-b594-a84cea74ebef tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.512399 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ebd70baa-c65c-4ff4-b594-a84cea74ebef tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1644 microversion: 2.1 time: 0.614993 Jun 16 18:31:13.513391 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 412/818] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:12 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1644 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:13.530310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:13.531195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:13.538207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.538661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.542149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.546014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.586954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.599959 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a45ebe40-1aa3-43a9-8057-22a46c3688e0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1487 microversion: 2.1 time: 0.705397 Jun 16 18:31:13.614651 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 407/819] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:12 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1487 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:13.621847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:13.622954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:13.630071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.630929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.631975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.632653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.926491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.936452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.948598 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3e7778f9-5798-44bc-ae4b-29b249bea8d7 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1523 microversion: 2.1 time: 0.434235 Jun 16 18:31:13.962153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 413/820] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:13 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:13.963257 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d016f780-506e-4fd6-99d4-644470bb5159 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1324 microversion: 2.1 time: 0.346918 Jun 16 18:31:13.964534 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 408/821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:13 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:13.969392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f293919-5a9c-4f8f-8849-5360ec002b25 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:13.972496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-20841e0d-dd0f-4a2d-a2a6-f5eacd1c92df req-2a126632-b24b-4933-a2c4-623ab85c4265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea640aa-c5ff-4c21-bbcf-b4cc4f343eec", "name": "network-vif-plugged", "status": "completed", "tag": "09c19a30-faf6-4963-973a-94992ff717ae"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:13.974488 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:31:13.974488 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:31:13.978987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f293919-5a9c-4f8f-8849-5360ec002b25 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.984668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f293919-5a9c-4f8f-8849-5360ec002b25 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.985822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f293919-5a9c-4f8f-8849-5360ec002b25 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.986429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f293919-5a9c-4f8f-8849-5360ec002b25 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.987844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20841e0d-dd0f-4a2d-a2a6-f5eacd1c92df req-2a126632-b24b-4933-a2c4-623ab85c4265 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.988485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20841e0d-dd0f-4a2d-a2a6-f5eacd1c92df req-2a126632-b24b-4933-a2c4-623ab85c4265 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.009869 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-20841e0d-dd0f-4a2d-a2a6-f5eacd1c92df req-2a126632-b24b-4933-a2c4-623ab85c4265 service nova] Creating event network-vif-plugged:09c19a30-faf6-4963-973a-94992ff717ae for instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec on n-h2-846209-2 Jun 16 18:31:14.018211 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-20841e0d-dd0f-4a2d-a2a6-f5eacd1c92df req-2a126632-b24b-4933-a2c4-623ab85c4265 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053260 Jun 16 18:31:14.019571 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 414/822] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:14.027901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:14.028956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.038908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.040304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.041691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.043575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.047609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:14.061491 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f293919-5a9c-4f8f-8849-5360ec002b25 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095317 Jun 16 18:31:14.068181 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 409/823] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:31:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:14.088749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:14.090295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.107797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.112270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.117757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.119687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.169701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lazy-loading 'flavor' on Instance uuid 05292bf7-3482-4a42-9f81-5759b17357aa {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:31:14.428991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.449286 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9c44b9c0-3e01-42c8-8216-1172140d8523 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa/action" status: 202 len: 0 microversion: 2.1 time: 0.368684 Jun 16 18:31:14.450490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 410/824] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:14 2022] POST /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:14.458227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.462321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.462974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:14.464400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.464564 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ec34b17d-b6df-4280-83a8-439cbc5cc3a6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.443018 Jun 16 18:31:14.465674 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 415/825] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:14 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:14.488799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.489490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.489939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846209-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:14.490780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.491804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.498510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.513464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.514507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.514861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.515319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.666720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lazy-loading 'flavor' on Instance uuid f4f015f4-9f00-4880-9173-03b674d03c95 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:31:14.767443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Going to try to live migrate instance to n-h1-846209-2 {{(pid=119206) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:31:15.448476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:15.457768 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90b18a4a-7af9-4e3f-b1e3-81d62c231ec3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 1.005473 Jun 16 18:31:15.458407 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 411/826] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:14 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:15.476752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-23cd371c-3592-4b1d-ab10-c4239d6bef67 req-23e98bd3-58b4-4dab-8bda-756bafe79dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8542d7-28dd-4d92-9478-29f75115d971", "name": "network-vif-unplugged", "status": "completed", "tag": "48a523f8-07e1-4b76-94e5-113d1c400297"}, {"name": "network-changed", "server_uuid": "8a8542d7-28dd-4d92-9478-29f75115d971", "tag": "48a523f8-07e1-4b76-94e5-113d1c400297"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:15.499306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-23cd371c-3592-4b1d-ab10-c4239d6bef67 req-23e98bd3-58b4-4dab-8bda-756bafe79dc7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:15.499762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-23cd371c-3592-4b1d-ab10-c4239d6bef67 req-23e98bd3-58b4-4dab-8bda-756bafe79dc7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:15.530849 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-23cd371c-3592-4b1d-ab10-c4239d6bef67 req-23e98bd3-58b4-4dab-8bda-756bafe79dc7 service nova] Creating event network-vif-unplugged:48a523f8-07e1-4b76-94e5-113d1c400297 for instance 8a8542d7-28dd-4d92-9478-29f75115d971 on n-h1-846209-2 Jun 16 18:31:15.531381 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-23cd371c-3592-4b1d-ab10-c4239d6bef67 req-23e98bd3-58b4-4dab-8bda-756bafe79dc7 service nova] Creating event network-changed:48a523f8-07e1-4b76-94e5-113d1c400297 for instance 8a8542d7-28dd-4d92-9478-29f75115d971 on n-h1-846209-2 Jun 16 18:31:15.545836 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-23cd371c-3592-4b1d-ab10-c4239d6bef67 req-23e98bd3-58b4-4dab-8bda-756bafe79dc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.082224 Jun 16 18:31:15.546863 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 412/827] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:15.552323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:15.564265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:15.582238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:15.583074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:15.593041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:15.594089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.068417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.089699 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3caf747-fad4-44c9-8aac-62e52d96e6c5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 200 len: 1478 microversion: 2.1 time: 0.541533 Jun 16 18:31:16.102761 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 413/828] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:15 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 1478 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:16.102761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:16.102761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:16.137931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.138716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.143823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.151011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.317787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.350256 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d76426f-91bd-4c06-a59e-342455286bb2 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 200 len: 1306 microversion: 2.1 time: 0.254790 Jun 16 18:31:16.350256 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 414/829] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:16 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:16.369747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:16.369747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:16.386104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.387070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.389292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.390720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.702783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.712821 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8a19cca8-c018-4d5f-ba44-da07fae1ab75 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1324 microversion: 2.1 time: 0.358782 Jun 16 18:31:16.713989 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 415/830] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:16 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:16.719281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:16.720120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:16.731250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.731773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.732613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.733059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.936793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.948757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.950643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.951950 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d69ad620-8fe2-4f20-9992-dc8db5bb2298 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.236814 Jun 16 18:31:16.953663 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 416/831] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:16 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:16.960021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b19bfcfb-2189-4207-bbc2-cc5921aab1d1 req-445dec9b-5bd7-4bcf-a0cd-e736a78c3d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31", "tag": "c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:16.973044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b19bfcfb-2189-4207-bbc2-cc5921aab1d1 req-445dec9b-5bd7-4bcf-a0cd-e736a78c3d37 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.973552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b19bfcfb-2189-4207-bbc2-cc5921aab1d1 req-445dec9b-5bd7-4bcf-a0cd-e736a78c3d37 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.989312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b19bfcfb-2189-4207-bbc2-cc5921aab1d1 req-445dec9b-5bd7-4bcf-a0cd-e736a78c3d37 service nova] Creating event network-changed:c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4 for instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 on n-h1-846209-2 Jun 16 18:31:16.997262 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b19bfcfb-2189-4207-bbc2-cc5921aab1d1 req-445dec9b-5bd7-4bcf-a0cd-e736a78c3d37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041528 Jun 16 18:31:16.998873 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 417/832] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:17.006599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d721210c-d46f-4990-add3-47a2e601a1a5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1918435656"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:17.007792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d721210c-d46f-4990-add3-47a2e601a1a5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:17.018596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d721210c-d46f-4990-add3-47a2e601a1a5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.019073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d721210c-d46f-4990-add3-47a2e601a1a5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.020128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d721210c-d46f-4990-add3-47a2e601a1a5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.020576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d721210c-d46f-4990-add3-47a2e601a1a5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.604674 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d721210c-d46f-4990-add3-47a2e601a1a5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa/action" status: 202 len: 0 microversion: 2.1 time: 0.603847 Jun 16 18:31:17.605505 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 418/833] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:16 2022] POST /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:31:17.611646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:17.612182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:17.620537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.621189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.622071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.622499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.792511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:17.831469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:17.846196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:17.861660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:17.871865 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-014af309-3bc4-4e2a-816b-ab657dcaa91f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 0.264233 Jun 16 18:31:17.872338 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 419/834] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:17 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:17.885178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:17.885892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:17.914486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.915528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.917544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.918439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.949807 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec HTTP/1.1 Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:31:17.953313 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:31:17.954900 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'bea640aa-c5ff-4c21-bbcf-b4cc4f343eec'} Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:17.955706 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:31:17.957033 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:17.959866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:17.959866 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3249653-4578-4866-a1d0-bd637854a164 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 404 len: 111 microversion: 2.1 time: 0.082320 Jun 16 18:31:17.966592 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 420/835] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:17 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:17.980096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-553a5186-7508-4c58-b51a-addceab3493b req-67d5dbd5-3347-4150-857f-98416b81f0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea640aa-c5ff-4c21-bbcf-b4cc4f343eec", "name": "network-vif-deleted", "tag": "09c19a30-faf6-4963-973a-94992ff717ae"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:18.002090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-553a5186-7508-4c58-b51a-addceab3493b req-67d5dbd5-3347-4150-857f-98416b81f0d1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.002550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-553a5186-7508-4c58-b51a-addceab3493b req-67d5dbd5-3347-4150-857f-98416b81f0d1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.017835 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-553a5186-7508-4c58-b51a-addceab3493b req-67d5dbd5-3347-4150-857f-98416b81f0d1 service nova] Creating event network-vif-deleted:09c19a30-faf6-4963-973a-94992ff717ae for instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec on n-h2-846209-2 Jun 16 18:31:18.026738 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-553a5186-7508-4c58-b51a-addceab3493b req-67d5dbd5-3347-4150-857f-98416b81f0d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048836 Jun 16 18:31:18.027736 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 421/836] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:18.035633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae0eba6a-b468-4f80-953a-867469b1e3b6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f7695e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:18.090308 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae0eba6a-b468-4f80-953a-867469b1e3b6 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.060854 Jun 16 18:31:18.099214 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 422/837] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:18 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:18.116505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:18.119437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:18.122664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:18.133140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.133763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.134855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.135354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.376551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:18.395572 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83b9adab-9aa1-4063-a70c-096186ddd80c tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1324 microversion: 2.1 time: 0.291189 Jun 16 18:31:18.396637 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 423/838] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:18 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:18.405095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:18.407505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:18.422792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.423343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.424230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.424900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.519580 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14dfacb8-9ecf-4f42-83f7-c066f152e494 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95/action" status: 202 len: 0 microversion: 2.1 time: 4.048767 Jun 16 18:31:18.521846 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 416/839] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:14 2022] POST /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95/action => generated 0 bytes in 4052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:18.538018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-606638b8-cca8-41dc-8974-e50ab0893fae tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'create', calling method: .version_select at 0x7f866f6da550>, body: {"keypair": {"name": "tempest-keypair-1773310378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGkQheOXCA1zTpjEqJuM5sHPAypGujj8MKd/70aq69Ey5TpBGfTUMQTPofhYCve13R+aRR07FstcoS4O40aE8RLLew653kgbKshG8lclW6sumKhY2ayQs3J6lADtT2EDw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:18.573478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-606638b8-cca8-41dc-8974-e50ab0893fae tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for project 14cf8ec8d4954e45857af05dc373a244. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:18.595492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-606638b8-cca8-41dc-8974-e50ab0893fae tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for user 25c692d1c95b4844812f6d3511268a45 and project 14cf8ec8d4954e45857af05dc373a244. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:18.640802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:18.661226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:18.666439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:18.668847 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-606638b8-cca8-41dc-8974-e50ab0893fae tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143813 Jun 16 18:31:18.669110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-006517c4-947f-4b79-a9ed-a56ecb3c10b8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.271253 Jun 16 18:31:18.673009 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 424/840] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:18 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:18.683462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:18.684250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:18.689216 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 417/841] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:31:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:18.726735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.730521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.731995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.732834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.909249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:18.915843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:18.959156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.962219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.969586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.972351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.580247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:19.593402 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c307158f-d086-46d0-a137-d42dfb1d3639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1503 microversion: 2.1 time: 0.919127 Jun 16 18:31:19.604011 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 425/842] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:18 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1503 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:19.621705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b971e9b-98e1-41c3-ad9a-a7f608c97fdd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f4a1040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:19.675307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:19.708799 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc23e5b5-df76-46dc-b06c-342aee068eab tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 0.810114 Jun 16 18:31:19.713711 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7b971e9b-98e1-41c3-ad9a-a7f608c97fdd tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.107826 Jun 16 18:31:19.714520 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 418/843] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:18 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:19.725398 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 426/844] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:19 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:19.727703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-430e3853-f742-4366-8002-69342f40b03e req-005fb989-9acb-4c79-b2ff-94271310ec1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5487e1c8-2792-405c-91ef-5c4b4c4acdc4", "name": "network-vif-plugged", "status": "completed", "tag": "614ced4d-0258-4800-8fd5-e223c2331b5e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:19.735526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:19.737407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:19.753427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.754581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.756586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.757847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.769642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-430e3853-f742-4366-8002-69342f40b03e req-005fb989-9acb-4c79-b2ff-94271310ec1c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.772615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-430e3853-f742-4366-8002-69342f40b03e req-005fb989-9acb-4c79-b2ff-94271310ec1c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.816284 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-430e3853-f742-4366-8002-69342f40b03e req-005fb989-9acb-4c79-b2ff-94271310ec1c service nova] Creating event network-vif-plugged:614ced4d-0258-4800-8fd5-e223c2331b5e for instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 on n-h1-846209-2 Jun 16 18:31:19.827353 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-430e3853-f742-4366-8002-69342f40b03e req-005fb989-9acb-4c79-b2ff-94271310ec1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109934 Jun 16 18:31:19.829230 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 419/845] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:19.841547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:19.843006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:19.861722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.863171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.865054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.865787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:20.376242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:20.403673 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eee32714-edc5-4b17-ab50-6eb006a542c5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1324 microversion: 2.1 time: 0.674957 Jun 16 18:31:20.447211 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 427/846] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:19 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1324 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:20.482836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:20.504863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:20.512866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:20.517142 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b8873703-5e5d-4c13-b766-8fc2f7afb45f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.686260 Jun 16 18:31:20.518515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 420/847] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:19 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:20.614172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:20.615740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:20.632829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.637162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:20.638840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.640578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:20.735030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:20.738531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:20.748647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.749154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:20.750046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.750500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.470079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:21.481232 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1daaddcd-237a-4490-a8d5-803d7e911a12 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1503 microversion: 2.1 time: 0.873631 Jun 16 18:31:21.486814 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 428/848] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:20 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1503 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:21.499916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b54743d8-f21c-4711-811b-136468c0bf18 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f378700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:21.528850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:21.545729 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4e30221-0ca5-40ad-ad9f-b9d0ae731c2a tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 0.820287 Jun 16 18:31:21.573431 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 421/849] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:20 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:21.603865 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b54743d8-f21c-4711-811b-136468c0bf18 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.106107 Jun 16 18:31:21.604893 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 429/850] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:21 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:21.625064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:21.626716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:21.648803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.653001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.656492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.657597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.751790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f7a8dcdc-839a-4d02-8a8f-a007a28cb6ed tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Action: 'create', calling method: .version_select at 0x7f866f6da0d0>, body: {"keypair": {"name": "tempest-keypair-563714311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTwnon1MdynuNLC1eT9JuqJe0Kspt3dTl66HPZA/L3VybNzStyFCb8Tz6Ryob7K10dl6KLzxgRJdS7lx1As7qIizs2eCKFtmORmZyTsmh/F0iHK0T6ckZNmhyD3JMkUuw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:21.782894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f7a8dcdc-839a-4d02-8a8f-a007a28cb6ed tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Getting quotas for project 5f56d74d6e1b49b6869e4f224a260de0. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:21.790579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f7a8dcdc-839a-4d02-8a8f-a007a28cb6ed tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Getting quotas for user 9433cd550c0549f38981948ac49c6614 and project 5f56d74d6e1b49b6869e4f224a260de0. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:21.828632 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f7a8dcdc-839a-4d02-8a8f-a007a28cb6ed tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253268 Jun 16 18:31:21.835825 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 422/851] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:31:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:21.848387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:21.852970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:21.872111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.872955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.874000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.875458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.272745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:22.294889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:22.298224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:22.304595 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3ffcb5b9-db16-4ddc-a7b6-8b0f05c02bb6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.463752 Jun 16 18:31:22.306713 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 423/852] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:21 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:22.318043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-89d5a432-d03e-4e64-9693-13a8b593c560 req-eca58751-2ae6-4999-84ff-8ba6d684ccde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8542d7-28dd-4d92-9478-29f75115d971", "name": "network-vif-unplugged", "status": "completed", "tag": "48a523f8-07e1-4b76-94e5-113d1c400297"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:22.342940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-89d5a432-d03e-4e64-9693-13a8b593c560 req-eca58751-2ae6-4999-84ff-8ba6d684ccde service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.354764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-89d5a432-d03e-4e64-9693-13a8b593c560 req-eca58751-2ae6-4999-84ff-8ba6d684ccde service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.385402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-89d5a432-d03e-4e64-9693-13a8b593c560 req-eca58751-2ae6-4999-84ff-8ba6d684ccde service nova] Creating event network-vif-unplugged:48a523f8-07e1-4b76-94e5-113d1c400297 for instance 8a8542d7-28dd-4d92-9478-29f75115d971 on n-h1-846209-2 Jun 16 18:31:22.401383 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-89d5a432-d03e-4e64-9693-13a8b593c560 req-eca58751-2ae6-4999-84ff-8ba6d684ccde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087845 Jun 16 18:31:22.402693 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 424/853] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:22.427841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:22.430429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:22.455600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.456100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.459288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.459648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.467176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:22.482096 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8322f6e-7a7a-4afe-bd2a-b7f2441eb957 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1324 microversion: 2.1 time: 0.875713 Jun 16 18:31:22.487336 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 430/854] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:21 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1324 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:22.515908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:22.518143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:22.532247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.535188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:31:22.536451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.541286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.547381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.744065 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6b285608-e3e8-4392-87bc-dde3dcd1ef4d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 204 len: 0 microversion: 2.1 time: 0.332456 Jun 16 18:31:22.748226 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 425/855] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:22 2022] DELETE /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:22.770515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:22.771245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:22.796110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.796673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.798008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.798453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:24.002601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:24.104324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:24.142989 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4740bf15-145f-4921-a2f2-1c113679af65 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1503 microversion: 2.1 time: 1.631169 Jun 16 18:31:24.144459 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 431/856] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:22 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1503 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:24.158507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-657da391-7bc7-4d97-8ff3-af697b223c45 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f378ee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:24.237896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:24.269250 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4df9041-8a6c-46cc-adc7-0c44b96db3d5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 1.500936 Jun 16 18:31:24.307029 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 426/857] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:22 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:24.329429 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-657da391-7bc7-4d97-8ff3-af697b223c45 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.172780 Jun 16 18:31:24.338529 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 432/858] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:24 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:24.343658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:24.348861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:24.383941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:24.388106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:24.406260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:24.408719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:24.411487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:24.415658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:24.428119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:24.430315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:24.432663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:24.437659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.148237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:27.149758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:27.194973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:27.209468 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ed89353e-9602-43c8-953e-eb881b6bb13f tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1712 microversion: 2.1 time: 2.893486 Jun 16 18:31:27.211952 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 427/859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:24 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1712 bytes in 2903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:27.236928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:27.239439 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-294c8765-093f-4484-ace1-a4917ea9d2d0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 2.898448 Jun 16 18:31:27.240453 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 433/860] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:24 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 2901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:27.272136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:27.277587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:27.283339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2aba3d87-32f2-4fb0-a366-7ae2ad44dd30 req-fdae0fb9-fd30-4838-b8f5-722f0f5a674d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f015f4-9f00-4880-9173-03b674d03c95", "name": "network-vif-unplugged", "status": "completed", "tag": "431965cc-38d3-4de3-a2d6-2aa176d81509"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:27.314441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2aba3d87-32f2-4fb0-a366-7ae2ad44dd30 req-fdae0fb9-fd30-4838-b8f5-722f0f5a674d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.316245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2aba3d87-32f2-4fb0-a366-7ae2ad44dd30 req-fdae0fb9-fd30-4838-b8f5-722f0f5a674d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.317759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.321405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.327492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.328392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.358856 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2aba3d87-32f2-4fb0-a366-7ae2ad44dd30 req-fdae0fb9-fd30-4838-b8f5-722f0f5a674d service nova] Creating event network-vif-unplugged:431965cc-38d3-4de3-a2d6-2aa176d81509 for instance f4f015f4-9f00-4880-9173-03b674d03c95 on n-h2-846209-2 Jun 16 18:31:27.366118 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2aba3d87-32f2-4fb0-a366-7ae2ad44dd30 req-fdae0fb9-fd30-4838-b8f5-722f0f5a674d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109612 Jun 16 18:31:27.368940 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 434/861] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:27.387230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9251a7da-4c2e-45d4-839c-124ebd8f736e req-0e24bd52-4515-4da6-8663-54c4d2029627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05292bf7-3482-4a42-9f81-5759b17357aa", "name": "network-vif-plugged", "status": "completed", "tag": "952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:27.471554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9251a7da-4c2e-45d4-839c-124ebd8f736e req-0e24bd52-4515-4da6-8663-54c4d2029627 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.481761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9251a7da-4c2e-45d4-839c-124ebd8f736e req-0e24bd52-4515-4da6-8663-54c4d2029627 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.530608 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9251a7da-4c2e-45d4-839c-124ebd8f736e req-0e24bd52-4515-4da6-8663-54c4d2029627 service nova] Creating event network-vif-plugged:952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5 for instance 05292bf7-3482-4a42-9f81-5759b17357aa on n-h2-846209-2 Jun 16 18:31:27.548609 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9251a7da-4c2e-45d4-839c-124ebd8f736e req-0e24bd52-4515-4da6-8663-54c4d2029627 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174717 Jun 16 18:31:27.553412 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 435/862] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:27.567889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:27.575373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:27.591170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.592007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.595718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.596419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:28.653651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:28.683866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:28.710225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e60ac847-db9f-4f56-addc-a6ddb9216a42 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1519 microversion: 2.1 time: 1.473482 Jun 16 18:31:28.724712 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 428/863] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:27 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1519 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:28.731588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:28.732665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:28.735156 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7c8414b-69c8-406c-a9cb-e94a1969ae01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1503 microversion: 2.1 time: 1.178485 Jun 16 18:31:28.737070 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 436/864] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:27 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1503 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:28.747526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62021eba-4914-466e-8f45-f83da30b8647 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f584c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:28.752472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:28.753408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:28.755903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:28.756967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:28.865772 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62021eba-4914-466e-8f45-f83da30b8647 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.126991 Jun 16 18:31:28.867177 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 437/865] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:28 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:28.873546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1818964644", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:28.996494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] validate_networks() for [('02050194-15bb-475f-8e51-c895317b0755', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:29.272214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:29.291704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-daec0142-7016-43e3-8261-6496cd52fca1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 0.562845 Jun 16 18:31:29.296117 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 429/866] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:28 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:29.310062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:29.315217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:29.352433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:29.352951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:29.353831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:29.359343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:29.575063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f947f4cdaa0949d1894a458a1c84bbc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb148860ba84601a7ff43b94223d7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:29.613075 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e5afd756-90ee-44b6-8184-73b4e3197392 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 200 len: 1644 microversion: 2.1 time: 0.314479 Jun 16 18:31:29.627144 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 430/867] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:29 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 1644 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:29.642127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:29.647502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:29.668511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:29.669796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:29.670820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:29.671437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:29.703985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:30.320499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:30.338370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:30.340875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:30.342510 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b96c3f87-4e69-4bc4-accf-fe5019e09434 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1567 microversion: 2.25 time: 0.713468 Jun 16 18:31:30.343694 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 431/868] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:29 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1567 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:30.350737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "625d45de-5ebe-41a7-86ca-98aa6503f01c"}], "security_groups": [{"name": "tempest-securitygroup--2099156849"}], "key_name": "tempest-keypair-563714311", "user_data": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:30.905193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:30.905748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:30.906115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:30.906550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:30.907176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:30.925345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:30.926537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:30.928781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:30.930949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:30.977725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for project 14cf8ec8d4954e45857af05dc373a244. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:30.978354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] validate_networks() for [('625d45de-5ebe-41a7-86ca-98aa6503f01c', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:30.984896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for user 25c692d1c95b4844812f6d3511268a45 and project 14cf8ec8d4954e45857af05dc373a244. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:31.009657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:31.012702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:31.133038 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-93c568e8-d377-4c08-9c62-1937ff67d2af tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.263984 Jun 16 18:31:31.138643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 438/869] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:31.147732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d7944cb-3718-460f-afaf-84b22b154616 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'create', calling method: .version_select at 0x7f866f378670>, body: {"pool": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:31.801423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:32.906294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:32.907319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:32.908033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:32.908774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:32.909548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:32.961410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:32.976536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:32.980539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:32.983092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:33.063918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:33.115516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Getting quotas for project 5f56d74d6e1b49b6869e4f224a260de0. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:33.157946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Getting quotas for user 9433cd550c0549f38981948ac49c6614 and project 5f56d74d6e1b49b6869e4f224a260de0. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:33.240974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:33.248790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:33.369086 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-93fd5a4c-7713-447a-99d5-d328eb570d73 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.015205 Jun 16 18:31:33.372205 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 432/870] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 3027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:33.389141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a18d4d4f-d9da-4677-89c8-ece7f1d28aab req-45f09e02-5b50-475f-b4b6-1a170f8f4e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31", "name": "network-vif-plugged", "status": "completed", "tag": "c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:33.403853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a18d4d4f-d9da-4677-89c8-ece7f1d28aab req-45f09e02-5b50-475f-b4b6-1a170f8f4e90 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:33.404328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a18d4d4f-d9da-4677-89c8-ece7f1d28aab req-45f09e02-5b50-475f-b4b6-1a170f8f4e90 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:33.443636 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a18d4d4f-d9da-4677-89c8-ece7f1d28aab req-45f09e02-5b50-475f-b4b6-1a170f8f4e90 service nova] Creating event network-vif-plugged:c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4 for instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 on n-h1-846209-2 Jun 16 18:31:33.458716 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a18d4d4f-d9da-4677-89c8-ece7f1d28aab req-45f09e02-5b50-475f-b4b6-1a170f8f4e90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080952 Jun 16 18:31:33.460631 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 433/871] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:33.468110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:33.470630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:33.480139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:33.481830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:33.482905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:33.483479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:34.162490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:34.177555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-294f9101-0f7f-42e9-849c-0dd83d3e2d4a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1503 microversion: 2.1 time: 0.715158 Jun 16 18:31:34.184565 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 434/872] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:33 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1503 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:34.190792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12db32de-f235-4ab1-a587-d97ceca3b244 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f21e430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:34.357804 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12db32de-f235-4ab1-a587-d97ceca3b244 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.167561 Jun 16 18:31:34.358864 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 435/873] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:34 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:34.366454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-209418dd-b3f6-42bf-8091-2bb5e1d10062 req-07a80afb-d83e-4e9f-aacf-179388785541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f015f4-9f00-4880-9173-03b674d03c95", "tag": "431965cc-38d3-4de3-a2d6-2aa176d81509"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:34.381067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-209418dd-b3f6-42bf-8091-2bb5e1d10062 req-07a80afb-d83e-4e9f-aacf-179388785541 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:34.381885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-209418dd-b3f6-42bf-8091-2bb5e1d10062 req-07a80afb-d83e-4e9f-aacf-179388785541 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:34.400103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-209418dd-b3f6-42bf-8091-2bb5e1d10062 req-07a80afb-d83e-4e9f-aacf-179388785541 service nova] Creating event network-changed:431965cc-38d3-4de3-a2d6-2aa176d81509 for instance f4f015f4-9f00-4880-9173-03b674d03c95 on n-h2-846209-2 Jun 16 18:31:34.408828 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-209418dd-b3f6-42bf-8091-2bb5e1d10062 req-07a80afb-d83e-4e9f-aacf-179388785541 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048451 Jun 16 18:31:34.409955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 436/874] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:34.418207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:34.419438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:34.427679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:34.428609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:34.430503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:34.431549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.080368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:35.097074 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97def486-59f6-42df-a71b-f1b6cebe4fba tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1379 microversion: 2.1 time: 0.685517 Jun 16 18:31:35.098032 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 437/875] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:34 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1379 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:35.103749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:35.111378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:35.126866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.130062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.132230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.133318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.204983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] HTTP exception thrown: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Request method failure captured: Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d HTTP/1.1 Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Y3zVFPME11GB5Z3CTf1Qc3kfIClRYH_UIBPuM_-gsZjRCfGNBBSK_5f8rQCw9lKSSQwhkfqyEi5kzzJwBCz3uelqYxtnwPrSs8RTEqw1LZgjM5czUufHwFGoSVvAqm_K-OfH_VphFs7C4VGl2_FGiUE-xdYdHyCbkPUODIfdTsQvM Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:31:35.212496 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eb148860ba84601a7ff43b94223d7e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: f947f4cdaa0949d1894a458a1c84bbc8 Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:35.215412 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'cc5b8207-d6e0-4a7a-a371-09ef84e6df0d'} Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:35.216992 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:35.221052 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:35.226634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Returning 404 to user: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:35.233126 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-621d39dd-5e60-48a6-abed-5c9d6b578b14 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 404 len: 111 microversion: 2.1 time: 0.128716 Jun 16 18:31:35.233834 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 438/876] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:35 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:35.261639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:35.262639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:35.279066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.279557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.280446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.281438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.743753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:35.764920 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fa0650e3-8fea-45e0-ae33-7e77a263bdca tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1283 microversion: 2.1 time: 0.519454 Jun 16 18:31:35.768949 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 439/877] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:35 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1283 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:35.784274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:35.796718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:35.834401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.834881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.836287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.836727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.473538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.489991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.496193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.503376 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f82ba238-04e0-4b06-bfb8-80e1402d642d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1557 microversion: 2.25 time: 0.730987 Jun 16 18:31:36.505451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 440/878] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:35 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1557 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:36.518168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:36.521740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:36.537996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.539875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.543265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.543740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.843162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.859462 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f68b2b25-93f6-4b4c-b5eb-99e688ba3fb1 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1277 microversion: 2.1 time: 0.351508 Jun 16 18:31:36.861158 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 441/879] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:36 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1277 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:36.890031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:36.890988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:36.900297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.901168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.902357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.903100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.524122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:37.551406 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4e34d86-1e76-44af-9ef5-393de9c18b08 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1503 microversion: 2.1 time: 0.672882 Jun 16 18:31:37.553169 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 442/880] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:36 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1503 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:37.562508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:37.568663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:37.591836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.595038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.599900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.603014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.635143 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] HTTP exception thrown: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Request method failure captured: Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a HTTP/1.1 Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Y3zVFPME11GB5Z3CTf1Qc3kfIClRYH_UIBPuM_-gsZjRCfGNBBSK_5f8rQCw9lKSSQwhkfqyEi5kzzJwBCz3uelqYxtnwPrSs8RTEqw1LZgjM5czUufHwFGoSVvAqm_K-OfH_VphFs7C4VGl2_FGiUE-xdYdHyCbkPUODIfdTsQvM Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:31:37.637513 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eb148860ba84601a7ff43b94223d7e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: f947f4cdaa0949d1894a458a1c84bbc8 Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:37.639216 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2f0c26f5-b935-4e31-b1d5-853ceef1469a'} Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:37.640128 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:37.641925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:37.643517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Returning 404 to user: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:37.645281 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4005e7b5-f162-496d-b64e-c2d39d0b7f8a tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 404 len: 111 microversion: 2.1 time: 0.089054 Jun 16 18:31:37.645281 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 443/881] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:37 2022] DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:37.659130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c556cf7b-c376-4517-bd7f-32337171317d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f6da940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:37.758040 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d7944cb-3718-460f-afaf-84b22b154616 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.616317 Jun 16 18:31:37.758663 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 439/882] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:31:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:37.781052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:37.782158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:37.792647 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c556cf7b-c376-4517-bd7f-32337171317d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.140801 Jun 16 18:31:37.802141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.802587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.803580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.804231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.810042 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 444/883] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:37 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:37.815132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4e67d76d-f7c9-4b37-9986-69bfaf5c2aa2 req-486b5a28-1e9f-4c78-909f-9cfe57b14c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5b8207-d6e0-4a7a-a371-09ef84e6df0d", "name": "network-vif-deleted", "tag": "8ee551b5-4eaf-466d-abf1-9999158dc897"}, {"server_uuid": "f4f015f4-9f00-4880-9173-03b674d03c95", "name": "network-vif-unplugged", "status": "completed", "tag": "431965cc-38d3-4de3-a2d6-2aa176d81509"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:37.875873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4e67d76d-f7c9-4b37-9986-69bfaf5c2aa2 req-486b5a28-1e9f-4c78-909f-9cfe57b14c85 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.877230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4e67d76d-f7c9-4b37-9986-69bfaf5c2aa2 req-486b5a28-1e9f-4c78-909f-9cfe57b14c85 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.919821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4e67d76d-f7c9-4b37-9986-69bfaf5c2aa2 req-486b5a28-1e9f-4c78-909f-9cfe57b14c85 service nova] Creating event network-vif-deleted:8ee551b5-4eaf-466d-abf1-9999158dc897 for instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d on n-h1-846209-2 Jun 16 18:31:37.926528 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4e67d76d-f7c9-4b37-9986-69bfaf5c2aa2 req-486b5a28-1e9f-4c78-909f-9cfe57b14c85 service nova] Creating event network-vif-unplugged:431965cc-38d3-4de3-a2d6-2aa176d81509 for instance f4f015f4-9f00-4880-9173-03b674d03c95 on n-h2-846209-2 Jun 16 18:31:37.942957 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4e67d76d-f7c9-4b37-9986-69bfaf5c2aa2 req-486b5a28-1e9f-4c78-909f-9cfe57b14c85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.130856 Jun 16 18:31:37.944479 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 445/884] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:37.955238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-033c9ed1-d754-4898-a566-6b675960a8b5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '.version_select at 0x7f866f2093a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:37.958839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-033c9ed1-d754-4898-a566-6b675960a8b5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.959637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-033c9ed1-d754-4898-a566-6b675960a8b5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.980850 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-033c9ed1-d754-4898-a566-6b675960a8b5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.033142 Jun 16 18:31:37.982910 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 446/885] 10.222.0.27 () {60 vars in 1183 bytes} [Thu Jun 16 18:31:37 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:37.994957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:37.996937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:38.012791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:38.014153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.017502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:38.018900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.896318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:38.924411 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-059851bd-ca73-44bd-a0e5-ef77ba7f68d0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1528 microversion: 2.1 time: 1.152488 Jun 16 18:31:38.926516 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 440/886] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:37 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1528 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:38.937891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:38.940845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:38.949969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:38.950520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.951420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:38.951950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.967233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:38.972282 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] HTTP exception thrown: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Request method failure captured: Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a HTTP/1.1 Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y3zVFPME11GB5Z3CTf1Qc3kfIClRYH_UIBPuM_-gsZjRCfGNBBSK_5f8rQCw9lKSSQwhkfqyEi5kzzJwBCz3uelqYxtnwPrSs8RTEqw1LZgjM5czUufHwFGoSVvAqm_K-OfH_VphFs7C4VGl2_FGiUE-xdYdHyCbkPUODIfdTsQvM Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:31:38.974342 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eb148860ba84601a7ff43b94223d7e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: f947f4cdaa0949d1894a458a1c84bbc8 Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:38.977898 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2f0c26f5-b935-4e31-b1d5-853ceef1469a'} Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:38.979582 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:38.983940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:38.989124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Returning 404 to user: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:38.989124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f111b04-6e67-4d2d-936d-3e1ddf75c74e tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 404 len: 111 microversion: 2.1 time: 0.048954 Jun 16 18:31:38.989124 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 441/887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:38 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:38.989690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:38.990458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:38.993658 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-883c4863-c043-4bee-b2fa-cd4607648820 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1325 microversion: 2.1 time: 1.007145 Jun 16 18:31:38.994300 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 447/888] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:37 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1325 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:39.008981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.009583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.010511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.011207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.011339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:39.013080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:39.034390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.034879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.035679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.036118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.185440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:39.204356 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-781728cc-065a-4570-ad3c-242e1b8511cf tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1283 microversion: 2.1 time: 0.219814 Jun 16 18:31:39.205586 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 442/889] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:38 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1283 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:39.211829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-832855874", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:39.293795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] validate_networks() for [('4212a0cd-cfb7-48a1-8db8-d3f563e64c9d', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:39.565147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 8a8542d7-28dd-4d92-9478-29f75115d971 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:31:39.590756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a4abeed-2bcf-4fb6-a1c6-2003d80489a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 2050 microversion: 2.25 time: 0.595197 Jun 16 18:31:39.591845 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 448/890] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:38 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 2050 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:39.629822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2a2157e3-8690-4b90-8850-3ff3046fe452 req-151b5d91-311f-4657-a81b-f665eefb61f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646961f9-f779-4578-8ce7-30ec0e9cbcae", "tag": "7f6d05c0-8081-46cb-b3ce-7c3738243ea5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:39.664123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2a2157e3-8690-4b90-8850-3ff3046fe452 req-151b5d91-311f-4657-a81b-f665eefb61f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.669591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2a2157e3-8690-4b90-8850-3ff3046fe452 req-151b5d91-311f-4657-a81b-f665eefb61f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.696760 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2a2157e3-8690-4b90-8850-3ff3046fe452 req-151b5d91-311f-4657-a81b-f665eefb61f6 service nova] Creating event network-changed:7f6d05c0-8081-46cb-b3ce-7c3738243ea5 for instance 646961f9-f779-4578-8ce7-30ec0e9cbcae on n-h2-846209-2 Jun 16 18:31:39.709946 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2a2157e3-8690-4b90-8850-3ff3046fe452 req-151b5d91-311f-4657-a81b-f665eefb61f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106143 Jun 16 18:31:39.712685 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 449/891] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:39.720214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:39.721030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:39.731190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.731765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.732641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.733187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.341002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:40.358127 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1f506a2-414d-4a20-a48f-decbeaffd32c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1503 microversion: 2.1 time: 0.643748 Jun 16 18:31:40.359436 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 450/892] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:39 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1503 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:40.364676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-37f691cf-4cc1-4cca-868b-60b713c25bef tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f6dad30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:40.425700 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-37f691cf-4cc1-4cca-868b-60b713c25bef tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1438 microversion: 2.1 time: 0.064901 Jun 16 18:31:40.426878 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 451/893] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:40 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:40.432547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:40.433487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:40.440700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:40.441409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.442390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:40.442994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.943396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:41.002199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:41.181435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:41.193801 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bdc91707-4676-45d1-91f9-4cd4d2944a67 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1528 microversion: 2.1 time: 0.765529 Jun 16 18:31:41.201852 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 452/894] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:40 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1528 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:41.218214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31284249-3119-46b3-bffa-d4e2736ff706 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '.version_select at 0x7f866f329dc0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:41.288029 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31284249-3119-46b3-bffa-d4e2736ff706 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204874955" status: 202 len: 0 microversion: 2.1 time: 0.084644 Jun 16 18:31:41.295276 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 453/895] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204874955 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:41.315795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1984289519", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "71375809-7321-4c5f-9d11-1e2aadbe705f"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:41.377119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:41.390319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:41.391242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:41.396559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:41.402787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:41.452243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.459886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:41.463390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.465437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:41.544844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Getting quotas for project 295e1cc58e82459ab321439379b227ea. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:41.558915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Getting quotas for user 7eee236345ec40729015a74ba7f05a82 and project 295e1cc58e82459ab321439379b227ea. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:41.563820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] validate_networks() for [('71375809-7321-4c5f-9d11-1e2aadbe705f', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:41.620097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:41.624475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:41.763322 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a630c298-0091-424f-9190-027555d1dceb tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556089 Jun 16 18:31:41.772129 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 443/896] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:41.785549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:41.790433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:41.824812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.825747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:41.828422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.829165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:42.607593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:42.616256 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5fbf1e5a-a77f-483f-bf1d-4950466fbdcb tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1325 microversion: 2.1 time: 0.837615 Jun 16 18:31:42.625585 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 444/897] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:41 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1325 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:42.631184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:42.634074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:42.650962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.653307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:42.656159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.657685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.037538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:43.207882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:43.245724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:43.265429 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87f64a26-70a3-444d-96dc-f2b8aa445014 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1351 microversion: 2.1 time: 0.637963 Jun 16 18:31:43.282518 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 445/898] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:42 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1351 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:43.292313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cbc5cf20-1c2b-4fc0-809f-5d96d831082b tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.293480 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:31:43.293480 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:31:43.328030 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cbc5cf20-1c2b-4fc0-809f-5d96d831082b tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/61c99f29-2703-45f8-8ddc-b1a402ff3352" status: 202 len: 0 microversion: 2.1 time: 0.043734 Jun 16 18:31:43.331701 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 446/899] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:43 2022] DELETE /compute/v2.1/flavors/61c99f29-2703-45f8-8ddc-b1a402ff3352 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:43.336754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:43.337355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.337866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:43.338391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:43.338571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:43.339013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:43.339439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:43.346223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.346916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.347888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.348481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.351277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.351986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.352845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.353476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.375610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:43.382764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for user 4060431577d14c5198872173d8375e26 and project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:43.401164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:43.403799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:43.471992 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4167d212-2fa1-4ea6-86b7-0b95f8e91dfa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.175120 Jun 16 18:31:43.474689 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 454/900] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:31:43.484516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14ede711-aad4-416a-8075-933e7dff4859 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f5701f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.560997 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14ede711-aad4-416a-8075-933e7dff4859 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1447 microversion: 2.1 time: 0.085005 Jun 16 18:31:43.561636 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 455/901] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:43 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1447 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:43.569153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.570288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:43.583441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.584275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.585543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.586219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.603047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:43.612259 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-424e951b-9e36-4f90-8a4c-aa4ee935f256 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1493 microversion: 2.1 time: 0.280881 Jun 16 18:31:43.630287 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 447/902] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:43 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1493 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:43.635823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-200d2af2-91e1-47df-adbe-c8e31e06a1ce req-5d5190f5-dc2c-45ac-8ce4-40f6d6c86de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646961f9-f779-4578-8ce7-30ec0e9cbcae", "name": "network-vif-plugged", "status": "completed", "tag": "7f6d05c0-8081-46cb-b3ce-7c3738243ea5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:43.661889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-200d2af2-91e1-47df-adbe-c8e31e06a1ce req-5d5190f5-dc2c-45ac-8ce4-40f6d6c86de8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.662484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-200d2af2-91e1-47df-adbe-c8e31e06a1ce req-5d5190f5-dc2c-45ac-8ce4-40f6d6c86de8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.671844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:43.692494 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-200d2af2-91e1-47df-adbe-c8e31e06a1ce req-5d5190f5-dc2c-45ac-8ce4-40f6d6c86de8 service nova] Creating event network-vif-plugged:7f6d05c0-8081-46cb-b3ce-7c3738243ea5 for instance 646961f9-f779-4578-8ce7-30ec0e9cbcae on n-h2-846209-2 Jun 16 18:31:43.698681 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-200d2af2-91e1-47df-adbe-c8e31e06a1ce req-5d5190f5-dc2c-45ac-8ce4-40f6d6c86de8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066664 Jun 16 18:31:43.700234 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 448/903] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:43.707322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6290545f-6c57-4c20-99be-c22aaaf4f41a tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.766930 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6290545f-6c57-4c20-99be-c22aaaf4f41a tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.065121 Jun 16 18:31:43.767578 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 449/904] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:31:43 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:43.781252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-58981743-a01e-43bb-b9ce-e5064faf5995 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.783277 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:31:43.783277 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:31:43.815948 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-58981743-a01e-43bb-b9ce-e5064faf5995 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/48325405" status: 202 len: 0 microversion: 2.1 time: 0.042983 Jun 16 18:31:43.817049 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 450/905] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:31:43 2022] DELETE /compute/v2.1/flavors/48325405 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:43.828932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cb557420-2ac6-49ae-8168-844de3f15ff9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.830581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cb557420-2ac6-49ae-8168-844de3f15ff9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.064609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.079456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4ed18f2f-1133-4748-b6dc-9a57950520a8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1275 microversion: 2.1 time: 0.515749 Jun 16 18:31:44.080457 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 456/906] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:43 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1275 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:44.087477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab90a7bc-7a1d-4d40-a535-ea4a3adb905a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f570b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.110792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cb557420-2ac6-49ae-8168-844de3f15ff9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.140685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cb557420-2ac6-49ae-8168-844de3f15ff9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.153861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cb557420-2ac6-49ae-8168-844de3f15ff9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.156634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cb557420-2ac6-49ae-8168-844de3f15ff9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1262 microversion: 2.25 time: 0.337672 Jun 16 18:31:44.178402 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 451/907] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:43 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1262 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:44.188547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23e998ad-0448-4686-a966-c786b317143e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '.version_select at 0x7f866f5ae9d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.191541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23e998ad-0448-4686-a966-c786b317143e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.192005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23e998ad-0448-4686-a966-c786b317143e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.204768 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-23e998ad-0448-4686-a966-c786b317143e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.022472 Jun 16 18:31:44.213756 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 452/908] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:44.220725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.222176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.239695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.243047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.243953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.244432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.284082 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab90a7bc-7a1d-4d40-a535-ea4a3adb905a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 200 len: 1447 microversion: 2.1 time: 0.200940 Jun 16 18:31:44.285268 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 457/909] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 1447 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:44.296575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:44.298738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.315279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.316308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.318440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.320043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.388233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.404256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Old instance type tempest-test_resize_flavor_-1956994194, new instance type m1.heat {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 18:31:44.422242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:44.423360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:44.424586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:44.426173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:44.427390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:44.542168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:44.607602 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28e48688-2690-460f-b5bb-969fd63ba9a0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31/action" status: 202 len: 0 microversion: 2.1 time: 0.319765 Jun 16 18:31:44.611590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 458/910] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:44 2022] POST /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:44.618378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7be3c9e4-ed37-4a97-bbc1-4e2ed2988299 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.691158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7be3c9e4-ed37-4a97-bbc1-4e2ed2988299 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.079539 Jun 16 18:31:44.693709 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 459/911] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:44.706215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e210fb3-0d1d-4e2f-b1f4-0e85ea57bba0 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.713815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e210fb3-0d1d-4e2f-b1f4-0e85ea57bba0 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.733458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e210fb3-0d1d-4e2f-b1f4-0e85ea57bba0 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.734830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e210fb3-0d1d-4e2f-b1f4-0e85ea57bba0 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.736701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e210fb3-0d1d-4e2f-b1f4-0e85ea57bba0 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.738094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e210fb3-0d1d-4e2f-b1f4-0e85ea57bba0 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.898086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.916412 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0be00b3b-231f-4182-8da4-c381dfbcc98b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1325 microversion: 2.1 time: 0.700555 Jun 16 18:31:44.926646 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 453/912] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1325 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:44.932044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.934168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.944874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.945412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.946290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.946755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.226537 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e210fb3-0d1d-4e2f-b1f4-0e85ea57bba0 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1644 microversion: 2.1 time: 0.530416 Jun 16 18:31:45.227787 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 460/913] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1644 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:45.277576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2b620c7-ae27-4da9-b3f5-788d6fd2d740 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f735940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:45.359100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:45.370761 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4e56e20d-0b12-4b8b-a3e3-def9adfc63c2 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1351 microversion: 2.1 time: 0.448076 Jun 16 18:31:45.372471 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 454/914] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1351 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:45.377669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6a337a6b-63db-49a1-811a-044c95bfcc8d req-14b5334e-1777-433c-a09d-2bc7cf0b8f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50284ce9-a3f0-41ac-9fd9-8dec7d534e49", "tag": "2708092f-949e-4075-8dd4-86a0edb36482"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:45.404062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6a337a6b-63db-49a1-811a-044c95bfcc8d req-14b5334e-1777-433c-a09d-2bc7cf0b8f8e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.404519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6a337a6b-63db-49a1-811a-044c95bfcc8d req-14b5334e-1777-433c-a09d-2bc7cf0b8f8e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.435049 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6a337a6b-63db-49a1-811a-044c95bfcc8d req-14b5334e-1777-433c-a09d-2bc7cf0b8f8e service nova] Creating event network-changed:2708092f-949e-4075-8dd4-86a0edb36482 for instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 on n-h1-846209-2 Jun 16 18:31:45.446108 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6a337a6b-63db-49a1-811a-044c95bfcc8d req-14b5334e-1777-433c-a09d-2bc7cf0b8f8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071776 Jun 16 18:31:45.451525 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 455/915] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:45.459746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:45.463439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:45.487148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.487847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.488808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.490917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.876649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:45.888816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ec8a121-deae-4603-a3d3-2331a5d358b1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1537 microversion: 2.1 time: 0.435554 Jun 16 18:31:45.899510 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 456/916] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:45 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1537 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:45.920088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-906a7fa8-6909-4fc8-ac11-9616eb0fa2b4 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:45.921114 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:31:45.921114 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:31:45.937123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:45.947434 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-906a7fa8-6909-4fc8-ac11-9616eb0fa2b4 tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2099322847" status: 202 len: 0 microversion: 2.1 time: 0.032089 Jun 16 18:31:45.948088 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 457/917] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:31:45 2022] DELETE /compute/v2.1/flavors/2099322847 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:45.958142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:45.959208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:45.969566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.970502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.972121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.973061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.222033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.233240 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1de920e8-bcf5-4254-8679-d0d37c0bfd2b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1323 microversion: 2.1 time: 0.283648 Jun 16 18:31:46.234849 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 458/918] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:45 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:46.249349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:46.249813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:46.257688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.258482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.259295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.259736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.341237 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2b620c7-ae27-4da9-b3f5-788d6fd2d740 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 204 len: 0 microversion: 2.1 time: 1.096816 Jun 16 18:31:46.342588 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 461/919] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:45 2022] DELETE /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:46.358664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-206225989", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "652e1c69-530a-4824-b271-fd75e40c3e31"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:46.363795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.375567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.376830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.378606 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5d90963a-a22a-4a3b-b2ff-c570705cabe5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1320 microversion: 2.25 time: 0.142338 Jun 16 18:31:46.393359 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 459/920] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:46 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:46.401303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:46.402365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:46.410746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.411592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.412851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.414223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.455774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] validate_networks() for [('652e1c69-530a-4824-b271-fd75e40c3e31', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:46.725292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.736254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c7ec01b7-9de4-4d65-a618-f28076e70c26 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1522 microversion: 2.1 time: 0.341059 Jun 16 18:31:46.737726 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 460/921] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:46 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:46.743159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7591948-a4ac-4948-a3b2-70ec3f03197e tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:46.774698 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7591948-a4ac-4948-a3b2-70ec3f03197e tempest-ServersWithSpecificFlavorTestJSON-1939142608 tempest-ServersWithSpecificFlavorTestJSON-1939142608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035437 Jun 16 18:31:46.776702 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 461/922] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:31:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:46.793484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:46.793484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:46.807076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.808625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.809485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.810208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.844085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:31:46.967575 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-216c213e-e053-4902-93a8-549c6378f59e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 204 len: 0 microversion: 2.1 time: 0.185567 Jun 16 18:31:46.969773 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 462/923] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:46 2022] DELETE /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:46.990664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:46.992897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:47.002831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.003288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.004848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.005316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.329274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:47.330349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:47.331890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:47.332702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:47.333154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:47.346568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.347944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.349354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.350227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.391527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:47.398754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for user 6483600a33ef407d9071cd24d84f6ee6 and project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:47.407370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:47.415798 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7de9324d-a4ea-48af-a3d9-11118b41d2d7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1351 microversion: 2.1 time: 0.442019 Jun 16 18:31:47.426158 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 463/924] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:46 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1351 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:47.426158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-236e8de0-1648-4574-86c4-684147b515e5 req-5b4b6e60-db97-452e-860a-64043f8c0520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05292bf7-3482-4a42-9f81-5759b17357aa", "name": "network-vif-unplugged", "status": "completed", "tag": "952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:47.433879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:47.438201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:47.448750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-236e8de0-1648-4574-86c4-684147b515e5 req-5b4b6e60-db97-452e-860a-64043f8c0520 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.448750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-236e8de0-1648-4574-86c4-684147b515e5 req-5b4b6e60-db97-452e-860a-64043f8c0520 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.487121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-236e8de0-1648-4574-86c4-684147b515e5 req-5b4b6e60-db97-452e-860a-64043f8c0520 service nova] Creating event network-vif-unplugged:952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5 for instance 05292bf7-3482-4a42-9f81-5759b17357aa on n-h2-846209-2 Jun 16 18:31:47.499747 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-236e8de0-1648-4574-86c4-684147b515e5 req-5b4b6e60-db97-452e-860a-64043f8c0520 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079292 Jun 16 18:31:47.504680 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 464/925] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:47.514958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:47.515946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:47.535378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.536132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.537784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.539315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.560090 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77af3685-e71b-421a-afc9-02da4b3d215e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215548 Jun 16 18:31:47.560743 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 462/926] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:47.580678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:47.582517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:47.601219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.601691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.602570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.603001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.642259 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] HTTP exception thrown: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Request method failure captured: Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d HTTP/1.1 Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Y3zVFPME11GB5Z3CTf1Qc3kfIClRYH_UIBPuM_-gsZjRCfGNBBSK_5f8rQCw9lKSSQwhkfqyEi5kzzJwBCz3uelqYxtnwPrSs8RTEqw1LZgjM5czUufHwFGoSVvAqm_K-OfH_VphFs7C4VGl2_FGiUE-xdYdHyCbkPUODIfdTsQvM Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:31:47.643990 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eb148860ba84601a7ff43b94223d7e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: f947f4cdaa0949d1894a458a1c84bbc8 Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:47.646322 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'cc5b8207-d6e0-4a7a-a371-09ef84e6df0d'} Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:47.647292 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:47.649222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:47.650726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Returning 404 to user: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:47.650726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-68a5e38f-37cb-4b76-a428-e58c895560b7 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 404 len: 111 microversion: 2.1 time: 0.080508 Jun 16 18:31:47.650726 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 463/927] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:47 2022] DELETE /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:47.672981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:47.674072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:47.690325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.690789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.691611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.692051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.158519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.184272 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78c0baf4-cce2-4aa2-b806-4f1e68534b7a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1522 microversion: 2.1 time: 0.677331 Jun 16 18:31:48.202791 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 465/928] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:47 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1522 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:48.216452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-394758485", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "608da02e-c32f-4a3c-bcd7-760fd8a6c9d5"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:48.238749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.258041 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72496343-b3c6-424c-825f-b4fe69263322 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1537 microversion: 2.1 time: 0.604998 Jun 16 18:31:48.259440 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 464/929] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:47 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1537 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:48.282421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:48.286675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:48.294698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.302763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.304353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.305129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.318423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] validate_networks() for [('608da02e-c32f-4a3c-bcd7-760fd8a6c9d5', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:48.899723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.909439 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50ae5459-dad6-4ac7-bd7b-a13837c7e5e2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1323 microversion: 2.1 time: 0.647725 Jun 16 18:31:48.910082 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 465/930] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:48 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1323 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:48.926930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:48.927570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:48.934831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.935569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.936730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.937329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:49.950363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.963348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.965571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.967136 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-170aaaf6-bd46-4065-909c-02b4718e4746 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1362 microversion: 2.25 time: 1.048027 Jun 16 18:31:49.968349 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 466/931] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:48 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1362 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:49.974759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4a79bc2d-2f2c-4df7-b500-6477e2b36122 req-82f6c1e8-0acd-4d73-8681-acd356aa30b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898264b4-f96e-47eb-bf78-c7d1ee36a44d", "tag": "c40d5082-5f99-494f-a31e-3fa04662e9ba"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:49.980014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:49.989268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4a79bc2d-2f2c-4df7-b500-6477e2b36122 req-82f6c1e8-0acd-4d73-8681-acd356aa30b7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:49.989975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4a79bc2d-2f2c-4df7-b500-6477e2b36122 req-82f6c1e8-0acd-4d73-8681-acd356aa30b7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.007763 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4a79bc2d-2f2c-4df7-b500-6477e2b36122 req-82f6c1e8-0acd-4d73-8681-acd356aa30b7 service nova] Creating event network-changed:c40d5082-5f99-494f-a31e-3fa04662e9ba for instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d on n-h2-846209-2 Jun 16 18:31:50.013983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4a79bc2d-2f2c-4df7-b500-6477e2b36122 req-82f6c1e8-0acd-4d73-8681-acd356aa30b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043892 Jun 16 18:31:50.015364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 467/932] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:50.023242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:50.024356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:50.031959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.032517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.033425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.034004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.268752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:50.277756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ce36d04-b79f-41e5-b5fd-f2ceb5947bf8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1268 microversion: 2.1 time: 0.260566 Jun 16 18:31:50.278519 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 468/933] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:50 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1268 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:50.287892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:50.287892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: cc5b8207-d6e0-4a7a-a371-09ef84e6df0d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:50.292392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.292854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.293695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.294194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.310329 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] HTTP exception thrown: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Request method failure captured: Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d HTTP/1.1 Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3Y3zVFPME11GB5Z3CTf1Qc3kfIClRYH_UIBPuM_-gsZjRCfGNBBSK_5f8rQCw9lKSSQwhkfqyEi5kzzJwBCz3uelqYxtnwPrSs8RTEqw1LZgjM5czUufHwFGoSVvAqm_K-OfH_VphFs7C4VGl2_FGiUE-xdYdHyCbkPUODIfdTsQvM Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:31:50.312099 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eb148860ba84601a7ff43b94223d7e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: f947f4cdaa0949d1894a458a1c84bbc8 Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:50.314698 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'cc5b8207-d6e0-4a7a-a371-09ef84e6df0d'} Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:50.315869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. Jun 16 18:31:50.320241 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:31:50.322568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Returning 404 to user: Instance cc5b8207-d6e0-4a7a-a371-09ef84e6df0d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:50.322568 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2de78939-c066-4810-942a-7e904e935d5c tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d" status: 404 len: 111 microversion: 2.1 time: 0.034611 Jun 16 18:31:50.322568 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 469/934] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:50 2022] GET /compute/v2.1/servers/cc5b8207-d6e0-4a7a-a371-09ef84e6df0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:50.323859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-30706e84-72fc-4636-a754-e7729bde118a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-108394818"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:50.324964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-30706e84-72fc-4636-a754-e7729bde118a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:50.332588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30706e84-72fc-4636-a754-e7729bde118a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.333081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30706e84-72fc-4636-a754-e7729bde118a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.333879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30706e84-72fc-4636-a754-e7729bde118a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.334362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30706e84-72fc-4636-a754-e7729bde118a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.377762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:50.378877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:50.379566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:50.380148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:50.380807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:50.395847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.396305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.397223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.398520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.456534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:50.464430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Getting quotas for user 33f458b13d494ef7bc8e7055be73fa42 and project 1723f1dfefc34199ba287d8693af1f45. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:50.485269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:50.492151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:50.709005 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ddad5a38-1ea2-493c-9d6f-13db695c49f5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.502993 Jun 16 18:31:50.724305 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 466/935] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:50.752054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:50.761794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:50.781553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.782733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.785951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.788978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.299373 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-30706e84-72fc-4636-a754-e7729bde118a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae/action" status: 202 len: 0 microversion: 2.1 time: 0.980348 Jun 16 18:31:51.300913 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 470/936] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:50 2022] POST /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae/action => generated 0 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:31:51.307546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:51.309360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:51.319139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.319939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.321508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.322303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.414897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:51.447579 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d428f62e-aa79-42ce-bdef-e2dc3564be4b tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1351 microversion: 2.1 time: 0.720199 Jun 16 18:31:51.448577 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 467/937] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:50 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1351 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:51.475017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:51.480964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:51.504815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.528026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.532788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.535609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.219649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.236051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.252911 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4325c856-4014-4bc4-89a3-8a4529b2176a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1323 microversion: 2.1 time: 0.789384 Jun 16 18:31:52.255002 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6f44a09-00b1-4e32-a632-2a68e846abd1 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 0.950228 Jun 16 18:31:52.265962 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 468/939] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:51 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1323 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:52.266339 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 471/939] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:51 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:52.279182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:52.280750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:52.288910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:52.289762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:52.301860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.305451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.307275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.308413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.367227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.369682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.369682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.370334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.419495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] HTTP exception thrown: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Request method failure captured: Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a HTTP/1.1 Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y3zVFPME11GB5Z3CTf1Qc3kfIClRYH_UIBPuM_-gsZjRCfGNBBSK_5f8rQCw9lKSSQwhkfqyEi5kzzJwBCz3uelqYxtnwPrSs8RTEqw1LZgjM5czUufHwFGoSVvAqm_K-OfH_VphFs7C4VGl2_FGiUE-xdYdHyCbkPUODIfdTsQvM Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:31:52.422041 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eb148860ba84601a7ff43b94223d7e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: f947f4cdaa0949d1894a458a1c84bbc8 Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:52.425528 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2f0c26f5-b935-4e31-b1d5-853ceef1469a'} Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:52.426837 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:52.429794 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:52.434509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Returning 404 to user: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:52.435493 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a91fdbf-52cb-4e9a-97cb-712c3b0f4c08 tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 404 len: 111 microversion: 2.1 time: 0.163013 Jun 16 18:31:52.436668 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 469/940] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:52 2022] DELETE /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:52.447451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c2cb86ff-dad5-49c9-84c2-0aaf6042d5a2 req-bfe28bd4-0741-4b12-851f-7e336faad8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05292bf7-3482-4a42-9f81-5759b17357aa", "name": "network-vif-deleted", "tag": "952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:52.459322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2cb86ff-dad5-49c9-84c2-0aaf6042d5a2 req-bfe28bd4-0741-4b12-851f-7e336faad8a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.460813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2cb86ff-dad5-49c9-84c2-0aaf6042d5a2 req-bfe28bd4-0741-4b12-851f-7e336faad8a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.491512 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c2cb86ff-dad5-49c9-84c2-0aaf6042d5a2 req-bfe28bd4-0741-4b12-851f-7e336faad8a7 service nova] Creating event network-vif-deleted:952f50ef-3b7e-4b87-8ae4-6f3c7c1a42c5 for instance 05292bf7-3482-4a42-9f81-5759b17357aa on n-h2-846209-2 Jun 16 18:31:52.498717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.501324 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c2cb86ff-dad5-49c9-84c2-0aaf6042d5a2 req-bfe28bd4-0741-4b12-851f-7e336faad8a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060417 Jun 16 18:31:52.502672 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 470/941] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:52.516783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:52.517988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:52.523669 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9afd4bd7-d8b2-48b1-86ce-770882aebe14 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1211 microversion: 2.1 time: 0.248372 Jun 16 18:31:52.529066 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 472/942] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:52 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:52.533447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.536742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.540001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.542990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.547670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:52.554686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:52.573496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.574156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.577413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.577981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.910912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.920002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.921093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.922797 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7cdcd904-4bae-4978-9300-157c3074c96d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1362 microversion: 2.25 time: 0.418177 Jun 16 18:31:52.923473 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 471/943] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:52 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:52.929615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1494e0eb-c87e-4c96-a018-5e5b6801c803 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '.version_select at 0x7f866f40bdc0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.009052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:53.025128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-351695f5-6d6c-499e-a310-622ac0840a27 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1310 microversion: 2.1 time: 0.491342 Jun 16 18:31:53.036284 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 473/944] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:52 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1310 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:53.048947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-61513f57-0347-4e88-b2f0-59a9eb8ce292 req-79f8b2bc-531f-43cc-aa75-41d46fc68436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50284ce9-a3f0-41ac-9fd9-8dec7d534e49", "name": "network-vif-plugged", "status": "completed", "tag": "2708092f-949e-4075-8dd4-86a0edb36482"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:53.071370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-61513f57-0347-4e88-b2f0-59a9eb8ce292 req-79f8b2bc-531f-43cc-aa75-41d46fc68436 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.071494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-61513f57-0347-4e88-b2f0-59a9eb8ce292 req-79f8b2bc-531f-43cc-aa75-41d46fc68436 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.101200 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-61513f57-0347-4e88-b2f0-59a9eb8ce292 req-79f8b2bc-531f-43cc-aa75-41d46fc68436 service nova] Creating event network-vif-plugged:2708092f-949e-4075-8dd4-86a0edb36482 for instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 on n-h1-846209-2 Jun 16 18:31:53.118652 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-61513f57-0347-4e88-b2f0-59a9eb8ce292 req-79f8b2bc-531f-43cc-aa75-41d46fc68436 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074962 Jun 16 18:31:53.118959 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 474/945] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:53.124368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2c8ffb91-0bc8-415c-b954-1ce8e5defd3e req-a62b2273-0e18-4392-8010-e99fff5b088d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dec74f5-68be-47e2-acc5-8a6eec839883", "tag": "5bf53088-fbdc-47e4-86c7-3a95436ab49b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:53.141048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2c8ffb91-0bc8-415c-b954-1ce8e5defd3e req-a62b2273-0e18-4392-8010-e99fff5b088d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.142172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2c8ffb91-0bc8-415c-b954-1ce8e5defd3e req-a62b2273-0e18-4392-8010-e99fff5b088d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.147446 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1494e0eb-c87e-4c96-a018-5e5b6801c803 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b" status: 204 len: 0 microversion: 2.1 time: 0.222848 Jun 16 18:31:53.152654 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 472/946] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:52 2022] DELETE /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:53.164205 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2c8ffb91-0bc8-415c-b954-1ce8e5defd3e req-a62b2273-0e18-4392-8010-e99fff5b088d service nova] Creating event network-changed:5bf53088-fbdc-47e4-86c7-3a95436ab49b for instance 4dec74f5-68be-47e2-acc5-8a6eec839883 on n-h2-846209-2 Jun 16 18:31:53.169738 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2c8ffb91-0bc8-415c-b954-1ce8e5defd3e req-a62b2273-0e18-4392-8010-e99fff5b088d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049275 Jun 16 18:31:53.171619 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 475/947] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:53.175469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.176306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] [instance: 2f0c26f5-b935-4e31-b1d5-853ceef1469a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:53.179805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.180668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:53.190114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.190683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.192458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.193119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.202879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.203898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.204611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.204794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.214348 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] HTTP exception thrown: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Request method failure captured: Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a HTTP/1.1 Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3Y3zVFPME11GB5Z3CTf1Qc3kfIClRYH_UIBPuM_-gsZjRCfGNBBSK_5f8rQCw9lKSSQwhkfqyEi5kzzJwBCz3uelqYxtnwPrSs8RTEqw1LZgjM5czUufHwFGoSVvAqm_K-OfH_VphFs7C4VGl2_FGiUE-xdYdHyCbkPUODIfdTsQvM Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:31:53.215921 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5eb148860ba84601a7ff43b94223d7e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5eb148860ba84601a7ff43b94223d7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 5eb148860ba84601a7ff43b94223d7e5 Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579 Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: f947f4cdaa0949d1894a458a1c84bbc8 Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1174212579-project Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:53.217592 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2f0c26f5-b935-4e31-b1d5-853ceef1469a'} Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:53.218533 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. Jun 16 18:31:53.219768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.222742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] Returning 404 to user: Instance 2f0c26f5-b935-4e31-b1d5-853ceef1469a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:53.223630 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab5bcc6a-72ec-408c-8ef8-47acaaf82d0d tempest-ServersWithSpecificFlavorTestJSON-1174212579 tempest-ServersWithSpecificFlavorTestJSON-1174212579-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a" status: 404 len: 111 microversion: 2.1 time: 0.069734 Jun 16 18:31:53.224454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 473/948] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/servers/2f0c26f5-b935-4e31-b1d5-853ceef1469a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:31:53.234277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-343b0b89-8786-4be9-baa2-f11b72bfe730 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '.version_select at 0x7f866f4740d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.271073 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-343b0b89-8786-4be9-baa2-f11b72bfe730 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Image not found. Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-343b0b89-8786-4be9-baa2-f11b72bfe730 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b HTTP/1.1 Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:31:53.274945 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a50dc87e-51a1-4846-93d0-8455d4c59d9b'} Jun 16 18:31:53.276533 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:31:53.277527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a50dc87e-51a1-4846-93d0-8455d4c59d9b Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:31:53.278900 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a50dc87e-51a1-4846-93d0-8455d4c59d9b could not be found. Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:31:53.280360 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:31:53.281716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-343b0b89-8786-4be9-baa2-f11b72bfe730 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:53.282992 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-343b0b89-8786-4be9-baa2-f11b72bfe730 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b" status: 404 len: 62 microversion: 2.1 time: 0.050836 Jun 16 18:31:53.282992 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 474/949] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:31:53.285346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.286271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:53.299270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.300030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.301406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.302204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.337005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:53.658237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:53.674667 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-86315fde-b812-41a3-a7dc-095245fda80d tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1351 microversion: 2.1 time: 0.501108 Jun 16 18:31:53.675551 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 476/950] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1351 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:53.676444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:53.689543 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-684fa05c-9473-4b04-a44c-abccc2f39c41 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 0.407904 Jun 16 18:31:53.689935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.690178 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 475/951] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:53.696255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.697180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:53.704332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.705155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.706275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.706807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.707801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:53.719661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.720821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.722397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.723075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.087317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.101204 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c91f1488-2303-4d6c-bb00-0716cf38ac22 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1540 microversion: 2.1 time: 0.409001 Jun 16 18:31:54.102974 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 476/952] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1540 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:54.111445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:54.113495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:54.123652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.138075 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7909b77-b801-46e8-87d0-77e5895f0b8f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1323 microversion: 2.1 time: 0.456899 Jun 16 18:31:54.142011 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 477/953] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:54.143578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.144402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.145817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.146629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.148592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:54.149603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:54.160190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.160723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.161573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.162126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.223372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.232812 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-60334fa2-9ac5-4a8e-a6b5-37bd91d2d90f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1259 microversion: 2.1 time: 0.128293 Jun 16 18:31:54.233939 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 477/954] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:54 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1259 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:54.239245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:54.239992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:54.247159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.247610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.248481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.249115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.466201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.483080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.484809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.486192 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb840592-89a3-44d3-9ba2-d613380aed90 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1362 microversion: 2.25 time: 0.342838 Jun 16 18:31:54.499316 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 478/955] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:54 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:54.505411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.516974 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2c54b571-49a6-4a8e-9599-7d26a5b82fc2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1310 microversion: 2.1 time: 0.281787 Jun 16 18:31:54.527412 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 478/956] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:54 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:54.535893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-737fa248-32d6-43ec-aa9f-390b8c44149a req-5c127923-feef-4462-beb1-01ea0fd78dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb575fd4-0970-400b-913f-721aafd46e61", "tag": "79471afd-118e-4f81-8fc5-5c6ef7b970c9"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:54.547837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-737fa248-32d6-43ec-aa9f-390b8c44149a req-5c127923-feef-4462-beb1-01ea0fd78dca service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.548408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-737fa248-32d6-43ec-aa9f-390b8c44149a req-5c127923-feef-4462-beb1-01ea0fd78dca service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.563882 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-737fa248-32d6-43ec-aa9f-390b8c44149a req-5c127923-feef-4462-beb1-01ea0fd78dca service nova] Creating event network-changed:79471afd-118e-4f81-8fc5-5c6ef7b970c9 for instance fb575fd4-0970-400b-913f-721aafd46e61 on n-h1-846209-2 Jun 16 18:31:54.574065 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-737fa248-32d6-43ec-aa9f-390b8c44149a req-5c127923-feef-4462-beb1-01ea0fd78dca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041537 Jun 16 18:31:54.575613 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 479/957] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:31:54.697249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:54.698678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:54.705738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.706604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.713862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:54.715354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:54.718872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.719720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.728992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.730128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.730992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.742523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.781594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:55.716304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:55.721883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:55.728889 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-55224977-311c-4e13-9894-20d8dd156be0 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1351 microversion: 2.1 time: 1.035640 Jun 16 18:31:55.738781 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 479/958] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:54 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1351 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:55.754482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:55.755655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:55.770990 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1681a895-cf31-4381-a857-84607a872f3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 1.061302 Jun 16 18:31:55.773324 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 480/959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:54 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:55.775828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.778542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.779484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.780042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.781066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4cafed4d-39e0-4e95-8548-57f835699548 req-89335654-6b8d-4ff6-bd45-201593822b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898264b4-f96e-47eb-bf78-c7d1ee36a44d", "name": "network-vif-plugged", "status": "completed", "tag": "c40d5082-5f99-494f-a31e-3fa04662e9ba"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:55.806499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4cafed4d-39e0-4e95-8548-57f835699548 req-89335654-6b8d-4ff6-bd45-201593822b30 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.808286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4cafed4d-39e0-4e95-8548-57f835699548 req-89335654-6b8d-4ff6-bd45-201593822b30 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.844534 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4cafed4d-39e0-4e95-8548-57f835699548 req-89335654-6b8d-4ff6-bd45-201593822b30 service nova] Creating event network-vif-plugged:c40d5082-5f99-494f-a31e-3fa04662e9ba for instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d on n-h2-846209-2 Jun 16 18:31:55.853426 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4cafed4d-39e0-4e95-8548-57f835699548 req-89335654-6b8d-4ff6-bd45-201593822b30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078510 Jun 16 18:31:55.854822 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 481/960] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:55.863019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:55.864134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:55.886134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.886975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.888477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.890792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.401292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.414210 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-736a48d8-ed96-41ed-82f3-01942d53a72e tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1522 microversion: 2.1 time: 0.671126 Jun 16 18:31:56.423052 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 480/961] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:55 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:56.423287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.428129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:56.429647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:56.436379 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2464745e-7962-46f2-80ac-ff80701ebdc6 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1323 microversion: 2.1 time: 0.580009 Jun 16 18:31:56.437948 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 482/962] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:55 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1323 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:56.440238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.440901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.442221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.442861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.446809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:56.447734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:56.455164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.455918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.456967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.457586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.591201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.611109 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c260b8a6-3012-4484-9370-7072f2356456 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1265 microversion: 2.1 time: 0.192330 Jun 16 18:31:56.612099 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 481/963] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:56 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:56.635854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:56.636819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:56.654233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.655268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.656460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.656919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.809592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.828233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.833078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.839742 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85571c75-4f13-4129-9a5f-5640b71ae061 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1362 microversion: 2.25 time: 0.397979 Jun 16 18:31:56.841348 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 483/964] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:56 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:56.855549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:56.858131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:56.871490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.872788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.876342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.879982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.966212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:31:57.130425 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab33c9cd-d7a1-40de-97af-1af96d81e220 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 204 len: 0 microversion: 2.1 time: 0.286018 Jun 16 18:31:57.138170 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 484/965] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:31:56 2022] DELETE /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:31:57.154113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:57.155794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:57.175596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.176663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.185250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.188502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.218425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:57.237659 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-47084e33-bb50-42eb-b32d-7a8f8c2e83b8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1310 microversion: 2.1 time: 0.623490 Jun 16 18:31:57.238967 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 482/966] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:56 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1310 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:57.249660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:57.251830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:57.263989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.265332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.266401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.267028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.377502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:57.409974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:57.615621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:57.635883 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-48436cf9-4eda-4d7d-9c45-7870cf6e3a3b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 0.395578 Jun 16 18:31:57.637575 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 483/967] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:57 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:57.646843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:57.648140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:57.668925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.671016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.671311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:57.674252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.675856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.689039 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca9a498b-8e1d-480b-a604-3a0849d7e02e tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1541 microversion: 2.1 time: 0.546105 Jun 16 18:31:57.692210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 485/968] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:57 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1541 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:57.713060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:57.714553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:57.727006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.727467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.728290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.728737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.188412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:58.200344 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb2508a9-8320-4cff-8855-3ef35675ecfe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1323 microversion: 2.1 time: 0.504634 Jun 16 18:31:58.200944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 486/969] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:57 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:58.215407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:58.216037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:58.238010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.242441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.245994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.253892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.288894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:58.302689 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-df147431-57e9-434d-a4a2-d426a547719f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1528 microversion: 2.1 time: 0.661241 Jun 16 18:31:58.306523 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 484/970] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:57 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1528 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:58.316095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61998fc5-cb56-4708-8944-90c08d594136 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:58.316813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-61998fc5-cb56-4708-8944-90c08d594136 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:58.337240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61998fc5-cb56-4708-8944-90c08d594136 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.337454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61998fc5-cb56-4708-8944-90c08d594136 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.338303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61998fc5-cb56-4708-8944-90c08d594136 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.340454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61998fc5-cb56-4708-8944-90c08d594136 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.620220 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61998fc5-cb56-4708-8944-90c08d594136 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.312427 Jun 16 18:31:58.621105 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 485/971] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:31:58 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49/os-interface => generated 285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:58.633032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:58.633971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:58.644907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.645717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.646821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.649228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.864636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:58.874341 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e170866b-7a08-40d1-9978-58fae50bd748 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1307 microversion: 2.1 time: 0.672265 Jun 16 18:31:58.882924 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 487/972] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:58 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1307 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:58.894112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-41092c92-5055-440e-bf34-697b33b75b59 req-13fe383d-f2b8-4a95-8497-2a3d7a8c2227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dec74f5-68be-47e2-acc5-8a6eec839883", "name": "network-vif-plugged", "status": "completed", "tag": "5bf53088-fbdc-47e4-86c7-3a95436ab49b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:58.922635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-41092c92-5055-440e-bf34-697b33b75b59 req-13fe383d-f2b8-4a95-8497-2a3d7a8c2227 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.923148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-41092c92-5055-440e-bf34-697b33b75b59 req-13fe383d-f2b8-4a95-8497-2a3d7a8c2227 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.969446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-41092c92-5055-440e-bf34-697b33b75b59 req-13fe383d-f2b8-4a95-8497-2a3d7a8c2227 service nova] Creating event network-vif-plugged:5bf53088-fbdc-47e4-86c7-3a95436ab49b for instance 4dec74f5-68be-47e2-acc5-8a6eec839883 on n-h2-846209-2 Jun 16 18:31:58.975103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-41092c92-5055-440e-bf34-697b33b75b59 req-13fe383d-f2b8-4a95-8497-2a3d7a8c2227 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090538 Jun 16 18:31:58.976096 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 488/973] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:58.986687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:58.991605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:59.015937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:59.016687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:59.017712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:59.018406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:59.322745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:59.339577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:59.342286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:59.344132 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-edaf098e-469c-4909-b249-2a735cb51921 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1362 microversion: 2.25 time: 0.720741 Jun 16 18:31:59.359497 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 486/974] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:58 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1362 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:59.382186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f24de8af-2631-4620-9d2f-ca0d74f95d1d req-98876923-e5fa-4247-bf6e-8b5fe4017496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7453b4f4-c53d-4314-8b06-75ce854a45e6", "tag": "32340453-7ece-4e56-9662-2db0d327f507"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:59.406964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f24de8af-2631-4620-9d2f-ca0d74f95d1d req-98876923-e5fa-4247-bf6e-8b5fe4017496 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:59.408036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f24de8af-2631-4620-9d2f-ca0d74f95d1d req-98876923-e5fa-4247-bf6e-8b5fe4017496 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:59.442479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f24de8af-2631-4620-9d2f-ca0d74f95d1d req-98876923-e5fa-4247-bf6e-8b5fe4017496 service nova] Creating event network-changed:32340453-7ece-4e56-9662-2db0d327f507 for instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 on n-h2-846209-2 Jun 16 18:31:59.455067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f24de8af-2631-4620-9d2f-ca0d74f95d1d req-98876923-e5fa-4247-bf6e-8b5fe4017496 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093168 Jun 16 18:31:59.456454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 487/975] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:59.465176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:59.466434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:59.476007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:59.478398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:59.479354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:59.479811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.221594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:00.232628 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9a34180-aa63-4a80-8af1-aeae668db5ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1310 microversion: 2.1 time: 1.254291 Jun 16 18:32:00.233382 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 489/976] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:58 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1310 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:00.239420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:00.240291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:00.251627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.252389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.253501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.254175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.407452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:00.476853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:00.483484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:00.493645 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-843cd19d-28a7-478e-8979-c08916750230 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 1.035687 Jun 16 18:32:00.494299 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 488/977] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:59 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:00.500097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:00.501246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:00.510004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.510474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.511298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.511755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.996249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.005346 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6aeb1ed0-035b-4286-a75e-c057b5007f02 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 200 len: 1518 microversion: 2.1 time: 0.770638 Jun 16 18:32:01.007051 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 490/978] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:00 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 1518 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:01.012621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:01.013506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:01.030499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.031257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.032412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.033104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.036946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.065265 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37006fac-9f1b-4386-9e19-76aed1869460 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 200 len: 1528 microversion: 2.1 time: 0.563909 Jun 16 18:32:01.082364 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 489/979] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:00 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 1528 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:01.105598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:01.110781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:01.126123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.126910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.128980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.129643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.669624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.715483 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6dd91e4f-a43d-4660-ba91-a06ac178e5b4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1307 microversion: 2.1 time: 0.703093 Jun 16 18:32:01.730888 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 491/980] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:01 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1307 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:01.756716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5ead27e1-273c-4129-b77c-1858ed882fc1 req-d238b70e-ed2c-45f1-8542-fc2b787c1a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646961f9-f779-4578-8ce7-30ec0e9cbcae", "name": "network-vif-plugged", "status": "completed", "tag": "7f6d05c0-8081-46cb-b3ce-7c3738243ea5"}, {"server_uuid": "646961f9-f779-4578-8ce7-30ec0e9cbcae", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6d05c0-8081-46cb-b3ce-7c3738243ea5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:01.763044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.774943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.780605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.784851 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7cac7030-cf98-4c67-baf9-b372b1fb2e59 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1558 microversion: 2.25 time: 0.698320 Jun 16 18:32:01.786575 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 490/981] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:01 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1558 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:01.787252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5ead27e1-273c-4129-b77c-1858ed882fc1 req-d238b70e-ed2c-45f1-8542-fc2b787c1a0f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.788677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5ead27e1-273c-4129-b77c-1858ed882fc1 req-d238b70e-ed2c-45f1-8542-fc2b787c1a0f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.797768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'action', calling method: .version_select at 0x7f8675a6a550>, body: {"addFloatingIp": {"address": "172.25.0.155"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:01.798970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:01.822404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.822984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.824960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.825652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.840411 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5ead27e1-273c-4129-b77c-1858ed882fc1 req-d238b70e-ed2c-45f1-8542-fc2b787c1a0f service nova] Creating event network-vif-plugged:7f6d05c0-8081-46cb-b3ce-7c3738243ea5 for instance 646961f9-f779-4578-8ce7-30ec0e9cbcae on n-h2-846209-2 Jun 16 18:32:01.842789 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5ead27e1-273c-4129-b77c-1858ed882fc1 req-d238b70e-ed2c-45f1-8542-fc2b787c1a0f service nova] Creating event network-vif-unplugged:7f6d05c0-8081-46cb-b3ce-7c3738243ea5 for instance 646961f9-f779-4578-8ce7-30ec0e9cbcae on n-h2-846209-2 Jun 16 18:32:01.850827 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5ead27e1-273c-4129-b77c-1858ed882fc1 req-d238b70e-ed2c-45f1-8542-fc2b787c1a0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.118396 Jun 16 18:32:01.851885 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 492/982] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:01.861022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:01.862154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:01.871142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.871995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.872840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.873456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.952355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Acquired lock "refresh_cache-5487e1c8-2792-405c-91ef-5c4b4c4acdc4" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:32:02.745477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:02.765072 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7812accc-f352-40f1-af61-c9c14d4dae40 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1310 microversion: 2.1 time: 0.911546 Jun 16 18:32:02.777972 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 493/983] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:01 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1310 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:02.777972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:02.777972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:02.780564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:02.781495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:02.782572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:02.783238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.199141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:03.216266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5a37d13a-1b39-4312-82ac-34ddc0cd083e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 0.448845 Jun 16 18:32:03.217652 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 494/984] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:02 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:03.223839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a2d18413-8e14-4358-bc98-a0dc2462c198 req-6ddfd257-001a-4566-88a5-8b4244cf8aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50284ce9-a3f0-41ac-9fd9-8dec7d534e49", "tag": "2708092f-949e-4075-8dd4-86a0edb36482"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:03.244357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a2d18413-8e14-4358-bc98-a0dc2462c198 req-6ddfd257-001a-4566-88a5-8b4244cf8aea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.244357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a2d18413-8e14-4358-bc98-a0dc2462c198 req-6ddfd257-001a-4566-88a5-8b4244cf8aea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.260901 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a2d18413-8e14-4358-bc98-a0dc2462c198 req-6ddfd257-001a-4566-88a5-8b4244cf8aea service nova] Creating event network-changed:2708092f-949e-4075-8dd4-86a0edb36482 for instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 on n-h1-846209-2 Jun 16 18:32:03.270549 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a2d18413-8e14-4358-bc98-a0dc2462c198 req-6ddfd257-001a-4566-88a5-8b4244cf8aea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050987 Jun 16 18:32:03.273147 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 495/985] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:03.283045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0bb8e549-3b16-4b49-95ce-456ba5ee680f req-9693552c-ced8-4399-a08a-ee622c73f9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646961f9-f779-4578-8ce7-30ec0e9cbcae", "name": "network-vif-deleted", "tag": "7f6d05c0-8081-46cb-b3ce-7c3738243ea5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:03.295446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0bb8e549-3b16-4b49-95ce-456ba5ee680f req-9693552c-ced8-4399-a08a-ee622c73f9b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.296267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0bb8e549-3b16-4b49-95ce-456ba5ee680f req-9693552c-ced8-4399-a08a-ee622c73f9b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.327097 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0bb8e549-3b16-4b49-95ce-456ba5ee680f req-9693552c-ced8-4399-a08a-ee622c73f9b9 service nova] Creating event network-vif-deleted:7f6d05c0-8081-46cb-b3ce-7c3738243ea5 for instance 646961f9-f779-4578-8ce7-30ec0e9cbcae on n-h2-846209-2 Jun 16 18:32:03.334311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0bb8e549-3b16-4b49-95ce-456ba5ee680f req-9693552c-ced8-4399-a08a-ee622c73f9b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057931 Jun 16 18:32:03.336320 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 496/986] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:03.343619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:03.344515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:03.360532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.361385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.363486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.364824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.888498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4dec74f5-68be-47e2-acc5-8a6eec839883 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:03.909797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-21c69a28-b4c5-4195-8657-59b95a246afc tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 2051 microversion: 2.25 time: 0.571541 Jun 16 18:32:03.910428 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 497/987] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:03 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 2051 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:03.922877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:03.922877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:03.923430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.923886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.924664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.925097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.940297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae HTTP/1.1 Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:03.941992 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:03.943623 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '646961f9-f779-4578-8ce7-30ec0e9cbcae'} Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:03.950581 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:03.951974 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:03.953180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:03.953180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59dec8c8-bb4c-4348-887e-e99baab7c284 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 404 len: 111 microversion: 2.1 time: 0.031950 Jun 16 18:32:03.953180 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 498/988] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:03 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:03.953180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:03.953180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:03.957046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.957681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.958507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.958942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.962187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:04.398276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:04.404904 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:32:04.405735 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 18:32:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action (ip 10.222.0.27) !!! Jun 16 18:32:04.421852 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-798837ff-9a27-4d50-843f-320cd8b92df5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1307 microversion: 2.1 time: 0.475513 Jun 16 18:32:04.434292 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 499/989] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:03 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1307 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:04.434292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:04.434292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:04.440418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:04.440418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:04.440418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:04.440418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:04.802988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:04.815309 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9f924815-91f7-40d5-946d-e0d0e43c42f7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1310 microversion: 2.1 time: 0.391490 Jun 16 18:32:04.826981 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 500/990] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:04 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1310 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:04.832113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c50381ba-5509-47b6-9f81-3f4f8b56e102 req-e9a7534d-90df-4899-bcc8-83723c08578f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb575fd4-0970-400b-913f-721aafd46e61", "name": "network-vif-plugged", "status": "completed", "tag": "79471afd-118e-4f81-8fc5-5c6ef7b970c9"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:04.847862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c50381ba-5509-47b6-9f81-3f4f8b56e102 req-e9a7534d-90df-4899-bcc8-83723c08578f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:04.848663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c50381ba-5509-47b6-9f81-3f4f8b56e102 req-e9a7534d-90df-4899-bcc8-83723c08578f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:04.863685 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c50381ba-5509-47b6-9f81-3f4f8b56e102 req-e9a7534d-90df-4899-bcc8-83723c08578f service nova] Creating event network-vif-plugged:79471afd-118e-4f81-8fc5-5c6ef7b970c9 for instance fb575fd4-0970-400b-913f-721aafd46e61 on n-h1-846209-2 Jun 16 18:32:04.871381 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c50381ba-5509-47b6-9f81-3f4f8b56e102 req-e9a7534d-90df-4899-bcc8-83723c08578f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042950 Jun 16 18:32:04.872766 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 501/991] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:04.879432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:04.880619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:04.894931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:04.896328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:04.900376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:04.901176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:05.668612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Building network info cache for instance {{(pid=119207) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:32:05.670246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4dec74f5-68be-47e2-acc5-8a6eec839883 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:05.692927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71e9ce98-4334-427a-a7b3-8d8a8cba3c1a tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 2051 microversion: 2.25 time: 0.817975 Jun 16 18:32:05.695350 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 502/992] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:04 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 2051 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:05.703766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-735996899", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:05.779446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] validate_networks() for [('02050194-15bb-475f-8e51-c895317b0755', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:32:06.646637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:32:06.649325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:32:06.650019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:32:06.650603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:32:06.651227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:32:06.663294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.664090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.664958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.665974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.692169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for project 14cf8ec8d4954e45857af05dc373a244. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:06.699961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Getting quotas for user 25c692d1c95b4844812f6d3511268a45 and project 14cf8ec8d4954e45857af05dc373a244. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:06.718025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:32:06.720752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:32:06.805644 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d5fc9020-5c6c-4e68-a1e4-ea2210295660 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.108643 Jun 16 18:32:06.807122 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 503/993] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:32:06.812696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Updating instance_info_cache with network_info: [{"id": "614ced4d-0258-4800-8fd5-e223c2331b5e", "address": "fa:16:3e:21:c8:da", "network": {"id": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709469550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "295e1cc58e82459ab321439379b227ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap614ced4d-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119207) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:32:06.814426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:06.815256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:06.823719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.824484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.825493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.826140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.846048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Releasing lock "refresh_cache-5487e1c8-2792-405c-91ef-5c4b4c4acdc4" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:32:06.847018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53a6d467-b308-4614-b855-57a7a1ed409e tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action" status: 202 len: 0 microversion: 2.1 time: 5.056651 Jun 16 18:32:06.850835 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 491/994] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:01 2022] POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action => generated 0 bytes in 5060 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:32:06.887773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:06.888725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:06.902505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.902961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.903759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.904430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.964967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:07.126640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:07.139291 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4bb6c73f-db6b-4bc5-911b-fa3a1a86c0aa tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 0.330625 Jun 16 18:32:07.158914 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 504/995] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:06 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:07.173887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8279f616-6b95-41f2-9183-37e95c398527 req-e592793a-f00b-4703-96dc-db43c7c9ddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5487e1c8-2792-405c-91ef-5c4b4c4acdc4", "tag": "614ced4d-0258-4800-8fd5-e223c2331b5e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:07.199104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8279f616-6b95-41f2-9183-37e95c398527 req-e592793a-f00b-4703-96dc-db43c7c9ddf3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.199443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8279f616-6b95-41f2-9183-37e95c398527 req-e592793a-f00b-4703-96dc-db43c7c9ddf3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.219939 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8279f616-6b95-41f2-9183-37e95c398527 req-e592793a-f00b-4703-96dc-db43c7c9ddf3 service nova] Creating event network-changed:614ced4d-0258-4800-8fd5-e223c2331b5e for instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 on n-h1-846209-2 Jun 16 18:32:07.230221 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8279f616-6b95-41f2-9183-37e95c398527 req-e592793a-f00b-4703-96dc-db43c7c9ddf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069727 Jun 16 18:32:07.231695 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 505/996] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:07.237828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8e5b1d2c-aef8-41b8-be9f-b77b72f34e6d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:07.239633 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:07.239633 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:07.241739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d2c-aef8-41b8-be9f-b77b72f34e6d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.243781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d2c-aef8-41b8-be9f-b77b72f34e6d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.244652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d2c-aef8-41b8-be9f-b77b72f34e6d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.245099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e5b1d2c-aef8-41b8-be9f-b77b72f34e6d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.271345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:07.297847 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6722429a-c835-4ad7-9412-944592cf7b2f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1307 microversion: 2.1 time: 0.445483 Jun 16 18:32:07.299665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:07.303970 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 492/997] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:06 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:07.311698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:07.312353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:07.326655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.327614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.329049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.329868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.332907 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8e5b1d2c-aef8-41b8-be9f-b77b72f34e6d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.099678 Jun 16 18:32:07.337973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 506/998] 10.222.0.27 () {60 vars in 1216 bytes} [Thu Jun 16 18:32:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:32:07.359617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c6d6455-f8c1-46fb-a16c-8d3b65a3e756 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:07.360828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c6d6455-f8c1-46fb-a16c-8d3b65a3e756 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:07.723744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3c6d6455-f8c1-46fb-a16c-8d3b65a3e756 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:07.750447 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c6d6455-f8c1-46fb-a16c-8d3b65a3e756 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1224 microversion: 2.1 time: 0.406739 Jun 16 18:32:07.760869 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 507/999] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:07 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1224 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:07.763539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'action', calling method: .version_select at 0x7f8675a69550>, body: {"addFloatingIp": {"address": "172.25.0.155"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:07.766586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:07.797083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.798285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.800074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.801313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.913339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:07.927248 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bebf2919-ed24-411e-a5be-70e816f8278c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1493 microversion: 2.1 time: 0.621485 Jun 16 18:32:07.942917 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 493/1000] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:07 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1493 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:07.955050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-97597807-47cd-464c-8c33-a502f4586aa9 req-d1041b88-c23b-428c-8307-3b2ca8fc007a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7453b4f4-c53d-4314-8b06-75ce854a45e6", "name": "network-vif-plugged", "status": "completed", "tag": "32340453-7ece-4e56-9662-2db0d327f507"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:07.965468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-97597807-47cd-464c-8c33-a502f4586aa9 req-d1041b88-c23b-428c-8307-3b2ca8fc007a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.965942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-97597807-47cd-464c-8c33-a502f4586aa9 req-d1041b88-c23b-428c-8307-3b2ca8fc007a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.982307 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-97597807-47cd-464c-8c33-a502f4586aa9 req-d1041b88-c23b-428c-8307-3b2ca8fc007a service nova] Creating event network-vif-plugged:32340453-7ece-4e56-9662-2db0d327f507 for instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 on n-h2-846209-2 Jun 16 18:32:07.995787 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-97597807-47cd-464c-8c33-a502f4586aa9 req-d1041b88-c23b-428c-8307-3b2ca8fc007a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050561 Jun 16 18:32:07.996984 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 494/1001] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:08.008380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c97b8fd2-c127-447b-ad7f-4e246f461ed9 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:08.009146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c97b8fd2-c127-447b-ad7f-4e246f461ed9 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:08.028815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c97b8fd2-c127-447b-ad7f-4e246f461ed9 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.029249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c97b8fd2-c127-447b-ad7f-4e246f461ed9 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.030080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c97b8fd2-c127-447b-ad7f-4e246f461ed9 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.030209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Acquired lock "refresh_cache-898264b4-f96e-47eb-bf78-c7d1ee36a44d" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:32:08.030515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c97b8fd2-c127-447b-ad7f-4e246f461ed9 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.161241 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c97b8fd2-c127-447b-ad7f-4e246f461ed9 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883/action" status: 202 len: 0 microversion: 2.25 time: 0.162775 Jun 16 18:32:08.162769 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 495/1002] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:32:07 2022] POST /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:08.170153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a813663-34f8-47d3-8c16-0b05d43b7008 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:08.171250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a813663-34f8-47d3-8c16-0b05d43b7008 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:08.201653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a813663-34f8-47d3-8c16-0b05d43b7008 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.202278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a813663-34f8-47d3-8c16-0b05d43b7008 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.203168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a813663-34f8-47d3-8c16-0b05d43b7008 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.203606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a813663-34f8-47d3-8c16-0b05d43b7008 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.689517 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a813663-34f8-47d3-8c16-0b05d43b7008 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1644 microversion: 2.1 time: 0.523734 Jun 16 18:32:08.691757 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 496/1003] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:08 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1644 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:08.698374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:08.701303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:08.710751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.711795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.712839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.713513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:09.112730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4dec74f5-68be-47e2-acc5-8a6eec839883 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:09.152240 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-993a8e13-33c3-4c1f-96e2-9847ade431a2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 2056 microversion: 2.25 time: 0.459037 Jun 16 18:32:09.177746 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 497/1004] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:08 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 2056 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:09.193397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:09.197083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:09.209956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:09.226645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:09.227537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:09.228587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:09.230300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.002573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:10.012552 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f397d000-6228-49e5-a619-8d53149edb79 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 0.831147 Jun 16 18:32:10.013473 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 498/1005] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:09 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:10.022368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:10.023437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:10.030363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.030825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.031639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.032269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.301976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:10.314952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52010af6-5f9b-4482-998a-e2d195f7adf7 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1487 microversion: 2.1 time: 0.299511 Jun 16 18:32:10.316531 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 499/1006] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:10 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1487 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:10.323834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17e3b299-f642-48b1-96fa-775a19d1bfd5 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:10.324610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17e3b299-f642-48b1-96fa-775a19d1bfd5 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:10.331845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e3b299-f642-48b1-96fa-775a19d1bfd5 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.332658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e3b299-f642-48b1-96fa-775a19d1bfd5 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.333697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e3b299-f642-48b1-96fa-775a19d1bfd5 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.335379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e3b299-f642-48b1-96fa-775a19d1bfd5 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.655510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17e3b299-f642-48b1-96fa-775a19d1bfd5 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1644 microversion: 2.1 time: 0.335564 Jun 16 18:32:10.658529 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 500/1007] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:10 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1644 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:10.669233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:10.670955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:10.689613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.691667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.692471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.692911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.070073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:11.093064 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4665ce3d-9c08-41ee-b392-4c7e800693d4 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1324 microversion: 2.1 time: 0.431383 Jun 16 18:32:11.094142 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 501/1008] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:10 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:11.111954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:11.113018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:11.121968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.122881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.123964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.124683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.423186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4dec74f5-68be-47e2-acc5-8a6eec839883 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:11.448965 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-715d5914-45b2-4cb5-916e-881c36aed3bd tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 2036 microversion: 2.25 time: 0.342174 Jun 16 18:32:11.464567 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 502/1009] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:11 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 2036 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:11.469861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c214f778-605e-424f-8f91-667b95d65d7c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1115064701"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:11.471868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c214f778-605e-424f-8f91-667b95d65d7c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:11.486434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c214f778-605e-424f-8f91-667b95d65d7c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.486691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c214f778-605e-424f-8f91-667b95d65d7c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.490312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c214f778-605e-424f-8f91-667b95d65d7c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.491961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c214f778-605e-424f-8f91-667b95d65d7c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.584958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.network.neutron [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] re-assign floating IP 172.25.0.155 from instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 Jun 16 18:32:11.685450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Building network info cache for instance {{(pid=119206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:32:11.970653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c214f778-605e-424f-8f91-667b95d65d7c tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "POST /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6/action" status: 202 len: 0 microversion: 2.1 time: 0.485125 Jun 16 18:32:11.982090 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 503/1010] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:11 2022] POST /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:32:11.991563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7784711-2042-45fc-9369-0d8ab3f5231d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:11.998125 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:11.998125 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:12.000758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7784711-2042-45fc-9369-0d8ab3f5231d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.001996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7784711-2042-45fc-9369-0d8ab3f5231d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.003060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7784711-2042-45fc-9369-0d8ab3f5231d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.003851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7784711-2042-45fc-9369-0d8ab3f5231d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.044639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7784711-2042-45fc-9369-0d8ab3f5231d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060299 Jun 16 18:32:12.072809 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 504/1011] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:32:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:12.083134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:12.085615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:12.119091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.120149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.122041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.123125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.728258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:12.748000 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28a0a44b-47a4-452c-b355-5482b616e4a2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1542 microversion: 2.1 time: 0.682588 Jun 16 18:32:12.748720 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 505/1012] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:12 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1542 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:12.757258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-cc521368-4d18-4ccd-9fe4-a7b5a15e51a7 req-357a7de9-49c6-4166-b7aa-c665382f288a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5487e1c8-2792-405c-91ef-5c4b4c4acdc4", "tag": "614ced4d-0258-4800-8fd5-e223c2331b5e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:12.778043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cc521368-4d18-4ccd-9fe4-a7b5a15e51a7 req-357a7de9-49c6-4166-b7aa-c665382f288a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.778587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cc521368-4d18-4ccd-9fe4-a7b5a15e51a7 req-357a7de9-49c6-4166-b7aa-c665382f288a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.792110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-cc521368-4d18-4ccd-9fe4-a7b5a15e51a7 req-357a7de9-49c6-4166-b7aa-c665382f288a service nova] Creating event network-changed:614ced4d-0258-4800-8fd5-e223c2331b5e for instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 on n-h1-846209-2 Jun 16 18:32:12.798637 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-cc521368-4d18-4ccd-9fe4-a7b5a15e51a7 req-357a7de9-49c6-4166-b7aa-c665382f288a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048409 Jun 16 18:32:12.800398 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 506/1013] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:12.806379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Updating instance_info_cache with network_info: [{"id": "614ced4d-0258-4800-8fd5-e223c2331b5e", "address": "fa:16:3e:21:c8:da", "network": {"id": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709469550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "295e1cc58e82459ab321439379b227ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap614ced4d-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:32:12.807820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846209-2", "block_migration": "auto"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:12.809041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:12.832566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Building network info cache for instance {{(pid=119206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:32:12.837303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.838378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.839849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.840450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.878028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'flavor' on Instance uuid 4dec74f5-68be-47e2-acc5-8a6eec839883 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:12.895874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Going to try to live migrate instance to n-h1-846209-2 {{(pid=119207) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:32:12.902447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:14.891171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Updating instance_info_cache with network_info: [{"id": "c40d5082-5f99-494f-a31e-3fa04662e9ba", "address": "fa:16:3e:a4:6c:83", "network": {"id": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709469550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "295e1cc58e82459ab321439379b227ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc40d5082-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:32:14.929591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Releasing lock "refresh_cache-898264b4-f96e-47eb-bf78-c7d1ee36a44d" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:32:14.931056 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e8d57a8-4049-42fc-855a-deaacf44a007 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d/action" status: 202 len: 0 microversion: 2.1 time: 7.172920 Jun 16 18:32:14.931950 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 508/1014] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:07 2022] POST /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d/action => generated 0 bytes in 7175 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:32:14.942335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-de9fb5de-9290-472e-ad1b-6e7f171d0f0a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866ef9d160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:15.022982 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-de9fb5de-9290-472e-ad1b-6e7f171d0f0a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d" status: 200 len: 1412 microversion: 2.1 time: 0.083878 Jun 16 18:32:15.024373 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 509/1015] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:32:14 2022] GET /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:15.029705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51ea1133-ec65-4ebf-9c31-7dbf4ba21d69 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:15.031075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51ea1133-ec65-4ebf-9c31-7dbf4ba21d69 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:15.044217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ea1133-ec65-4ebf-9c31-7dbf4ba21d69 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.045142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ea1133-ec65-4ebf-9c31-7dbf4ba21d69 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.046243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ea1133-ec65-4ebf-9c31-7dbf4ba21d69 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.047144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ea1133-ec65-4ebf-9c31-7dbf4ba21d69 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.181010 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51ea1133-ec65-4ebf-9c31-7dbf4ba21d69 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61/action" status: 202 len: 0 microversion: 2.1 time: 0.154474 Jun 16 18:32:15.189413 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 510/1016] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:15 2022] POST /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:15.202812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:15.204530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:15.225494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.226848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.229569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.231884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.863062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:15.876618 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-75496079-a9c2-4baa-be3c-64ae00dac52f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1324 microversion: 2.1 time: 0.684293 Jun 16 18:32:15.877269 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 511/1017] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:15 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:16.095699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e36890b7-d4d5-4f12-a688-f7dc7fa2c169 req-0494760e-eeff-42d0-b819-8f3bafe00c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211554fa-d881-43d0-9431-43e3f0eed006", "tag": "dcd96ea1-8e46-4212-8b07-f5167dcf8bf0"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:16.112729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e36890b7-d4d5-4f12-a688-f7dc7fa2c169 req-0494760e-eeff-42d0-b819-8f3bafe00c6a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.113795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e36890b7-d4d5-4f12-a688-f7dc7fa2c169 req-0494760e-eeff-42d0-b819-8f3bafe00c6a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.133083 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e36890b7-d4d5-4f12-a688-f7dc7fa2c169 req-0494760e-eeff-42d0-b819-8f3bafe00c6a service nova] Creating event network-changed:dcd96ea1-8e46-4212-8b07-f5167dcf8bf0 for instance 211554fa-d881-43d0-9431-43e3f0eed006 on n-h2-846209-2 Jun 16 18:32:16.139694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e36890b7-d4d5-4f12-a688-f7dc7fa2c169 req-0494760e-eeff-42d0-b819-8f3bafe00c6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258475 Jun 16 18:32:16.140920 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 512/1018] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:16.158045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:16.158784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:16.175754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.176700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.178131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.178716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.236713 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5e6d8bf9-99ca-43b9-971d-008d210ee1a3 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883/action" status: 202 len: 0 microversion: 2.25 time: 3.434331 Jun 16 18:32:16.238293 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 507/1019] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:32:12 2022] POST /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883/action => generated 0 bytes in 3437 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:16.246922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a6391faf-7bc3-4c89-bdf5-e4bf96abd290 req-f48219a8-bd57-48d5-ab30-9f17ffed0a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898264b4-f96e-47eb-bf78-c7d1ee36a44d", "tag": "c40d5082-5f99-494f-a31e-3fa04662e9ba"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:16.258479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a6391faf-7bc3-4c89-bdf5-e4bf96abd290 req-f48219a8-bd57-48d5-ab30-9f17ffed0a0a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.259423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a6391faf-7bc3-4c89-bdf5-e4bf96abd290 req-f48219a8-bd57-48d5-ab30-9f17ffed0a0a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.276391 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a6391faf-7bc3-4c89-bdf5-e4bf96abd290 req-f48219a8-bd57-48d5-ab30-9f17ffed0a0a service nova] Creating event network-changed:c40d5082-5f99-494f-a31e-3fa04662e9ba for instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d on n-h2-846209-2 Jun 16 18:32:16.284477 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a6391faf-7bc3-4c89-bdf5-e4bf96abd290 req-f48219a8-bd57-48d5-ab30-9f17ffed0a0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043744 Jun 16 18:32:16.286317 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 508/1020] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:16.295706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'action', calling method: .version_select at 0x7f86764d3f70>, body: {"removeFloatingIp": {"address": "172.25.0.155"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:16.750464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:16.783763 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-187c6e53-bc47-4e08-8e39-d27f59a89ba6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1473 microversion: 2.1 time: 0.641210 Jun 16 18:32:16.802501 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 513/1021] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:16 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1473 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:16.881650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:16.898799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.902576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.908229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.911181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.933077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dae99573-edcd-43fa-9bc1-fb5edd52531c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-592492984", "id": 1493483138, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:16.947050 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:16.947050 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:17.011147 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dae99573-edcd-43fa-9bc1-fb5edd52531c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.206500 Jun 16 18:32:17.014575 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 514/1022] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:16 2022] POST /compute/v2.1/flavors => generated 429 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:17.039240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-38b6a4e2-185d-48ed-b10e-b1634297183e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f223430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:17.160246 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-38b6a4e2-185d-48ed-b10e-b1634297183e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d" status: 200 len: 1412 microversion: 2.1 time: 0.143057 Jun 16 18:32:17.175579 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 515/1023] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:32:17 2022] GET /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d => generated 1412 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:17.203033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3eea0548-ded9-4a9d-93e8-dc27d59abd47 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:17.204509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3eea0548-ded9-4a9d-93e8-dc27d59abd47 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:17.225498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eea0548-ded9-4a9d-93e8-dc27d59abd47 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:17.226220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eea0548-ded9-4a9d-93e8-dc27d59abd47 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:17.231629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eea0548-ded9-4a9d-93e8-dc27d59abd47 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:17.234905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eea0548-ded9-4a9d-93e8-dc27d59abd47 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:17.279612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:17.754808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:17.982148 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] HTTP exception thrown: Floating IP 172.25.0.155 is not associated with instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4. Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Request method failure captured: Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action HTTP/1.1 Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 49 Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3bh-5kEbVuY9bNpPQRtRnGxIKgd6sTCSqnqh2FWXZO59eoOPZRxhn8WaEk3vlZaNsBruz59xhLWkfNkFmn-RWO5GqbPADGKf0wdAMSCZz2HxdaEz_IQo5nfCGN7IXlcWUKgPB3mEXsyjPFSAVMsONa0MhXq00QVHW9kNhBl5hoh-jY Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:17.986336 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/295e1cc58e82459ab321439379b227ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_295e1cc58e82459ab321439379b227ea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 7eee236345ec40729015a74ba7f05a82 Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: {"removeFloatingIp": {"address": "172.25.0.155"}} Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:32:17.989091 n-d-846209-2 devstack@n-api.service[119207]: exception: Floating IP 172.25.0.155 is not associated with instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4. Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5487e1c8-2792-405c-91ef-5c4b4c4acdc4', 'body': {'removeFloatingIp': {'address': '172.25.0.155'}}} Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.155 is not associated with instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4. Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:17.991739 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:17.994278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:17.994278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:17.994278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:17.994278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:17.994278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.155 is not associated with instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4. Jun 16 18:32:17.994278 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:17.997357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Returning 409 to user: Floating IP 172.25.0.155 is not associated with instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:17.999680 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd6e2842-0c1a-4529-9d2c-3ac3dfb147bc tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action" status: 409 len: 146 microversion: 2.1 time: 1.710610 Jun 16 18:32:18.002404 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 509/1024] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:16 2022] POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action => generated 146 bytes in 1715 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:18.027683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:18.031453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:18.066986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.069516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.071601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.073814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.190418 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3eea0548-ded9-4a9d-93e8-dc27d59abd47 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1629 microversion: 2.1 time: 1.012784 Jun 16 18:32:18.227871 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 516/1025] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:17 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1629 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:18.259793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:18.263379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:18.280599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.281641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.283374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.284197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.774381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:18.791457 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2edff954-d5d7-49d8-bded-184d01554d43 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1324 microversion: 2.1 time: 0.560889 Jun 16 18:32:18.800296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:18.808420 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 517/1026] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:18 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1324 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:18.810230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:18.812044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:18.813250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6701ed46-a305-4053-a3cf-ba55419ba63b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1568 microversion: 2.25 time: 0.798571 Jun 16 18:32:18.813823 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 510/1027] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:18 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1568 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:18.834922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b520aeea-8f28-4508-8376-3e68b6637124 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f2e48b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:18.835690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a817a4a7-de23-4e69-9690-ddff5f864071 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:18.836930 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:18.836930 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:18.886175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a817a4a7-de23-4e69-9690-ddff5f864071 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1493483138" status: 202 len: 0 microversion: 2.1 time: 0.075667 Jun 16 18:32:18.887343 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 518/1028] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:32:18 2022] DELETE /compute/v2.1/flavors/1493483138 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:18.906101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5cee1ae6-9aa8-42b0-95b8-f6fb379c35ea req-783a45c5-2c5f-4d4e-8c65-140175bd3c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31", "name": "network-vif-unplugged", "status": "completed", "tag": "c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:18.939819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5cee1ae6-9aa8-42b0-95b8-f6fb379c35ea req-783a45c5-2c5f-4d4e-8c65-140175bd3c77 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.942383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5cee1ae6-9aa8-42b0-95b8-f6fb379c35ea req-783a45c5-2c5f-4d4e-8c65-140175bd3c77 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.982809 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5cee1ae6-9aa8-42b0-95b8-f6fb379c35ea req-783a45c5-2c5f-4d4e-8c65-140175bd3c77 service nova] Creating event network-vif-unplugged:c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4 for instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 on n-h1-846209-2 Jun 16 18:32:19.006259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-5cee1ae6-9aa8-42b0-95b8-f6fb379c35ea req-783a45c5-2c5f-4d4e-8c65-140175bd3c77 service nova] Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:32:19.031637 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5cee1ae6-9aa8-42b0-95b8-f6fb379c35ea req-783a45c5-2c5f-4d4e-8c65-140175bd3c77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136951 Jun 16 18:32:19.033792 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 519/1029] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:19.046608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:19.048124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:19.070698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.071794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.073054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.073893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.140711 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b520aeea-8f28-4508-8376-3e68b6637124 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d" status: 204 len: 0 microversion: 2.1 time: 0.313486 Jun 16 18:32:19.141409 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 511/1030] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:18 2022] DELETE /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:19.146533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.155"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:19.558074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:19.562972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.563798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.565661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.568799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.633725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:19.637288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:19.663193 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9fad3b5f-2bb5-4a77-b785-27fd87485047 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1470 microversion: 2.1 time: 0.624993 Jun 16 18:32:19.664749 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 520/1031] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:19 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1470 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:19.671443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846209-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:19.673506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:19.682599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.683327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.684363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.685040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.728721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lazy-loading 'flavor' on Instance uuid fb575fd4-0970-400b-913f-721aafd46e61 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:19.750110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Going to try to live migrate instance to n-h2-846209-2 {{(pid=119206) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:32:20.063335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Acquired lock "refresh_cache-898264b4-f96e-47eb-bf78-c7d1ee36a44d" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:32:21.968738 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24045a8f-a050-44b2-b316-c8bd375557ab tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61/action" status: 202 len: 0 microversion: 2.1 time: 2.302530 Jun 16 18:32:21.969402 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 521/1032] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:19 2022] POST /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61/action => generated 0 bytes in 2304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:21.977483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-372bd5ee-ca37-432c-a09e-463d0c78c233 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:22.012185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Building network info cache for instance {{(pid=119207) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:32:22.038743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:22.042856 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-372bd5ee-ca37-432c-a09e-463d0c78c233 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068662 Jun 16 18:32:22.043869 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 522/1033] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:22.063102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14eba89a-2ef2-4882-a840-4c1215214b50 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f6da550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:22.132955 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-14eba89a-2ef2-4882-a840-4c1215214b50 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Image not found. Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14eba89a-2ef2-4882-a840-4c1215214b50 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d HTTP/1.1 Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:22.153847 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3467dc70-b170-4f45-9b29-990a2de8648d'} Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:22.156244 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3467dc70-b170-4f45-9b29-990a2de8648d Jun 16 18:32:22.157252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:22.159698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3467dc70-b170-4f45-9b29-990a2de8648d could not be found. Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:22.162586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:22.166681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14eba89a-2ef2-4882-a840-4c1215214b50 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:22.168299 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14eba89a-2ef2-4882-a840-4c1215214b50 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d" status: 404 len: 62 microversion: 2.1 time: 0.111811 Jun 16 18:32:22.168999 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 523/1034] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:32:22 2022] GET /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:22.185300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:22.186167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:22.196844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.197978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:22.199288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.200029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:22.275835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.276721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:22.277864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.278631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:22.333726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:22.344367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for user 209d0e879aea45269c56a7c7d9869b23 and project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:22.608383 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-26285c9a-8629-4055-9faa-7ac0a1d310b3 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31/action" status: 202 len: 0 microversion: 2.1 time: 0.432745 Jun 16 18:32:22.609593 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 524/1035] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:22 2022] POST /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:22.633301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:22.640775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:22.656467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.656942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:22.668012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.669116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.185197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:23.205947 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7af48b90-dbfd-4a6f-aa7c-cda0ef39777a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1324 microversion: 2.1 time: 0.592912 Jun 16 18:32:23.206228 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 525/1036] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:22 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1324 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:23.221176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:23.221470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:23.229058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.229404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.234162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.234162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.649851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Updating instance_info_cache with network_info: [{"id": "c40d5082-5f99-494f-a31e-3fa04662e9ba", "address": "fa:16:3e:a4:6c:83", "network": {"id": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709469550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "295e1cc58e82459ab321439379b227ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc40d5082-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119207) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:32:23.672864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Releasing lock "refresh_cache-898264b4-f96e-47eb-bf78-c7d1ee36a44d" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:32:23.674715 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-feaf7a72-bac7-40ff-8914-fdb63d1d4f1b tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d/action" status: 202 len: 0 microversion: 2.1 time: 4.532068 Jun 16 18:32:23.676027 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 512/1037] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:19 2022] POST /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d/action => generated 0 bytes in 4534 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:32:23.683975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2d14fa78-8e67-468e-b676-1739e98a7f06 req-3f6b82f6-6f40-4c3b-ad70-28179577456c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7453b4f4-c53d-4314-8b06-75ce854a45e6", "name": "network-vif-plugged", "status": "completed", "tag": "32340453-7ece-4e56-9662-2db0d327f507"}, {"server_uuid": "211554fa-d881-43d0-9431-43e3f0eed006", "name": "network-vif-plugged", "status": "completed", "tag": "dcd96ea1-8e46-4212-8b07-f5167dcf8bf0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:23.701509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2d14fa78-8e67-468e-b676-1739e98a7f06 req-3f6b82f6-6f40-4c3b-ad70-28179577456c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.702727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2d14fa78-8e67-468e-b676-1739e98a7f06 req-3f6b82f6-6f40-4c3b-ad70-28179577456c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.722845 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2d14fa78-8e67-468e-b676-1739e98a7f06 req-3f6b82f6-6f40-4c3b-ad70-28179577456c service nova] Creating event network-vif-plugged:32340453-7ece-4e56-9662-2db0d327f507 for instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 on n-h2-846209-2 Jun 16 18:32:23.723650 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2d14fa78-8e67-468e-b676-1739e98a7f06 req-3f6b82f6-6f40-4c3b-ad70-28179577456c service nova] Creating event network-vif-plugged:dcd96ea1-8e46-4212-8b07-f5167dcf8bf0 for instance 211554fa-d881-43d0-9431-43e3f0eed006 on n-h2-846209-2 Jun 16 18:32:23.732463 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2d14fa78-8e67-468e-b676-1739e98a7f06 req-3f6b82f6-6f40-4c3b-ad70-28179577456c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054165 Jun 16 18:32:23.734113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 513/1038] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:23.742529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-eccd6cad-452a-47e0-9e6f-77a157de5513 req-02282d07-965f-40f9-a40c-32f76b14af3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dec74f5-68be-47e2-acc5-8a6eec839883", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf53088-fbdc-47e4-86c7-3a95436ab49b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:23.753961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-eccd6cad-452a-47e0-9e6f-77a157de5513 req-02282d07-965f-40f9-a40c-32f76b14af3a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.754401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-eccd6cad-452a-47e0-9e6f-77a157de5513 req-02282d07-965f-40f9-a40c-32f76b14af3a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.770421 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-eccd6cad-452a-47e0-9e6f-77a157de5513 req-02282d07-965f-40f9-a40c-32f76b14af3a service nova] Creating event network-vif-unplugged:5bf53088-fbdc-47e4-86c7-3a95436ab49b for instance 4dec74f5-68be-47e2-acc5-8a6eec839883 on n-h2-846209-2 Jun 16 18:32:23.777655 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-eccd6cad-452a-47e0-9e6f-77a157de5513 req-02282d07-965f-40f9-a40c-32f76b14af3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041579 Jun 16 18:32:23.779156 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 514/1039] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:23.784289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:23.786330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:23.788409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:23.794888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:23.796806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.797708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.798943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.799747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.801187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:23.806235 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-118d03d9-f3b7-40c2-99a2-c7db49dbe5ad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1568 microversion: 2.25 time: 0.589220 Jun 16 18:32:23.809592 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 526/1040] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:23 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1568 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:23.814795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4082e3fd-8bf8-46ec-a466-1199748af799 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1411750837", "id": 2097905857, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:23.827663 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:23.827663 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:23.867696 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4082e3fd-8bf8-46ec-a466-1199748af799 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.056507 Jun 16 18:32:23.868312 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 527/1041] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:23 2022] POST /compute/v2.1/flavors => generated 417 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:23.877965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:23.878603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:23.886387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.886718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.888120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.888729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.357551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:24.383038 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3be44901-a1cd-476d-8eb0-b3b541b9357a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.601738 Jun 16 18:32:24.393187 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 515/1042] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:23 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:24.402626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:24.403347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:24.418626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:24.433457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.434692 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa087a48-2f2f-4be0-8f8c-423c4486c19a tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1500 microversion: 2.1 time: 0.565244 Jun 16 18:32:24.435358 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 528/1043] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:23 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1500 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:24.440304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.441148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.441599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.450595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:24.451119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:24.467336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.468197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.469222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.470200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.514927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:24.653275 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31527d19-507d-4f9e-9442-54cdaf119ffe tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 204 len: 0 microversion: 2.1 time: 0.216259 Jun 16 18:32:24.654298 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 529/1044] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:24 2022] DELETE /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:24.663369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48c5a29d-4000-4757-bdbc-64092334c8c3 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:24.688877 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48c5a29d-4000-4757-bdbc-64092334c8c3 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.031531 Jun 16 18:32:24.698425 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 530/1045] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:24 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:24.698425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:24.698425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:24.705694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.706136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.707111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.708525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.791302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:24.799597 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-14b75124-09a6-4b01-9412-740afc08fc95 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1469 microversion: 2.1 time: 0.405209 Jun 16 18:32:24.800470 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 516/1046] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:24 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1469 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:24.806635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.155"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:24.808091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:24.818069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.818979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.820851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:24.821542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:24.858472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Acquired lock "refresh_cache-5487e1c8-2792-405c-91ef-5c4b4c4acdc4" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:32:25.458225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:25.478615 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-40493072-39de-4534-96be-f37d32d7ae68 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1324 microversion: 2.1 time: 0.786664 Jun 16 18:32:25.479557 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 531/1047] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:24 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1324 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:25.485954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e5a721b5-e4b3-497c-acf5-a42a473fdf64 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:25.488115 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:25.488115 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:25.532889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e5a721b5-e4b3-497c-acf5-a42a473fdf64 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2097905857" status: 202 len: 0 microversion: 2.1 time: 0.052128 Jun 16 18:32:25.534107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 532/1048] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:32:25 2022] DELETE /compute/v2.1/flavors/2097905857 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:25.539849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:25.540470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:25.547836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:25.548427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:25.549279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:25.550001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:25.832752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:25.851206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:25.853142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:25.854607 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-00fbec93-d6bb-422e-8637-162359ec4f16 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1568 microversion: 2.25 time: 0.319404 Jun 16 18:32:25.866360 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 533/1049] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:25 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:25.871770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:25.872397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:25.879092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:25.879555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:25.880430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:25.880978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:26.166738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:26.181489 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e0b1c650-95d1-435f-b893-df6890f62f5f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.313878 Jun 16 18:32:26.182477 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 534/1050] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:25 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:26.188118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:26.188823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:26.203282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:26.204056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:26.205412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:26.206062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:26.491799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:26.502386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:26.507054 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-527d26b2-dc8f-44e2-8afe-5756c94c1f12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1500 microversion: 2.1 time: 0.322311 Jun 16 18:32:26.520110 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 535/1051] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:26 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1500 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:26.526574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8eb7d69f-105e-497c-9fa2-9ff69f6e9849 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:26.569027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8eb7d69f-105e-497c-9fa2-9ff69f6e9849 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045798 Jun 16 18:32:26.569633 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 536/1052] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:26.574609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fed8a339-7e8e-4e67-9b24-0adadfae6b00 req-8efbb40d-6f4b-4360-af7d-2c3682faf9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31", "name": "network-vif-plugged", "status": "completed", "tag": "c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:26.584799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fed8a339-7e8e-4e67-9b24-0adadfae6b00 req-8efbb40d-6f4b-4360-af7d-2c3682faf9c9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:26.585232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fed8a339-7e8e-4e67-9b24-0adadfae6b00 req-8efbb40d-6f4b-4360-af7d-2c3682faf9c9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:26.616740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fed8a339-7e8e-4e67-9b24-0adadfae6b00 req-8efbb40d-6f4b-4360-af7d-2c3682faf9c9 service nova] Creating event network-vif-plugged:c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4 for instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 on n-h1-846209-2 Jun 16 18:32:26.623520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-fed8a339-7e8e-4e67-9b24-0adadfae6b00 req-8efbb40d-6f4b-4360-af7d-2c3682faf9c9 service nova] Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:32:26.630756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fed8a339-7e8e-4e67-9b24-0adadfae6b00 req-8efbb40d-6f4b-4360-af7d-2c3682faf9c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059647 Jun 16 18:32:26.631998 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 537/1053] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:26.637496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:26.638320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:26.645170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:26.645631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:26.647055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:26.647601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:27.018016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:27.027245 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f40fae79-ac59-467f-846c-0e8cef17299b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1469 microversion: 2.1 time: 0.393969 Jun 16 18:32:27.035172 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 538/1054] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:26 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:27.043973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-aa015ae2-ac6b-43b3-83d6-6559d6e78353 req-e3659447-4121-445c-8108-d918ae3c6a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898264b4-f96e-47eb-bf78-c7d1ee36a44d", "tag": "c40d5082-5f99-494f-a31e-3fa04662e9ba"}, {"name": "network-changed", "server_uuid": "4dec74f5-68be-47e2-acc5-8a6eec839883", "tag": "5bf53088-fbdc-47e4-86c7-3a95436ab49b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:27.061658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:27.069578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-aa015ae2-ac6b-43b3-83d6-6559d6e78353 req-e3659447-4121-445c-8108-d918ae3c6a0b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:27.070143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-aa015ae2-ac6b-43b3-83d6-6559d6e78353 req-e3659447-4121-445c-8108-d918ae3c6a0b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:27.098121 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-aa015ae2-ac6b-43b3-83d6-6559d6e78353 req-e3659447-4121-445c-8108-d918ae3c6a0b service nova] Creating event network-changed:c40d5082-5f99-494f-a31e-3fa04662e9ba for instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d on n-h2-846209-2 Jun 16 18:32:27.099705 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-aa015ae2-ac6b-43b3-83d6-6559d6e78353 req-e3659447-4121-445c-8108-d918ae3c6a0b service nova] Creating event network-changed:5bf53088-fbdc-47e4-86c7-3a95436ab49b for instance 4dec74f5-68be-47e2-acc5-8a6eec839883 on n-h2-846209-2 Jun 16 18:32:27.109399 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-aa015ae2-ac6b-43b3-83d6-6559d6e78353 req-e3659447-4121-445c-8108-d918ae3c6a0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072755 Jun 16 18:32:27.110916 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 539/1055] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:27.117173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:27.118228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:27.125469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:27.126192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:27.127112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:27.127661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:27.624672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:27.640745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Building network info cache for instance {{(pid=119207) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:32:27.642823 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6a8f3f3-2c46-45f2-bf36-b4075a8555f8 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1520 microversion: 2.1 time: 0.530549 Jun 16 18:32:27.658620 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 540/1056] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:27 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1520 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:27.674669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2843bf34-e403-441b-82db-0f04a24602c7 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-922432260", "id": 1635583158, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:27.683261 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:27.683261 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:27.735729 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2843bf34-e403-441b-82db-0f04a24602c7 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.074965 Jun 16 18:32:27.736987 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 541/1057] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:27 2022] POST /compute/v2.1/flavors => generated 428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:27.750291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:27.752211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:27.768563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:27.769242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:27.781119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:27.784904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:28.640886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:28.674457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:28.676510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:28.681787 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a536ca99-a7d7-4200-880d-74eca735a418 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1568 microversion: 2.25 time: 0.942539 Jun 16 18:32:28.692766 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 542/1058] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:27 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1568 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:28.702329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:28.702944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:28.744767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:28.745313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:28.749486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:28.753537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:29.620476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:29.636402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e385ad5-5e74-4235-8c3e-454bc0da40c7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.942469 Jun 16 18:32:29.652760 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 543/1059] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:28 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:29.672427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:29.673432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:29.692797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:29.693644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:29.695368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:29.696072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:30.626927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:30.637880 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9afe9211-becf-401c-9f28-113a587d605b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1500 microversion: 2.1 time: 0.983106 Jun 16 18:32:30.639197 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 544/1060] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:29 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1500 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:30.646618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:30.648504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:30.659503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:30.661034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:30.664343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:30.665230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:30.701352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:30.826464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9bd36360-484a-4bf2-a754-83430fa22e85 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 204 len: 0 microversion: 2.1 time: 0.185745 Jun 16 18:32:30.829260 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 545/1061] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:30 2022] DELETE /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:30.843058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-869503fe-f7f2-49ea-8f7f-b78f5f202d81 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:30.844450 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:30.844450 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:30.877659 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-869503fe-f7f2-49ea-8f7f-b78f5f202d81 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1635583158" status: 202 len: 0 microversion: 2.1 time: 0.045454 Jun 16 18:32:30.885522 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 546/1062] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:32:30 2022] DELETE /compute/v2.1/flavors/1635583158 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:30.892685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:30.893818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:30.910385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:30.911430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:30.913782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:30.914541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.296412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Updating instance_info_cache with network_info: [{"id": "614ced4d-0258-4800-8fd5-e223c2331b5e", "address": "fa:16:3e:21:c8:da", "network": {"id": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709469550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "295e1cc58e82459ab321439379b227ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap614ced4d-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119207) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:32:31.311842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Releasing lock "refresh_cache-5487e1c8-2792-405c-91ef-5c4b4c4acdc4" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:32:31.313145 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fefad5c8-7049-4359-b7cb-34588a11be78 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action" status: 202 len: 0 microversion: 2.1 time: 6.511280 Jun 16 18:32:31.316571 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 517/1063] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:24 2022] POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action => generated 0 bytes in 6513 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:32:31.322031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e636c30a-4565-4c97-a406-7d7a8cf3945a req-33bcfe10-3c13-4d5d-ba92-8a94753ae072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dec74f5-68be-47e2-acc5-8a6eec839883", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf53088-fbdc-47e4-86c7-3a95436ab49b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:31.335901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e636c30a-4565-4c97-a406-7d7a8cf3945a req-33bcfe10-3c13-4d5d-ba92-8a94753ae072 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.337422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e636c30a-4565-4c97-a406-7d7a8cf3945a req-33bcfe10-3c13-4d5d-ba92-8a94753ae072 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.356159 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e636c30a-4565-4c97-a406-7d7a8cf3945a req-33bcfe10-3c13-4d5d-ba92-8a94753ae072 service nova] Creating event network-vif-unplugged:5bf53088-fbdc-47e4-86c7-3a95436ab49b for instance 4dec74f5-68be-47e2-acc5-8a6eec839883 on n-h2-846209-2 Jun 16 18:32:31.361442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e636c30a-4565-4c97-a406-7d7a8cf3945a req-33bcfe10-3c13-4d5d-ba92-8a94753ae072 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046013 Jun 16 18:32:31.368258 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 518/1064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:31.396994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:31.414711 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-07fd35c8-289b-4d4d-8223-7a2dbde34e60 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1535 microversion: 2.1 time: 0.526861 Jun 16 18:32:31.416332 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 547/1065] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:30 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1535 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:31.427462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:31.429366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:31.442340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.443624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.444952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.445632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.506117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3a4382ca-07ea-4346-8cfc-24176c5cf87c req-20d0b184-100a-4efb-a3a5-992d71a92518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5487e1c8-2792-405c-91ef-5c4b4c4acdc4", "tag": "614ced4d-0258-4800-8fd5-e223c2331b5e"}, {"server_uuid": "fb575fd4-0970-400b-913f-721aafd46e61", "name": "network-vif-unplugged", "status": "completed", "tag": "79471afd-118e-4f81-8fc5-5c6ef7b970c9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:31.518128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3a4382ca-07ea-4346-8cfc-24176c5cf87c req-20d0b184-100a-4efb-a3a5-992d71a92518 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.518922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3a4382ca-07ea-4346-8cfc-24176c5cf87c req-20d0b184-100a-4efb-a3a5-992d71a92518 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.539074 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3a4382ca-07ea-4346-8cfc-24176c5cf87c req-20d0b184-100a-4efb-a3a5-992d71a92518 service nova] Creating event network-changed:614ced4d-0258-4800-8fd5-e223c2331b5e for instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 on n-h1-846209-2 Jun 16 18:32:31.539914 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3a4382ca-07ea-4346-8cfc-24176c5cf87c req-20d0b184-100a-4efb-a3a5-992d71a92518 service nova] Creating event network-vif-unplugged:79471afd-118e-4f81-8fc5-5c6ef7b970c9 for instance fb575fd4-0970-400b-913f-721aafd46e61 on n-h1-846209-2 Jun 16 18:32:31.549149 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3a4382ca-07ea-4346-8cfc-24176c5cf87c req-20d0b184-100a-4efb-a3a5-992d71a92518 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.181958 Jun 16 18:32:31.550403 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 519/1066] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:31.558111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:31.559106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:31.570451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.571135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.572107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.572711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.853396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:31.878631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:31.881978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:31.883342 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c9c5cc3-60ae-4e0b-8b26-21ea53eb1dd1 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1568 microversion: 2.25 time: 0.464722 Jun 16 18:32:31.894152 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 548/1067] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:31 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1568 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:31.894152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:31.894152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:31.901387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.902022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.902907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.903379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.919733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:31.927731 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e070b7a4-f1d8-4120-963d-d3b4d43b3e80 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.375613 Jun 16 18:32:31.928517 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 520/1068] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:31 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:31.933047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e5fe43b-150b-4e59-b64c-d8f9a87ffc64 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:31.956579 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e5fe43b-150b-4e59-b64c-d8f9a87ffc64 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026905 Jun 16 18:32:31.957187 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 521/1069] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:31.964011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37e1990f-6a86-4a9a-9726-879d857674ba tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '.version_select at 0x7f866f2b7820>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:32.130044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:32.138987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55f48e79-f9bc-48a0-bacf-2508f7d8d959 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1526 microversion: 2.1 time: 0.253338 Jun 16 18:32:32.139828 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 549/1070] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:31 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1526 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:32.207996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2961eb7f-5cbc-419a-9a38-b66a82b79995 req-73408add-ae75-4a82-a683-bbcf7fc0d7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31", "name": "network-vif-unplugged", "status": "completed", "tag": "c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:32.217173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2961eb7f-5cbc-419a-9a38-b66a82b79995 req-73408add-ae75-4a82-a683-bbcf7fc0d7dd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.217607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2961eb7f-5cbc-419a-9a38-b66a82b79995 req-73408add-ae75-4a82-a683-bbcf7fc0d7dd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.221320 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37e1990f-6a86-4a9a-9726-879d857674ba tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/2fb785f6-a5c9-4c61-bd7b-3c39ada07ae7" status: 200 len: 184 microversion: 2.1 time: 0.263067 Jun 16 18:32:32.222103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 522/1071] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:32:31 2022] GET /compute/v2.1/os-floating-ips/2fb785f6-a5c9-4c61-bd7b-3c39ada07ae7 => generated 184 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:32.227078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:32.227776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:32.236298 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2961eb7f-5cbc-419a-9a38-b66a82b79995 req-73408add-ae75-4a82-a683-bbcf7fc0d7dd service nova] Creating event network-vif-unplugged:c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4 for instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 on n-h1-846209-2 Jun 16 18:32:32.236489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.236836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.237710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.238979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.242932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-2961eb7f-5cbc-419a-9a38-b66a82b79995 req-73408add-ae75-4a82-a683-bbcf7fc0d7dd service nova] Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:32:32.250627 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2961eb7f-5cbc-419a-9a38-b66a82b79995 req-73408add-ae75-4a82-a683-bbcf7fc0d7dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100543 Jun 16 18:32:32.251310 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 550/1072] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:32.258714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fea1edfc-b37b-466b-a7bb-97c6b669e8f3 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-214172554", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:32.260330 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:32.260330 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:32.278758 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fea1edfc-b37b-466b-a7bb-97c6b669e8f3 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.026006 Jun 16 18:32:32.279443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 551/1073] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:32 2022] POST /compute/v2.1/flavors => generated 506 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:32.284142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Action: 'action', calling method: .version_select at 0x7f86764d3f70>, body: {"removeFloatingIp": {"address": "172.25.0.155"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:32.305949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:32.547184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:32.556278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:32.556429 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1119b853-d5b9-4ae0-8a1f-b319dbf0e511 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1500 microversion: 2.1 time: 0.332820 Jun 16 18:32:32.565971 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 523/1074] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:32 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1500 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:32.565971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d6d92a92-af6c-4a2b-9e38-45b2f28b9aae tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:32.565971 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:32.565971 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:32.567657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.569240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.570158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.570706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.584297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d6d92a92-af6c-4a2b-9e38-45b2f28b9aae tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/3ce6e1ac-1e90-464e-96be-4a0fbd17ad9f" status: 202 len: 0 microversion: 2.1 time: 0.025844 Jun 16 18:32:32.585698 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 524/1075] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:32 2022] DELETE /compute/v2.1/flavors/3ce6e1ac-1e90-464e-96be-4a0fbd17ad9f => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:32.592769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:32.593393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:32.599994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.600443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.601302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.601667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.943223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:32.952041 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-287de888-5eb4-4d58-8d7c-c624104300c0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1535 microversion: 2.1 time: 0.365088 Jun 16 18:32:32.952932 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 525/1076] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:32 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1535 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:32.957389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e0a89838-2a6e-406b-9b9a-77c48c50ded8 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:32.976941 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e0a89838-2a6e-406b-9b9a-77c48c50ded8 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022875 Jun 16 18:32:32.977525 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 526/1077] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:32.982186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:32.982794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:32.990460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.990921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.991720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.992166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:33.002156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Acquired lock "refresh_cache-5487e1c8-2792-405c-91ef-5c4b4c4acdc4" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:32:33.275267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:33.284298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:33.285858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:33.287819 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e7528cd-8873-41b8-b92a-9545f79949bb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1568 microversion: 2.25 time: 0.309326 Jun 16 18:32:33.288423 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 527/1078] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:32 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1568 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:33.292907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:33.293523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:33.299892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:33.300352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:33.301125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:33.301562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.000544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:34.014360 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-399a113a-0023-4bbc-9a71-2ecc9721e5f4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.724348 Jun 16 18:32:34.017125 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 528/1079] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:33 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:34.028545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-321d14ba-6757-4683-a75d-314a11c2dc4f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-331730486", "id": "0b9cef42-2730-488d-9c17-20e70ba2bd2c", "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:34.032668 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:34.032668 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:34.058811 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-321d14ba-6757-4683-a75d-314a11c2dc4f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.039756 Jun 16 18:32:34.059558 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 529/1080] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:34 2022] POST /compute/v2.1/flavors => generated 506 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:34.065162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:34.065791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:34.072721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.073178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.074531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.075169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.111812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.112267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.112725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lazy-loading 'fault' on Instance uuid 211554fa-d881-43d0-9431-43e3f0eed006 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:34.117412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:34.175346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c692d1c95b4844812f6d3511268a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cf8ec8d4954e45857af05dc373a244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:34.184289 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ee3b383b-79aa-4881-b8c8-c5fa01729cef tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 200 len: 1314 microversion: 2.1 time: 0.123075 Jun 16 18:32:34.194897 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 530/1081] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:34 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 1314 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:34.202158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-efd53004-bb38-4071-bba6-b6bb95ec1a1d req-c7c1daf5-f4dd-40c8-963d-9487372ca591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898264b4-f96e-47eb-bf78-c7d1ee36a44d", "name": "network-vif-deleted", "tag": "c40d5082-5f99-494f-a31e-3fa04662e9ba"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:34.213955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-efd53004-bb38-4071-bba6-b6bb95ec1a1d req-c7c1daf5-f4dd-40c8-963d-9487372ca591 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.215075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-efd53004-bb38-4071-bba6-b6bb95ec1a1d req-c7c1daf5-f4dd-40c8-963d-9487372ca591 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.235857 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-efd53004-bb38-4071-bba6-b6bb95ec1a1d req-c7c1daf5-f4dd-40c8-963d-9487372ca591 service nova] Creating event network-vif-deleted:c40d5082-5f99-494f-a31e-3fa04662e9ba for instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d on n-h2-846209-2 Jun 16 18:32:34.258688 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-efd53004-bb38-4071-bba6-b6bb95ec1a1d req-c7c1daf5-f4dd-40c8-963d-9487372ca591 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048572 Jun 16 18:32:34.261532 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 531/1082] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:34.268595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:34.269478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:34.277839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.278422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.279303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.280301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.495507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Building network info cache for instance {{(pid=119206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:32:34.568354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:34.579838 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-edac112d-a40d-4f65-b6f0-c314a03ebee5 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1487 microversion: 2.1 time: 0.315562 Jun 16 18:32:34.585967 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 532/1083] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:34 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1487 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:34.586602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1eaf900e-b0ca-4230-bd00-5808140b14e1 req-ccc510a2-45b9-46e2-9ef6-a6686dc9be59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb575fd4-0970-400b-913f-721aafd46e61", "tag": "79471afd-118e-4f81-8fc5-5c6ef7b970c9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:34.599951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1eaf900e-b0ca-4230-bd00-5808140b14e1 req-ccc510a2-45b9-46e2-9ef6-a6686dc9be59 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.600375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1eaf900e-b0ca-4230-bd00-5808140b14e1 req-ccc510a2-45b9-46e2-9ef6-a6686dc9be59 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.624852 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1eaf900e-b0ca-4230-bd00-5808140b14e1 req-ccc510a2-45b9-46e2-9ef6-a6686dc9be59 service nova] Creating event network-changed:79471afd-118e-4f81-8fc5-5c6ef7b970c9 for instance fb575fd4-0970-400b-913f-721aafd46e61 on n-h1-846209-2 Jun 16 18:32:34.634049 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1eaf900e-b0ca-4230-bd00-5808140b14e1 req-ccc510a2-45b9-46e2-9ef6-a6686dc9be59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051257 Jun 16 18:32:34.635147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 533/1084] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:34.644632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:34.647548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:34.659187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.660173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.660996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.662404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.996033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:35.004876 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd17117d-cd0a-4efe-b083-8d5495fdea29 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1528 microversion: 2.1 time: 0.368411 Jun 16 18:32:35.012097 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 534/1085] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:34 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:35.041572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11a58342-4448-4595-a6bb-41e5276193df tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:35.043174 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:35.043174 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:35.122532 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-11a58342-4448-4595-a6bb-41e5276193df tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/0b9cef42-2730-488d-9c17-20e70ba2bd2c" status: 202 len: 0 microversion: 2.1 time: 0.108436 Jun 16 18:32:35.131934 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 535/1086] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:35 2022] DELETE /compute/v2.1/flavors/0b9cef42-2730-488d-9c17-20e70ba2bd2c => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:35.149102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:35.155519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:35.177756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.178749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.179837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.180502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.451794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Updating instance_info_cache with network_info: [{"id": "614ced4d-0258-4800-8fd5-e223c2331b5e", "address": "fa:16:3e:21:c8:da", "network": {"id": "4212a0cd-cfb7-48a1-8db8-d3f563e64c9d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-709469550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "295e1cc58e82459ab321439379b227ea", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap614ced4d-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:32:35.479626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Releasing lock "refresh_cache-5487e1c8-2792-405c-91ef-5c4b4c4acdc4" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:32:35.480923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3884328c-9226-4ff7-9787-bdf4fc6bcba5 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action" status: 202 len: 0 microversion: 2.1 time: 3.200212 Jun 16 18:32:35.482019 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 552/1087] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:32 2022] POST /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4/action => generated 0 bytes in 3202 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:32:35.562349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:35.572065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:35.573581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:35.574834 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b57c775-6c37-4d4a-b800-1fa7c2918190 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1543 microversion: 2.25 time: 0.440120 Jun 16 18:32:35.575654 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 536/1088] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:35 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1543 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:35.586482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:35.587109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:35.593584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.594075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.594859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.595299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.748091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:35.748610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:35.754974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.755687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.756668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.757105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.788115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:35.790046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:35.799549 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3ca1c007-77cc-43b1-89ad-aac7de2958a8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1528 microversion: 2.1 time: 0.223085 Jun 16 18:32:35.800448 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 537/1089] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:35 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1528 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:35.807179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:35.807853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:35.815664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.816115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.816965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.817413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.864998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:35.927852 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e45c76e2-0ded-4a29-b43f-c919c84df34e tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 204 len: 0 microversion: 2.1 time: 0.443033 Jun 16 18:32:35.930002 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 553/1090] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:35 2022] DELETE /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:35.938173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2d64cb0-cb74-4b0d-aad9-f838fad87741 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:35.964396 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2d64cb0-cb74-4b0d-aad9-f838fad87741 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032964 Jun 16 18:32:35.965065 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 554/1091] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:35.970412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:35.971199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 211554fa-d881-43d0-9431-43e3f0eed006] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:35.982746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.983566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.984598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:35.985164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.003009 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Instance 211554fa-d881-43d0-9431-43e3f0eed006 could not be found. Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 HTTP/1.1 Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:36.004833 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 211554fa-d881-43d0-9431-43e3f0eed006 could not be found. Jun 16 18:32:36.007159 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '211554fa-d881-43d0-9431-43e3f0eed006'} Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211554fa-d881-43d0-9431-43e3f0eed006 could not be found. Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:36.007957 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211554fa-d881-43d0-9431-43e3f0eed006 could not be found. Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211554fa-d881-43d0-9431-43e3f0eed006 could not be found. Jun 16 18:32:36.009246 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.010538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Instance 211554fa-d881-43d0-9431-43e3f0eed006 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:36.010538 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1cdc7c40-330e-4889-b2f2-600f24329361 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006" status: 404 len: 111 microversion: 2.1 time: 0.040323 Jun 16 18:32:36.010538 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 555/1092] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:35 2022] GET /compute/v2.1/servers/211554fa-d881-43d0-9431-43e3f0eed006 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:36.012174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-998cf309-e49c-4f40-8e7f-a68d11030b89 req-9a744bb8-69e3-4888-9399-f037dad700d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7453b4f4-c53d-4314-8b06-75ce854a45e6", "name": "network-vif-unplugged", "status": "completed", "tag": "32340453-7ece-4e56-9662-2db0d327f507"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:36.018625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:36.023428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-998cf309-e49c-4f40-8e7f-a68d11030b89 req-9a744bb8-69e3-4888-9399-f037dad700d3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.023870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-998cf309-e49c-4f40-8e7f-a68d11030b89 req-9a744bb8-69e3-4888-9399-f037dad700d3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.027201 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f0d806b0-9745-4d97-ad3f-0776e5a88934 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.225509 Jun 16 18:32:36.027788 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 538/1093] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:35 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:36.034223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.034970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.037220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-998cf309-e49c-4f40-8e7f-a68d11030b89 req-9a744bb8-69e3-4888-9399-f037dad700d3 service nova] Creating event network-vif-unplugged:32340453-7ece-4e56-9662-2db0d327f507 for instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 on n-h2-846209-2 Jun 16 18:32:36.041938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.042503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.042833 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-998cf309-e49c-4f40-8e7f-a68d11030b89 req-9a744bb8-69e3-4888-9399-f037dad700d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034272 Jun 16 18:32:36.043450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.043590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 556/1094] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:36.044051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.048795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4c788bbc-2d3e-4657-8d9f-48ac45966601 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '.version_select at 0x7f866efeab80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.051264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c788bbc-2d3e-4657-8d9f-48ac45966601 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.051811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c788bbc-2d3e-4657-8d9f-48ac45966601 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.059220 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] HTTP exception thrown: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Request method failure captured: Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d HTTP/1.1 Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3bh-5kEbVuY9bNpPQRtRnGxIKgd6sTCSqnqh2FWXZO59eoOPZRxhn8WaEk3vlZaNsBruz59xhLWkfNkFmn-RWO5GqbPADGKf0wdAMSCZz2HxdaEz_IQo5nfCGN7IXlcWUKgPB3mEXsyjPFSAVMsONa0MhXq00QVHW9kNhBl5hoh-jY Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:36.061161 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/295e1cc58e82459ab321439379b227ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_295e1cc58e82459ab321439379b227ea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 7eee236345ec40729015a74ba7f05a82 Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.063090 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '898264b4-f96e-47eb-bf78-c7d1ee36a44d'} Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:36.064019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.067380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.069455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Returning 404 to user: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:36.069455 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6b71d564-5ed3-481c-a3b0-3a71ab0e1772 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 404 len: 111 microversion: 2.1 time: 0.034848 Jun 16 18:32:36.069455 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 539/1095] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:36.070884 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4c788bbc-2d3e-4657-8d9f-48ac45966601 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3205 microversion: 2.25 time: 0.025428 Jun 16 18:32:36.071300 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 557/1096] 10.222.0.27 () {60 vars in 1183 bytes} [Thu Jun 16 18:32:36 2022] GET /compute/v2.1/os-migrations => generated 3205 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:36.072049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5fc7752-4e46-4e8e-9d98-e8e6b11b051a tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.072895 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:36.072895 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:36.078302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f1f5df7-f0f2-4b45-ab84-c8f263c8db74 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866ef524c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.082369 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-c5fc7752-4e46-4e8e-9d98-e8e6b11b051a tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] HTTP exception thrown: Flavor 61c99f29-2703-45f8-8ddc-b1a402ff3352 could not be found. Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5fc7752-4e46-4e8e-9d98-e8e6b11b051a tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Request method failure captured: Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/flavors/61c99f29-2703-45f8-8ddc-b1a402ff3352 HTTP/1.1 Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YuVAlDumQfoYmOr68Zzh-89Gi5JAfzNPDAZ5Wb1Xxy0eBjL1Vk1Euz01xJKsAeGS8b7bEzfHjjLo8SHighF7NsT-TXx0LQ-3fky0L_VCnWTc0LDOBqa1RW05H9cmFnfcHlACGsXUA6kUe23NdAf52ttZpoDQq-nI9fP7-bTHENPz8 Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2fa27497c68a47608861797aaf3efe6c Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MigrationsAdminTest-1132488612 Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:32:36.085105 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fa27497c68a47608861797aaf3efe6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fa27497c68a47608861797aaf3efe6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fa27497c68a47608861797aaf3efe6c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fa27497c68a47608861797aaf3efe6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MigrationsAdminTest-1132488612 Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2fa27497c68a47608861797aaf3efe6c Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MigrationsAdminTest-1132488612 Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MigrationsAdminTest-1132488612-project-admin Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 76023de61b274299a5e3b4815ab67990 Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MigrationsAdminTest-1132488612-project-admin Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: exception: Flavor 61c99f29-2703-45f8-8ddc-b1a402ff3352 could not be found. Jun 16 18:32:36.087159 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '61c99f29-2703-45f8-8ddc-b1a402ff3352'} Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi flavor.destroy() Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 61c99f29-2703-45f8-8ddc-b1a402ff3352 could not be found. Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.088705 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 61c99f29-2703-45f8-8ddc-b1a402ff3352 could not be found. Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 61c99f29-2703-45f8-8ddc-b1a402ff3352 could not be found. Jun 16 18:32:36.093160 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.094314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5fc7752-4e46-4e8e-9d98-e8e6b11b051a tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Returning 404 to user: Flavor 61c99f29-2703-45f8-8ddc-b1a402ff3352 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:36.094314 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5fc7752-4e46-4e8e-9d98-e8e6b11b051a tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/61c99f29-2703-45f8-8ddc-b1a402ff3352" status: 404 len: 109 microversion: 2.1 time: 0.020882 Jun 16 18:32:36.094314 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 540/1097] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/flavors/61c99f29-2703-45f8-8ddc-b1a402ff3352 => generated 109 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:36.094520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffddd6a2-00df-4de5-b20e-5eb9deb7e80d tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-746650961", "id": 807261322, "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:36.095883 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:36.095883 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:36.103447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:36.122096 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ffddd6a2-00df-4de5-b20e-5eb9deb7e80d tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.031117 Jun 16 18:32:36.128274 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 541/1098] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:36 2022] POST /compute/v2.1/flavors => generated 410 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3f1f5df7-f0f2-4b45-ab84-c8f263c8db74 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Image not found. Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f1f5df7-f0f2-4b45-ab84-c8f263c8db74 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d HTTP/1.1 Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:36.128477 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3467dc70-b170-4f45-9b29-990a2de8648d'} Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:36.130386 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3467dc70-b170-4f45-9b29-990a2de8648d to delete Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.131392 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3467dc70-b170-4f45-9b29-990a2de8648d could not be found. Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:36.132669 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:32:36.133899 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.134657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c7258b2-0ceb-4ca2-8745-79179dab326f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '.version_select at 0x7f866f3cf1f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.134743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f1f5df7-f0f2-4b45-ab84-c8f263c8db74 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:36.134743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3f1f5df7-f0f2-4b45-ab84-c8f263c8db74 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d" status: 404 len: 62 microversion: 2.1 time: 0.057343 Jun 16 18:32:36.134743 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 558/1099] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/images/3467dc70-b170-4f45-9b29-990a2de8648d => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:36.152473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.153217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 898264b4-f96e-47eb-bf78-c7d1ee36a44d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.160133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.160587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.162381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.163055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.164597 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-0c7258b2-0ceb-4ca2-8745-79179dab326f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Image not found. Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c7258b2-0ceb-4ca2-8745-79179dab326f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b HTTP/1.1 Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:36.166638 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a50dc87e-51a1-4846-93d0-8455d4c59d9b'} Jun 16 18:32:36.169492 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a50dc87e-51a1-4846-93d0-8455d4c59d9b to delete Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.173743 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a50dc87e-51a1-4846-93d0-8455d4c59d9b could not be found. Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:36.176453 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c7258b2-0ceb-4ca2-8745-79179dab326f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:36.183767 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c7258b2-0ceb-4ca2-8745-79179dab326f tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b" status: 404 len: 62 microversion: 2.1 time: 0.044294 Jun 16 18:32:36.185760 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 542/1100] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/images/a50dc87e-51a1-4846-93d0-8455d4c59d9b => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:36.185760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.185760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.185760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.192110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.192110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.192110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.195575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] HTTP exception thrown: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Request method failure captured: Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d HTTP/1.1 Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3bh-5kEbVuY9bNpPQRtRnGxIKgd6sTCSqnqh2FWXZO59eoOPZRxhn8WaEk3vlZaNsBruz59xhLWkfNkFmn-RWO5GqbPADGKf0wdAMSCZz2HxdaEz_IQo5nfCGN7IXlcWUKgPB3mEXsyjPFSAVMsONa0MhXq00QVHW9kNhBl5hoh-jY Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:36.196715 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/295e1cc58e82459ab321439379b227ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_295e1cc58e82459ab321439379b227ea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 7eee236345ec40729015a74ba7f05a82 Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.198718 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '898264b4-f96e-47eb-bf78-c7d1ee36a44d'} Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:36.199659 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. Jun 16 18:32:36.201202 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.202751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Returning 404 to user: Instance 898264b4-f96e-47eb-bf78-c7d1ee36a44d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:36.202751 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b25cd40d-697a-4502-bcd5-9debcb2a0a32 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d" status: 404 len: 111 microversion: 2.1 time: 0.063410 Jun 16 18:32:36.205148 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 559/1101] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:36 2022] GET /compute/v2.1/servers/898264b4-f96e-47eb-bf78-c7d1ee36a44d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:36.210487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8d23b95-96cd-4ebf-86b4-caebd14a91b6 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.219740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8d23b95-96cd-4ebf-86b4-caebd14a91b6 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/807261322" status: 200 len: 410 microversion: 2.1 time: 0.015060 Jun 16 18:32:36.220555 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 560/1102] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:32:36 2022] GET /compute/v2.1/flavors/807261322 => generated 410 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:36.228018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.228685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.236603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.237237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.238923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.239578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.295207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:36.386603 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Instance is already in deleting state, ignoring this request Jun 16 18:32:36.387699 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25a6434b-e991-40ec-ba2b-50e9ef8baa16 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 204 len: 0 microversion: 2.1 time: 0.166014 Jun 16 18:32:36.392258 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 561/1103] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:36.398633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.399485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.413000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.413866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.415626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.416414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.436259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4dec74f5-68be-47e2-acc5-8a6eec839883 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:36.447454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:36.454765 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1e3ee4f-4efb-4368-880f-754e63edbf19 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 2036 microversion: 2.25 time: 0.283522 Jun 16 18:32:36.455544 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 543/1104] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:36 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 2036 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:36.461465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.462241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.469431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.469886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.471083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.471348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.488522 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae HTTP/1.1 Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:36.490267 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:36.491982 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '646961f9-f779-4578-8ce7-30ec0e9cbcae'} Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:36.492808 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:36.494266 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:36.495767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:36.495767 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16b45d65-4c68-4452-957e-70c00833e7f9 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 404 len: 111 microversion: 2.1 time: 0.034819 Jun 16 18:32:36.495767 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 544/1105] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:36.499069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d62b4c31-70d8-4117-b1cf-54303a5e60e8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '.version_select at 0x7f866f25dee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.549235 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aaaa8e9d-07ca-41e6-8476-468ec0e9be53 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "DELETE /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 204 len: 0 microversion: 2.1 time: 0.155374 Jun 16 18:32:36.549820 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 562/1106] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:36.682930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b98dc838-864a-490f-b445-84c5a9138943 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.704973 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b98dc838-864a-490f-b445-84c5a9138943 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.153753 Jun 16 18:32:36.705580 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 563/1107] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:36 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:36.711138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1667173614", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:36.766427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:32:37.164773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:32:37.165199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:32:37.165673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:32:37.166120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:32:37.166532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:32:37.175926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.176374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.177926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.178371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.198069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:37.202999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Getting quotas for user 209d0e879aea45269c56a7c7d9869b23 and project 2978681eacda4da685a087c0b1025df3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:37.214986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:32:37.217436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:32:37.265898 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d0b1c35b-6d66-4412-bb3b-4b39e948452b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559214 Jun 16 18:32:37.271898 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 564/1108] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:32:37.271898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:37.272225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:37.278353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.278801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.279564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.279999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.555863 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d62b4c31-70d8-4117-b1cf-54303a5e60e8 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/2fb785f6-a5c9-4c61-bd7b-3c39ada07ae7" status: 202 len: 0 microversion: 2.1 time: 1.062426 Jun 16 18:32:37.556492 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 545/1109] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:32:36 2022] DELETE /compute/v2.1/os-floating-ips/2fb785f6-a5c9-4c61-bd7b-3c39ada07ae7 => generated 0 bytes in 1064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:37.559053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:37.563680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-744f32a6-3a4d-4273-a6d1-757c716a1735 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Action: 'create', calling method: .version_select at 0x7f867428d9d0>, body: {"keypair": {"name": "tempest-keypair-1246039555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFNIg1gIA5fJUaKgynl4U2pSRax99t/8DS72ccyW5uPQXOD1fK5vwoUadXHmhuFMJWdnlRpaqgp72FckI6cNTyjCCT4VXPUC519rmW+FOGh7Cv6gNzTYFVdbZkizOkTKg=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:37.578192 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9e564a70-e6c6-4e46-8729-312eb633280f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1493 microversion: 2.1 time: 0.309808 Jun 16 18:32:37.582830 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 565/1110] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:37 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1493 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:37.584079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-744f32a6-3a4d-4273-a6d1-757c716a1735 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:37.593225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:37.594341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: 646961f9-f779-4578-8ce7-30ec0e9cbcae] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:37.595654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-744f32a6-3a4d-4273-a6d1-757c716a1735 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for user 4060431577d14c5198872173d8375e26 and project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:37.608341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.609358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.613723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.616177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.650630 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-744f32a6-3a4d-4273-a6d1-757c716a1735 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.092888 Jun 16 18:32:37.651601 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 546/1111] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:32:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:32:37.652750 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae HTTP/1.1 Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:37.656069 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:37.657544 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '646961f9-f779-4578-8ce7-30ec0e9cbcae'} Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:37.658838 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. Jun 16 18:32:37.660342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:37.662294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Instance 646961f9-f779-4578-8ce7-30ec0e9cbcae could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:37.662294 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ea63f456-3590-4998-b58f-16b5aeb48e2a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae" status: 404 len: 111 microversion: 2.1 time: 0.073252 Jun 16 18:32:37.662294 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 566/1112] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:37 2022] GET /compute/v2.1/servers/646961f9-f779-4578-8ce7-30ec0e9cbcae => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:37.666238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c7395eea-3ecc-4a7e-ad92-5b380a5b17cf req-c3869024-da23-4531-ab15-4766858b8bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211554fa-d881-43d0-9431-43e3f0eed006", "name": "network-vif-deleted", "tag": "dcd96ea1-8e46-4212-8b07-f5167dcf8bf0"}, {"name": "network-changed", "server_uuid": "5487e1c8-2792-405c-91ef-5c4b4c4acdc4", "tag": "614ced4d-0258-4800-8fd5-e223c2331b5e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:37.673487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:37.674409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:37.678876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c7395eea-3ecc-4a7e-ad92-5b380a5b17cf req-c3869024-da23-4531-ab15-4766858b8bd6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.679328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c7395eea-3ecc-4a7e-ad92-5b380a5b17cf req-c3869024-da23-4531-ab15-4766858b8bd6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.682389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.682848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.683647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.684610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.698537 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c7395eea-3ecc-4a7e-ad92-5b380a5b17cf req-c3869024-da23-4531-ab15-4766858b8bd6 service nova] Creating event network-vif-deleted:dcd96ea1-8e46-4212-8b07-f5167dcf8bf0 for instance 211554fa-d881-43d0-9431-43e3f0eed006 on n-h2-846209-2 Jun 16 18:32:37.699418 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c7395eea-3ecc-4a7e-ad92-5b380a5b17cf req-c3869024-da23-4531-ab15-4766858b8bd6 service nova] Creating event network-changed:614ced4d-0258-4800-8fd5-e223c2331b5e for instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 on n-h1-846209-2 Jun 16 18:32:37.712077 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c7395eea-3ecc-4a7e-ad92-5b380a5b17cf req-c3869024-da23-4531-ab15-4766858b8bd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050136 Jun 16 18:32:37.714048 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 567/1113] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:37.719838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d69d236-f35d-4018-bb07-dc1f689c0d84 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:37.720662 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:37.720662 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:37.735382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:UPDATE=3,nova_api:DELETE=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:37.750763 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d69d236-f35d-4018-bb07-dc1f689c0d84 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/807261322" status: 202 len: 0 microversion: 2.1 time: 0.035132 Jun 16 18:32:37.751948 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 568/1114] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:32:37 2022] DELETE /compute/v2.1/flavors/807261322 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:37.759907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:37.761201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:37.776668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.779736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.781965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.782952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.550215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:38.561241 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ec279483-37fa-408e-bd99-4fb58308b348 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1666 microversion: 2.1 time: 0.907976 Jun 16 18:32:38.563600 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 547/1115] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:37 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1666 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:38.569234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.570555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:38.578625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.579345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.580413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.581660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.643180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:38.660159 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-64883f71-1314-4f64-a8e3-8256fe2d32e2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.906782 Jun 16 18:32:38.662350 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 569/1116] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:37 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:38.668627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.669968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:38.682813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.684148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.686303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.687271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.729361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:38.756920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:38.783535 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bdaeba39-3892-438e-b9ef-aa0055df0e97 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1283 microversion: 2.1 time: 0.218208 Jun 16 18:32:38.802011 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 548/1117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:38 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:38.815981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69f5743b-3f06-4d76-a071-698a5fceee3a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '.version_select at 0x7f866f22a1f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.863269 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69f5743b-3f06-4d76-a071-698a5fceee3a tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773310378" status: 202 len: 0 microversion: 2.1 time: 0.059750 Jun 16 18:32:38.868674 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 549/1118] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:32:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773310378 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:38.876390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cee1c4d4-e2d9-44f8-b2ee-30c9c7612d53 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.929743 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cee1c4d4-e2d9-44f8-b2ee-30c9c7612d53 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058898 Jun 16 18:32:38.931188 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 550/1119] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:38.947213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-794a03ac-abd9-4e00-8d82-47ca9040e186 req-95ba55e3-be57-466c-bb86-64676a4cbc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31", "name": "network-vif-plugged", "status": "completed", "tag": "c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:38.949969 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8e76d3a0-ab81-490b-89df-f4072134e924 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 204 len: 0 microversion: 2.1 time: 0.285352 Jun 16 18:32:38.952289 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 570/1120] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:38 2022] DELETE /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:38.962742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-794a03ac-abd9-4e00-8d82-47ca9040e186 req-95ba55e3-be57-466c-bb86-64676a4cbc7c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.963496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-794a03ac-abd9-4e00-8d82-47ca9040e186 req-95ba55e3-be57-466c-bb86-64676a4cbc7c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.964625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.968515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:38.978194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.978694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.980447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.981069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.993479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-794a03ac-abd9-4e00-8d82-47ca9040e186 req-95ba55e3-be57-466c-bb86-64676a4cbc7c service nova] Creating event network-vif-plugged:c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4 for instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 on n-h1-846209-2 Jun 16 18:32:38.999988 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-794a03ac-abd9-4e00-8d82-47ca9040e186 req-95ba55e3-be57-466c-bb86-64676a4cbc7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066295 Jun 16 18:32:39.001765 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 551/1121] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:39.012946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5d40c447-dd85-462f-b350-936e64f36325 req-045cfbed-b866-48b4-bff8-054171679aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb575fd4-0970-400b-913f-721aafd46e61", "name": "network-vif-unplugged", "status": "completed", "tag": "79471afd-118e-4f81-8fc5-5c6ef7b970c9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:39.024180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5d40c447-dd85-462f-b350-936e64f36325 req-045cfbed-b866-48b4-bff8-054171679aac service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.024735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5d40c447-dd85-462f-b350-936e64f36325 req-045cfbed-b866-48b4-bff8-054171679aac service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:39.040126 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5d40c447-dd85-462f-b350-936e64f36325 req-045cfbed-b866-48b4-bff8-054171679aac service nova] Creating event network-vif-unplugged:79471afd-118e-4f81-8fc5-5c6ef7b970c9 for instance fb575fd4-0970-400b-913f-721aafd46e61 on n-h1-846209-2 Jun 16 18:32:39.047777 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5d40c447-dd85-462f-b350-936e64f36325 req-045cfbed-b866-48b4-bff8-054171679aac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044101 Jun 16 18:32:39.048504 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 552/1122] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:39.055914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bc65aa0f-c6ac-4139-a9df-dd5a528c379c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-918461638", "id": 2047443891, "os-flavor-access:is_public": "False"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:39.057858 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:39.057858 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:39.077770 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bc65aa0f-c6ac-4139-a9df-dd5a528c379c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.027647 Jun 16 18:32:39.078393 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 553/1123] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:39 2022] POST /compute/v2.1/flavors => generated 429 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:39.086528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:39.094139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:39.105963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.107953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:39.109093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.109870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:39.533817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:39.548114 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb7a892d-d9d0-44e7-9525-5174499de2ab tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1493 microversion: 2.1 time: 0.593306 Jun 16 18:32:39.548778 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 571/1124] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:38 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1493 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:39.564902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97fbadcd-ac7a-4fdc-ae60-49e64b2ee295 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "2047443891"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:39.576035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-97fbadcd-ac7a-4fdc-ae60-49e64b2ee295 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] HTTP exception thrown: Flavor 2047443891 could not be found. Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97fbadcd-ac7a-4fdc-ae60-49e64b2ee295 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] Request method failure captured: Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 107 Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ctUHMhIx5N2z3X8YqFoi4AzVfL2tiJfq5gNJcvN-nbf8AB3gAbWqQ5W5x0TsudoQzT-J7iap0vhemyRqw-FW0A1nxiYvY0l_Y6N9cHJQaU7pDXtiYq50mL12VXdJ7uMHHk94YBgOhtDySbtcYyPcUe3_E65K8ddwaaAYQfWiFmm_I Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: abc20f5098124577a3e961c210dbc4d7 Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsAdminTestJSON-1500035307 Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:39.578363 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abc20f5098124577a3e961c210dbc4d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abc20f5098124577a3e961c210dbc4d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abc20f5098124577a3e961c210dbc4d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abc20f5098124577a3e961c210dbc4d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsAdminTestJSON-1500035307 Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: abc20f5098124577a3e961c210dbc4d7 Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1500035307 Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsAdminTestJSON-1500035307-project Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: cd7b3cda204f40b0ad871bcb1f6fb37e Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsAdminTestJSON-1500035307-project Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "test", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "2047443891"}} Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:39.580031 n-d-846209-2 devstack@n-api.service[119206]: exception: Flavor 2047443891 could not be found. Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '2047443891'}}} Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2047443891 could not be found. Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:39.581108 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2047443891 could not be found. Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:39.582646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2047443891 could not be found. Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97fbadcd-ac7a-4fdc-ae60-49e64b2ee295 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] Returning 400 to user: Flavor 2047443891 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97fbadcd-ac7a-4fdc-ae60-49e64b2ee295 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.020383 Jun 16 18:32:39.586481 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 572/1125] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:39 2022] POST /compute/v2.1/servers => generated 81 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:32:39.590038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:39.590762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:39.599046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.599949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:39.600731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.601170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:39.735984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:39.754634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3ef081e2-1d21-459b-99d7-9a4d0540a3c2 tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1525 microversion: 2.1 time: 0.674523 Jun 16 18:32:39.756301 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 554/1126] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:39 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1525 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:39.778722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c61677f6-e356-42d1-9df6-14be6028d4ef tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:39.779718 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:39.779718 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:39.801004 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c61677f6-e356-42d1-9df6-14be6028d4ef tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2047443891" status: 202 len: 0 microversion: 2.1 time: 0.028031 Jun 16 18:32:39.806310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 555/1127] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:32:39 2022] DELETE /compute/v2.1/flavors/2047443891 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:39.811580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:39.812716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:39.820820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.821934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:39.823944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.825394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.268840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:40.293542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-09f34195-d0c7-4fe4-b775-e598038acc75 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1666 microversion: 2.1 time: 0.707481 Jun 16 18:32:40.294162 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 573/1128] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:39 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1666 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:40.310102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:40.311869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:40.327738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:40.328569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.329615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:40.330442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.674256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:40.689001 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae0d4a96-aa00-4adb-a2d0-e8f20fc3c78f tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.881174 Jun 16 18:32:40.690080 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 556/1129] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:39 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:40.705581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-984f3949-06de-4b82-8dfa-b6321e748d7f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:40.741833 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-984f3949-06de-4b82-8dfa-b6321e748d7f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050489 Jun 16 18:32:40.742987 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 557/1130] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:40.772145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:40.773312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:40.809447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:40.811311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.814397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:40.815211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.939970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:40.941176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.941929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lazy-loading 'fault' on Instance uuid 7453b4f4-c53d-4314-8b06-75ce854a45e6 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:40.987869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:41.004421 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af7ac5d0-d544-476b-bd22-45eda4dc8b6f tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1313 microversion: 2.1 time: 0.708890 Jun 16 18:32:41.008373 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 574/1131] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:40 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1313 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:41.026990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7316153e-b446-4d31-aa27-f0bc0a229ff2 req-1c114e72-2097-42ee-bdab-c714afe963cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7453b4f4-c53d-4314-8b06-75ce854a45e6", "name": "network-vif-deleted", "tag": "32340453-7ece-4e56-9662-2db0d327f507"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:41.049329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7316153e-b446-4d31-aa27-f0bc0a229ff2 req-1c114e72-2097-42ee-bdab-c714afe963cb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.053186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7316153e-b446-4d31-aa27-f0bc0a229ff2 req-1c114e72-2097-42ee-bdab-c714afe963cb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.097963 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7316153e-b446-4d31-aa27-f0bc0a229ff2 req-1c114e72-2097-42ee-bdab-c714afe963cb service nova] Creating event network-vif-deleted:32340453-7ece-4e56-9662-2db0d327f507 for instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 on n-h2-846209-2 Jun 16 18:32:41.120079 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7316153e-b446-4d31-aa27-f0bc0a229ff2 req-1c114e72-2097-42ee-bdab-c714afe963cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109535 Jun 16 18:32:41.134129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 575/1132] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:41.144878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7388eef-4e67-435a-9d85-53b2f259b1f1 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2051161832", "id": 661639512, "os-flavor-access:is_public": "False"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:41.151242 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:41.151242 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:41.180211 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a7388eef-4e67-435a-9d85-53b2f259b1f1 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.042339 Jun 16 18:32:41.182895 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 576/1133] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:41 2022] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:41.188837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.189939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:41.198702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.199445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.200436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.201040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.327180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f458b13d494ef7bc8e7055be73fa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1723f1dfefc34199ba287d8693af1f45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:41.335601 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-768af145-49b7-4188-82ce-50e15fb46fec tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 200 len: 1384 microversion: 2.1 time: 0.575927 Jun 16 18:32:41.344344 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 558/1134] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:40 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 1384 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:41.376773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37b7117c-8d2a-4585-a87d-7e301a7fb26f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-314379690", "id": 2143223027, "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:41.381339 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:41.381339 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:41.415314 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37b7117c-8d2a-4585-a87d-7e301a7fb26f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.069659 Jun 16 18:32:41.418446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 559/1135] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:41 2022] POST /compute/v2.1/flavors => generated 413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:41.430949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.438025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:41.457076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.457830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.459574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.460183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.617889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:41.627994 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6d8752e4-e13a-4dc0-a328-1efed7738524 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1598 microversion: 2.1 time: 0.205675 Jun 16 18:32:41.638203 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 560/1136] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:41 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1598 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:41.638203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9241afcc-dec1-40bf-8864-7384bc933b4a tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.658765 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9241afcc-dec1-40bf-8864-7384bc933b4a tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.028533 Jun 16 18:32:41.659698 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 561/1137] 10.222.0.27 () {58 vars in 1168 bytes} [Thu Jun 16 18:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:41.666905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06cca560-1f8a-4af9-8916-d26b85c27339 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '.version_select at 0x7f866f26ab80>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.696442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-06cca560-1f8a-4af9-8916-d26b85c27339 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Image not found. Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06cca560-1f8a-4af9-8916-d26b85c27339 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/images/729ee2fd-ad98-460c-82ba-2979cd038645 HTTP/1.1 Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:41.699314 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '729ee2fd-ad98-460c-82ba-2979cd038645'} Jun 16 18:32:41.700886 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 729ee2fd-ad98-460c-82ba-2979cd038645 to delete Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:41.701961 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 729ee2fd-ad98-460c-82ba-2979cd038645 could not be found. Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:41.703381 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:32:41.704862 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.709016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06cca560-1f8a-4af9-8916-d26b85c27339 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:41.710166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-06cca560-1f8a-4af9-8916-d26b85c27339 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/images/729ee2fd-ad98-460c-82ba-2979cd038645" status: 404 len: 62 microversion: 2.1 time: 0.048246 Jun 16 18:32:41.711322 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 562/1138] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:41 2022] DELETE /compute/v2.1/images/729ee2fd-ad98-460c-82ba-2979cd038645 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:41.717629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5f99d8c-40a1-4013-9cde-488f8ef238ce tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.730535 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5f99d8c-40a1-4013-9cde-488f8ef238ce tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.017953 Jun 16 18:32:41.732173 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 563/1139] 10.222.0.27 () {58 vars in 1176 bytes} [Thu Jun 16 18:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:41.738584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.739723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:41.748013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.749227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.751170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.751792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.770266 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec HTTP/1.1 Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:41.772982 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:41.774578 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'bea640aa-c5ff-4c21-bbcf-b4cc4f343eec'} Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:41.775339 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:41.776572 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:41.777780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:41.785854 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a2352c8d-a2e0-4a4f-8887-0b14e273e2a0 tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 404 len: 111 microversion: 2.1 time: 0.042286 Jun 16 18:32:41.788028 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 564/1140] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:41 2022] DELETE /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:41.796782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.797788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:41.806857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.807697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.808779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.811087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.254865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eee236345ec40729015a74ba7f05a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295e1cc58e82459ab321439379b227ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:42.278875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:42.284865 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36133e11-3a37-44cd-82bc-92382134852a tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 200 len: 1525 microversion: 2.1 time: 1.098095 Jun 16 18:32:42.287058 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 577/1141] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:41 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 1525 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:42.301251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6e13e95-0375-48f4-a596-aa8e59120d7d tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:42.320436 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6e13e95-0375-48f4-a596-aa8e59120d7d tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.027237 Jun 16 18:32:42.326705 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 578/1142] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Jun 16 18:32:42 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:42.333980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:42.334772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] [instance: bea640aa-c5ff-4c21-bbcf-b4cc4f343eec] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:42.359250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.359613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.360662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.361108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.400201 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] HTTP exception thrown: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Request method failure captured: Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec HTTP/1.1 Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ajcjjEH-YNHMwNy7GXc2CNL1wcAFBynWwivLG4bz59nHhPUeO1_9HkeimxDtj1n4QGii7JsFxqNFKj70aA2jvd-TcbC8jt_9miF7BhcvyH2poyrrF_8FDbK4sLWF6R2Au-Pr6OHFUwMNuaflj8BDSrv90HKnwNOpW0nwinRpuJIA0 Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:42.404333 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14cf8ec8d4954e45857af05dc373a244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14cf8ec8d4954e45857af05dc373a244"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 14cf8ec8d4954e45857af05dc373a244 Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-905438517 Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 25c692d1c95b4844812f6d3511268a45 Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-905438517-project Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:42.405853 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'bea640aa-c5ff-4c21-bbcf-b4cc4f343eec'} Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:42.406637 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. Jun 16 18:32:42.407876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.413136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] Returning 404 to user: Instance bea640aa-c5ff-4c21-bbcf-b4cc4f343eec could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:42.415452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b01918a8-f188-44d8-bf40-a4b8ebe30b3b tempest-ImagesOneServerNegativeTestJSON-905438517 tempest-ImagesOneServerNegativeTestJSON-905438517-project] 10.222.0.27 "GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec" status: 404 len: 111 microversion: 2.1 time: 0.092911 Jun 16 18:32:42.417307 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 579/1143] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:42 2022] GET /compute/v2.1/servers/bea640aa-c5ff-4c21-bbcf-b4cc4f343eec => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:42.423049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:42.423967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:42.440217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.440855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.441694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.442215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.713217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:42.730952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-acbec372-af2b-43db-ae45-798ec9bff2ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1503 microversion: 2.1 time: 0.941511 Jun 16 18:32:42.733955 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 565/1144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:41 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1503 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:42.736865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-03b414d6-0c7d-4b05-9016-b415b06e9229 req-402098ee-27b6-46d1-8c13-55864324dd0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5487e1c8-2792-405c-91ef-5c4b4c4acdc4", "name": "network-vif-deleted", "tag": "614ced4d-0258-4800-8fd5-e223c2331b5e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:42.750708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-03b414d6-0c7d-4b05-9016-b415b06e9229 req-402098ee-27b6-46d1-8c13-55864324dd0a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.755417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-03b414d6-0c7d-4b05-9016-b415b06e9229 req-402098ee-27b6-46d1-8c13-55864324dd0a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.780332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:42.785313 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-03b414d6-0c7d-4b05-9016-b415b06e9229 req-402098ee-27b6-46d1-8c13-55864324dd0a service nova] Creating event network-vif-deleted:614ced4d-0258-4800-8fd5-e223c2331b5e for instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 on n-h1-846209-2 Jun 16 18:32:42.794458 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-03b414d6-0c7d-4b05-9016-b415b06e9229 req-402098ee-27b6-46d1-8c13-55864324dd0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060760 Jun 16 18:32:42.797282 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 566/1145] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:42.805689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-430ccace-e2d4-4521-9985-f6d07d4966f2 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:42.846098 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-430ccace-e2d4-4521-9985-f6d07d4966f2 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.046657 Jun 16 18:32:42.847965 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 567/1146] 10.222.0.27 () {58 vars in 1168 bytes} [Thu Jun 16 18:32:42 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:42.860408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:42.862017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 7453b4f4-c53d-4314-8b06-75ce854a45e6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:42.876923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.877793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.879671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.880955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.906262 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 could not be found. Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 HTTP/1.1 Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:42.908917 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 could not be found. Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '7453b4f4-c53d-4314-8b06-75ce854a45e6'} Jun 16 18:32:42.910745 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 could not be found. Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:42.912550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 could not be found. Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 could not be found. Jun 16 18:32:42.914085 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:42.916562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Instance 7453b4f4-c53d-4314-8b06-75ce854a45e6 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:42.917869 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72107edf-49bf-4676-94d4-1912642f739d tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6" status: 404 len: 111 microversion: 2.1 time: 0.067860 Jun 16 18:32:42.922428 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 568/1147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:42 2022] GET /compute/v2.1/servers/7453b4f4-c53d-4314-8b06-75ce854a45e6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:42.929099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:42.929788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:42.937699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.938394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.939711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.940161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.990478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.990937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.991457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lazy-loading 'fault' on Instance uuid 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:43.038162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:43.055723 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c52bc60b-fb99-4ac5-9b63-5043af0b33b6 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1313 microversion: 2.1 time: 0.636279 Jun 16 18:32:43.063047 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 580/1148] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:42 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:43.075580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-254a79e5-3d6b-45a2-8501-1dc8f0b033bc tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.101567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9433cd550c0549f38981948ac49c6614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d74d6e1b49b6869e4f224a260de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:43.122630 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-45e286fe-6866-41e3-a162-817027e2cd28 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 200 len: 1315 microversion: 2.1 time: 0.190635 Jun 16 18:32:43.132830 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 569/1149] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:42 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:43.133031 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-254a79e5-3d6b-45a2-8501-1dc8f0b033bc tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.058599 Jun 16 18:32:43.133031 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 581/1150] 10.222.0.27 () {58 vars in 1168 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:43.133211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f57e37f5-0093-4f19-ae6f-76833a88917f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866f2ac4c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.148383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6a5f324-90f7-4493-a018-3adbdcd1438f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.170837 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f57e37f5-0093-4f19-ae6f-76833a88917f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Image not found. Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f57e37f5-0093-4f19-ae6f-76833a88917f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 HTTP/1.1 Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:43.173130 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: exception: Image not found. Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5cd0b367-aeb2-4875-9f48-c81cc520c659'} Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.174617 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5cd0b367-aeb2-4875-9f48-c81cc520c659 to delete Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.175570 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5cd0b367-aeb2-4875-9f48-c81cc520c659 could not be found. Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.178479 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f57e37f5-0093-4f19-ae6f-76833a88917f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Image not found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f57e37f5-0093-4f19-ae6f-76833a88917f tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659" status: 404 len: 62 microversion: 2.1 time: 0.049759 Jun 16 18:32:43.181185 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 570/1151] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/images/5cd0b367-aeb2-4875-9f48-c81cc520c659 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:43.184172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.184172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.200801 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6a5f324-90f7-4493-a018-3adbdcd1438f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.062723 Jun 16 18:32:43.201782 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 582/1152] 10.222.0.27 () {58 vars in 1174 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:43.204388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.204848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.205660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.206132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.220738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7be4a013-1d11-488d-8c6d-93b876037a8c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.247778 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa HTTP/1.1 Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:43.249868 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '05292bf7-3482-4a42-9f81-5759b17357aa'} Jun 16 18:32:43.251893 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.252963 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.254922 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.257159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.258227 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7df3cba5-57ff-47f2-9d4f-c15344c8d7a0 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 404 len: 111 microversion: 2.1 time: 0.078324 Jun 16 18:32:43.259509 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 571/1153] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:43.271196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4dd8fa92-923e-48a6-9530-8db36a242eaa req-65629cd2-70e6-4c2e-b065-88db8d10b9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50284ce9-a3f0-41ac-9fd9-8dec7d534e49", "name": "network-vif-deleted", "tag": "2708092f-949e-4075-8dd4-86a0edb36482"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:43.277012 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7be4a013-1d11-488d-8c6d-93b876037a8c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.059821 Jun 16 18:32:43.278256 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 583/1154] 10.222.0.27 () {58 vars in 1172 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:43.286682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.287475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 05292bf7-3482-4a42-9f81-5759b17357aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.291292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4dd8fa92-923e-48a6-9530-8db36a242eaa req-65629cd2-70e6-4c2e-b065-88db8d10b9be service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.294737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4dd8fa92-923e-48a6-9530-8db36a242eaa req-65629cd2-70e6-4c2e-b065-88db8d10b9be service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.295069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.296612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.297530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.298549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.316644 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4dd8fa92-923e-48a6-9530-8db36a242eaa req-65629cd2-70e6-4c2e-b065-88db8d10b9be service nova] Creating event network-vif-deleted:2708092f-949e-4075-8dd4-86a0edb36482 for instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 on n-h1-846209-2 Jun 16 18:32:43.318829 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa HTTP/1.1 Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:43.320795 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '05292bf7-3482-4a42-9f81-5759b17357aa'} Jun 16 18:32:43.322202 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.323177 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. Jun 16 18:32:43.328429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.331233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Instance 05292bf7-3482-4a42-9f81-5759b17357aa could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.331233 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-899c6b2d-7d0d-4e58-bac7-a1ae343096f4 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa" status: 404 len: 111 microversion: 2.1 time: 0.044095 Jun 16 18:32:43.331233 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 584/1155] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/servers/05292bf7-3482-4a42-9f81-5759b17357aa => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:43.332603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-382d70fa-f429-483b-83b8-f328dc05d290 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.339705 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4dd8fa92-923e-48a6-9530-8db36a242eaa req-65629cd2-70e6-4c2e-b065-88db8d10b9be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078551 Jun 16 18:32:43.340322 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 572/1156] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:43.350767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.352069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] [instance: 5487e1c8-2792-405c-91ef-5c4b4c4acdc4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.372936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.373123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.374168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.374760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.385131 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-382d70fa-f429-483b-83b8-f328dc05d290 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.056957 Jun 16 18:32:43.393169 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 585/1157] 10.222.0.27 () {58 vars in 1168 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:43.401361 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] HTTP exception thrown: Instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 could not be found. Jun 16 18:32:43.403889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48a72131-8c80-495c-be03-c7db2672e56b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866eea8700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Request method failure captured: Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 HTTP/1.1 Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3bh-5kEbVuY9bNpPQRtRnGxIKgd6sTCSqnqh2FWXZO59eoOPZRxhn8WaEk3vlZaNsBruz59xhLWkfNkFmn-RWO5GqbPADGKf0wdAMSCZz2HxdaEz_IQo5nfCGN7IXlcWUKgPB3mEXsyjPFSAVMsONa0MhXq00QVHW9kNhBl5hoh-jY Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:43.411035 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/295e1cc58e82459ab321439379b227ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_295e1cc58e82459ab321439379b227ea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/295e1cc58e82459ab321439379b227ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 295e1cc58e82459ab321439379b227ea Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-209428022 Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 7eee236345ec40729015a74ba7f05a82 Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-209428022-project Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 could not be found. Jun 16 18:32:43.413092 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5487e1c8-2792-405c-91ef-5c4b4c4acdc4'} Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 could not be found. Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.413879 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 could not be found. Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 could not be found. Jun 16 18:32:43.415333 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.417514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] Returning 404 to user: Instance 5487e1c8-2792-405c-91ef-5c4b4c4acdc4 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.418567 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e891f8f8-9660-4227-a483-c1666f75dc2f tempest-FloatingIPsAssociationTestJSON-209428022 tempest-FloatingIPsAssociationTestJSON-209428022-project] 10.222.0.27 "GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4" status: 404 len: 111 microversion: 2.1 time: 0.077114 Jun 16 18:32:43.420277 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 573/1158] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/servers/5487e1c8-2792-405c-91ef-5c4b4c4acdc4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:43.437535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-48927376-e756-41d4-aa85-56ef7053cfaa tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.445190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-48a72131-8c80-495c-be03-c7db2672e56b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Image not found. Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48a72131-8c80-495c-be03-c7db2672e56b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea HTTP/1.1 Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:43.447259 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '8e53cbc0-3293-48dd-bac8-c0e5d0a948ea'} Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.449169 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8e53cbc0-3293-48dd-bac8-c0e5d0a948ea to delete Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.450443 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8e53cbc0-3293-48dd-bac8-c0e5d0a948ea could not be found. Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.451892 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:32:43.453519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.458523 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:43.458523 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:43.460298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48a72131-8c80-495c-be03-c7db2672e56b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.461521 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48a72131-8c80-495c-be03-c7db2672e56b tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea" status: 404 len: 62 microversion: 2.1 time: 0.067051 Jun 16 18:32:43.466699 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 586/1159] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/images/8e53cbc0-3293-48dd-bac8-c0e5d0a948ea => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:43.477805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.480055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.495439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.496478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.497614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.498310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.505180 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-48927376-e756-41d4-aa85-56ef7053cfaa tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2143223027" status: 202 len: 0 microversion: 2.1 time: 0.082914 Jun 16 18:32:43.506233 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 574/1160] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/flavors/2143223027 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:43.514662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15d8084f-99ff-48fb-b43c-68b1a261cc5c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.541821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e HTTP/1.1 Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:43.543525 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a485eb4a-1ede-45ad-86b0-2b290fcef08e'} Jun 16 18:32:43.545157 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.546716 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.548407 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.563056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.564249 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-047c62aa-2b0f-449e-94c4-da55240efdc8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 404 len: 111 microversion: 2.1 time: 0.096082 Jun 16 18:32:43.568007 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 587/1161] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:43.573324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.573991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: a485eb4a-1ede-45ad-86b0-2b290fcef08e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.576555 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-15d8084f-99ff-48fb-b43c-68b1a261cc5c tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065976 Jun 16 18:32:43.579566 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 575/1162] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:43.595359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.595891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.596821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.597505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.599720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-507677bf-b08c-4c1e-923c-0a56c1f3aba6 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.621728 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e HTTP/1.1 Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:43.625368 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a485eb4a-1ede-45ad-86b0-2b290fcef08e'} Jun 16 18:32:43.626898 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.628613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. Jun 16 18:32:43.630515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.631828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Instance a485eb4a-1ede-45ad-86b0-2b290fcef08e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.631828 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0b323624-9f97-4945-99c1-c74c81cbbc12 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e" status: 404 len: 111 microversion: 2.1 time: 0.056321 Jun 16 18:32:43.631828 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 588/1163] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/servers/a485eb4a-1ede-45ad-86b0-2b290fcef08e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:43.636283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae957364-529b-4a19-810f-a80d08b8ad78 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '.version_select at 0x7f866ef52b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.651597 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-507677bf-b08c-4c1e-923c-0a56c1f3aba6 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/661639512" status: 202 len: 0 microversion: 2.1 time: 0.060610 Jun 16 18:32:43.652908 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 576/1164] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/flavors/661639512 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:43.663189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40b95760-d18d-4efa-a529-93d4b1e57934 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.680506 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ae957364-529b-4a19-810f-a80d08b8ad78 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Image not found. Jun 16 18:32:43.680978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae957364-529b-4a19-810f-a80d08b8ad78 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e HTTP/1.1 Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:43.687994 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '859347af-9f94-484a-ba5e-ff6ebfd0594e'} Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.689840 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 859347af-9f94-484a-ba5e-ff6ebfd0594e to delete Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.691214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 859347af-9f94-484a-ba5e-ff6ebfd0594e could not be found. Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.692496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae957364-529b-4a19-810f-a80d08b8ad78 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae957364-529b-4a19-810f-a80d08b8ad78 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e" status: 404 len: 62 microversion: 2.1 time: 0.059120 Jun 16 18:32:43.698205 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 589/1165] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/images/859347af-9f94-484a-ba5e-ff6ebfd0594e => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:32:43.706178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.707468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.709389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-40b95760-d18d-4efa-a529-93d4b1e57934 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050650 Jun 16 18:32:43.717970 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 577/1166] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:43.727384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.727865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.728657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.729188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.738735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af827f92-8b33-4cab-b83d-1185327a436a tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1654446193", "id": 274537869, "os-flavor-access:is_public": "False"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:43.740769 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:43.740769 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:43.756506 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 HTTP/1.1 Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:43.773741 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '24e2a156-987a-4ecc-a83e-d5c84b21d291'} Jun 16 18:32:43.775475 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.776329 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.784224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.785595 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af827f92-8b33-4cab-b83d-1185327a436a tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.048639 Jun 16 18:32:43.785595 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 578/1167] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:43 2022] POST /compute/v2.1/flavors => generated 412 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:43.789633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.791004 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d7bb3d78-6f3b-416b-bd41-6826352271f8 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 404 len: 111 microversion: 2.1 time: 0.095098 Jun 16 18:32:43.792210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 590/1168] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:43 2022] DELETE /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:43.796348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.800233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.809272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d92b2e49-cc11-4ef8-ab96-d8bf14586309 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.835170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.835874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.836828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.838132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.847652 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d92b2e49-cc11-4ef8-ab96-d8bf14586309 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054144 Jun 16 18:32:43.860207 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 591/1169] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:43.891700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.893595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] [instance: 24e2a156-987a-4ecc-a83e-d5c84b21d291] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.908540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.909182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.910066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.910701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.939179 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] HTTP exception thrown: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Request method failure captured: Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 HTTP/1.1 Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3YWZB-6nsRv0QXR_kpA49Fvdxl3vCauZ_D556gnrjVjGeZgp71594H_Jg5d5a9MvZx2jlwVbjVT6p3rJc6S2zT3vwZ-Nc5sG5RAQvzVVmh2DWme6fzva0tXC8TxKLSzx8QmmdADaE8yWMBvoL5YuNB47I3PuUN7mZcOhFKIIqFrttI Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:32:43.943304 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1723f1dfefc34199ba287d8693af1f45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1723f1dfefc34199ba287d8693af1f45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1723f1dfefc34199ba287d8693af1f45 Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesTestJSON-593474663 Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 33f458b13d494ef7bc8e7055be73fa42 Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesTestJSON-593474663-project Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '24e2a156-987a-4ecc-a83e-d5c84b21d291'} Jun 16 18:32:43.945078 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:43.946295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. Jun 16 18:32:43.948746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:32:43.950827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] Returning 404 to user: Instance 24e2a156-987a-4ecc-a83e-d5c84b21d291 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:43.952598 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-725b55fa-7944-41ca-b652-686a7c689752 tempest-ImagesTestJSON-593474663 tempest-ImagesTestJSON-593474663-project] 10.222.0.27 "GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291" status: 404 len: 111 microversion: 2.1 time: 0.082609 Jun 16 18:32:43.962767 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 592/1170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/servers/24e2a156-987a-4ecc-a83e-d5c84b21d291 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:43.968417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77c1d9b8-2606-4b63-8f1a-bc3e4bf041b3 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.008581 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77c1d9b8-2606-4b63-8f1a-bc3e4bf041b3 tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044157 Jun 16 18:32:44.009220 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 593/1171] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:44.029721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-581fd1dd-0bec-4837-a343-c8f1cc9827cc tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.030986 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:44.030986 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:44.065080 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-581fd1dd-0bec-4837-a343-c8f1cc9827cc tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/274537869" status: 202 len: 0 microversion: 2.1 time: 0.040144 Jun 16 18:32:44.070914 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 594/1172] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:32:44 2022] DELETE /compute/v2.1/flavors/274537869 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:44.092719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e63dd7da-77a4-43a4-90f1-50e8d8fabe87 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.147417 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e63dd7da-77a4-43a4-90f1-50e8d8fabe87 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073466 Jun 16 18:32:44.158449 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 595/1173] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:44.163571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.164386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:44.176573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.177647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.178584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.181333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.585549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:44.600170 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dff913ae-b272-43fa-b0f7-ed5c67e95273 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1478 microversion: 2.1 time: 0.820578 Jun 16 18:32:44.601450 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 579/1174] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1478 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:44.609042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.610261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] [instance: 50284ce9-a3f0-41ac-9fd9-8dec7d534e49] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:44.621463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.622391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.623464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.624107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.642536 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] HTTP exception thrown: Instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 could not be found. Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Request method failure captured: Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 HTTP/1.1 Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3b41-KHEPsoh1Gy2H-D74E6hZFdGfEiAeQKA8iidgE56-l1b6teBd3fj-kMAy7VUdqljKJo-C3NKbE6s1f5IXCqG7t5H2n4jGX2pqwIwzFiSfCqEFpPfU5GiaevOnCa6yidhkbzCD6Mm7eIrtnH2uAaf8kPHWZSuByT-bWNPXYJ9tY Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 5f56d74d6e1b49b6869e4f224a260de0 Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestFqdnHostnames-722683237 Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:32:44.645036 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f56d74d6e1b49b6869e4f224a260de0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f56d74d6e1b49b6869e4f224a260de0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f56d74d6e1b49b6869e4f224a260de0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f56d74d6e1b49b6869e4f224a260de0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestFqdnHostnames-722683237 Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 5f56d74d6e1b49b6869e4f224a260de0 Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-722683237 Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestFqdnHostnames-722683237-project Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9433cd550c0549f38981948ac49c6614 Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestFqdnHostnames-722683237-project Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 could not be found. Jun 16 18:32:44.647151 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '50284ce9-a3f0-41ac-9fd9-8dec7d534e49'} Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 could not be found. Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:44.647979 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 could not be found. Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 could not be found. Jun 16 18:32:44.649265 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:32:44.652317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Returning 404 to user: Instance 50284ce9-a3f0-41ac-9fd9-8dec7d534e49 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:44.657723 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8b704106-87e6-423f-83cd-79612dd2dbe7 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49" status: 404 len: 111 microversion: 2.1 time: 0.054407 Jun 16 18:32:44.658641 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 580/1175] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:44 2022] GET /compute/v2.1/servers/50284ce9-a3f0-41ac-9fd9-8dec7d534e49 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:44.663999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4a49985-e702-430c-8c73-3ccee85324b8 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1039198299", "id": 1164256095, "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:44.666975 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:44.666975 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:32:44.686025 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4a49985-e702-430c-8c73-3ccee85324b8 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026381 Jun 16 18:32:44.686697 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 581/1176] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:44.696914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-713b5d6e-dd80-4cf6-ae68-9130b1cc6493 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '.version_select at 0x7f866f1d7c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.699371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-713b5d6e-dd80-4cf6-ae68-9130b1cc6493 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.699827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-713b5d6e-dd80-4cf6-ae68-9130b1cc6493 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.711435 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-713b5d6e-dd80-4cf6-ae68-9130b1cc6493 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2728 microversion: 2.1 time: 0.018577 Jun 16 18:32:44.712227 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 582/1177] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:32:44 2022] GET /compute/v2.1/os-migrations => generated 2728 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:44.724375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72824fa6-422b-4378-9ab5-1881ca17b565 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] Calling method '.version_select at 0x7f866f26aee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.726451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:44.743463 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-459f054d-1146-45cf-a625-2660a1b8c1f5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1313 microversion: 2.1 time: 0.583400 Jun 16 18:32:44.745224 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 596/1178] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:44 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:44.749416 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72824fa6-422b-4378-9ab5-1881ca17b565 tempest-ServersTestFqdnHostnames-722683237 tempest-ServersTestFqdnHostnames-722683237-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-563714311" status: 202 len: 0 microversion: 2.1 time: 0.028889 Jun 16 18:32:44.753485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 583/1179] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-563714311 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:44.761898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a81ec32e-bfea-4097-b4eb-ae061b0e1a2c tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.768646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5592ef1-842d-4f2b-be67-4f592a54efeb tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.769297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5592ef1-842d-4f2b-be67-4f592a54efeb tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:44.776655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5592ef1-842d-4f2b-be67-4f592a54efeb tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.777399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5592ef1-842d-4f2b-be67-4f592a54efeb tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.778215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5592ef1-842d-4f2b-be67-4f592a54efeb tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.778663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5592ef1-842d-4f2b-be67-4f592a54efeb tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.804408 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a81ec32e-bfea-4097-b4eb-ae061b0e1a2c tempest-FlavorsAdminTestJSON-1500035307 tempest-FlavorsAdminTestJSON-1500035307-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.057036 Jun 16 18:32:44.805704 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 597/1180] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:44 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:44.828068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d9d0b13b-d4d4-4c33-9797-60d984335770 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.830763 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:44.830763 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:44.866735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d9d0b13b-d4d4-4c33-9797-60d984335770 tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1164256095" status: 202 len: 0 microversion: 2.1 time: 0.050080 Jun 16 18:32:44.868343 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 598/1181] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:32:44 2022] DELETE /compute/v2.1/flavors/1164256095 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:44.891190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c1c08254-80f4-4c49-b4bf-252de43f101b req-a00af041-6271-4754-9464-21cd65073b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:44.900665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c1c08254-80f4-4c49-b4bf-252de43f101b req-a00af041-6271-4754-9464-21cd65073b56 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:44.901123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c1c08254-80f4-4c49-b4bf-252de43f101b req-a00af041-6271-4754-9464-21cd65073b56 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.915554 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c1c08254-80f4-4c49-b4bf-252de43f101b req-a00af041-6271-4754-9464-21cd65073b56 service nova] Creating event network-changed:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h2-846209-2 Jun 16 18:32:44.923002 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c1c08254-80f4-4c49-b4bf-252de43f101b req-a00af041-6271-4754-9464-21cd65073b56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052735 Jun 16 18:32:44.924191 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 599/1182] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:44.931273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-766f771f-b977-4f16-a050-6a767e0b930f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:44.954283 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-766f771f-b977-4f16-a050-6a767e0b930f tempest-FlavorsAdminTestJSON-1558114165 tempest-FlavorsAdminTestJSON-1558114165-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027762 Jun 16 18:32:44.966847 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 600/1183] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:32:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:44.995493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1453267575", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "71375809-7321-4c5f-9d11-1e2aadbe705f"}], "security_groups": [{"name": "tempest-securitygroup--2128087077"}], "key_name": "tempest-keypair-1246039555", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:45.278710 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5592ef1-842d-4f2b-be67-4f592a54efeb tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1629 microversion: 2.1 time: 0.524255 Jun 16 18:32:45.280193 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 584/1184] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:44 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1629 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:45.293655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] validate_networks() for [('71375809-7321-4c5f-9d11-1e2aadbe705f', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:32:45.303885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ce33d325-e7ae-43f8-ab89-4eb4b32f6a4c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Action: 'create', calling method: .version_select at 0x7f866f25da60>, body: {"keypair": {"name": "tempest-keypair-209082973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyUNIJeuR5G1INEjhea4sdEA+1PLW32l8HvL8YO5adyHP3guFXg/WVw/HdGJCw2cl7T7BP/xIQIf8dsImrQAJBQj5mOX0R/zZXxQkXKmV4InLQawc4pHNx/Jg9fPyvtpw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:45.321795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ce33d325-e7ae-43f8-ab89-4eb4b32f6a4c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for project 3d84e38d180849e98a2222aede57177d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:45.328593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ce33d325-e7ae-43f8-ab89-4eb4b32f6a4c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for user 6483600a33ef407d9071cd24d84f6ee6 and project 3d84e38d180849e98a2222aede57177d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:45.380973 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ce33d325-e7ae-43f8-ab89-4eb4b32f6a4c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080826 Jun 16 18:32:45.381831 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 585/1185] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:32:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:32:45.765090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:45.766567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:45.773870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:45.774494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:45.775373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:45.776045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:46.297051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:46.310621 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f87bb96-55ae-4199-b00a-344805baa533 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1313 microversion: 2.1 time: 0.552019 Jun 16 18:32:46.321960 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 586/1186] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:45 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:47.186403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:47.210072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:47.232020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:32:47.232646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:32:47.233417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:32:47.233944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:32:47.235199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:32:47.254380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:47.256840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:47.258680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:47.261975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:47.297484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:47.303539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for user 4060431577d14c5198872173d8375e26 and project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:47.330069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:32:47.331561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:47.334635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:32:47.336027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:47.382255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:47.385168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:47.386131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:47.388539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:47.434486 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-829f13db-ca8a-4d21-82c6-b50336352ee0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.452018 Jun 16 18:32:47.441039 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 601/1187] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:32:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:32:47.460472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c9237f4-643b-4b91-ba13-7b7e28a0e458 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:47.462766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c9237f4-643b-4b91-ba13-7b7e28a0e458 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:47.498954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:47.855338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c9237f4-643b-4b91-ba13-7b7e28a0e458 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:47.869373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c9237f4-643b-4b91-ba13-7b7e28a0e458 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:47.871112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c9237f4-643b-4b91-ba13-7b7e28a0e458 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:47.878533 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c9237f4-643b-4b91-ba13-7b7e28a0e458 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1286 microversion: 2.25 time: 0.426024 Jun 16 18:32:47.880149 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 602/1188] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:47 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1286 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:48.217071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:48.227448 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ae3b982-f8a2-4e24-bae0-04328fc399cc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1313 microversion: 2.1 time: 0.902158 Jun 16 18:32:48.233252 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 587/1189] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:47 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:48.907656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:48.908635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:48.923237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:48.924066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:48.925464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:48.926167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:49.136436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:49.150338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:49.158600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:49.162842 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a48ad96a-7e7b-4d2d-8790-68bb29043abc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1338 microversion: 2.25 time: 0.268500 Jun 16 18:32:49.188719 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 603/1190] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:48 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:49.251059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:49.252391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:49.269229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:49.270245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:49.271053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:49.271494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:49.299056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-152c36fd-6a65-4a3f-8f51-5d1643ad3278 req-e06f3fb3-8425-490f-97e9-5deb0c4edfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "name": "network-vif-plugged", "status": "completed", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:49.325971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-152c36fd-6a65-4a3f-8f51-5d1643ad3278 req-e06f3fb3-8425-490f-97e9-5deb0c4edfb9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:49.328086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-152c36fd-6a65-4a3f-8f51-5d1643ad3278 req-e06f3fb3-8425-490f-97e9-5deb0c4edfb9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:49.367558 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-152c36fd-6a65-4a3f-8f51-5d1643ad3278 req-e06f3fb3-8425-490f-97e9-5deb0c4edfb9 service nova] Creating event network-vif-plugged:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h2-846209-2 Jun 16 18:32:49.403836 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-152c36fd-6a65-4a3f-8f51-5d1643ad3278 req-e06f3fb3-8425-490f-97e9-5deb0c4edfb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105833 Jun 16 18:32:49.404397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 604/1191] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:32:49.937001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:49.955668 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8f2ca8de-9f44-4289-b1f0-a4ef1e7902e8 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1313 microversion: 2.1 time: 0.703706 Jun 16 18:32:49.958159 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 588/1192] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:49 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1313 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:50.187436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:50.188923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:50.215548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:50.218929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:50.222241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:50.227014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:50.667587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:50.680756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:50.682516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:50.686217 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1813000-b387-4abd-8c7f-1008f0a4a865 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1344 microversion: 2.25 time: 0.503987 Jun 16 18:32:50.689174 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 605/1193] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:50 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1344 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:50.982202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:50.983012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:51.002669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:51.005567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:51.009661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:51.012836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:51.708146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:51.709070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:51.717468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:51.724496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:51.725746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:51.736950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:52.016058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:52.028632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:52.031260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:52.032862 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1190b676-0332-4fc4-a198-2bca825a0555 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1344 microversion: 2.25 time: 0.328929 Jun 16 18:32:52.035180 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 606/1194] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:51 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1344 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:52.212924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:52.221509 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-866760ae-5c50-454b-a436-40635f9ebbd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1463 microversion: 2.1 time: 1.243949 Jun 16 18:32:52.228967 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 589/1195] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:50 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1463 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:52.235311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1594177582", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "652e1c69-530a-4824-b271-fd75e40c3e31"}], "security_groups": [{"name": "tempest-securitygroup--236566235"}], "key_name": "tempest-keypair-209082973", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:52.287582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2730b0f4-cb83-41f0-beb5-d5e3e88ce865 tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1562519626", "id": 249731116, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:52.289430 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:52.289430 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:52.315037 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2730b0f4-cb83-41f0-beb5-d5e3e88ce865 tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.278412 Jun 16 18:32:52.316460 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 607/1196] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:32:52 2022] POST /compute/v2.1/flavors => generated 465 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:32:52.322421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc373206-4225-476d-8a12-0c511de0dad6 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:52.323771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc373206-4225-476d-8a12-0c511de0dad6 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:52.335159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc373206-4225-476d-8a12-0c511de0dad6 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:52.335802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc373206-4225-476d-8a12-0c511de0dad6 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:52.336944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc373206-4225-476d-8a12-0c511de0dad6 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:52.337749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc373206-4225-476d-8a12-0c511de0dad6 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:52.882269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] validate_networks() for [('652e1c69-530a-4824-b271-fd75e40c3e31', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:32:53.095176 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc373206-4225-476d-8a12-0c511de0dad6 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1614 microversion: 2.1 time: 0.776630 Jun 16 18:32:53.109466 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 608/1197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:52 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1614 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:53.268466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-feaf6a34-fd1a-48ac-a41c-42d0ed97bd79 tempest-FlavorsV261TestJSON-1801873185 tempest-FlavorsV261TestJSON-1801873185-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:53.281663 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-feaf6a34-fd1a-48ac-a41c-42d0ed97bd79 tempest-FlavorsV261TestJSON-1801873185 tempest-FlavorsV261TestJSON-1801873185-project] 10.222.0.27 "GET /compute/v2.1/flavors/249731116" status: 200 len: 465 microversion: 2.61 time: 0.170589 Jun 16 18:32:53.282908 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 609/1198] 10.222.0.27 () {60 vars in 1195 bytes} [Thu Jun 16 18:32:53 2022] GET /compute/v2.1/flavors/249731116 => generated 465 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:32:53.296830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:53.298601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:53.313395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:53.314229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:53.316232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:53.317548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:53.944533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:53.959680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:53.964549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:53.966918 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92d0f9fe-c71b-457d-9bb0-ca48b2670600 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.682602 Jun 16 18:32:53.968157 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 610/1199] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:53 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:53.993369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:53.994193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:54.012976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:54.014048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:54.016056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:54.017347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:54.061074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '76023de61b274299a5e3b4815ab67990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa27497c68a47608861797aaf3efe6c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:54.062126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] flavor_id is None. Assuming migration. {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 16 18:32:54.062689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 18:32:54.242081 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9595e4d-7624-49c9-9154-28b98f5150fe tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5/action" status: 202 len: 0 microversion: 2.1 time: 0.272127 Jun 16 18:32:54.243704 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 611/1200] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:53 2022] POST /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:54.251500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e32760df-a8e6-4914-8d59-4081dc275374 tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] Action: 'update', calling method: .version_select at 0x7f8675c68f70>, body: {"flavor": {"description": "new"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:54.267096 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:54.267096 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:54.317361 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e32760df-a8e6-4914-8d59-4081dc275374 tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/249731116" status: 200 len: 466 microversion: 2.61 time: 0.071650 Jun 16 18:32:54.318633 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 612/1201] 10.222.0.27 () {62 vars in 1215 bytes} [Thu Jun 16 18:32:54 2022] PUT /compute/v2.1/flavors/249731116 => generated 466 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:32:54.323580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:54.324426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:54.333256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:54.334049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:54.335112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:54.335732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:54.931059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:54.943180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-770cab6c-bb13-4140-ae79-2c2b6fcb2f47 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1472 microversion: 2.1 time: 0.622226 Jun 16 18:32:54.944562 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 613/1202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:54 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1472 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:54.968285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bbe2c9f8-c961-4595-ac75-f9981bec55a6 tempest-FlavorsV261TestJSON-1801873185 tempest-FlavorsV261TestJSON-1801873185-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:55.016479 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bbe2c9f8-c961-4595-ac75-f9981bec55a6 tempest-FlavorsV261TestJSON-1801873185 tempest-FlavorsV261TestJSON-1801873185-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.070246 Jun 16 18:32:55.029508 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 614/1203] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:32:54 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:55.036940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:55.037295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:55.049411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:55.050105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:55.051021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:55.052562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:55.338130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:55.647486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:32:55.648047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:32:55.648802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:32:55.649470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:32:55.650164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:32:55.668669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:55.682180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:55.683507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:55.684236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:55.731682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:55.745894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for user 6483600a33ef407d9071cd24d84f6ee6 and project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:55.789062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:32:55.792532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:32:55.809582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:55.822651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:55.824164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:55.825308 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd7fe4c9-10bf-48a2-b054-4b5425e62acb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.794078 Jun 16 18:32:55.829352 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 615/1204] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:55 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:55.836931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bd35c50a-71d1-4495-bfa8-10a2a9329ad5 tempest-FlavorsV261TestJSON-1801873185 tempest-FlavorsV261TestJSON-1801873185-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:55.886239 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bd35c50a-71d1-4495-bfa8-10a2a9329ad5 tempest-FlavorsV261TestJSON-1801873185 tempest-FlavorsV261TestJSON-1801873185-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.055648 Jun 16 18:32:55.887258 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 616/1205] 10.222.0.27 () {60 vars in 1165 bytes} [Thu Jun 16 18:32:55 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:55.901667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8cb4f1ab-7f08-4d60-aaf6-3a727351450d tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:55.903139 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:32:55.903139 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:32:55.944416 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9320e7fd-362e-4d50-b8dc-62a2d86a5e33 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.713868 Jun 16 18:32:55.945457 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8cb4f1ab-7f08-4d60-aaf6-3a727351450d tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/249731116" status: 202 len: 0 microversion: 2.61 time: 0.047535 Jun 16 18:32:55.946496 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 617/1206] 10.222.0.27 () {60 vars in 1198 bytes} [Thu Jun 16 18:32:55 2022] DELETE /compute/v2.1/flavors/249731116 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:55.952903 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 590/1207] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 3721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:32:55.954783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-617b215b-7db3-4837-b5c6-ac6260080fd5 tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:55.963581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f472cf6-2deb-4e27-b927-cb652f437015 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:55.964237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f472cf6-2deb-4e27-b927-cb652f437015 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:56.006607 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-617b215b-7db3-4837-b5c6-ac6260080fd5 tempest-FlavorsV261TestJSON-338814235 tempest-FlavorsV261TestJSON-338814235-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.046578 Jun 16 18:32:56.015930 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 618/1208] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:32:55 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:56.037330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:56.038407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:56.055641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:56.072794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:56.073650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:56.074146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:56.195733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f472cf6-2deb-4e27-b927-cb652f437015 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:56.207949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f472cf6-2deb-4e27-b927-cb652f437015 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1234 microversion: 2.1 time: 0.253541 Jun 16 18:32:56.208438 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 591/1209] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:55 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1234 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:56.563297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:56.589141 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cdc9e3ad-8b8d-42d1-ba5e-4a21e09cfb27 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1472 microversion: 2.1 time: 0.571411 Jun 16 18:32:56.589736 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 619/1210] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:56 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1472 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:56.845331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:56.846190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:56.889161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:56.891253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:56.897179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:56.905287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.035954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-31b5847c-cc9f-42a6-9149-be2cdacdc6cc req-d967b7c9-899f-4b1d-932f-44f456967e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:57.057714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-31b5847c-cc9f-42a6-9149-be2cdacdc6cc req-d967b7c9-899f-4b1d-932f-44f456967e11 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:57.067864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-31b5847c-cc9f-42a6-9149-be2cdacdc6cc req-d967b7c9-899f-4b1d-932f-44f456967e11 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.111963 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-31b5847c-cc9f-42a6-9149-be2cdacdc6cc req-d967b7c9-899f-4b1d-932f-44f456967e11 service nova] Creating event network-changed:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h1-846209-2 Jun 16 18:32:57.139715 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-31b5847c-cc9f-42a6-9149-be2cdacdc6cc req-d967b7c9-899f-4b1d-932f-44f456967e11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101394 Jun 16 18:32:57.140571 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 620/1211] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:32:57.227091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:57.231604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:57.264407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:57.272073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.277023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:57.278694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.360339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:57.361632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:57.625379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:57.634418 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-911c575c-972f-4632-acb4-61d0946f806c tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1238 microversion: 2.1 time: 0.412937 Jun 16 18:32:57.638868 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 621/1212] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:57 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1238 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:57.715694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:57.729509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:57.734264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:57.741287 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cdd42fb9-49cf-451e-ac13-4569dbdbc3cb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.898654 Jun 16 18:32:57.742369 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 592/1213] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:56 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:57.756647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:57.757702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:57.782132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:57.782614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.783405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:57.786916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.870060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:58.033786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1065728487", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:58.156756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:32:58.665071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:58.673456 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03f647eb-8c29-48b5-a0f5-9437fef322e7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1472 microversion: 2.1 time: 0.927949 Jun 16 18:32:58.685418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 593/1214] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:57 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1472 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:58.685418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:58.685418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:58.691595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:58.692262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:58.693370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:58.693820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:58.964001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:58.972205 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-23972e85-7ced-42d3-88a0-98a1fdad7d94 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1292 microversion: 2.1 time: 0.296738 Jun 16 18:32:58.973348 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 594/1215] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:58 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:58.982268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:58.983424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:58.990578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:58.991776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:58.992638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:58.993324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.270640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:32:59.272494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:32:59.282706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:32:59.287484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:32:59.289036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:32:59.320627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.321467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.322859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.323771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.358472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Getting quotas for project 8c8f0f4fccf345a0993a233c0f5db0dc. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:59.376244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Getting quotas for user 286b7d5de8b54d4693a8465ea2665a2a and project 8c8f0f4fccf345a0993a233c0f5db0dc. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:59.415888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:59.425299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:32:59.428513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:32:59.477376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:59.490807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:59.503040 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f88eb93-3b66-41bf-89bd-0c71aee937e0 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.525513 Jun 16 18:32:59.504512 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 595/1216] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:58 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:59.535969 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ddb30cca-1989-44aa-94b3-8b7f978475cf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.895011 Jun 16 18:32:59.536632 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 622/1217] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:32:59.548989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-caa855b9-2b18-4487-b15b-6336a63ecff0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:59.550875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-caa855b9-2b18-4487-b15b-6336a63ecff0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:59.767490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-caa855b9-2b18-4487-b15b-6336a63ecff0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:59.777954 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-caa855b9-2b18-4487-b15b-6336a63ecff0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1216 microversion: 2.1 time: 0.233907 Jun 16 18:32:59.802920 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 596/1218] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:59 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:59.991565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:59.992502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:00.001502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.002628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.004186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.006896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.230138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:00.247165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7ea0483c-b357-433d-8e72-23f02f183f8e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1292 microversion: 2.1 time: 0.259691 Jun 16 18:33:00.250248 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 597/1219] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:59 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1292 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:00.527644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:00.528957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:00.563539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.565516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.569240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.570349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.755962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:00.757245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:00.776127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.777195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.778251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.780463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.331343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.344093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.358367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.364587 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6d07f4e1-07aa-4f0f-9f77-1d392fad5bac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.842533 Jun 16 18:33:01.366501 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 598/1220] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:00 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:01.378493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:01.382042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:01.399771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.401333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.402898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.407692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.476680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.490667 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a16dddf-bad4-47dc-b393-8d2e36ee5c53 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 1.798091 Jun 16 18:33:01.500593 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 623/1221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:59 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:01.507855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:01.508654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:01.530995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.531533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.532383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.532850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.987682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.994001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:02.007618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9769758-d6b4-40ef-9e5c-76138d7aced8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1276 microversion: 2.1 time: 0.638366 Jun 16 18:33:02.008753 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 599/1222] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:01 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1276 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:02.266725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:02.281506 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8590a0ef-63d4-4349-95e3-d48ee4013108 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.783404 Jun 16 18:33:02.285462 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 624/1223] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:01 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:02.386671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:02.387350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:02.401203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.401688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:02.402579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.407089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:02.508869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:02.509501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:02.529801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.530336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:02.531295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.532291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.154850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.174154 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-67f515ae-5311-498d-9047-791a6ad53f00 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.666834 Jun 16 18:33:03.178972 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 625/1224] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:02 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:03.187587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:03.203069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:03.240346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:03.245359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.246609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:03.248652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.260429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.275836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.280322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.282557 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-24efc658-a28a-4473-8e8a-7551eda307d2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.901594 Jun 16 18:33:03.285512 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 600/1225] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:02 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:03.307265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:03.308244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:03.327760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:03.330275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.333989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:03.337334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.390269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.425178 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24ffd687-722a-45ca-89ad-723d7a112e79 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1274 microversion: 2.1 time: 0.243464 Jun 16 18:33:03.427772 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 626/1226] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:03 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:03.714996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.751697 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dc21f589-b0cf-4b36-bb14-db8d87877639 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.443021 Jun 16 18:33:03.762366 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 601/1227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:03 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:04.210342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:04.212148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:04.229143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.231614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.234110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.235388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.306365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:04.307080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:04.331087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.331731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.333167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.334410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.563474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:04.576367 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15fa3da3-e3bb-4f8e-9fa8-649d8cdbcaf0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.380453 Jun 16 18:33:04.587336 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 627/1228] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:04 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:04.590402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:04.591483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:04.621623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.622591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.623780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.624925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.733616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:04.750571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:04.755310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:04.757532 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50b079c0-721c-44ff-aeec-37ef6eeb4f2b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.457671 Jun 16 18:33:04.763825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:04.775771 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 602/1229] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:04 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:04.781721 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f18c6533-12b4-4ce0-a564-11fe0b6d5497 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1274 microversion: 2.1 time: 0.201277 Jun 16 18:33:04.793386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:04.793386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:04.794596 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 628/1230] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:04 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:04.809015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.809735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.825732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.830622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.084360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f540e6de-f244-4076-9b2b-4d45f3b3ed1f tempest-InstanceUsageAuditLogTestJSON-622486449 tempest-InstanceUsageAuditLogTestJSON-622486449-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.086188 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:33:05.086188 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:33:05.161469 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f540e6de-f244-4076-9b2b-4d45f3b3ed1f tempest-InstanceUsageAuditLogTestJSON-622486449 tempest-InstanceUsageAuditLogTestJSON-622486449-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16 18:33:04" status: 200 len: 318 microversion: 2.1 time: 0.365452 Jun 16 18:33:05.162383 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 629/1231] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:33:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16%2018%3A33%3A04 => generated 318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:05.167364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e28a53e5-383b-4cd8-a5ad-7a07b6698239 req-5b62ffb7-d11e-47b9-956c-1bc91ff34b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:05.188468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e28a53e5-383b-4cd8-a5ad-7a07b6698239 req-5b62ffb7-d11e-47b9-956c-1bc91ff34b0d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.192903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e28a53e5-383b-4cd8-a5ad-7a07b6698239 req-5b62ffb7-d11e-47b9-956c-1bc91ff34b0d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.225429 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e28a53e5-383b-4cd8-a5ad-7a07b6698239 req-5b62ffb7-d11e-47b9-956c-1bc91ff34b0d service nova] Creating event network-changed:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h2-846209-2 Jun 16 18:33:05.230672 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e28a53e5-383b-4cd8-a5ad-7a07b6698239 req-5b62ffb7-d11e-47b9-956c-1bc91ff34b0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066682 Jun 16 18:33:05.231586 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 630/1232] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:05.236901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da050bdd-a0ad-4568-ba8e-97bf496ad784 tempest-InstanceUsageAuditLogTestJSON-622486449 tempest-InstanceUsageAuditLogTestJSON-622486449-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.237768 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:33:05.237768 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:33:05.267885 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da050bdd-a0ad-4568-ba8e-97bf496ad784 tempest-InstanceUsageAuditLogTestJSON-622486449 tempest-InstanceUsageAuditLogTestJSON-622486449-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034808 Jun 16 18:33:05.273288 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 631/1233] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Jun 16 18:33:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:05.539196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:05.563697 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f0cf8f73-a022-47c1-8458-a3c5d95e4208 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.785154 Jun 16 18:33:05.564340 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 603/1234] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:04 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:05.595435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.596353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:05.604192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.604698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.605817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.606283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.782582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.783777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:05.798849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:05.806202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.807086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.808569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.811993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.922693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:05.935647 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-75bf990c-6e65-4a2c-8a92-3520e2fd64fc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.344051 Jun 16 18:33:05.946648 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 632/1235] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:05 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:05.946648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.951637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:05.963738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.964351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.965252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.967804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:06.371142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:06.416376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:06.431488 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d7c9faa6-5674-4312-9d0f-a46b4089cd05 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.492842 Jun 16 18:33:06.437278 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 633/1236] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:05 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:06.438379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:06.446737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:06.448826 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a6a03c5-21cf-4c33-bf79-e594ae417e74 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.671602 Jun 16 18:33:06.450340 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 604/1237] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:05 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:06.461387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1390f5a0-4d04-48fe-a115-e85bbdbb76c7 req-9fff2cad-401a-416f-a997-9fd48ee1bc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "name": "network-vif-plugged", "status": "completed", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:06.491212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1390f5a0-4d04-48fe-a115-e85bbdbb76c7 req-9fff2cad-401a-416f-a997-9fd48ee1bc91 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:06.491652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1390f5a0-4d04-48fe-a115-e85bbdbb76c7 req-9fff2cad-401a-416f-a997-9fd48ee1bc91 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:06.512502 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1390f5a0-4d04-48fe-a115-e85bbdbb76c7 req-9fff2cad-401a-416f-a997-9fd48ee1bc91 service nova] Creating event network-vif-plugged:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h1-846209-2 Jun 16 18:33:06.525375 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1390f5a0-4d04-48fe-a115-e85bbdbb76c7 req-9fff2cad-401a-416f-a997-9fd48ee1bc91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084476 Jun 16 18:33:06.528965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 634/1238] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:06.586567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:06.587487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:06.622265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:06.625360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:06.626952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:06.630685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:06.955143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:06.955866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:06.974668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:06.976068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:06.980856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:06.991802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:06.996393 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0723ed85-b660-424b-a034-a053c66db1f1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.417307 Jun 16 18:33:06.997345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:07.011907 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 605/1239] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:06 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:07.222326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:07.234650 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8a0211e-dc86-4926-9495-b71ab6f9b1ce tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.283860 Jun 16 18:33:07.250777 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 635/1240] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:06 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:07.458633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:07.459255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:07.468097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:07.468705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:07.479304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:07.480569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:07.481026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:07.482570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:07.482570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:07.487222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:07.488879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:07.490147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:07.814411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:07.845200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:07.847129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:07.850084 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81155921-fabf-4c69-84b1-f656c988598b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1412 microversion: 2.25 time: 0.386074 Jun 16 18:33:07.853149 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 636/1241] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:07 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1412 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:07.876212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:07.894047 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8462950f-90dd-404b-8687-81ef3fc0d194 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.440040 Jun 16 18:33:07.895936 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 606/1242] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:07 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:08.023401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:08.024018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:08.035196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.035196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.036471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.036739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.259514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:08.260856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:08.267982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.268881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.270343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.270981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.384696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:08.409240 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0f3a2575-0463-4b1a-8d80-a3ba2be71159 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.388860 Jun 16 18:33:08.415566 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 637/1243] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:08 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:08.682341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:08.695210 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16450157-7469-4f66-ac19-f4c08de20f1d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.441319 Jun 16 18:33:08.701726 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 607/1244] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:08 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:08.869173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:08.869790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:08.892862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.894642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.897370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.898055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.913525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:08.914190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:08.923917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.924374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.925153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.926260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.287344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.305533 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b6f425a9-e2ff-4bd1-8811-2c9da1d1ce7f tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.394572 Jun 16 18:33:09.308729 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 608/1245] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:08 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:09.338549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:09.435743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:09.439053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:09.466921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.467384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.469210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.470187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.659801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.678058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.679652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.680859 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0b136351-625e-444d-9c12-dbacfff5c0d5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1608 microversion: 2.25 time: 0.815588 Jun 16 18:33:09.681792 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 638/1246] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:08 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1608 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:09.699948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71cb1a48-2edc-4fc7-93fe-4c2a23dae1a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:09.700508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-71cb1a48-2edc-4fc7-93fe-4c2a23dae1a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:09.709873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71cb1a48-2edc-4fc7-93fe-4c2a23dae1a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.710373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71cb1a48-2edc-4fc7-93fe-4c2a23dae1a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.711585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71cb1a48-2edc-4fc7-93fe-4c2a23dae1a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.712491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71cb1a48-2edc-4fc7-93fe-4c2a23dae1a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.773018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:10.250476 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71cb1a48-2edc-4fc7-93fe-4c2a23dae1a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.552975 Jun 16 18:33:10.251811 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 639/1247] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:33:09 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-interface => generated 285 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:33:10.265503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:10.267412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:10.291875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:10.299336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.303263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:10.304353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.305222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:10.330520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:10.340259 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-358a7466-4418-4615-b425-0f45e4db5415 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.916322 Jun 16 18:33:10.347003 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 609/1248] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:09 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:10.357254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:10.359755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:10.365497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:10.382868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.383649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:10.384784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.387811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:11.006058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:11.023873 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a834e45c-96f0-4d20-b267-35e0db265b3a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.674730 Jun 16 18:33:11.024884 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 610/1249] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:10 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:11.092602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:11.129976 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-559a8d45-fcff-4194-a7db-b00f991d82a5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.875842 Jun 16 18:33:11.130706 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 640/1250] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:10 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:11.367188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:11.368436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:11.371426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e00abbc3-fe3f-49d5-924d-8b6459a5e461 req-d7547485-b7a1-43b9-b4a5-c3fbbaa89639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef6f1caa-d4d3-4731-b888-93a450c7360b", "tag": "118ce63a-acf9-43c2-bf5f-646a6494fb44"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:11.383494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:11.384237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:11.385224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:11.385863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:11.406494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e00abbc3-fe3f-49d5-924d-8b6459a5e461 req-d7547485-b7a1-43b9-b4a5-c3fbbaa89639 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:11.406869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e00abbc3-fe3f-49d5-924d-8b6459a5e461 req-d7547485-b7a1-43b9-b4a5-c3fbbaa89639 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:11.433517 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e00abbc3-fe3f-49d5-924d-8b6459a5e461 req-d7547485-b7a1-43b9-b4a5-c3fbbaa89639 service nova] Creating event network-changed:118ce63a-acf9-43c2-bf5f-646a6494fb44 for instance ef6f1caa-d4d3-4731-b888-93a450c7360b on n-h2-846209-2 Jun 16 18:33:11.454300 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e00abbc3-fe3f-49d5-924d-8b6459a5e461 req-d7547485-b7a1-43b9-b4a5-c3fbbaa89639 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089089 Jun 16 18:33:11.461997 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 641/1251] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:12.042582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:12.045543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:12.052393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:12.081764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:12.083190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:12.099612 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ee7cfc4c-e499-4237-ad0a-6edec267b40e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.716871 Jun 16 18:33:12.108774 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 611/1252] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:11 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:12.109423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:12.111036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:12.152723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:12.153637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:12.194060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:12.199349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:12.207645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:12.209099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:12.895489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:12.915389 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3f44b48f-09fb-408e-8ebe-ec9b6010c3bf tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.877982 Jun 16 18:33:12.916317 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 642/1253] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:12 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:12.930480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:12.941439 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5fc6548c-f536-4f04-a6c3-94e9527a4356 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.794639 Jun 16 18:33:12.944541 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 612/1254] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:12 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:13.121295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:13.122145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:13.138508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.138962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.140125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.140418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.151371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:13.446530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8168b008-637e-4c94-874b-46e66370acfc req-14a5b973-cb70-4151-9361-c19e6769dc58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:13.480248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8168b008-637e-4c94-874b-46e66370acfc req-14a5b973-cb70-4151-9361-c19e6769dc58 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.480902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8168b008-637e-4c94-874b-46e66370acfc req-14a5b973-cb70-4151-9361-c19e6769dc58 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.522195 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8168b008-637e-4c94-874b-46e66370acfc req-14a5b973-cb70-4151-9361-c19e6769dc58 service nova] Creating event network-changed:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h1-846209-2 Jun 16 18:33:13.539915 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8168b008-637e-4c94-874b-46e66370acfc req-14a5b973-cb70-4151-9361-c19e6769dc58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102355 Jun 16 18:33:13.545734 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 613/1255] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:13.704807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:13.717702 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48d0bb98-0bc9-40c3-a2e7-c7b9115289f0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.600170 Jun 16 18:33:13.719352 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 643/1256] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:13 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:13.933443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:13.934290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:13.949253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.950596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.951496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.951946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.962634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:13.963584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:13.982826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.983295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.984107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.984559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:14.982292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:14.998647 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19edd934-3627-48b0-a246-d4c5d005925c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 1.069340 Jun 16 18:33:14.999506 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 614/1257] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:13 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:15.031390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:15.040835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-952ab7d2-1033-4e30-8f64-4720ec1fdb15 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 1.082866 Jun 16 18:33:15.046861 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 644/1258] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:13 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:15.067889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:15.083927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:15.098938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:15.103090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:15.109697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:15.110403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:15.225799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-446309792", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:15.266458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=14 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:15.352821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:15.920036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:15.932743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2695025-9993-4056-a07b-078381d371ef tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.882133 Jun 16 18:33:15.938556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 645/1259] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:15 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:15.944559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4df538ba-9c12-432b-b4d1-31121794e8c5 req-de395c10-8f0b-4456-a763-b937405e4fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "name": "network-vif-plugged", "status": "completed", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:15.978863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4df538ba-9c12-432b-b4d1-31121794e8c5 req-de395c10-8f0b-4456-a763-b937405e4fca service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:15.979662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4df538ba-9c12-432b-b4d1-31121794e8c5 req-de395c10-8f0b-4456-a763-b937405e4fca service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.002236 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4df538ba-9c12-432b-b4d1-31121794e8c5 req-de395c10-8f0b-4456-a763-b937405e4fca service nova] Creating event network-vif-plugged:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h2-846209-2 Jun 16 18:33:16.017460 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4df538ba-9c12-432b-b4d1-31121794e8c5 req-de395c10-8f0b-4456-a763-b937405e4fca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077211 Jun 16 18:33:16.018817 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 646/1260] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:16.026323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:16.039530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:16.057027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.059846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.060941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.063247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.169666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:16.171676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:16.172588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:16.173234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:16.173871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:16.201232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.203478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.205227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.208249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.294052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Getting quotas for project 79372073be7047c1a4b57c6a7c9921e3. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:16.323061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Getting quotas for user 3951b78564ed40e09eba285f35e4db6b and project 79372073be7047c1a4b57c6a7c9921e3. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:16.361673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:16.370379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:16.495970 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-54e37247-04ab-4ad6-941c-b9211b48e3a1 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493947 Jun 16 18:33:16.496636 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 615/1261] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:33:16.498455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:16.520415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:16.521188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:16.523401 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36857da4-66fb-4b95-8e3b-fca65d0ed479 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.503062 Jun 16 18:33:16.526247 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 647/1262] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:16 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:16.534485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.535522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.536324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.536766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.559079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f285db5c-a901-40eb-a750-e79304e04717 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:16.560709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f285db5c-a901-40eb-a750-e79304e04717 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:16.657114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f285db5c-a901-40eb-a750-e79304e04717 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:16.672317 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f285db5c-a901-40eb-a750-e79304e04717 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1218 microversion: 2.1 time: 0.143355 Jun 16 18:33:16.673759 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 648/1263] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:16 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:16.912811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:16.929296 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a59d01e8-c73d-4b00-b3b7-23805da93c86 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1477 microversion: 2.1 time: 0.422149 Jun 16 18:33:16.932310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 616/1264] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:16 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1477 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:16.958951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:16.960263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:16.993669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.995111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.997231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.999838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:17.296717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-630766964", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6f1e60f2-34cd-4516-b0e8-416dd034a849"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:17.334088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:17.351555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51c02e5a-a235-4fed-8295-727de445b34b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1359 microversion: 2.1 time: 0.397673 Jun 16 18:33:17.364525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 649/1265] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:16 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1359 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:17.408423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] validate_networks() for [('6f1e60f2-34cd-4516-b0e8-416dd034a849', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:17.539897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:17.540898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:17.561174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:17.561931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:17.562927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:17.563545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.053595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:18.073511 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd31d040-8dee-4acb-a33c-7ad86bddcba0 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.537516 Jun 16 18:33:18.077100 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 650/1266] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:17 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:18.093051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:18.093681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:18.124062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.124516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.125296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.125735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.594629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:18.632711 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ebd1dcb-6233-468c-81fa-afbe1315c4ff tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1270 microversion: 2.1 time: 0.547647 Jun 16 18:33:18.635488 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 651/1267] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:18 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1270 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:18.666906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:18.667459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:18.667805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:18.668219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:18.668641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:18.676324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:18.680395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:18.696705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.697215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.698195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.698651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.716310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.718715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.733350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.735229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.752318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Getting quotas for project 03e5c869e0fc4b16b621b3115222065a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:18.779133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Getting quotas for user 6e8e89541e92470e915701bf2ead618c and project 03e5c869e0fc4b16b621b3115222065a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:18.802317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:18.806714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:18.923231 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfed3b93-5eba-4e04-9f64-18cd5cc7d670 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738676 Jun 16 18:33:18.927226 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 617/1268] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:33:18.934797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:18.935718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:18.946738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.947538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.948484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.949084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.973861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:19.365635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:19.380656 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e5b3bd19-42c0-49ce-ab02-def66b39d2b0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1476 microversion: 2.1 time: 0.723104 Jun 16 18:33:19.381312 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 652/1269] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:18 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1476 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:19.390928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9572047-6611-40a8-9c41-21475262e845 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:19.391751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e9572047-6611-40a8-9c41-21475262e845 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:19.954089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9572047-6611-40a8-9c41-21475262e845 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:19.961452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9572047-6611-40a8-9c41-21475262e845 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1224 microversion: 2.1 time: 0.579030 Jun 16 18:33:19.962092 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 653/1270] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:19 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1224 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:19.976211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:19.977125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:19.994412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:19.995091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:19.997431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.006891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.372315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:20.388360 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9d974bb2-0119-4665-b4f2-8c2a68ef329e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1542 microversion: 2.1 time: 1.458015 Jun 16 18:33:20.389049 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 618/1271] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:18 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1542 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:20.406765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:20.413832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:20.423372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.424163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.425759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.426512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.531514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:20.539693 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c428e65f-3b4c-4b66-b03b-e554c688ce37 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.567629 Jun 16 18:33:20.540295 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 654/1272] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:19 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:20.549192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:20.561358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:20.573863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.574375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.575387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.586706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.646537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:20.662459 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ffe6cdbf-08e9-4ea2-a771-129d51c77b6b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1276 microversion: 2.1 time: 0.266452 Jun 16 18:33:20.673304 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 619/1273] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:20 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1276 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:20.673304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47559813-1ddd-47c3-bf46-24b64c36543e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:20.673304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-47559813-1ddd-47c3-bf46-24b64c36543e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:20.692548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47559813-1ddd-47c3-bf46-24b64c36543e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.693181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47559813-1ddd-47c3-bf46-24b64c36543e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.694153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47559813-1ddd-47c3-bf46-24b64c36543e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.694739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47559813-1ddd-47c3-bf46-24b64c36543e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.991186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-47559813-1ddd-47c3-bf46-24b64c36543e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326274 Jun 16 18:33:20.991796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 620/1274] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:33:20 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:21.251901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1907805033", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "378157bc-3224-41cb-9ae7-5658c29da6c5"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:21.395101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] validate_networks() for [('378157bc-3224-41cb-9ae7-5658c29da6c5', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:21.534461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:21.547150 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-26616d1a-c61a-40b2-bc67-2b779e96d494 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1476 microversion: 2.1 time: 1.005681 Jun 16 18:33:21.563883 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 655/1275] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:20 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1476 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:21.579865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:21.582688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:21.598731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:21.605525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:21.608136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:21.608603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:22.044065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:22.059504 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b56ae470-ad8a-450d-8b96-4bdb9812202c tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1282 microversion: 2.1 time: 0.494114 Jun 16 18:33:22.060509 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 656/1276] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:21 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1282 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:22.075773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:22.076706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:22.089192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:22.094994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:22.096092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:22.096710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:23.682293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:23.692056 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b83817a-a8b0-4fd6-9784-c0572db0c98d tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 1.630113 Jun 16 18:33:23.692967 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 657/1277] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:22 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:23.698260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-562d0946-2b4a-41bf-85f8-896b8ee373e1 req-055a9f03-ae2f-46a6-882e-4bf35a52477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "name": "network-vif-unplugged", "status": "completed", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:23.708726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-562d0946-2b4a-41bf-85f8-896b8ee373e1 req-055a9f03-ae2f-46a6-882e-4bf35a52477e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:23.709494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-562d0946-2b4a-41bf-85f8-896b8ee373e1 req-055a9f03-ae2f-46a6-882e-4bf35a52477e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:23.725168 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-562d0946-2b4a-41bf-85f8-896b8ee373e1 req-055a9f03-ae2f-46a6-882e-4bf35a52477e service nova] Creating event network-vif-unplugged:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h1-846209-2 Jun 16 18:33:23.739837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-562d0946-2b4a-41bf-85f8-896b8ee373e1 req-055a9f03-ae2f-46a6-882e-4bf35a52477e service nova] Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:33:23.758272 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-562d0946-2b4a-41bf-85f8-896b8ee373e1 req-055a9f03-ae2f-46a6-882e-4bf35a52477e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063608 Jun 16 18:33:23.759090 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 658/1278] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:23.765810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:23.770378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:23.797596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:23.798114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:23.798910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:23.806580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:24.616472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:24.632590 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dfe402cb-7362-4296-87e0-48fd1eb613c6 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1276 microversion: 2.1 time: 0.872000 Jun 16 18:33:24.639757 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 659/1279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:23 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1276 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:24.657451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:24.659069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:24.669109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:24.671250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:24.672325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:24.672954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.624664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:25.653701 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ee53266a-267c-4699-a829-3d44f51331da tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1476 microversion: 2.1 time: 1.011235 Jun 16 18:33:25.656067 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 660/1280] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:24 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1476 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:25.673422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:25.674412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:25.683318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.686874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.688026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.690741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.715673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:25.716157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:25.716774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:25.717161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:25.717874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:25.739277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.741284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.743096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.744428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.822979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Getting quotas for project 6950ba42a3434feca292d74540c20ea6. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:25.840467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Getting quotas for user 6d0ef6fec2fd46c68afb5d3631c4391d and project 6950ba42a3434feca292d74540c20ea6. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:25.856858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:25.859007 n-d-846209-2 devstack@n-api.service[119207]: WARNING nova.utils [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1907805033 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-190780503 Jun 16 18:33:25.859872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:25.929842 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3bc2a696-7002-4009-9c87-5e46d1694ac5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.936634 Jun 16 18:33:25.930943 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 621/1281] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:33:25.937160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2a2bb268-2f0c-4755-bc05-21dad8904d3f req-a565c9d6-f73a-4154-b52b-35cad8b3d7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde572fd-eb29-49bc-80ff-df6f2bab357c", "tag": "d7c4e981-2d53-4908-83ea-56a1198ad18b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:25.953326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2a2bb268-2f0c-4755-bc05-21dad8904d3f req-a565c9d6-f73a-4154-b52b-35cad8b3d7bf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.954324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2a2bb268-2f0c-4755-bc05-21dad8904d3f req-a565c9d6-f73a-4154-b52b-35cad8b3d7bf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.975518 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2a2bb268-2f0c-4755-bc05-21dad8904d3f req-a565c9d6-f73a-4154-b52b-35cad8b3d7bf service nova] Creating event network-changed:d7c4e981-2d53-4908-83ea-56a1198ad18b for instance dde572fd-eb29-49bc-80ff-df6f2bab357c on n-h2-846209-2 Jun 16 18:33:25.983789 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2a2bb268-2f0c-4755-bc05-21dad8904d3f req-a565c9d6-f73a-4154-b52b-35cad8b3d7bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049382 Jun 16 18:33:25.994352 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 622/1282] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:26.003364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:26.005087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:26.013151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:26.014188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:26.015259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:26.015970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:26.492388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:26.500482 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-115bc314-8fd5-497c-994a-f0baa23f40da tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1324 microversion: 2.1 time: 0.831404 Jun 16 18:33:26.501083 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 661/1283] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:25 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1324 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:26.507973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a3335d14-d3a0-4d2a-a2e5-b4bf20ee6f19 req-432c42b5-5f49-42d4-a676-81e9d3e8cec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6f1caa-d4d3-4731-b888-93a450c7360b", "name": "network-vif-plugged", "status": "completed", "tag": "118ce63a-acf9-43c2-bf5f-646a6494fb44"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:26.527104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a3335d14-d3a0-4d2a-a2e5-b4bf20ee6f19 req-432c42b5-5f49-42d4-a676-81e9d3e8cec7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:26.527814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a3335d14-d3a0-4d2a-a2e5-b4bf20ee6f19 req-432c42b5-5f49-42d4-a676-81e9d3e8cec7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:26.545868 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a3335d14-d3a0-4d2a-a2e5-b4bf20ee6f19 req-432c42b5-5f49-42d4-a676-81e9d3e8cec7 service nova] Creating event network-vif-plugged:118ce63a-acf9-43c2-bf5f-646a6494fb44 for instance ef6f1caa-d4d3-4731-b888-93a450c7360b on n-h2-846209-2 Jun 16 18:33:26.554234 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a3335d14-d3a0-4d2a-a2e5-b4bf20ee6f19 req-432c42b5-5f49-42d4-a676-81e9d3e8cec7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051638 Jun 16 18:33:26.557195 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 662/1284] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:26.565185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:26.567419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:26.575259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:26.575721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:26.577216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:26.577661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:26.622095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:26.931979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:26.941130 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-170ce4b3-9ab6-4b33-8a94-9694b06b2d4c tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1316 microversion: 2.1 time: 0.944586 Jun 16 18:33:26.942386 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 623/1285] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:25 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1316 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:26.947826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:26.948633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:26.971747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:26.972537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:26.972932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:26.973372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:27.615118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:27.625110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd74f4c6-527d-416a-9f7f-e2e6356bc481 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1228 microversion: 2.1 time: 0.681218 Jun 16 18:33:27.632594 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 624/1286] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:26 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1228 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:27.645358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-126920c9-780f-4b84-aa76-c4456bb94d43 req-e1976f68-ae39-4e88-a9cf-ca08df22427e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:27.671844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-126920c9-780f-4b84-aa76-c4456bb94d43 req-e1976f68-ae39-4e88-a9cf-ca08df22427e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:27.674422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-126920c9-780f-4b84-aa76-c4456bb94d43 req-e1976f68-ae39-4e88-a9cf-ca08df22427e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:27.710338 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-126920c9-780f-4b84-aa76-c4456bb94d43 req-e1976f68-ae39-4e88-a9cf-ca08df22427e service nova] Creating event network-changed:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h1-846209-2 Jun 16 18:33:27.725810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-126920c9-780f-4b84-aa76-c4456bb94d43 req-e1976f68-ae39-4e88-a9cf-ca08df22427e service nova] Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:33:27.747022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:27.757752 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-126920c9-780f-4b84-aa76-c4456bb94d43 req-e1976f68-ae39-4e88-a9cf-ca08df22427e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118249 Jun 16 18:33:27.762061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bf465390-0cb1-42a3-a97d-e43f68c5d97d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 1.200105 Jun 16 18:33:27.762283 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 625/1287] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:27.773056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:27.774517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:27.778170 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 663/1288] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:26 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:27.785615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:27.786108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:27.787541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:27.788016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:27.796713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:27.797341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:27.820601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:27.821057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:27.821849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:27.822316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:28.479365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:28.487290 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a10844df-7d36-460a-bdce-aea9c04bc15f tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1324 microversion: 2.1 time: 0.695982 Jun 16 18:33:28.488838 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 664/1289] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:27 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1324 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:28.495311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:28.496132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:28.496709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:28.504846 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f1754c69-a50e-466b-a7b0-9da46b57f8f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1476 microversion: 2.1 time: 0.739908 Jun 16 18:33:28.509851 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 626/1290] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:27 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1476 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:28.511611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:28.512258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:28.514434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:28.515040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:28.643389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:28.645664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:28.652639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:28.653079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:28.654147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:28.654588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:28.825510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:28.838923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d31c12e-6ddf-4cdb-9c54-86db555908c1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1290 microversion: 2.1 time: 0.198294 Jun 16 18:33:28.842288 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 627/1291] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:28 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1290 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:28.853170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:28.854108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:28.860835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:28.861712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:28.862986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:28.863709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.089605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:29.104542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d21fce21-86f4-4355-87f9-f944940b97e7 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1465 microversion: 2.1 time: 0.614331 Jun 16 18:33:29.113856 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 665/1292] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:28 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1465 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:29.133268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:29.135205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:29.145516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.146275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.147337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.148452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.220234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:33:29.429599 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-893f2ef7-3caf-4e87-beea-23e06000648b tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 204 len: 0 microversion: 2.1 time: 0.303980 Jun 16 18:33:29.436931 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 666/1293] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:33:29 2022] DELETE /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:33:29.443951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:29.445437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:29.453404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.454289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.455357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.456570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.652830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:29.670971 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8a0b70be-6da0-467e-b094-771c8527b53d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.826107 Jun 16 18:33:29.676124 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 628/1294] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:28 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:29.703138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:29.712651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:29.731304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.733992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.735293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.736128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.961584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:29.973355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:29.997845 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b5783338-27ae-49e9-a691-8366fadf1114 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1471 microversion: 2.1 time: 0.558654 Jun 16 18:33:30.015144 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 667/1295] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:29 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1471 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:30.022234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:30.023332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:30.040864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.042025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:30.043286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.044114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:30.357818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:30.371611 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d6eecfdc-423e-43c0-a85b-c85f6ea5d5d6 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1324 microversion: 2.1 time: 0.677714 Jun 16 18:33:30.373264 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 629/1296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:29 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1324 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:30.379859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f223434e-f5c0-460c-8150-5f257175b5fe req-201e1664-abd9-4919-951d-3ccae18da933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:30.395421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f223434e-f5c0-460c-8150-5f257175b5fe req-201e1664-abd9-4919-951d-3ccae18da933 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.396237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f223434e-f5c0-460c-8150-5f257175b5fe req-201e1664-abd9-4919-951d-3ccae18da933 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:30.411835 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f223434e-f5c0-460c-8150-5f257175b5fe req-201e1664-abd9-4919-951d-3ccae18da933 service nova] Creating event network-changed:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h2-846209-2 Jun 16 18:33:30.418191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f223434e-f5c0-460c-8150-5f257175b5fe req-201e1664-abd9-4919-951d-3ccae18da933 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043203 Jun 16 18:33:30.419425 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 630/1297] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:30.427609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:30.428345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:30.441474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.442720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:30.444527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.445547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:30.692383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:30.711158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eccd9889-75d3-4324-ba99-596b5b294cb4 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1474 microversion: 2.1 time: 0.694119 Jun 16 18:33:30.711776 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 668/1298] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:30 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1474 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:30.716737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-75eb42c3-39e0-4f5e-8c1c-5bff50efdadc req-32ed65ff-af37-40a1-8a7e-223a8f78a54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde572fd-eb29-49bc-80ff-df6f2bab357c", "name": "network-vif-plugged", "status": "completed", "tag": "d7c4e981-2d53-4908-83ea-56a1198ad18b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:30.760455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75eb42c3-39e0-4f5e-8c1c-5bff50efdadc req-32ed65ff-af37-40a1-8a7e-223a8f78a54a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.761432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75eb42c3-39e0-4f5e-8c1c-5bff50efdadc req-32ed65ff-af37-40a1-8a7e-223a8f78a54a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:30.795245 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-75eb42c3-39e0-4f5e-8c1c-5bff50efdadc req-32ed65ff-af37-40a1-8a7e-223a8f78a54a service nova] Creating event network-vif-plugged:d7c4e981-2d53-4908-83ea-56a1198ad18b for instance dde572fd-eb29-49bc-80ff-df6f2bab357c on n-h2-846209-2 Jun 16 18:33:30.810479 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-75eb42c3-39e0-4f5e-8c1c-5bff50efdadc req-32ed65ff-af37-40a1-8a7e-223a8f78a54a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094733 Jun 16 18:33:30.814582 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 669/1299] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:30.840352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:30.841142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:30.859854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.861457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:30.863322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:30.864050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:31.793864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:31.825412 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7181c7ff-e78a-44e7-a48c-a36dd97e862d tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1332 microversion: 2.1 time: 1.403111 Jun 16 18:33:31.826955 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 631/1300] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:30 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1332 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:31.839176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:31.840590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:31.859785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:31.862438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:31.866353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:31.867676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:32.228373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:32.243887 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-740608da-c2b1-42a6-b656-505ce6b3c668 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 1.424473 Jun 16 18:33:32.245328 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 670/1301] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:30 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:32.251604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:32.252507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:32.261612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:32.262369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:32.263342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:32.264206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:32.735320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286b7d5de8b54d4693a8465ea2665a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f0f4fccf345a0993a233c0f5db0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:32.750355 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-286001ae-08c4-4d26-8e99-3768f051f4eb tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 200 len: 1471 microversion: 2.1 time: 0.919776 Jun 16 18:33:32.758054 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 632/1302] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:31 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 1471 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:32.764156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:32.768252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:32.784910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:32.787828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:32.791388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:32.792472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.028798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:33.054712 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e054aa7d-34de-4857-908f-a313127c98b5 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1324 microversion: 2.1 time: 0.807923 Jun 16 18:33:33.062469 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 671/1303] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:32 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1324 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:33.074644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-01f3380b-b86c-4eb5-b626-14c95840a2d7 req-b8458373-6b90-48ad-bbfb-6ac21fd94895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6f1caa-d4d3-4731-b888-93a450c7360b", "name": "network-vif-deleted", "tag": "118ce63a-acf9-43c2-bf5f-646a6494fb44"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:33.116359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-01f3380b-b86c-4eb5-b626-14c95840a2d7 req-b8458373-6b90-48ad-bbfb-6ac21fd94895 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.116816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-01f3380b-b86c-4eb5-b626-14c95840a2d7 req-b8458373-6b90-48ad-bbfb-6ac21fd94895 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.138907 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-01f3380b-b86c-4eb5-b626-14c95840a2d7 req-b8458373-6b90-48ad-bbfb-6ac21fd94895 service nova] Creating event network-vif-deleted:118ce63a-acf9-43c2-bf5f-646a6494fb44 for instance ef6f1caa-d4d3-4731-b888-93a450c7360b on n-h2-846209-2 Jun 16 18:33:33.150873 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-01f3380b-b86c-4eb5-b626-14c95840a2d7 req-b8458373-6b90-48ad-bbfb-6ac21fd94895 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083501 Jun 16 18:33:33.154163 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 672/1304] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:33.162873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7bc9c940-b7a1-45ef-b7dc-14182e0ac3f4 req-5b363f67-aa53-42dd-8060-654e5257ed16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47fbd7d-f805-4344-a460-290bb5446846", "tag": "d2024d90-2975-4da0-a55d-361d7d8a78b3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:33.173853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7bc9c940-b7a1-45ef-b7dc-14182e0ac3f4 req-5b363f67-aa53-42dd-8060-654e5257ed16 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.175674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7bc9c940-b7a1-45ef-b7dc-14182e0ac3f4 req-5b363f67-aa53-42dd-8060-654e5257ed16 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.194934 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7bc9c940-b7a1-45ef-b7dc-14182e0ac3f4 req-5b363f67-aa53-42dd-8060-654e5257ed16 service nova] Creating event network-changed:d2024d90-2975-4da0-a55d-361d7d8a78b3 for instance a47fbd7d-f805-4344-a460-290bb5446846 on n-h1-846209-2 Jun 16 18:33:33.212270 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7bc9c940-b7a1-45ef-b7dc-14182e0ac3f4 req-5b363f67-aa53-42dd-8060-654e5257ed16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055494 Jun 16 18:33:33.213076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 673/1305] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:33.220691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.221447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.253024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:33.267037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.267722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.274052 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5cbdb311-270b-4e1b-ab5c-fe95367907bc tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1471 microversion: 2.1 time: 0.514304 Jun 16 18:33:33.274645 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 633/1306] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:32 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1471 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:33.279765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.282298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.293654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.296437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.310230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.315787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.316809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.317255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.645040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:33.657881 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a3acdc5-c5c5-4868-b88b-869a7ed6e0c9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.381945 Jun 16 18:33:33.658739 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 634/1307] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:33 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:33.680993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ecdfa46-008a-4948-b5b8-2db31c3b94df tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:33.682538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2ecdfa46-008a-4948-b5b8-2db31c3b94df tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.695135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa46-008a-4948-b5b8-2db31c3b94df tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.695741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:33.695992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa46-008a-4948-b5b8-2db31c3b94df tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.696935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa46-008a-4948-b5b8-2db31c3b94df tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.697717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ecdfa46-008a-4948-b5b8-2db31c3b94df tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.706726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f2ff0dc-de72-4f8a-9da0-e08aafabaf39 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1332 microversion: 2.1 time: 0.492122 Jun 16 18:33:33.745224 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 674/1308] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:33 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1332 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:33.783460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.788096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.799299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.800131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.801089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.801594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.829025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] HTTP exception thrown: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Request method failure captured: Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b HTTP/1.1 Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dYIWBGG1xuDVY5BtHDqZqBNmeVhb6U7ADjPq9HDkVjbJiz0HdKihSmwKFi81E6u6j4ddXTkKmCjy6qUwOJxecya4inJlEPwed37J4Xl1LkR7I059ipWLzuK7GphntcsnVucB_8-a52F-HEEOnidFXIhG9s198JVFXIww8zuVDWWzc Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:33.831009 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8f0f4fccf345a0993a233c0f5db0dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 286b7d5de8b54d4693a8465ea2665a2a Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.832960 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ef6f1caa-d4d3-4731-b888-93a450c7360b'} Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:33.833763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.835134 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.836397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Returning 404 to user: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:33.836397 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15f7a8d2-73c3-4e6d-b6ce-2cc0ea97066a tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 404 len: 111 microversion: 2.1 time: 0.059706 Jun 16 18:33:33.836397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 675/1309] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:33 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:33.845413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-794198512", "metadata": {"image_type": "test"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:33.847412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.855949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.856661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.857398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.858167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.865702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:33.880225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] HTTP exception thrown: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Request method failure captured: Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b/action HTTP/1.1 Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 111 Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dYIWBGG1xuDVY5BtHDqZqBNmeVhb6U7ADjPq9HDkVjbJiz0HdKihSmwKFi81E6u6j4ddXTkKmCjy6qUwOJxecya4inJlEPwed37J4Xl1LkR7I059ipWLzuK7GphntcsnVucB_8-a52F-HEEOnidFXIhG9s198JVFXIww8zuVDWWzc Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:33.881949 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8f0f4fccf345a0993a233c0f5db0dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 286b7d5de8b54d4693a8465ea2665a2a Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-794198512", "metadata": {"image_type": "test"}}} Jun 16 18:33:33.883747 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ef6f1caa-d4d3-4731-b888-93a450c7360b', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-794198512', 'metadata': {'image_type': 'test'}}}} Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.884704 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.886858 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Returning 404 to user: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0eb940cf-852e-4e95-b1f0-5570ca5903db tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "POST /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b/action" status: 404 len: 111 microversion: 2.1 time: 0.044525 Jun 16 18:33:33.889307 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 676/1310] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Jun 16 18:33:33 2022] POST /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:33.898481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b61cbcf-539e-4c6f-ab59-d502f266aee6 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-5051854", "metadata": {"image_type": "test"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:33.899661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b61cbcf-539e-4c6f-ab59-d502f266aee6 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Failed to fetch instance by id tempest-invalid-771253449 {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 18:33:33.899910 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2ecdfa46-008a-4948-b5b8-2db31c3b94df tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "POST /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5/action" status: 202 len: 0 microversion: 2.1 time: 0.229316 Jun 16 18:33:33.900181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-5b61cbcf-539e-4c6f-ab59-d502f266aee6 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] HTTP exception thrown: Instance tempest-invalid-771253449 could not be found. Jun 16 18:33:33.900698 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 635/1311] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:33:33 2022] POST /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b61cbcf-539e-4c6f-ab59-d502f266aee6 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Request method failure captured: Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/tempest-invalid-771253449/action HTTP/1.1 Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 109 Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dYIWBGG1xuDVY5BtHDqZqBNmeVhb6U7ADjPq9HDkVjbJiz0HdKihSmwKFi81E6u6j4ddXTkKmCjy6qUwOJxecya4inJlEPwed37J4Xl1LkR7I059ipWLzuK7GphntcsnVucB_8-a52F-HEEOnidFXIhG9s198JVFXIww8zuVDWWzc Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:33.902230 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8f0f4fccf345a0993a233c0f5db0dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 286b7d5de8b54d4693a8465ea2665a2a Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-5051854", "metadata": {"image_type": "test"}}} Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:33.903892 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance tempest-invalid-771253449 could not be found. Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'tempest-invalid-771253449', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-5051854', 'metadata': {'image_type': 'test'}}}} Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-771253449 could not be found. Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.904726 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-771253449 could not be found. Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-771253449 could not be found. Jun 16 18:33:33.906563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.907986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b61cbcf-539e-4c6f-ab59-d502f266aee6 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Returning 404 to user: Instance tempest-invalid-771253449 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:33.907986 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b61cbcf-539e-4c6f-ab59-d502f266aee6 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-771253449/action" status: 404 len: 100 microversion: 2.1 time: 0.011029 Jun 16 18:33:33.907986 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 677/1312] 10.222.0.27 () {60 vars in 1245 bytes} [Thu Jun 16 18:33:33 2022] POST /compute/v2.1/servers/tempest-invalid-771253449/action => generated 100 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:33:33.914162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.916448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5373071e-f49b-4f2b-9017-7bcb3f3f02a8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1255482152"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:33.917609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5373071e-f49b-4f2b-9017-7bcb3f3f02a8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 18:33:33.918109 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-5373071e-f49b-4f2b-9017-7bcb3f3f02a8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5373071e-f49b-4f2b-9017-7bcb3f3f02a8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Request method failure captured: Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 57 Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dYIWBGG1xuDVY5BtHDqZqBNmeVhb6U7ADjPq9HDkVjbJiz0HdKihSmwKFi81E6u6j4ddXTkKmCjy6qUwOJxecya4inJlEPwed37J4Xl1LkR7I059ipWLzuK7GphntcsnVucB_8-a52F-HEEOnidFXIhG9s198JVFXIww8zuVDWWzc Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:33.919744 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8f0f4fccf345a0993a233c0f5db0dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 286b7d5de8b54d4693a8465ea2665a2a Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: {"createImage": {"name": "tempest-test-snap-1255482152"}} Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:33.921372 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1255482152'}}} Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.922460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.923914 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.926379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5373071e-f49b-4f2b-9017-7bcb3f3f02a8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:33.926379 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5373071e-f49b-4f2b-9017-7bcb3f3f02a8 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009089 Jun 16 18:33:33.927159 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 678/1313] 10.222.0.27 () {60 vars in 1274 bytes} [Thu Jun 16 18:33:33 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:33.931862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.933710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0dce360-5573-4e3b-9301-772061f2c2c4 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-140528665"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:33.934771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c0dce360-5573-4e3b-9301-772061f2c2c4 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 18:33:33.935351 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-c0dce360-5573-4e3b-9301-772061f2c2c4 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0dce360-5573-4e3b-9301-772061f2c2c4 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Request method failure captured: Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 56 Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dYIWBGG1xuDVY5BtHDqZqBNmeVhb6U7ADjPq9HDkVjbJiz0HdKihSmwKFi81E6u6j4ddXTkKmCjy6qUwOJxecya4inJlEPwed37J4Xl1LkR7I059ipWLzuK7GphntcsnVucB_8-a52F-HEEOnidFXIhG9s198JVFXIww8zuVDWWzc Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:33.937069 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8f0f4fccf345a0993a233c0f5db0dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 286b7d5de8b54d4693a8465ea2665a2a Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: {"createImage": {"name": "tempest-test-snap-140528665"}} Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:33.938604 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-140528665'}}} Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.939647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 18:33:33.941965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.943513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0dce360-5573-4e3b-9301-772061f2c2c4 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:33.943513 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c0dce360-5573-4e3b-9301-772061f2c2c4 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010328 Jun 16 18:33:33.944236 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 679/1314] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Jun 16 18:33:33 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:33.949377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.949995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.955550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.956085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.958145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.958494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.959293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.959793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.963610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.964098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.978156 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] HTTP exception thrown: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Request method failure captured: Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b HTTP/1.1 Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dYIWBGG1xuDVY5BtHDqZqBNmeVhb6U7ADjPq9HDkVjbJiz0HdKihSmwKFi81E6u6j4ddXTkKmCjy6qUwOJxecya4inJlEPwed37J4Xl1LkR7I059ipWLzuK7GphntcsnVucB_8-a52F-HEEOnidFXIhG9s198JVFXIww8zuVDWWzc Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:33.979720 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8f0f4fccf345a0993a233c0f5db0dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 286b7d5de8b54d4693a8465ea2665a2a Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.981315 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ef6f1caa-d4d3-4731-b888-93a450c7360b'} Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:33.982454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:33.984031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:33.985431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Returning 404 to user: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:33.985431 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f85420b-7d04-4e45-add0-de6b6100467e tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 404 len: 111 microversion: 2.1 time: 0.035873 Jun 16 18:33:33.985431 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 680/1315] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:33:33 2022] DELETE /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:33.990873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.991583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] [instance: ef6f1caa-d4d3-4731-b888-93a450c7360b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:34.001078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.001616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.002630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.004029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.043304 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] HTTP exception thrown: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Request method failure captured: Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b HTTP/1.1 Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dYIWBGG1xuDVY5BtHDqZqBNmeVhb6U7ADjPq9HDkVjbJiz0HdKihSmwKFi81E6u6j4ddXTkKmCjy6qUwOJxecya4inJlEPwed37J4Xl1LkR7I059ipWLzuK7GphntcsnVucB_8-a52F-HEEOnidFXIhG9s198JVFXIww8zuVDWWzc Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:34.046574 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8f0f4fccf345a0993a233c0f5db0dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8f0f4fccf345a0993a233c0f5db0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8c8f0f4fccf345a0993a233c0f5db0dc Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1709841780 Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 286b7d5de8b54d4693a8465ea2665a2a Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesNegativeTestJSON-1709841780-project Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:34.048254 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ef6f1caa-d4d3-4731-b888-93a450c7360b'} Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:34.049023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. Jun 16 18:33:34.051131 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.052266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] Returning 404 to user: Instance ef6f1caa-d4d3-4731-b888-93a450c7360b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:34.052266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-22590f48-d233-4a77-9002-5ac6f473cc24 tempest-ImagesNegativeTestJSON-1709841780 tempest-ImagesNegativeTestJSON-1709841780-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b" status: 404 len: 111 microversion: 2.1 time: 0.062281 Jun 16 18:33:34.057538 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 681/1316] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:33 2022] GET /compute/v2.1/servers/ef6f1caa-d4d3-4731-b888-93a450c7360b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:34.084384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:34.087748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:34.107860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.108909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.113977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.126368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.608589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:34.618787 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-350cd1f5-70f3-4b86-8ff4-580144d86cd2 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 0.713078 Jun 16 18:33:34.619579 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 636/1317] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:33 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:34.676931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:34.677800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:34.681062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:34.688022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.689081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.690414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.691191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.939858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:34.953296 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-95a9ed2c-6db1-4dc2-9d49-246340cb5e06 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1520 microversion: 2.1 time: 0.874409 Jun 16 18:33:34.954395 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 682/1318] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:34 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1520 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:34.970252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:34.971139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:34.986388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.987960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.002168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.004522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.345638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:35.380320 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e97abb2f-3172-4b26-a252-08ed72fdd8e2 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.703482 Jun 16 18:33:35.382418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 637/1319] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:34 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:35.399440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.402699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.412263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:35.420668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.422304 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4217e3a6-7eb0-453c-834b-a67a8010c4fb tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1332 microversion: 2.1 time: 0.463854 Jun 16 18:33:35.422823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.423755 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 683/1320] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:34 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1332 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:35.425200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.428557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.444802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f82c5225-2c38-44c5-845f-24aae131eea1 req-20e642b3-3a30-477b-8441-fdeafb791abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037688ff-f5d2-41d0-a06e-24efe64e927f", "tag": "df861561-6bdf-4f2b-8ac3-c070c3621f0d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:35.481659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f82c5225-2c38-44c5-845f-24aae131eea1 req-20e642b3-3a30-477b-8441-fdeafb791abd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.483198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f82c5225-2c38-44c5-845f-24aae131eea1 req-20e642b3-3a30-477b-8441-fdeafb791abd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.522313 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] HTTP exception thrown: Action 999 not found Jun 16 18:33:35.523173 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f82c5225-2c38-44c5-845f-24aae131eea1 req-20e642b3-3a30-477b-8441-fdeafb791abd service nova] Creating event network-changed:df861561-6bdf-4f2b-8ac3-c070c3621f0d for instance 037688ff-f5d2-41d0-a06e-24efe64e927f on n-h1-846209-2 Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Request method failure captured: Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c/os-instance-actions/999 HTTP/1.1 Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ds6SVua2fty6YF40qz8eLn2OYj8GSNZcUjm9_sCj28xzzN4KIFK3pjUR7s4Sh-KzUJOCXLn5DpXodTP8H86Pc_qzwTzeMaRleKbgZjQFwrCFk9q9HZ834qPovhOW1VrbalUmSDnZ5eAY2LkWo1V8tmRzOf9utmXNWozLxSQvEqKn0 Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 03e5c869e0fc4b16b621b3115222065a Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:33:35.524700 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5c869e0fc4b16b621b3115222065a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 03e5c869e0fc4b16b621b3115222065a Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-InstanceActionsNegativeTestJSON-201411221-project Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6e8e89541e92470e915701bf2ead618c Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-201411221-project Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: exception: Action 999 not found Jun 16 18:33:35.526399 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': 'dde572fd-eb29-49bc-80ff-df6f2bab357c', 'id': '999'} Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jun 16 18:33:35.527763 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.533661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Returning 404 to user: Action 999 not found {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:35.533661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-249781c8-2bcd-4a4e-a09f-306042be437a tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.139868 Jun 16 18:33:35.533661 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 638/1321] 10.222.0.27 () {58 vars in 1307 bytes} [Thu Jun 16 18:33:35 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c/os-instance-actions/999 => generated 66 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:33:35.534004 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f82c5225-2c38-44c5-845f-24aae131eea1 req-20e642b3-3a30-477b-8441-fdeafb791abd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106293 Jun 16 18:33:35.539077 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 684/1322] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:35.543546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca2b6978-9620-459e-98df-16d40e00e515 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '.version_select at 0x7f866f199ee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.543944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca2b6978-9620-459e-98df-16d40e00e515 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: c52ec086-7a7a-4d6b-b82c-fd437dee2d95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.593814 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ca2b6978-9620-459e-98df-16d40e00e515 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] HTTP exception thrown: Instance c52ec086-7a7a-4d6b-b82c-fd437dee2d95 could not be found. Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca2b6978-9620-459e-98df-16d40e00e515 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Request method failure captured: Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/c52ec086-7a7a-4d6b-b82c-fd437dee2d95/os-instance-actions HTTP/1.1 Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ds6SVua2fty6YF40qz8eLn2OYj8GSNZcUjm9_sCj28xzzN4KIFK3pjUR7s4Sh-KzUJOCXLn5DpXodTP8H86Pc_qzwTzeMaRleKbgZjQFwrCFk9q9HZ834qPovhOW1VrbalUmSDnZ5eAY2LkWo1V8tmRzOf9utmXNWozLxSQvEqKn0 Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 03e5c869e0fc4b16b621b3115222065a Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:33:35.595431 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5c869e0fc4b16b621b3115222065a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 03e5c869e0fc4b16b621b3115222065a Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-InstanceActionsNegativeTestJSON-201411221-project Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6e8e89541e92470e915701bf2ead618c Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-201411221-project Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance c52ec086-7a7a-4d6b-b82c-fd437dee2d95 could not be found. Jun 16 18:33:35.597784 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': 'c52ec086-7a7a-4d6b-b82c-fd437dee2d95'} Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52ec086-7a7a-4d6b-b82c-fd437dee2d95 could not be found. Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:33:35.598702 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52ec086-7a7a-4d6b-b82c-fd437dee2d95 could not be found. Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52ec086-7a7a-4d6b-b82c-fd437dee2d95 could not be found. Jun 16 18:33:35.600301 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:33:35.604596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca2b6978-9620-459e-98df-16d40e00e515 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Returning 404 to user: Instance c52ec086-7a7a-4d6b-b82c-fd437dee2d95 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:35.605689 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca2b6978-9620-459e-98df-16d40e00e515 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/c52ec086-7a7a-4d6b-b82c-fd437dee2d95/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.071405 Jun 16 18:33:35.606785 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 639/1323] 10.222.0.27 () {58 vars in 1295 bytes} [Thu Jun 16 18:33:35 2022] GET /compute/v2.1/servers/c52ec086-7a7a-4d6b-b82c-fd437dee2d95/os-instance-actions => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:35.617480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.618122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.628524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.628524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.629770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.630248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.652719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.665346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.684045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.684512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.686815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.689321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.692012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:33:35.750067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:35.790646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:35.848071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:35.852934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=18 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:35.865565 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-65974ab8-493a-4286-a593-e4bab35dcd8d tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 204 len: 0 microversion: 2.1 time: 0.249834 Jun 16 18:33:35.868520 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 685/1324] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:33:35 2022] DELETE /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:33:35.901288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.903638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.930431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.934137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.935047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.936993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:36.116792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:36.125653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a189839e-57af-42c9-9f87-6f239c9fde9d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 0.484158 Jun 16 18:33:36.130012 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 640/1325] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:35 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:36.399874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:36.400498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:36.410942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:36.428771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:36.429134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:36.429980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:36.431171 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6f029516-1ae2-45f1-a2c7-caf4494f6f82 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1526 microversion: 2.1 time: 0.558471 Jun 16 18:33:36.434389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:36.435530 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 686/1326] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:35 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1526 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:36.453499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:36.458750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:36.494296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:36.494296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:36.499376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:36.499376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.071922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:37.086618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6354a3f4-77c9-458c-80a7-0377152f3e6d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.690168 Jun 16 18:33:37.089631 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 641/1327] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:36 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:37.107544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:37.109378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-bfe3fbef-3bcf-4b21-82dd-e45bbe8409b7 req-1dd9c7b4-3b92-4317-93cb-de7033b2bdc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "name": "network-vif-plugged", "status": "completed", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:37.124324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bfe3fbef-3bcf-4b21-82dd-e45bbe8409b7 req-1dd9c7b4-3b92-4317-93cb-de7033b2bdc6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.125571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bfe3fbef-3bcf-4b21-82dd-e45bbe8409b7 req-1dd9c7b4-3b92-4317-93cb-de7033b2bdc6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.127670 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-633f57ab-f4bc-4e40-aa3f-f59297d9841e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1332 microversion: 2.1 time: 0.689480 Jun 16 18:33:37.128746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 687/1328] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:36 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1332 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:37.146748 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-bfe3fbef-3bcf-4b21-82dd-e45bbe8409b7 req-1dd9c7b4-3b92-4317-93cb-de7033b2bdc6 service nova] Creating event network-vif-plugged:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h1-846209-2 Jun 16 18:33:37.156733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-bfe3fbef-3bcf-4b21-82dd-e45bbe8409b7 req-1dd9c7b4-3b92-4317-93cb-de7033b2bdc6 service nova] Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:33:37.166596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:37.167934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:37.183464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.183920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.184815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.185133 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-bfe3fbef-3bcf-4b21-82dd-e45bbe8409b7 req-1dd9c7b4-3b92-4317-93cb-de7033b2bdc6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093657 Jun 16 18:33:37.185475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.186312 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 642/1329] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:37.453175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:37.454162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:37.461346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.462138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.463131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.463737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.012271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:38.027311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0cdf61f1-0a3f-40ff-bab1-7a6419c869f0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 0.886124 Jun 16 18:33:38.028130 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 688/1330] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:37 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:38.106961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:38.107782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:38.125704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:38.126195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.128018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:38.128807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.355624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e89541e92470e915701bf2ead618c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5c869e0fc4b16b621b3115222065a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:38.375527 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e582a35-8f82-43aa-9fb2-a632b883f146 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 200 len: 1526 microversion: 2.1 time: 0.926170 Jun 16 18:33:38.377994 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 643/1331] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:37 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 1526 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:38.391929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:38.392567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:38.403721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:38.404611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.407113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:38.408130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.476013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:38.486495 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2e44d98-a547-4067-87c8-e9d9d4f4d1ab tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.383277 Jun 16 18:33:38.500566 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 689/1332] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:38 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:38.579797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ed4e3e27-10f2-4130-8033-7933c714a130 req-a8431cd9-307c-4f3f-b365-79dfe5c6175d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde572fd-eb29-49bc-80ff-df6f2bab357c", "name": "network-vif-deleted", "tag": "d7c4e981-2d53-4908-83ea-56a1198ad18b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:38.612674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ed4e3e27-10f2-4130-8033-7933c714a130 req-a8431cd9-307c-4f3f-b365-79dfe5c6175d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:38.613836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ed4e3e27-10f2-4130-8033-7933c714a130 req-a8431cd9-307c-4f3f-b365-79dfe5c6175d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.618963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:38.627386 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5164f088-88ea-4625-966f-322969f2f009 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1332 microversion: 2.1 time: 0.247773 Jun 16 18:33:38.637361 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 644/1333] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:38 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1332 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:38.641969 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ed4e3e27-10f2-4130-8033-7933c714a130 req-a8431cd9-307c-4f3f-b365-79dfe5c6175d service nova] Creating event network-vif-deleted:d7c4e981-2d53-4908-83ea-56a1198ad18b for instance dde572fd-eb29-49bc-80ff-df6f2bab357c on n-h2-846209-2 Jun 16 18:33:38.649061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ed4e3e27-10f2-4130-8033-7933c714a130 req-a8431cd9-307c-4f3f-b365-79dfe5c6175d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074565 Jun 16 18:33:38.649681 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 690/1334] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:38.897198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b206bf6-7ead-4f53-8579-3695d0ce3481 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f474af0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:38.960407 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2b206bf6-7ead-4f53-8579-3695d0ce3481 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/f70a53e8-1a3b-4897-8876-dc0e6ca0e6a7" status: 200 len: 662 microversion: 2.1 time: 0.068214 Jun 16 18:33:38.961109 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 645/1335] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:33:38 2022] GET /compute/v2.1/images/f70a53e8-1a3b-4897-8876-dc0e6ca0e6a7 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:38.976208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-673dac25-9f23-4e0c-a5d3-0ec2df56e91a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ed5ea60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:39.034313 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-673dac25-9f23-4e0c-a5d3-0ec2df56e91a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/f70a53e8-1a3b-4897-8876-dc0e6ca0e6a7" status: 200 len: 662 microversion: 2.1 time: 0.062091 Jun 16 18:33:39.036179 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 691/1336] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:33:38 2022] GET /compute/v2.1/images/f70a53e8-1a3b-4897-8876-dc0e6ca0e6a7 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:39.046206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:39.047178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:39.066846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.075368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.077068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.077753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.368685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:39.381726 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ee7931d-cf57-4803-88a2-5572bf08a619 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 0.341166 Jun 16 18:33:39.382355 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 646/1337] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:39 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:39.397601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:39.398554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] [instance: dde572fd-eb29-49bc-80ff-df6f2bab357c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:39.421340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.426238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.428020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.428807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.462334 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] HTTP exception thrown: Instance dde572fd-eb29-49bc-80ff-df6f2bab357c could not be found. Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Request method failure captured: Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c HTTP/1.1 Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ds6SVua2fty6YF40qz8eLn2OYj8GSNZcUjm9_sCj28xzzN4KIFK3pjUR7s4Sh-KzUJOCXLn5DpXodTP8H86Pc_qzwTzeMaRleKbgZjQFwrCFk9q9HZ834qPovhOW1VrbalUmSDnZ5eAY2LkWo1V8tmRzOf9utmXNWozLxSQvEqKn0 Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 03e5c869e0fc4b16b621b3115222065a Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:33:39.465750 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5c869e0fc4b16b621b3115222065a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5c869e0fc4b16b621b3115222065a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 03e5c869e0fc4b16b621b3115222065a Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-201411221 Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-InstanceActionsNegativeTestJSON-201411221-project Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e8e89541e92470e915701bf2ead618c Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-201411221-project Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance dde572fd-eb29-49bc-80ff-df6f2bab357c could not be found. Jun 16 18:33:39.467492 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'dde572fd-eb29-49bc-80ff-df6f2bab357c'} Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde572fd-eb29-49bc-80ff-df6f2bab357c could not be found. Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:39.468417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde572fd-eb29-49bc-80ff-df6f2bab357c could not be found. Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde572fd-eb29-49bc-80ff-df6f2bab357c could not be found. Jun 16 18:33:39.470001 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:39.472037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] Returning 404 to user: Instance dde572fd-eb29-49bc-80ff-df6f2bab357c could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:39.472037 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a71d8972-837d-4efb-a654-268822f1b318 tempest-InstanceActionsNegativeTestJSON-201411221 tempest-InstanceActionsNegativeTestJSON-201411221-project] 10.222.0.27 "GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c" status: 404 len: 111 microversion: 2.1 time: 0.077915 Jun 16 18:33:39.475136 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 692/1338] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:39 2022] GET /compute/v2.1/servers/dde572fd-eb29-49bc-80ff-df6f2bab357c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:39.510516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:39.511570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:39.521178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.522103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.523159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.523822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.645026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:39.645641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:39.656547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.656997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.661848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.663027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.086260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:40.104080 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a925db16-de4a-48a6-93a9-2e1c0181e85a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.598744 Jun 16 18:33:40.107465 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 647/1339] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:39 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:40.144245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:40.159533 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-07c4b643-5bd2-490b-823c-646854b8aaf1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1332 microversion: 2.1 time: 0.515565 Jun 16 18:33:40.161407 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 693/1340] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:39 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1332 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:40.403517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:40.404502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:40.442677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-359227a3-32ef-4403-971e-aae9357ec928 req-9dcd1c38-40af-4e12-86dd-07381f90cbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037688ff-f5d2-41d0-a06e-24efe64e927f", "name": "network-vif-plugged", "status": "completed", "tag": "df861561-6bdf-4f2b-8ac3-c070c3621f0d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:40.447291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.450106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.451262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.451890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.471231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-359227a3-32ef-4403-971e-aae9357ec928 req-9dcd1c38-40af-4e12-86dd-07381f90cbff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.473780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-359227a3-32ef-4403-971e-aae9357ec928 req-9dcd1c38-40af-4e12-86dd-07381f90cbff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.517025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-359227a3-32ef-4403-971e-aae9357ec928 req-9dcd1c38-40af-4e12-86dd-07381f90cbff service nova] Creating event network-vif-plugged:df861561-6bdf-4f2b-8ac3-c070c3621f0d for instance 037688ff-f5d2-41d0-a06e-24efe64e927f on n-h1-846209-2 Jun 16 18:33:40.547171 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-359227a3-32ef-4403-971e-aae9357ec928 req-9dcd1c38-40af-4e12-86dd-07381f90cbff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103441 Jun 16 18:33:40.555867 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 694/1341] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:40.932133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e262a81-5af3-43b2-9977-a6a547a1937c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ee11430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:41.038092 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e262a81-5af3-43b2-9977-a6a547a1937c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/607a8946-95bc-4345-be89-ce6a825da235" status: 200 len: 661 microversion: 2.1 time: 0.111294 Jun 16 18:33:41.046032 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 695/1342] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:33:40 2022] GET /compute/v2.1/images/607a8946-95bc-4345-be89-ce6a825da235 => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:41.053533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8855b6e-9c26-488f-9c34-de40956228cf tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ed5edc0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:41.149767 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f8855b6e-9c26-488f-9c34-de40956228cf tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/607a8946-95bc-4345-be89-ce6a825da235" status: 200 len: 661 microversion: 2.1 time: 0.102585 Jun 16 18:33:41.155301 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 696/1343] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:33:41 2022] GET /compute/v2.1/images/607a8946-95bc-4345-be89-ce6a825da235 => generated 661 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:41.174331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:41.177262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:41.202336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:41.204642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:41.215511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:41.216232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:41.662380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:41.677036 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5842ae6-6144-4b51-a386-b4c0343d4eb0 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 1.279961 Jun 16 18:33:41.688498 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 648/1344] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:40 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:41.694488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:41.695196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:41.711345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:41.711816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:41.712634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:41.713082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:41.815938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:41.828900 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f224f90b-2282-4924-996e-2788c7c2da41 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.672208 Jun 16 18:33:41.831990 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 697/1345] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:41 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:42.663048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-37d3674d-6998-4185-b8ce-5420dd25b01e req-2d87f33c-36c8-4e64-8061-ffb5de160df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47fbd7d-f805-4344-a460-290bb5446846", "name": "network-vif-plugged", "status": "completed", "tag": "d2024d90-2975-4da0-a55d-361d7d8a78b3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:42.722785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-37d3674d-6998-4185-b8ce-5420dd25b01e req-2d87f33c-36c8-4e64-8061-ffb5de160df9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:42.723244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-37d3674d-6998-4185-b8ce-5420dd25b01e req-2d87f33c-36c8-4e64-8061-ffb5de160df9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:42.758074 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-37d3674d-6998-4185-b8ce-5420dd25b01e req-2d87f33c-36c8-4e64-8061-ffb5de160df9 service nova] Creating event network-vif-plugged:d2024d90-2975-4da0-a55d-361d7d8a78b3 for instance a47fbd7d-f805-4344-a460-290bb5446846 on n-h1-846209-2 Jun 16 18:33:42.774531 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-37d3674d-6998-4185-b8ce-5420dd25b01e req-2d87f33c-36c8-4e64-8061-ffb5de160df9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116584 Jun 16 18:33:42.784041 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 698/1346] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:42.801299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:42.805263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:42.829529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:42.830296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:42.834298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:42.837480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:42.942083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:42.983960 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-892c7ba7-6e58-473b-8542-3b897f74c208 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1332 microversion: 2.1 time: 1.293193 Jun 16 18:33:43.006865 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 649/1347] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:41 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1332 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:43.027450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:43.028483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:43.056852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:43.066928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:43.075029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:43.075992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:43.332190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:43.351401 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef91768e-76dc-4cb7-9a67-722e2559d6c7 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 0.565555 Jun 16 18:33:43.352780 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 699/1348] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:42 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:43.359782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a9ce5b72-b0a2-4a5b-8ec2-66434ccd18f4 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ed590d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:43.434036 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a9ce5b72-b0a2-4a5b-8ec2-66434ccd18f4 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/1e4aaee4-cd3a-4bee-b967-58dac8d5cf7e" status: 200 len: 661 microversion: 2.1 time: 0.079389 Jun 16 18:33:43.435452 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 700/1349] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:33:43 2022] GET /compute/v2.1/images/1e4aaee4-cd3a-4bee-b967-58dac8d5cf7e => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:43.463791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a4119635-6fc2-42f6-8eef-f672d6d211de req-e501ae71-a802-476a-9ea7-9a5ff64379c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "name": "network-vif-unplugged", "status": "completed", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:43.483900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a4119635-6fc2-42f6-8eef-f672d6d211de req-e501ae71-a802-476a-9ea7-9a5ff64379c1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:43.484352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a4119635-6fc2-42f6-8eef-f672d6d211de req-e501ae71-a802-476a-9ea7-9a5ff64379c1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:43.505107 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a4119635-6fc2-42f6-8eef-f672d6d211de req-e501ae71-a802-476a-9ea7-9a5ff64379c1 service nova] Creating event network-vif-unplugged:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h2-846209-2 Jun 16 18:33:43.513950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-a4119635-6fc2-42f6-8eef-f672d6d211de req-e501ae71-a802-476a-9ea7-9a5ff64379c1 service nova] Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:33:43.528504 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a4119635-6fc2-42f6-8eef-f672d6d211de req-e501ae71-a802-476a-9ea7-9a5ff64379c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091267 Jun 16 18:33:43.530980 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 701/1350] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:43.539030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2efd694f-9bda-45d7-b234-34c047011686 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ed59f70>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:43.540250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:43.570785 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e60c4f9f-17ba-4c44-9041-7ba8042e61d5 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1318 microversion: 2.1 time: 0.555774 Jun 16 18:33:43.580613 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 650/1351] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:43 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:43.613712 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2efd694f-9bda-45d7-b234-34c047011686 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/1e4aaee4-cd3a-4bee-b967-58dac8d5cf7e" status: 200 len: 661 microversion: 2.1 time: 0.079955 Jun 16 18:33:43.630130 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 702/1352] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:33:43 2022] GET /compute/v2.1/images/1e4aaee4-cd3a-4bee-b967-58dac8d5cf7e => generated 661 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:43.749025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-537438956", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:43.944490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:44.040666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:44.041494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:44.056839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:44.057314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:44.067527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:44.073446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:44.390425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:44.402303 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-08de4e80-fd85-42e1-952e-78c622cf541e tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1537 microversion: 2.1 time: 0.373771 Jun 16 18:33:44.402880 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 703/1353] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:44 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1537 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:44.420390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:44.421066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:44.433373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:44.433850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:44.434665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:44.438763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:44.659369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:44.660019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:44.660535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:44.660962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:44.661385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:44.679532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:44.680331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:44.708911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:44.713616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:44.797046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Getting quotas for project 9052d541d3ef42d7922200d19150f9b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:44.816425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Getting quotas for user 16aaf7f1bd5c4e8491f60046adb9e0a5 and project 9052d541d3ef42d7922200d19150f9b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:44.865269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:44.883550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:44.951081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:44.952144 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-41c61cc4-49b6-4aea-a15f-37376b45480f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210825 Jun 16 18:33:44.967513 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 651/1354] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:33:44.984417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e972979-d8d7-406e-9203-4af310dbf483 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'create', calling method: .version_select at 0x7f866f1bd8b0>, body: {"pool": "3ad5ca60-7a28-42cd-a61b-5c333cdc1258"} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:44.994440 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c245ccb-ebf5-410f-81ce-4c765eb83011 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 0.587183 Jun 16 18:33:44.998410 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 704/1355] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:44 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:45.019784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:45.022549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:45.046794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:45.046794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:45.050872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:45.054282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:46.424880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:46.437618 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d17ee170-f103-46a2-a7e8-d98bb9992841 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1467 microversion: 2.1 time: 1.435240 Jun 16 18:33:46.438337 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 705/1356] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:44 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1467 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:46.444146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-698118067", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:46.563340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:47.036300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:47.036738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:47.037741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:47.038405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:47.039008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:47.056255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:47.058505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:47.059918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:47.060549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:47.088078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Getting quotas for project 9052d541d3ef42d7922200d19150f9b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:47.120743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Getting quotas for user 16aaf7f1bd5c4e8491f60046adb9e0a5 and project 9052d541d3ef42d7922200d19150f9b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:47.156709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:47.160852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:47.277961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-897087b2-6252-4422-b124-efda8429a731 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838273 Jun 16 18:33:47.284810 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 706/1357] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:33:47.291158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-dc9a5177-6ae0-4a6b-9f5f-5732c636d65a req-f6b8996b-8796-4242-b609-5e2e1e3d6877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:47.332248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dc9a5177-6ae0-4a6b-9f5f-5732c636d65a req-f6b8996b-8796-4242-b609-5e2e1e3d6877 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:47.332741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dc9a5177-6ae0-4a6b-9f5f-5732c636d65a req-f6b8996b-8796-4242-b609-5e2e1e3d6877 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:47.359913 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-dc9a5177-6ae0-4a6b-9f5f-5732c636d65a req-f6b8996b-8796-4242-b609-5e2e1e3d6877 service nova] Creating event network-changed:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h2-846209-2 Jun 16 18:33:47.386468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-dc9a5177-6ae0-4a6b-9f5f-5732c636d65a req-f6b8996b-8796-4242-b609-5e2e1e3d6877 service nova] Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 18:33:47.420456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-dc9a5177-6ae0-4a6b-9f5f-5732c636d65a req-f6b8996b-8796-4242-b609-5e2e1e3d6877 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139992 Jun 16 18:33:47.434236 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 707/1358] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:47.459377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:47.460662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:47.485659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:47.487188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:47.488560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:47.489257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:48.150226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:48.159068 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a3b84bc-e82b-4a06-8826-c210003d1b84 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1470 microversion: 2.1 time: 0.721274 Jun 16 18:33:48.161129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 708/1359] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:47 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1470 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:48.800798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1962192698", "block_migration": true, "disk_over_commit": false}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:48.802315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:48.843253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:48.844783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:48.850364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:48.851430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:48.958766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lazy-loading 'flavor' on Instance uuid a47fbd7d-f805-4344-a460-290bb5446846 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:33:48.995384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Going to try to live migrate instance to tempest-host-1962192698 {{(pid=119206) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:33:49.007905 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] HTTP exception thrown: Compute host tempest-host-1962192698 could not be found. Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Request method failure captured: Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846/action HTTP/1.1 Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 107 Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dqMGY5hkcGRk6-N36_9pnkJWqkPMZHhVqhHlkhksfA1O0Vvx-lSHxEATM815btuqlRdscKyWwjlWQXXh0309eP3oi3DLmR831eijDJxB5-xZHZqVwFqQ75xHscXBgeqt2Ao7lOk1Fk0dow0nZ5Z4WK-ok965rO1C-dEKYTOT8Pc9I Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6f6b20d18bd1426fb7601af882467b34 Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveMigrationNegativeTest-1034999695 Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:33:49.019575 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f6b20d18bd1426fb7601af882467b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f6b20d18bd1426fb7601af882467b34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f6b20d18bd1426fb7601af882467b34", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f6b20d18bd1426fb7601af882467b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveMigrationNegativeTest-1034999695 Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6f6b20d18bd1426fb7601af882467b34 Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1034999695 Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveMigrationNegativeTest-1034999695-project-admin Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 48dd1bb4ab054149bbf221eb4f8114c2 Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveMigrationNegativeTest-1034999695-project-admin Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: {"os-migrateLive": {"host": "tempest-host-1962192698", "block_migration": true, "disk_over_commit": false}} Jun 16 18:33:49.021457 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: exception: Compute host tempest-host-1962192698 could not be found. Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a47fbd7d-f805-4344-a460-290bb5446846', 'body': {'os-migrateLive': {'host': 'tempest-host-1962192698', 'block_migration': True, 'disk_over_commit': False}}} Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:33:49.022494 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1962192698 could not be found. Jun 16 18:33:49.024283 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1962192698 could not be found. Jun 16 18:33:49.025876 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1962192698 could not be found. Jun 16 18:33:49.027446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:33:49.040817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Returning 400 to user: Compute host tempest-host-1962192698 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:49.043525 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51abec1b-136f-4b89-a0b9-3dbc290cf111 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846/action" status: 400 len: 100 microversion: 2.1 time: 0.878421 Jun 16 18:33:49.044725 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 709/1360] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Jun 16 18:33:48 2022] POST /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846/action => generated 100 bytes in 881 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:33:49.058540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:49.063997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:49.144607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:49.145143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:49.150703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:49.151633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:49.219128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:49.624030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:49.666334 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-586b8ed5-22f7-41c7-9ed0-31b271182a91 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1269 microversion: 2.1 time: 0.596346 Jun 16 18:33:49.669378 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 710/1361] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:49 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1269 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:49.699235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:49.700100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:49.722288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:49.722743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:49.723534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:49.742742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:50.338493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 39d14e76-7250-4441-98dc-a361072f16a9 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:33:50.391169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6857939-e1f1-4018-9ad2-dda0d61d8d06 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 2345 microversion: 2.25 time: 0.718548 Jun 16 18:33:50.411047 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 711/1362] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:49 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 2345 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:50.426237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:50.429662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:50.445528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:50.448345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:50.450528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:50.452435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.047619 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e972979-d8d7-406e-9203-4af310dbf483 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.078471 Jun 16 18:33:51.050448 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 652/1363] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:33:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:51.066926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:51.073800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:51.109981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.110308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.114874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.115591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.410426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:51.426407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24d605c4-f0ae-4dc0-8b1f-240d092bf60b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1467 microversion: 2.1 time: 1.009895 Jun 16 18:33:51.433163 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 712/1364] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:50 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1467 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:51.447953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-80565a79-e331-40e5-aa99-e6ab7d9110a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:51.451117 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:33:51.451117 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:33:51.458390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80565a79-e331-40e5-aa99-e6ab7d9110a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.459152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80565a79-e331-40e5-aa99-e6ab7d9110a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.469458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80565a79-e331-40e5-aa99-e6ab7d9110a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.469948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80565a79-e331-40e5-aa99-e6ab7d9110a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.541025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-80565a79-e331-40e5-aa99-e6ab7d9110a7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.106068 Jun 16 18:33:51.551774 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 713/1365] 10.222.0.27 () {60 vars in 1216 bytes} [Thu Jun 16 18:33:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:33:51.558643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:51.559618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:51.570879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.574110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.575251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.575935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.770682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:51.772085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:51.807379 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cc02a749-1e31-43f8-a608-0d9ab45c4659 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1463 microversion: 2.1 time: 0.753099 Jun 16 18:33:51.809816 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 653/1366] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:51 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1463 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:51.810361 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b80a8c19-6a7d-4661-8d2b-08dbb92aae31 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1275 microversion: 2.1 time: 0.255477 Jun 16 18:33:51.819039 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 714/1367] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:51 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:51.828821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.121"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:51.832670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1341734098", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:51.846747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:51.858898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.862241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.864253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.875089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.936170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Acquired lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:33:51.994192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:53.879714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:53.880812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:53.881556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:53.885001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:53.885816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:53.951831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:53.954307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:53.958559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:53.959860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:54.066967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Getting quotas for project 79372073be7047c1a4b57c6a7c9921e3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:54.107092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Getting quotas for user 3951b78564ed40e09eba285f35e4db6b and project 79372073be7047c1a4b57c6a7c9921e3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:54.184228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:54.190780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:54.301587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9fcee106-1d9c-411a-b644-90fe79f98b80 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480711 Jun 16 18:33:54.307594 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 715/1368] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:33:54.747009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:54.841476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:54.948850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dd934eca-cb00-4578-a684-ae240d6c18c8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:54.960499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dd934eca-cb00-4578-a684-ae240d6c18c8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:54.998662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd934eca-cb00-4578-a684-ae240d6c18c8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:55.001228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd934eca-cb00-4578-a684-ae240d6c18c8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:55.006892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd934eca-cb00-4578-a684-ae240d6c18c8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:55.011947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd934eca-cb00-4578-a684-ae240d6c18c8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:56.177219 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dd934eca-cb00-4578-a684-ae240d6c18c8 tempest-MigrationsAdminTest-1132488612 tempest-MigrationsAdminTest-1132488612-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1614 microversion: 2.1 time: 1.868181 Jun 16 18:33:56.194341 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 716/1369] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:54 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1614 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:56.210087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:56.217537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:56.246046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:56.247734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:56.251384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:56.256721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:56.905332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:56.916905 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-619baf45-22c7-42df-9e73-53c1506f5546 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 0.720924 Jun 16 18:33:56.918172 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 717/1370] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:56 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:56.933131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-597c3b2e-10a0-41b5-8130-e9e51a4b793a req-911885f9-4c8e-4f9b-a6d1-b9714520ca60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "name": "network-vif-plugged", "status": "completed", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:56.952523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-597c3b2e-10a0-41b5-8130-e9e51a4b793a req-911885f9-4c8e-4f9b-a6d1-b9714520ca60 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:56.953369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-597c3b2e-10a0-41b5-8130-e9e51a4b793a req-911885f9-4c8e-4f9b-a6d1-b9714520ca60 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:56.997021 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-597c3b2e-10a0-41b5-8130-e9e51a4b793a req-911885f9-4c8e-4f9b-a6d1-b9714520ca60 service nova] Creating event network-vif-plugged:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h2-846209-2 Jun 16 18:33:57.007654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-597c3b2e-10a0-41b5-8130-e9e51a4b793a req-911885f9-4c8e-4f9b-a6d1-b9714520ca60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086880 Jun 16 18:33:57.012576 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 718/1371] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:57.015770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-558f1076-bd71-4db6-8499-5f344f4b7bff tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:57.016989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-558f1076-bd71-4db6-8499-5f344f4b7bff tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:57.027726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558f1076-bd71-4db6-8499-5f344f4b7bff tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.028497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558f1076-bd71-4db6-8499-5f344f4b7bff tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.029319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558f1076-bd71-4db6-8499-5f344f4b7bff tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.029968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558f1076-bd71-4db6-8499-5f344f4b7bff tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.401173 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-558f1076-bd71-4db6-8499-5f344f4b7bff tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1812 microversion: 2.1 time: 0.391243 Jun 16 18:33:57.402314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 719/1372] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:57 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1812 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:57.417928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:57.419016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:57.452233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.452698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.453516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.454279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.729504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:57.747601 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-db5bd5f8-d688-4a32-8c58-ed75719154cf tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1271 microversion: 2.1 time: 0.336102 Jun 16 18:33:57.750131 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 720/1373] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:57 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1271 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:57.770226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b880e296-9358-400b-909b-e83853df2540 req-64125851-b69f-4abc-82f7-49ce45d30dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0271c7ba-7672-4448-8a5f-33e3150857fd", "tag": "c6d88fb8-bcea-40fb-9158-9244e91ce3f1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:57.805189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b880e296-9358-400b-909b-e83853df2540 req-64125851-b69f-4abc-82f7-49ce45d30dab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.827080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b880e296-9358-400b-909b-e83853df2540 req-64125851-b69f-4abc-82f7-49ce45d30dab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.885758 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b880e296-9358-400b-909b-e83853df2540 req-64125851-b69f-4abc-82f7-49ce45d30dab service nova] Creating event network-changed:c6d88fb8-bcea-40fb-9158-9244e91ce3f1 for instance 0271c7ba-7672-4448-8a5f-33e3150857fd on n-h2-846209-2 Jun 16 18:33:57.904615 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b880e296-9358-400b-909b-e83853df2540 req-64125851-b69f-4abc-82f7-49ce45d30dab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142744 Jun 16 18:33:57.910859 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 721/1374] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:57.922921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:57.935582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:57.960581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.961741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.963573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.964778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:58.044881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:33:58.194142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Building network info cache for instance {{(pid=119207) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:33:58.246474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:58.273641 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-95c26e20-7366-4c49-ae7b-3c4fa6fca2ad tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 204 len: 0 microversion: 2.1 time: 0.353245 Jun 16 18:33:58.277557 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 722/1375] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:33:57 2022] DELETE /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:33:58.294531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59b841f1-a925-4862-baab-fbe2919bd083 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8be85c53-5250-4280-a95a-350696059599", "device": "/dev/xvdb"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:58.303784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59b841f1-a925-4862-baab-fbe2919bd083 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:58.328507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b841f1-a925-4862-baab-fbe2919bd083 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:58.329877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b841f1-a925-4862-baab-fbe2919bd083 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:58.332191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b841f1-a925-4862-baab-fbe2919bd083 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:58.333341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b841f1-a925-4862-baab-fbe2919bd083 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:59.212948 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59b841f1-a925-4862-baab-fbe2919bd083 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "POST /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.932348 Jun 16 18:33:59.218024 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 723/1376] 10.222.0.27 () {62 vars in 1363 bytes} [Thu Jun 16 18:33:58 2022] POST /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:33:59.257599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2fb9ed5-8a2c-4e12-9141-aa63d8731102 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:59.296151 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:33:59.296151 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:33:59.300468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fb9ed5-8a2c-4e12-9141-aa63d8731102 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:59.304449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fb9ed5-8a2c-4e12-9141-aa63d8731102 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:59.305807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fb9ed5-8a2c-4e12-9141-aa63d8731102 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:59.315439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2fb9ed5-8a2c-4e12-9141-aa63d8731102 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:59.486740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2fb9ed5-8a2c-4e12-9141-aa63d8731102 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.250461 Jun 16 18:33:59.502460 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 724/1377] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:33:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:59.502984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:59.504842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:59.537144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:59.538077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:59.543533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:59.544368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.433363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Updating instance_info_cache with network_info: [{"id": "df861561-6bdf-4f2b-8ac3-c070c3621f0d", "address": "fa:16:3e:86:7a:dc", "network": {"id": "378157bc-3224-41cb-9ae7-5658c29da6c5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1686821723-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6950ba42a3434feca292d74540c20ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdf861561-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119207) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:34:01.476367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:01.498578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Releasing lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:34:01.500302 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8a679d31-63a0-4ff5-80c4-103dfb91d4d7 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action" status: 202 len: 0 microversion: 2.1 time: 9.688034 Jun 16 18:34:01.503560 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 654/1378] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:33:51 2022] POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action => generated 0 bytes in 9692 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:34:01.509249 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c178da1b-e8e4-421f-8cf6-23b7aadbae99 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 2.012325 Jun 16 18:34:01.515317 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 725/1379] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:59 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:01.533377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:01.541325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e2d0b2e7-07f4-4567-9e29-f4f312c046ab req-ee35d763-b6c1-4274-9f29-f96931dbc1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037688ff-f5d2-41d0-a06e-24efe64e927f", "tag": "df861561-6bdf-4f2b-8ac3-c070c3621f0d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:01.542193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:01.559994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.560865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.562039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.567930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.585969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e2d0b2e7-07f4-4567-9e29-f4f312c046ab req-ee35d763-b6c1-4274-9f29-f96931dbc1cf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.596905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e2d0b2e7-07f4-4567-9e29-f4f312c046ab req-ee35d763-b6c1-4274-9f29-f96931dbc1cf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.647135 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e2d0b2e7-07f4-4567-9e29-f4f312c046ab req-ee35d763-b6c1-4274-9f29-f96931dbc1cf service nova] Creating event network-changed:df861561-6bdf-4f2b-8ac3-c070c3621f0d for instance 037688ff-f5d2-41d0-a06e-24efe64e927f on n-h1-846209-2 Jun 16 18:34:01.669018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e2d0b2e7-07f4-4567-9e29-f4f312c046ab req-ee35d763-b6c1-4274-9f29-f96931dbc1cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162925 Jun 16 18:34:01.670634 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 655/1380] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:01.698347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:01.699625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:01.728102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.728850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.729710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.736227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.834103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:02.331904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:02.364707 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d0c44577-11ff-4c84-b648-1bf216e92b47 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1277 microversion: 2.1 time: 0.691985 Jun 16 18:34:02.388121 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 656/1381] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:01 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1277 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:02.413237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d95d5feb-ead9-484a-b1f1-0d88e2f8c073 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'create', calling method: .version_select at 0x7f866f1bca60>, body: {"pool": "3ad5ca60-7a28-42cd-a61b-5c333cdc1258"} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:02.748283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:02.797199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c530394f-aaaa-4c02-aa8d-dff25d665910 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1469 microversion: 2.1 time: 1.279320 Jun 16 18:34:02.805123 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 726/1382] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:01 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1469 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:02.845166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:02.852873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:02.884014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:02.885231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:02.886892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:02.889450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:02.943468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:03.800631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:03.819836 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88d508d3-9360-4a5e-9520-ee98716247e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 1.009475 Jun 16 18:34:03.820632 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 727/1383] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:02 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:03.844325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:03.844997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:03.878709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:03.879284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:03.880294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:03.880852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.141119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:04.321444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:04.338355 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5a11fe2d-4fc9-42ff-8c89-aa462986a114 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 0.510894 Jun 16 18:34:04.357630 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 728/1384] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:03 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:04.368657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-941a0a43-45ea-4ae9-9fe1-b728e670437d req-325c033b-e408-4258-bf5f-1236c3fe35fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5779c9c3-e87d-4f34-927f-80dcc658a1ac", "tag": "15a9a46d-c311-4249-9ee6-e83453d113e4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:04.392021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-941a0a43-45ea-4ae9-9fe1-b728e670437d req-325c033b-e408-4258-bf5f-1236c3fe35fa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:04.398603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-941a0a43-45ea-4ae9-9fe1-b728e670437d req-325c033b-e408-4258-bf5f-1236c3fe35fa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.426162 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-941a0a43-45ea-4ae9-9fe1-b728e670437d req-325c033b-e408-4258-bf5f-1236c3fe35fa service nova] Creating event network-changed:15a9a46d-c311-4249-9ee6-e83453d113e4 for instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac on n-h2-846209-2 Jun 16 18:34:04.448046 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-941a0a43-45ea-4ae9-9fe1-b728e670437d req-325c033b-e408-4258-bf5f-1236c3fe35fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086389 Jun 16 18:34:04.449320 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 729/1385] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:04.466529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:04.469521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:04.485480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:04.486309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.490197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:04.491035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:05.588022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:05.619092 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6df75d11-1ffb-4509-8de3-7ecc72c83421 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1469 microversion: 2.1 time: 1.167535 Jun 16 18:34:05.621973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 730/1386] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:04 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1469 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:05.632219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d53772a-c58b-42dd-ac85-8d0063262bfe tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dd71fa1-3a12-4fcb-9e7b-60d6a78d1b98", "device": "/dev/xvdb"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:05.638151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d53772a-c58b-42dd-ac85-8d0063262bfe tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:05.657420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d53772a-c58b-42dd-ac85-8d0063262bfe tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:05.657942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d53772a-c58b-42dd-ac85-8d0063262bfe tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:05.659590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d53772a-c58b-42dd-ac85-8d0063262bfe tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:05.664024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d53772a-c58b-42dd-ac85-8d0063262bfe tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:06.762983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d53772a-c58b-42dd-ac85-8d0063262bfe tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "POST /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.134775 Jun 16 18:34:06.780782 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 731/1387] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:34:05 2022] POST /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:06.820874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:06.825732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:06.861241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:06.867744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:06.868785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:06.870164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.360572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:07.395679 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d2e7a4c-7d30-47b4-b64b-68d67f38c81e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 0.618480 Jun 16 18:34:07.401436 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 732/1388] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:06 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:07.447433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-be9994a3-f610-4c28-8f88-be66922b2cb8 req-4d5f3f1b-3457-4676-8e95-468c725c7806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0271c7ba-7672-4448-8a5f-33e3150857fd", "name": "network-vif-plugged", "status": "completed", "tag": "c6d88fb8-bcea-40fb-9158-9244e91ce3f1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:07.514420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-be9994a3-f610-4c28-8f88-be66922b2cb8 req-4d5f3f1b-3457-4676-8e95-468c725c7806 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.515687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-be9994a3-f610-4c28-8f88-be66922b2cb8 req-4d5f3f1b-3457-4676-8e95-468c725c7806 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.616126 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-be9994a3-f610-4c28-8f88-be66922b2cb8 req-4d5f3f1b-3457-4676-8e95-468c725c7806 service nova] Creating event network-vif-plugged:c6d88fb8-bcea-40fb-9158-9244e91ce3f1 for instance 0271c7ba-7672-4448-8a5f-33e3150857fd on n-h2-846209-2 Jun 16 18:34:07.644577 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-be9994a3-f610-4c28-8f88-be66922b2cb8 req-4d5f3f1b-3457-4676-8e95-468c725c7806 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236114 Jun 16 18:34:07.645701 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 733/1389] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:07.700469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:07.701737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:07.746335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.747130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.748524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.749297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:08.889594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:08.906679 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-638024ee-dbcc-4694-92c8-d35ff5f79958 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 1.250921 Jun 16 18:34:08.908800 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 734/1390] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:07 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:08.927650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:08.929607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:08.940697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:08.946279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:08.950601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:08.951447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.022895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.023369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.038022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lazy-loading 'fault' on Instance uuid a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:09.152007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:09.164941 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d712e981-bb94-4cbd-b6e6-a3e2cb3454b5 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 200 len: 1303 microversion: 2.1 time: 0.252186 Jun 16 18:34:09.165636 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 735/1391] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:08 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:09.192997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:09.195875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:09.223288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.224321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.226331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.227231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.329718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:09.689950 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d95d5feb-ead9-484a-b1f1-0d88e2f8c073 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.297643 Jun 16 18:34:09.690815 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 657/1392] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:34:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:09.696580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e0248f55-4e7e-4487-8955-58cefcc9dbb9 req-3cd7460b-9677-4864-bb64-b469aed81db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5", "name": "network-vif-deleted", "tag": "5093c330-433f-457a-b191-8d5428d0661a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:09.718657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:09.732082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:09.733838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e0248f55-4e7e-4487-8955-58cefcc9dbb9 req-3cd7460b-9677-4864-bb64-b469aed81db5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.734453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e0248f55-4e7e-4487-8955-58cefcc9dbb9 req-3cd7460b-9677-4864-bb64-b469aed81db5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.756375 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e59fef1-fddc-4921-9d32-9f110dd8e435 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 0.584137 Jun 16 18:34:09.769949 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 736/1393] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:09 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:09.775208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.129"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:09.775208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:09.775681 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e0248f55-4e7e-4487-8955-58cefcc9dbb9 req-3cd7460b-9677-4864-bb64-b469aed81db5 service nova] Creating event network-vif-deleted:5093c330-433f-457a-b191-8d5428d0661a for instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 on n-h2-846209-2 Jun 16 18:34:09.789553 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e0248f55-4e7e-4487-8955-58cefcc9dbb9 req-3cd7460b-9677-4864-bb64-b469aed81db5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097346 Jun 16 18:34:09.792015 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 658/1394] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:09.795378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.795838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.797607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.798040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.922309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Acquired lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:34:09.940497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:09.941753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:09.959962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.960601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.961474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:09.961942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.605613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:10.641814 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-88b402aa-04ba-4ed7-9d20-d5bf779c87c3 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 0.708490 Jun 16 18:34:10.644247 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 659/1395] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:09 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:10.650231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:10.651611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:10.664534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.665419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.668318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.670691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.719292 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] HTTP exception thrown: Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 could not be found. Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Request method failure captured: Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 HTTP/1.1 Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YsmyNMDQCVX1ur-Gu0UeJlHlfQyryzy0d7tNloScIuoBNLkFcwzDKfT3hoZST_PdWtygD9JMUBTRNaQEq7qy1RHFQGNOWWpsyMGRFAR9AHJIZlDA4gHPGmCMa-Y53I5_ev0Xb1SiNlftszIypGIYgc1lTa5U-bgtRfT7eGHKjo6rQ Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:34:10.723372 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2978681eacda4da685a087c0b1025df3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2978681eacda4da685a087c0b1025df3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 209d0e879aea45269c56a7c7d9869b23 Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 could not be found. Jun 16 18:34:10.725243 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5'} Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 could not be found. Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:10.726186 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 could not be found. Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 could not be found. Jun 16 18:34:10.727716 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.730770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Returning 404 to user: Instance a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:10.733661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf557769-210e-4bbf-9ead-a42fdb9af49b tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5" status: 404 len: 111 microversion: 2.1 time: 0.087740 Jun 16 18:34:10.735330 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 660/1396] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:10 2022] GET /compute/v2.1/servers/a664f8a0-d2ac-4f9f-a6d3-4cc8cd1a45e5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:10.747044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:10.747801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:10.766851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.768867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.770240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.770428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258.", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:34:10.770864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Releasing lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:34:10.771420 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258. Jun 16 18:34:10.771420 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-fba67232-2d09-42a4-a209-c06e9c3531fa'] Jun 16 18:34:10.772930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Request method failure captured: Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action HTTP/1.1 Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 46 Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dwRjOp8ons6MKXGE0S2FvlpvwxGAAEWqRWE9z4vPNQ2pqWabV7oWLVAsKKqRh9mMY26N8TyfFBbWS3_uxd_m28317siVtS1yCCFX4MyGo8gc1KSPzwpZGEBSlVTq-pezGzEvRBqFFfxq2agB6bWu0MpzHLHuWUuvaQnuJ3dupn5ho Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:34:10.776166 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6950ba42a3434feca292d74540c20ea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d0ef6fec2fd46c68afb5d3631c4391d Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: {"addFloatingIp": {"address": "172.25.0.129"}} Jun 16 18:34:10.777766 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258. Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-fba67232-2d09-42a4-a209-c06e9c3531fa'] Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '037688ff-f5d2-41d0-a06e-24efe64e927f', 'body': {'addFloatingIp': {'address': '172.25.0.129'}}} Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:34:10.778682 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:34:10.779925 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258. Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba67232-2d09-42a4-a209-c06e9c3531fa'] Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258. Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba67232-2d09-42a4-a209-c06e9c3531fa'] Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.781864 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258. Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba67232-2d09-42a4-a209-c06e9c3531fa'] Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.785350 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258. Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fba67232-2d09-42a4-a209-c06e9c3531fa'] Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Returning 400 to user: Cannot associate floating IP 172.25.0.129 (39b2635d-b79c-4d3b-bbe6-c0b7050a22ea) with port df861561-6bdf-4f2b-8ac3-c070c3621f0d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 3ad5ca60-7a28-42cd-a61b-5c333cdc1258. Jun 16 18:34:10.788040 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-fba67232-2d09-42a4-a209-c06e9c3531fa'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:10.790547 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-393410c1-ad5c-42e8-8e40-c891bfe60f22 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action" status: 400 len: 382 microversion: 2.1 time: 1.017277 Jun 16 18:34:10.790547 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 737/1397] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:09 2022] POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action => generated 382 bytes in 1026 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:34:10.793525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:10.794242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:10.808221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.809198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.809515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.809998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.848380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:11.087877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:11.091893 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-021bce9f-954b-4c30-a884-b6023d716853 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 204 len: 0 microversion: 2.1 time: 0.349981 Jun 16 18:34:11.094972 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 661/1398] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:10 2022] DELETE /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:11.112581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ec8f7dd-ddf2-4b79-a8c6-d4cd7d321000 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '.version_select at 0x7f866f2ac280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:11.124151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-379df4f9-6755-4228-b37d-fdd6af43b0ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 0.333012 Jun 16 18:34:11.126424 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 738/1399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:10 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:11.145978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:11.148460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:11.174841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:11.176998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:11.180330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:11.187168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:11.838507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:11.855217 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b15db31-e56e-4e1b-84d4-fccecee97f13 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1534 microversion: 2.1 time: 0.725901 Jun 16 18:34:11.855754 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 739/1400] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:11 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1534 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:11.863429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9961672e-55c8-4ea2-aeaf-b5f16787fd24 req-94755502-4d82-4869-8481-09adb3a84746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5779c9c3-e87d-4f34-927f-80dcc658a1ac", "name": "network-vif-plugged", "status": "completed", "tag": "15a9a46d-c311-4249-9ee6-e83453d113e4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:11.888645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9961672e-55c8-4ea2-aeaf-b5f16787fd24 req-94755502-4d82-4869-8481-09adb3a84746 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:11.889150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9961672e-55c8-4ea2-aeaf-b5f16787fd24 req-94755502-4d82-4869-8481-09adb3a84746 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:11.928334 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9961672e-55c8-4ea2-aeaf-b5f16787fd24 req-94755502-4d82-4869-8481-09adb3a84746 service nova] Creating event network-vif-plugged:15a9a46d-c311-4249-9ee6-e83453d113e4 for instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac on n-h2-846209-2 Jun 16 18:34:11.935956 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9961672e-55c8-4ea2-aeaf-b5f16787fd24 req-94755502-4d82-4869-8481-09adb3a84746 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077603 Jun 16 18:34:11.938034 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 740/1401] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:11.946457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:11.948926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:11.961290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:11.962177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:11.967217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:11.968625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:12.873353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:12.896618 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2a558bc-ab8f-4fba-b262-f8bdf9831eba tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 0.956583 Jun 16 18:34:12.903719 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 741/1402] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:11 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:12.914166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a83be951-6c28-439f-a1f5-545bb1d5fc66 req-53885d85-68dc-4cea-a964-83a87a7b6667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa21ace-bb5c-437c-a8e8-5ebc39d8d568", "tag": "00f32dbf-86c6-4af9-ade9-144ec3209afc"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:12.960685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a83be951-6c28-439f-a1f5-545bb1d5fc66 req-53885d85-68dc-4cea-a964-83a87a7b6667 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:12.961852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a83be951-6c28-439f-a1f5-545bb1d5fc66 req-53885d85-68dc-4cea-a964-83a87a7b6667 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:12.980488 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a83be951-6c28-439f-a1f5-545bb1d5fc66 req-53885d85-68dc-4cea-a964-83a87a7b6667 service nova] Creating event network-changed:00f32dbf-86c6-4af9-ade9-144ec3209afc for instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 on n-h2-846209-2 Jun 16 18:34:12.986989 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a83be951-6c28-439f-a1f5-545bb1d5fc66 req-53885d85-68dc-4cea-a964-83a87a7b6667 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080353 Jun 16 18:34:12.988171 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 742/1403] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:13.003649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:13.005541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:13.016074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.016825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.019295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.019974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.319109 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0ec8f7dd-ddf2-4b79-a8c6-d4cd7d321000 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/39b2635d-b79c-4d3b-bbe6-c0b7050a22ea" status: 202 len: 0 microversion: 2.1 time: 2.219501 Jun 16 18:34:13.325686 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 662/1404] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:34:11 2022] DELETE /compute/v2.1/os-floating-ips/39b2635d-b79c-4d3b-bbe6-c0b7050a22ea => generated 0 bytes in 2230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:34:13.326334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:13.332258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:13.333509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:13.337212 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61b5227b-0098-434a-8b0f-14db264a433e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 0.347469 Jun 16 18:34:13.340996 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 743/1405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:12 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:13.342513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.343171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.344147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.344779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.377792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.121"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:13.626810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:13.646748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.648778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.651587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.654655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:13.664182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.669838 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bc9c2e30-867f-4cea-8177-2e728ad32f07 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 200 len: 1534 microversion: 2.1 time: 0.342400 Jun 16 18:34:13.671253 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 663/1406] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:13 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 1534 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:13.930632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:13.931318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:13.959340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.959988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.960807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.961829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:14.701167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:14.718002 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28a25941-88e4-422f-9636-924cc9b5e56d tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 0.791924 Jun 16 18:34:14.724239 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 664/1407] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:13 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:14.745444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:14.746126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:14.756146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:14.756733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:14.757641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:14.758180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.304010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Acquired lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:34:15.598525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:15.624387 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3372c3d-55da-456f-84a6-dcd9c3872b2a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1317 microversion: 2.1 time: 0.885622 Jun 16 18:34:15.635547 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 665/1408] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:14 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:15.641050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:15.641700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:15.659687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.660156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.660967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.661415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.695408 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] HTTP exception thrown: Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 could not be found. Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Request method failure captured: Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 HTTP/1.1 Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YsmyNMDQCVX1ur-Gu0UeJlHlfQyryzy0d7tNloScIuoBNLkFcwzDKfT3hoZST_PdWtygD9JMUBTRNaQEq7qy1RHFQGNOWWpsyMGRFAR9AHJIZlDA4gHPGmCMa-Y53I5_ev0Xb1SiNlftszIypGIYgc1lTa5U-bgtRfT7eGHKjo6rQ Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:34:15.697237 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2978681eacda4da685a087c0b1025df3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2978681eacda4da685a087c0b1025df3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 209d0e879aea45269c56a7c7d9869b23 Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 could not be found. Jun 16 18:34:15.700112 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31'} Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 could not be found. Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:15.702549 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 could not be found. Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 could not be found. Jun 16 18:34:15.706050 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:15.710352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Returning 404 to user: Instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:15.710352 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-089de4f5-d06a-42f9-9af2-cf6daa05a847 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31" status: 404 len: 111 microversion: 2.1 time: 0.062132 Jun 16 18:34:15.710352 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 666/1409] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:15 2022] GET /compute/v2.1/servers/eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:15.710352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-39742ca3-ed8b-4264-a511-ae1aa5e3220f req-779ccdea-2b7e-46e9-a409-2a5d295a1a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31", "name": "network-vif-deleted", "tag": "c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:15.734706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-39742ca3-ed8b-4264-a511-ae1aa5e3220f req-779ccdea-2b7e-46e9-a409-2a5d295a1a2f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.734706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-39742ca3-ed8b-4264-a511-ae1aa5e3220f req-779ccdea-2b7e-46e9-a409-2a5d295a1a2f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.760834 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-39742ca3-ed8b-4264-a511-ae1aa5e3220f req-779ccdea-2b7e-46e9-a409-2a5d295a1a2f service nova] Creating event network-vif-deleted:c3bb5452-1bb4-4d71-95ec-8fbd3968c5b4 for instance eb0d4ed3-5ed8-43d3-9f94-9cab8b355c31 on n-h1-846209-2 Jun 16 18:34:15.775018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-39742ca3-ed8b-4264-a511-ae1aa5e3220f req-779ccdea-2b7e-46e9-a409-2a5d295a1a2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071792 Jun 16 18:34:15.776174 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 667/1410] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:15.783595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40970aa1-7828-446f-b0f6-214e87a8e920 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '.version_select at 0x7f866f1f74c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:15.834857 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-40970aa1-7828-446f-b0f6-214e87a8e920 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748357638" status: 202 len: 0 microversion: 2.1 time: 0.057316 Jun 16 18:34:15.835474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 668/1411] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748357638 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:34:15.840971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:15.841735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:15.859482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.859936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.860790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.861261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.425436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:16.436074 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0367f3d8-9031-47ac-9c18-b49676595b95 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 0.598999 Jun 16 18:34:16.446336 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 669/1412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:15 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:16.644629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:16.644629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:16.656021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.656496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.657330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.657773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:17.083754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:17.092717 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-82a1bef5-dbab-4035-a25a-ef4e82e0daf9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1466 microversion: 2.1 time: 0.453604 Jun 16 18:34:17.106372 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 670/1413] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:16 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1466 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:17.124469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:17.125831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:17.147152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:17.148655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:17.150054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:17.151725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:17.712575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:17.721701 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a919415e-2834-4d9e-949e-b8d064853155 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 200 len: 1466 microversion: 2.1 time: 0.601693 Jun 16 18:34:17.726088 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 671/1414] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:17 2022] GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 1466 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:17.743362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:17.744352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:17.760321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:17.761207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:17.762651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:17.766768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:17.816733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:17.989774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Building network info cache for instance {{(pid=119206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:34:17.994376 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-09cc5c4e-183e-4179-a377-bdb0c5a62eda tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 204 len: 0 microversion: 2.1 time: 0.266472 Jun 16 18:34:17.995552 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 672/1415] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:17 2022] DELETE /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:18.006275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:18.007617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:18.017052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:18.024672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:18.027171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:18.031477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:19.383402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:19.395968 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-469e582e-aa03-409a-bf36-c6680e447993 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 1.397902 Jun 16 18:34:19.397234 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 673/1416] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:17 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:19.418617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b2ebfe8-be26-48f8-ad58-c4dff6a58eab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2121347415"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:19.419722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7b2ebfe8-be26-48f8-ad58-c4dff6a58eab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:19.443338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b2ebfe8-be26-48f8-ad58-c4dff6a58eab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:19.443798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b2ebfe8-be26-48f8-ad58-c4dff6a58eab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:19.444687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b2ebfe8-be26-48f8-ad58-c4dff6a58eab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:19.445131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b2ebfe8-be26-48f8-ad58-c4dff6a58eab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.033970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:20.150188 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7b2ebfe8-be26-48f8-ad58-c4dff6a58eab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "POST /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd/action" status: 202 len: 0 microversion: 2.1 time: 0.741146 Jun 16 18:34:20.152537 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 674/1417] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:19 2022] POST /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd/action => generated 0 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:34:20.188782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:20.209296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:20.256226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.264365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.269352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.270671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.570950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:20.596593 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c25a6f1-f4ff-4361-9fa3-60d3ef59e3f9 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 200 len: 1425 microversion: 2.1 time: 0.438015 Jun 16 18:34:20.597475 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 675/1418] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:20 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 1425 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:20.615878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-68ae332c-d1df-4cfe-8daf-e0c4ad5b42e9 req-fa2eeaa9-0667-410a-a867-7573f24a0ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037688ff-f5d2-41d0-a06e-24efe64e927f", "tag": "df861561-6bdf-4f2b-8ac3-c070c3621f0d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:20.652914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-68ae332c-d1df-4cfe-8daf-e0c4ad5b42e9 req-fa2eeaa9-0667-410a-a867-7573f24a0ace service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.656199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-68ae332c-d1df-4cfe-8daf-e0c4ad5b42e9 req-fa2eeaa9-0667-410a-a867-7573f24a0ace service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.691841 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-68ae332c-d1df-4cfe-8daf-e0c4ad5b42e9 req-fa2eeaa9-0667-410a-a867-7573f24a0ace service nova] Creating event network-changed:df861561-6bdf-4f2b-8ac3-c070c3621f0d for instance 037688ff-f5d2-41d0-a06e-24efe64e927f on n-h1-846209-2 Jun 16 18:34:20.703901 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-68ae332c-d1df-4cfe-8daf-e0c4ad5b42e9 req-fa2eeaa9-0667-410a-a867-7573f24a0ace service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101127 Jun 16 18:34:20.718636 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 676/1419] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:20.730656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-cef5b271-01b0-4dc1-9d96-1c9de6479575 req-2655d8e1-8599-4e84-9db1-fd6dadf4a029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa21ace-bb5c-437c-a8e8-5ebc39d8d568", "name": "network-vif-plugged", "status": "completed", "tag": "00f32dbf-86c6-4af9-ade9-144ec3209afc"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:20.777787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cef5b271-01b0-4dc1-9d96-1c9de6479575 req-2655d8e1-8599-4e84-9db1-fd6dadf4a029 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.778698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cef5b271-01b0-4dc1-9d96-1c9de6479575 req-2655d8e1-8599-4e84-9db1-fd6dadf4a029 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.819013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-cef5b271-01b0-4dc1-9d96-1c9de6479575 req-2655d8e1-8599-4e84-9db1-fd6dadf4a029 service nova] Creating event network-vif-plugged:00f32dbf-86c6-4af9-ade9-144ec3209afc for instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 on n-h2-846209-2 Jun 16 18:34:20.843780 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-cef5b271-01b0-4dc1-9d96-1c9de6479575 req-2655d8e1-8599-4e84-9db1-fd6dadf4a029 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118453 Jun 16 18:34:20.847457 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 677/1420] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:20.871683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-181fee1c-20b1-424c-95df-f9a85e70e807 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1f7670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:21.026057 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-181fee1c-20b1-424c-95df-f9a85e70e807 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.177298 Jun 16 18:34:21.035320 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 678/1421] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:20 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:21.059690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:21.060755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:21.080137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:21.083036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:21.088230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:21.092701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:21.218908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Updating instance_info_cache with network_info: [{"id": "df861561-6bdf-4f2b-8ac3-c070c3621f0d", "address": "fa:16:3e:86:7a:dc", "network": {"id": "378157bc-3224-41cb-9ae7-5658c29da6c5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1686821723-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6950ba42a3434feca292d74540c20ea6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdf861561-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:34:21.224271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:21.255234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Releasing lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:34:21.261540 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8dbd60c-f245-414c-9a25-6df8e882e122 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action" status: 202 len: 0 microversion: 2.1 time: 7.919153 Jun 16 18:34:21.264764 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 744/1422] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:13 2022] POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action => generated 0 bytes in 7923 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:34:21.277643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-342d937c-92e5-46f9-a8a9-4e1006eb0852 req-cf88fd3d-804e-4133-8cab-f34506a2224f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e9024f-4e2b-4f1c-a71e-1390992cad98", "name": "network-vif-deleted", "tag": "fcb637ef-3933-4d14-be52-088ea331e952"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:21.334699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-342d937c-92e5-46f9-a8a9-4e1006eb0852 req-cf88fd3d-804e-4133-8cab-f34506a2224f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:21.335062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-342d937c-92e5-46f9-a8a9-4e1006eb0852 req-cf88fd3d-804e-4133-8cab-f34506a2224f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:21.400528 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-342d937c-92e5-46f9-a8a9-4e1006eb0852 req-cf88fd3d-804e-4133-8cab-f34506a2224f service nova] Creating event network-vif-deleted:fcb637ef-3933-4d14-be52-088ea331e952 for instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 on n-h1-846209-2 Jun 16 18:34:21.417871 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-342d937c-92e5-46f9-a8a9-4e1006eb0852 req-cf88fd3d-804e-4133-8cab-f34506a2224f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151584 Jun 16 18:34:21.427445 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 745/1423] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:21.439026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-05155cd1-bf61-4e18-ae75-dd227d098ac1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '.version_select at 0x7f866f3b60d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:21.871516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:21.884608 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e32a322-192b-4375-abe8-e62b582e9493 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1319 microversion: 2.1 time: 0.848033 Jun 16 18:34:21.891932 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 679/1424] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:21 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:21.904764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:21.906754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: f7e9024f-4e2b-4f1c-a71e-1390992cad98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:21.923365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:21.927926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:21.929263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:21.929959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:21.964923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] HTTP exception thrown: Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 could not be found. Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Request method failure captured: Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 HTTP/1.1 Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YsmyNMDQCVX1ur-Gu0UeJlHlfQyryzy0d7tNloScIuoBNLkFcwzDKfT3hoZST_PdWtygD9JMUBTRNaQEq7qy1RHFQGNOWWpsyMGRFAR9AHJIZlDA4gHPGmCMa-Y53I5_ev0Xb1SiNlftszIypGIYgc1lTa5U-bgtRfT7eGHKjo6rQ Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:34:21.971107 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2978681eacda4da685a087c0b1025df3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2978681eacda4da685a087c0b1025df3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 209d0e879aea45269c56a7c7d9869b23 Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 could not be found. Jun 16 18:34:21.972762 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'f7e9024f-4e2b-4f1c-a71e-1390992cad98'} Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 could not be found. Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:21.973720 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 could not be found. Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 could not be found. Jun 16 18:34:21.975256 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:21.978681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Returning 404 to user: Instance f7e9024f-4e2b-4f1c-a71e-1390992cad98 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:21.980324 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8c64a03b-8a09-428c-9180-c6175740a25e tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98" status: 404 len: 111 microversion: 2.1 time: 0.085664 Jun 16 18:34:21.983343 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 680/1425] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:21 2022] GET /compute/v2.1/servers/f7e9024f-4e2b-4f1c-a71e-1390992cad98 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:22.269808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-141514873", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "06a9a0f4-e2e7-4b09-9d3d-fea8950fac70"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:22.359466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:34:23.573478 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-05155cd1-bf61-4e18-ae75-dd227d098ac1 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/c89dd55b-5d14-4106-b5fa-10a1073092f2" status: 202 len: 0 microversion: 2.1 time: 2.144316 Jun 16 18:34:23.575440 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 746/1426] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:34:21 2022] DELETE /compute/v2.1/os-floating-ips/c89dd55b-5d14-4106-b5fa-10a1073092f2 => generated 0 bytes in 2147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:34:23.583019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:23.602698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:23.631899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:23.637633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:23.643489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:23.644340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:23.783384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:23.832887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:34:23.833722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:34:23.833898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:34:23.834299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:34:23.834722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:34:23.866546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:23.868398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:23.868891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:23.869349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:23.962038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:23.990573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:24.028923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da78cebc-4237-42ef-9f4f-1ee90bb04580 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 204 len: 0 microversion: 2.1 time: 0.449849 Jun 16 18:34:24.030246 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 747/1427] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:23 2022] DELETE /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:24.043361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f31f9b44-9737-4991-bd27-6256d74e0ff4 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f86740421f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:24.053499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:34:24.058099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:34:24.122435 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f31f9b44-9737-4991-bd27-6256d74e0ff4 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.086650 Jun 16 18:34:24.129184 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 748/1428] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:24 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:24.134961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:24.135919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:24.144464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.145032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:24.145967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.146538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:24.313669 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2147803a-f484-4f5b-a2e5-055cb5c14630 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.328591 Jun 16 18:34:24.326183 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 681/1429] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:34:24.358764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd331421-2898-4a65-9f1f-a43cddb4c649 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd331421-2898-4a65-9f1f-a43cddb4c649 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Request method failure captured: Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action HTTP/1.1 Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 34 Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3dwRjOp8ons6MKXGE0S2FvlpvwxGAAEWqRWE9z4vPNQ2pqWabV7oWLVAsKKqRh9mMY26N8TyfFBbWS3_uxd_m28317siVtS1yCCFX4MyGo8gc1KSPzwpZGEBSlVTq-pezGzEvRBqFFfxq2agB6bWu0MpzHLHuWUuvaQnuJ3dupn5ho Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:34:24.396162 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6950ba42a3434feca292d74540c20ea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6d0ef6fec2fd46c68afb5d3631c4391d Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: {"addFloatingIp": {"address": ""}} Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:34:24.399033 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '037688ff-f5d2-41d0-a06e-24efe64e927f', 'body': {'addFloatingIp': {'address': ''}}} Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi '' Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:24.409795 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:34:24.418809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:34:24.422537 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 16 18:34:24.422537 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:24.422537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd331421-2898-4a65-9f1f-a43cddb4c649 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:24.422537 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd331421-2898-4a65-9f1f-a43cddb4c649 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action" status: 400 len: 142 microversion: 2.1 time: 0.072959 Jun 16 18:34:24.422537 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 682/1430] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:24 2022] POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action => generated 142 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:34:24.431593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:24.437138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:24.479599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.480350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:24.481788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.482619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:24.488985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:24.520094 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-06c6e6d8-ea10-4f4e-a60b-56cdd1b38342 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1469 microversion: 2.1 time: 0.389094 Jun 16 18:34:24.531747 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 749/1431] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:24 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:24.549191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf7986a5-fad9-4e3a-946a-17bf7bbe5b94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:24.554499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf7986a5-fad9-4e3a-946a-17bf7bbe5b94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:24.785561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cf7986a5-fad9-4e3a-946a-17bf7bbe5b94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:24.812571 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf7986a5-fad9-4e3a-946a-17bf7bbe5b94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1192 microversion: 2.1 time: 0.276090 Jun 16 18:34:24.848291 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 750/1432] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:24 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1192 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:24.881480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:24.883827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:24.899568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.901384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:24.903318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.904450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.076483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Acquired lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:34:25.185977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:25.210329 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad073c12-d30e-4b0c-a185-c1d6c856478d tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1469 microversion: 2.1 time: 0.806021 Jun 16 18:34:25.228887 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 683/1433] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:24 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1469 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:25.254933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:25.258244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:25.282695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:25.292005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.294370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:25.295639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.367502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lazy-loading 'flavor' on Instance uuid ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:25.441287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Releasing lock "refresh_cache-037688ff-f5d2-41d0-a06e-24efe64e927f" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:34:25.442319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] HTTP exception thrown: floating IP not found Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Request method failure captured: Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action HTTP/1.1 Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 41 Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dwRjOp8ons6MKXGE0S2FvlpvwxGAAEWqRWE9z4vPNQ2pqWabV7oWLVAsKKqRh9mMY26N8TyfFBbWS3_uxd_m28317siVtS1yCCFX4MyGo8gc1KSPzwpZGEBSlVTq-pezGzEvRBqFFfxq2agB6bWu0MpzHLHuWUuvaQnuJ3dupn5ho Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:34:25.444438 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6950ba42a3434feca292d74540c20ea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d0ef6fec2fd46c68afb5d3631c4391d Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: {"addFloatingIp": {"address": "0.0.0.0"}} Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: exception: floating IP not found Jun 16 18:34:25.447263 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '037688ff-f5d2-41d0-a06e-24efe64e927f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:25.449017 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jun 16 18:34:25.453775 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.461731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Returning 404 to user: floating IP not found {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:25.461731 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fa4313d6-dda3-4105-bd2e-61805a5b3cf5 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action" status: 404 len: 67 microversion: 2.1 time: 0.594993 Jun 16 18:34:25.461731 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 751/1434] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:24 2022] POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action => generated 67 bytes in 602 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:34:25.461731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90fd45eb-4ef5-458c-8f39-95cfc0621568 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f673700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:25.601267 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90fd45eb-4ef5-458c-8f39-95cfc0621568 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.147325 Jun 16 18:34:25.603397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 752/1435] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:25 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:25.642616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d54c4ba-1882-47c8-b95b-3c182e5cfc56 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:25.758418 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f822c79-2540-4565-8855-a11c7ec5b341 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568/action" status: 202 len: 0 microversion: 2.1 time: 0.524846 Jun 16 18:34:25.765259 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 684/1436] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:25 2022] POST /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:34:25.790518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:25.793298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:25.815904 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2d54c4ba-1882-47c8-b95b-3c182e5cfc56 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d54c4ba-1882-47c8-b95b-3c182e5cfc56 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Request method failure captured: Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action HTTP/1.1 Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 44 Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dwRjOp8ons6MKXGE0S2FvlpvwxGAAEWqRWE9z4vPNQ2pqWabV7oWLVAsKKqRh9mMY26N8TyfFBbWS3_uxd_m28317siVtS1yCCFX4MyGo8gc1KSPzwpZGEBSlVTq-pezGzEvRBqFFfxq2agB6bWu0MpzHLHuWUuvaQnuJ3dupn5ho Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:34:25.819903 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6950ba42a3434feca292d74540c20ea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d0ef6fec2fd46c68afb5d3631c4391d Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:34:25.821331 n-d-846209-2 devstack@n-api.service[119206]: exception: Floating IP not found for address 0.0.0.0. Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '037688ff-f5d2-41d0-a06e-24efe64e927f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:25.822243 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jun 16 18:34:25.823450 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:25.824801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d54c4ba-1882-47c8-b95b-3c182e5cfc56 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:25.824893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:25.824893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.825066 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2d54c4ba-1882-47c8-b95b-3c182e5cfc56 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action" status: 404 len: 88 microversion: 2.1 time: 0.217251 Jun 16 18:34:25.825149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:25.825149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.839935 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 753/1437] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:25 2022] POST /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f/action => generated 88 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:34:25.868663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:25.895825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:25.953675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:25.961644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.965837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:25.966331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.223624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:26.468732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-76c8a66c-3917-488e-95d9-23f58e8a0361 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "DELETE /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 204 len: 0 microversion: 2.1 time: 0.617131 Jun 16 18:34:26.483243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 754/1438] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:25 2022] DELETE /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:26.538535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:26.558127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:26.602689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.616031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:26.623904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.626200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.628098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.662217 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-187fb975-a602-4851-a11d-98ba2fb4663c tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1477 microversion: 2.1 time: 0.883589 Jun 16 18:34:26.663812 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 685/1439] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:25 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1477 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:26.689806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-94b3ef56-7b0b-4845-b7ff-ab173a450bf9 req-6dec5a82-2d25-473b-8168-c553340e1485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0271c7ba-7672-4448-8a5f-33e3150857fd", "name": "network-vif-plugged", "status": "completed", "tag": "c6d88fb8-bcea-40fb-9158-9244e91ce3f1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:26.735014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-94b3ef56-7b0b-4845-b7ff-ab173a450bf9 req-6dec5a82-2d25-473b-8168-c553340e1485 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.736073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-94b3ef56-7b0b-4845-b7ff-ab173a450bf9 req-6dec5a82-2d25-473b-8168-c553340e1485 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.775700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:26.786335 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-00bb5b8f-424f-4ce5-a246-79a63b314839 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1196 microversion: 2.1 time: 0.300621 Jun 16 18:34:26.802461 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 755/1440] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:26 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1196 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:26.812484 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-94b3ef56-7b0b-4845-b7ff-ab173a450bf9 req-6dec5a82-2d25-473b-8168-c553340e1485 service nova] Creating event network-vif-plugged:c6d88fb8-bcea-40fb-9158-9244e91ce3f1 for instance 0271c7ba-7672-4448-8a5f-33e3150857fd on n-h2-846209-2 Jun 16 18:34:26.813888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:26.815519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:26.823432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.825592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.826739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.827467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.842366 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-94b3ef56-7b0b-4845-b7ff-ab173a450bf9 req-6dec5a82-2d25-473b-8168-c553340e1485 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175419 Jun 16 18:34:26.849050 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 686/1441] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:26.883860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:26.893378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:26.930426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.935476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.947212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.950002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.042315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:27.056244 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-219fd8f8-ac51-4d7d-93cf-47ad2cf36980 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1469 microversion: 2.1 time: 0.252392 Jun 16 18:34:27.057256 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 756/1442] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:26 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1469 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:27.062437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:27.063773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:27.088565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.090543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.099728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.100928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.551536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:27.563167 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-202af7a5-4a86-4bb5-a30c-a80900cad385 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1543 microversion: 2.1 time: 0.709573 Jun 16 18:34:27.584670 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 687/1443] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:26 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1543 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:27.590446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a276ddc-8f18-4419-aa82-894995c7842e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f2ac280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:27.619398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 39d14e76-7250-4441-98dc-a361072f16a9 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:27.682446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-135830de-9f6f-4a87-8f69-2175eee7828d tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 2423 microversion: 2.25 time: 0.623452 Jun 16 18:34:27.687020 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 757/1444] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:27 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 2423 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:27.709643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7ad52edb-a4ab-4dda-aa61-c9de0a67ebef req-15c8a182-c464-4a1b-bd6c-16ba7c804a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf781a8-6d20-42d8-8a48-4c62f18f815a", "name": "network-vif-deleted", "tag": "28aa9ab0-5760-41d2-8199-2de4e727f2e6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:27.728092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7ad52edb-a4ab-4dda-aa61-c9de0a67ebef req-15c8a182-c464-4a1b-bd6c-16ba7c804a98 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.736164 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a276ddc-8f18-4419-aa82-894995c7842e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.149952 Jun 16 18:34:27.737544 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 688/1445] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:27 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:27.738757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7ad52edb-a4ab-4dda-aa61-c9de0a67ebef req-15c8a182-c464-4a1b-bd6c-16ba7c804a98 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.748985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:27.760013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:27.776652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.778282 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7ad52edb-a4ab-4dda-aa61-c9de0a67ebef req-15c8a182-c464-4a1b-bd6c-16ba7c804a98 service nova] Creating event network-vif-deleted:28aa9ab0-5760-41d2-8199-2de4e727f2e6 for instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a on n-h1-846209-2 Jun 16 18:34:27.779984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.783367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.784250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.790293 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7ad52edb-a4ab-4dda-aa61-c9de0a67ebef req-15c8a182-c464-4a1b-bd6c-16ba7c804a98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101595 Jun 16 18:34:27.795693 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 758/1446] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:27.811018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846209-2", "block_migration": "auto"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:27.816715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:27.850268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.853019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.857934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.859382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:28.001107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'flavor' on Instance uuid 39d14e76-7250-4441-98dc-a361072f16a9 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:28.028427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Going to try to live migrate instance to n-h2-846209-2 {{(pid=119206) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:34:28.301536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:28.323893 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-59b699b2-56cb-43aa-a127-3b9e973f787a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1460 microversion: 2.1 time: 0.580617 Jun 16 18:34:28.325399 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 689/1447] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:27 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1460 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:28.341734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:28.343092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:28.359437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:28.360816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:28.364044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:28.365635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:28.513597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:28.534843 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b7844e1a-277d-4209-b942-9b00863db4da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1244 microversion: 2.1 time: 0.207524 Jun 16 18:34:28.551210 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 690/1448] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:28 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1244 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:28.559276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:28.561125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:28.572921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:28.574118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:28.579536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:28.580158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:28.638482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:28.639341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:28.640086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lazy-loading 'fault' on Instance uuid 5bf781a8-6d20-42d8-8a48-4c62f18f815a {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:28.763377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209d0e879aea45269c56a7c7d9869b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2978681eacda4da685a087c0b1025df3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:28.774963 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f51d90fc-f7ed-4f9e-a967-ea754e121861 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 200 len: 1303 microversion: 2.1 time: 0.222128 Jun 16 18:34:28.778770 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 691/1449] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:28 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:28.793455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a8302b2-bc24-4a36-abfc-33a666bec96b tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:28.800901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a8302b2-bc24-4a36-abfc-33a666bec96b tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:28.834047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a8302b2-bc24-4a36-abfc-33a666bec96b tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:28.834047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a8302b2-bc24-4a36-abfc-33a666bec96b tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:28.834811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a8302b2-bc24-4a36-abfc-33a666bec96b tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:28.835445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a8302b2-bc24-4a36-abfc-33a666bec96b tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:29.950920 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a8302b2-bc24-4a36-abfc-33a666bec96b tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1611 microversion: 2.1 time: 1.159322 Jun 16 18:34:29.956210 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 692/1450] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:28 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1611 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:29.979545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:29.982235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:30.008317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:30.009721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:30.012269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:30.014683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:30.157210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:30.158099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:30.162811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lazy-loading 'fault' on Instance uuid 037688ff-f5d2-41d0-a06e-24efe64e927f {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:30.655617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0ef6fec2fd46c68afb5d3631c4391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950ba42a3434feca292d74540c20ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:30.677875 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c1104c25-6a80-48dd-a159-d9c3f0c8de6a tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 200 len: 1322 microversion: 2.1 time: 0.719576 Jun 16 18:34:30.682798 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 693/1451] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:29 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 1322 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:30.716648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb227bfe-e68b-469e-bab9-6d4c4a11dbc9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f126040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:30.852484 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eb227bfe-e68b-469e-bab9-6d4c4a11dbc9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.155207 Jun 16 18:34:30.855869 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 694/1452] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:30 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:30.875869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:30.876994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:30.892227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:30.892786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:30.895115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:30.895590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.129510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:31.150916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:31.168126 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfeab235-6c2a-47f6-9360-eadec0d45455 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1250 microversion: 2.1 time: 0.310009 Jun 16 18:34:31.169993 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 695/1453] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:30 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1250 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:31.191549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:31.193110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] [instance: 5bf781a8-6d20-42d8-8a48-4c62f18f815a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:31.211739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.219776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.230468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.231654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.277978 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] HTTP exception thrown: Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a could not be found. Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Request method failure captured: Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a HTTP/1.1 Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3YsmyNMDQCVX1ur-Gu0UeJlHlfQyryzy0d7tNloScIuoBNLkFcwzDKfT3hoZST_PdWtygD9JMUBTRNaQEq7qy1RHFQGNOWWpsyMGRFAR9AHJIZlDA4gHPGmCMa-Y53I5_ev0Xb1SiNlftszIypGIYgc1lTa5U-bgtRfT7eGHKjo6rQ Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:34:31.281329 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2978681eacda4da685a087c0b1025df3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2978681eacda4da685a087c0b1025df3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2978681eacda4da685a087c0b1025df3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2978681eacda4da685a087c0b1025df3 Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MigrationsAdminTest-1486003199 Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 209d0e879aea45269c56a7c7d9869b23 Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MigrationsAdminTest-1486003199-project Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a could not be found. Jun 16 18:34:31.285088 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5bf781a8-6d20-42d8-8a48-4c62f18f815a'} Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a could not be found. Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:31.286882 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a could not be found. Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a could not be found. Jun 16 18:34:31.289715 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.294848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] Returning 404 to user: Instance 5bf781a8-6d20-42d8-8a48-4c62f18f815a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:31.295498 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-feb64724-6675-409e-bf39-caf44a8b3a81 tempest-MigrationsAdminTest-1486003199 tempest-MigrationsAdminTest-1486003199-project] 10.222.0.27 "GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a" status: 404 len: 111 microversion: 2.1 time: 0.122302 Jun 16 18:34:31.297226 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 696/1454] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:31 2022] GET /compute/v2.1/servers/5bf781a8-6d20-42d8-8a48-4c62f18f815a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:31.308178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-aa3bd3dd-d116-4c40-b712-2d67bbf460d6 req-6dbb37e1-d729-4028-8576-ab8635347daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037688ff-f5d2-41d0-a06e-24efe64e927f", "name": "network-vif-deleted", "tag": "df861561-6bdf-4f2b-8ac3-c070c3621f0d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:31.326479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:31.331334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-aa3bd3dd-d116-4c40-b712-2d67bbf460d6 req-6dbb37e1-d729-4028-8576-ab8635347daf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.332836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-aa3bd3dd-d116-4c40-b712-2d67bbf460d6 req-6dbb37e1-d729-4028-8576-ab8635347daf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.357945 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-aa3bd3dd-d116-4c40-b712-2d67bbf460d6 req-6dbb37e1-d729-4028-8576-ab8635347daf service nova] Creating event network-vif-deleted:df861561-6bdf-4f2b-8ac3-c070c3621f0d for instance 037688ff-f5d2-41d0-a06e-24efe64e927f on n-h1-846209-2 Jun 16 18:34:31.368736 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-aa3bd3dd-d116-4c40-b712-2d67bbf460d6 req-6dbb37e1-d729-4028-8576-ab8635347daf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068654 Jun 16 18:34:31.377751 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 697/1455] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:31.395378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e301aa89-1feb-493c-8093-979fba27ed19 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:31.407332 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:34:31.407332 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:34:31.410814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e301aa89-1feb-493c-8093-979fba27ed19 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.414429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e301aa89-1feb-493c-8093-979fba27ed19 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.422003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e301aa89-1feb-493c-8093-979fba27ed19 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.423460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e301aa89-1feb-493c-8093-979fba27ed19 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.542537 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e301aa89-1feb-493c-8093-979fba27ed19 tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.153362 Jun 16 18:34:31.544143 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 698/1456] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:34:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:31.561485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ce4fa016-7c31-4061-9ae1-dd7eec4cd5ee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:31.563308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ce4fa016-7c31-4061-9ae1-dd7eec4cd5ee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:31.583500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce4fa016-7c31-4061-9ae1-dd7eec4cd5ee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.584698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce4fa016-7c31-4061-9ae1-dd7eec4cd5ee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.586491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce4fa016-7c31-4061-9ae1-dd7eec4cd5ee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.587630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce4fa016-7c31-4061-9ae1-dd7eec4cd5ee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.792423 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f1b3848-dae4-4167-82c8-5ae5421593a5 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/action" status: 202 len: 0 microversion: 2.25 time: 3.994919 Jun 16 18:34:31.793304 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 759/1457] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:34:27 2022] POST /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/action => generated 0 bytes in 3997 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:31.798725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846209-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:31.800804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:31.810791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:31.833582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.834937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.838613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.839435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.915553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Lazy-loading 'flavor' on Instance uuid ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:31.940443 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 while it is in vm_state suspended Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Request method failure captured: Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568/action HTTP/1.1 Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 97 Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dqMGY5hkcGRk6-N36_9pnkJWqkPMZHhVqhHlkhksfA1O0Vvx-lSHxEATM815btuqlRdscKyWwjlWQXXh0309eP3oi3DLmR831eijDJxB5-xZHZqVwFqQ75xHscXBgeqt2Ao7lOk1Fk0dow0nZ5Z4WK-ok965rO1C-dEKYTOT8Pc9I Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6f6b20d18bd1426fb7601af882467b34 Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveMigrationNegativeTest-1034999695 Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:34:31.943497 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f6b20d18bd1426fb7601af882467b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f6b20d18bd1426fb7601af882467b34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f6b20d18bd1426fb7601af882467b34", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f6b20d18bd1426fb7601af882467b34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveMigrationNegativeTest-1034999695 Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6f6b20d18bd1426fb7601af882467b34 Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1034999695 Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveMigrationNegativeTest-1034999695-project-admin Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 48dd1bb4ab054149bbf221eb4f8114c2 Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveMigrationNegativeTest-1034999695-project-admin Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: {"os-migrateLive": {"host": "n-h1-846209-2", "block_migration": true, "disk_over_commit": false}} Jun 16 18:34:31.945449 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'os-migrateLive' instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 while it is in vm_state suspended Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ffa21ace-bb5c-437c-a8e8-5ebc39d8d568', 'body': {'os-migrateLive': {'host': 'n-h1-846209-2', 'block_migration': True, 'disk_over_commit': False}}} Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 16 18:34:31.946346 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:34:31.947571 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 while it is in vm_state suspended Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 while it is in vm_state suspended Jun 16 18:34:31.949006 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:31.951845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 while it is in vm_state suspended {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:31.953192 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ad9fdfd3-c323-4790-be75-cf3ab998dacc tempest-LiveMigrationNegativeTest-1034999695 tempest-LiveMigrationNegativeTest-1034999695-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568/action" status: 409 len: 155 microversion: 2.1 time: 0.158997 Jun 16 18:34:31.954514 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 760/1458] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:31 2022] POST /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568/action => generated 155 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:34:31.964960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:31.966083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] [instance: 037688ff-f5d2-41d0-a06e-24efe64e927f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:31.975200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.976241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.977624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.978381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.998044 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] HTTP exception thrown: Instance 037688ff-f5d2-41d0-a06e-24efe64e927f could not be found. Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Request method failure captured: Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f HTTP/1.1 Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3dwRjOp8ons6MKXGE0S2FvlpvwxGAAEWqRWE9z4vPNQ2pqWabV7oWLVAsKKqRh9mMY26N8TyfFBbWS3_uxd_m28317siVtS1yCCFX4MyGo8gc1KSPzwpZGEBSlVTq-pezGzEvRBqFFfxq2agB6bWu0MpzHLHuWUuvaQnuJ3dupn5ho Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:34:32.000124 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6950ba42a3434feca292d74540c20ea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6950ba42a3434feca292d74540c20ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6950ba42a3434feca292d74540c20ea6 Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743 Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d0ef6fec2fd46c68afb5d3631c4391d Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 037688ff-f5d2-41d0-a06e-24efe64e927f could not be found. Jun 16 18:34:32.001600 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '037688ff-f5d2-41d0-a06e-24efe64e927f'} Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 037688ff-f5d2-41d0-a06e-24efe64e927f could not be found. Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:32.003011 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 037688ff-f5d2-41d0-a06e-24efe64e927f could not be found. Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 037688ff-f5d2-41d0-a06e-24efe64e927f could not be found. Jun 16 18:34:32.004741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:34:32.007727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] Returning 404 to user: Instance 037688ff-f5d2-41d0-a06e-24efe64e927f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:32.008856 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9901c2e-262c-4b46-b9f0-70ca0623d9e2 tempest-FloatingIPsAssociationNegativeTestJSON-795806743 tempest-FloatingIPsAssociationNegativeTestJSON-795806743-project] 10.222.0.27 "GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f" status: 404 len: 111 microversion: 2.1 time: 0.053131 Jun 16 18:34:32.010005 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 761/1459] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:31 2022] GET /compute/v2.1/servers/037688ff-f5d2-41d0-a06e-24efe64e927f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:32.015959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:32.017210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:32.025490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:32.026578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:32.028056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:32.028929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.205285 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ce4fa016-7c31-4061-9ae1-dd7eec4cd5ee tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1858 microversion: 2.1 time: 1.659328 Jun 16 18:34:33.208699 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 699/1460] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:31 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1858 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:33.217581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b09e3051-df56-4168-b660-89c7a22029d1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f25d550>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:33.329422 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b09e3051-df56-4168-b660-89c7a22029d1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.118459 Jun 16 18:34:33.330124 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 700/1461] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:33 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:33.337855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:33.338469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:33.367005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:33.374797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=5,nova_cell1:RELEASE=1,nova_cell1:SELECT=90,nova_cell1:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:33.386868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:33.388190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.388704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.390504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.391280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.400840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:33.407731 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-944096ef-37ec-48a2-acf7-6f375b7d58ab tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 1.394658 Jun 16 18:34:33.421940 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 762/1462] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:32 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:33.443177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:33.446152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:33.466922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:33.486018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.491724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.492827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.493548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.689757 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d287b20b-bdcd-430e-a244-31521f036282 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 204 len: 0 microversion: 2.1 time: 0.356507 Jun 16 18:34:33.691887 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 701/1463] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:33 2022] DELETE /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:33.710836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846209-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:33.714071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:33.732903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.734413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.736181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.738082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.795130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lazy-loading 'flavor' on Instance uuid 49c0df03-5e10-4077-b47c-d7600c7800da {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:33.821869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Going to try to live migrate instance to n-h1-846209-2 {{(pid=119207) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:34:34.036433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:34.056062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:34.070988 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ea960d60-ca68-497f-b889-8ca6d952b22c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1292 microversion: 2.1 time: 0.651612 Jun 16 18:34:34.081310 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 763/1464] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:33 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1292 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:34.092556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:34.097080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:34.115373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:34.123074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:34.124181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:34.131435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:34.467147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:34.485225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b647d0bb-bfd7-42c9-98b5-67fd9888d11a tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1466 microversion: 2.1 time: 0.398680 Jun 16 18:34:34.510787 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 764/1465] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:34 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1466 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:34.530383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-db8933fa-0fa9-4a80-a9fb-7c800772c5a1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f50ef70>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:34.661424 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-db8933fa-0fa9-4a80-a9fb-7c800772c5a1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.148621 Jun 16 18:34:34.663337 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 765/1466] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:34 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:34.673636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:34.679652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:34.701273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:34.702633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:34.707591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:34.711005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:34.808973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:35.303663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:35.323295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:35.325099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:35.326567 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0552de9e-5a08-4b6f-80d6-1f4c84ca48a4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.661597 Jun 16 18:34:35.338781 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 766/1467] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:34 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:35.339273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:35.339987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:35.351568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:35.351568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:35.351568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:35.351568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:36.041845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:36.072991 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-78b2b8a2-481f-4af1-b692-e9f508c0f18b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1292 microversion: 2.1 time: 0.738442 Jun 16 18:34:36.073939 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 767/1468] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:35 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1292 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:36.101933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:36.103265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:36.154521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:36.155401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:36.165627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:36.166565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:37.166837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:37.213499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-32feab07-2340-41c4-8b6a-8718f412f202 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1466 microversion: 2.1 time: 1.124371 Jun 16 18:34:37.215776 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 768/1469] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:36 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1466 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:37.225900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f0f25af-ecf4-4a63-9add-1d91357342c9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f50ef70>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:37.344589 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f0f25af-ecf4-4a63-9add-1d91357342c9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.123498 Jun 16 18:34:37.348439 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 769/1470] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:37 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:37.374593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7efbbadd-efa7-4716-8e78-38cbb2d3f8aa req-470a8aee-5ed3-4cff-9da0-87e82131cbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa", "tag": "e9fb4dde-f4d4-44f7-9761-1b447219da30"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:37.413892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7efbbadd-efa7-4716-8e78-38cbb2d3f8aa req-470a8aee-5ed3-4cff-9da0-87e82131cbe3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:37.414764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7efbbadd-efa7-4716-8e78-38cbb2d3f8aa req-470a8aee-5ed3-4cff-9da0-87e82131cbe3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:37.443311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7efbbadd-efa7-4716-8e78-38cbb2d3f8aa req-470a8aee-5ed3-4cff-9da0-87e82131cbe3 service nova] Creating event network-changed:e9fb4dde-f4d4-44f7-9761-1b447219da30 for instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa on n-h1-846209-2 Jun 16 18:34:37.454152 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7efbbadd-efa7-4716-8e78-38cbb2d3f8aa req-470a8aee-5ed3-4cff-9da0-87e82131cbe3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098772 Jun 16 18:34:37.457821 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 770/1471] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:37.469631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:37.471285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:37.484791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:37.486039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:37.488024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:37.490271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:37.942694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:37.963983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:37.970354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:37.980425 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f9df8769-c4a5-45e9-a1f2-359d5204d2c2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.510726 Jun 16 18:34:37.981095 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 771/1472] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:37 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:38.005223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:38.014908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:38.045469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.050692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.057490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.057973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.243102 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e99daa35-c7bf-4e39-a40c-a86c1b71d342 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/action" status: 202 len: 0 microversion: 2.1 time: 4.546060 Jun 16 18:34:38.246085 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 702/1473] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:34:33 2022] POST /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/action => generated 0 bytes in 4552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:34:38.299148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:38.310393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:38.366091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.375449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.384864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.391509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.500970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:38.520533 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ac3695c5-ca5a-4e49-8b5f-02d2b5690c4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1292 microversion: 2.1 time: 0.532123 Jun 16 18:34:38.530828 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 772/1474] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:37 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1292 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:38.537754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:38.539646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:38.546930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.547692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.548669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.550250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.836402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:38.861257 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfcd6f05-46ab-47e0-be7a-1294b106928b tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 200 len: 1424 microversion: 2.1 time: 0.606640 Jun 16 18:34:38.866144 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 703/1475] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:38 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 1424 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:38.884456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-706aafec-15cc-4617-8cf5-1315192a4489 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f126160>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:39.037681 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-706aafec-15cc-4617-8cf5-1315192a4489 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.168611 Jun 16 18:34:39.038621 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 704/1476] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:38 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:39.067254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7b1d6538-fb32-4b79-ad86-e4cd66ea35b2 req-52f57e0f-1d57-465a-b475-1163350cf24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa21ace-bb5c-437c-a8e8-5ebc39d8d568", "name": "network-vif-deleted", "tag": "00f32dbf-86c6-4af9-ade9-144ec3209afc"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:39.087091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7b1d6538-fb32-4b79-ad86-e4cd66ea35b2 req-52f57e0f-1d57-465a-b475-1163350cf24f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:39.087857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7b1d6538-fb32-4b79-ad86-e4cd66ea35b2 req-52f57e0f-1d57-465a-b475-1163350cf24f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:39.117055 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7b1d6538-fb32-4b79-ad86-e4cd66ea35b2 req-52f57e0f-1d57-465a-b475-1163350cf24f service nova] Creating event network-vif-deleted:00f32dbf-86c6-4af9-ade9-144ec3209afc for instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 on n-h2-846209-2 Jun 16 18:34:39.134407 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7b1d6538-fb32-4b79-ad86-e4cd66ea35b2 req-52f57e0f-1d57-465a-b475-1163350cf24f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093800 Jun 16 18:34:39.136318 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 705/1477] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:39.153275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:39.154202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:39.195231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:39.196598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:39.199257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:39.200529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:40.107741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.137214 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69782982-c556-4e70-a082-2322f7669eb4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 1.605126 Jun 16 18:34:40.152056 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 773/1478] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:38 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:40.157998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:40.159994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:40.168639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:40.169714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:40.171227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:40.172658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:40.813789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.845720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.848321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.861251 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-696c0927-f713-44b5-a7b6-8724cddf4457 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 1.707991 Jun 16 18:34:40.862012 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 706/1479] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:39 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:40.888488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:40.894863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: ffa21ace-bb5c-437c-a8e8-5ebc39d8d568] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:40.913998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:40.935615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:40.939575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:40.943823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.020995 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] HTTP exception thrown: Instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 could not be found. Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Request method failure captured: Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 HTTP/1.1 Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3doF9MjxxkJjWQin07sI9SUiAvJxcvIpeTVdg9sJeMlg5ga3KQlAlQURKHhjnsvGHomrN2p_W62-uCD7S9iY4bKUHcMiq4_K8-hJ5OvL2TaagfwHpIFPREuh75Gc6LMzCFnBAvUP5OikJUZfkvSX7RxapHDtv2knd2oPWtpCN3vJ5w Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 79372073be7047c1a4b57c6a7c9921e3 Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-LiveMigrationNegativeTest-354821352 Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:34:41.022787 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79372073be7047c1a4b57c6a7c9921e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79372073be7047c1a4b57c6a7c9921e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79372073be7047c1a4b57c6a7c9921e3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79372073be7047c1a4b57c6a7c9921e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-LiveMigrationNegativeTest-354821352 Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 79372073be7047c1a4b57c6a7c9921e3 Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-354821352 Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-LiveMigrationNegativeTest-354821352-project Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 3951b78564ed40e09eba285f35e4db6b Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-LiveMigrationNegativeTest-354821352-project Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 could not be found. Jun 16 18:34:41.025511 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ffa21ace-bb5c-437c-a8e8-5ebc39d8d568'} Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 could not be found. Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:41.027128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 could not be found. Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 could not be found. Jun 16 18:34:41.040328 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:41.046891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Returning 404 to user: Instance ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:41.046891 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f479547a-c41f-4be6-bf32-c5e4f0d52ada tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568" status: 404 len: 111 microversion: 2.1 time: 0.156942 Jun 16 18:34:41.046891 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 707/1480] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:40 2022] GET /compute/v2.1/servers/ffa21ace-bb5c-437c-a8e8-5ebc39d8d568 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:41.060293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-755eae39-5e03-4d3b-a025-cf4a9b857528 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1bd160>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:41.170437 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-755eae39-5e03-4d3b-a025-cf4a9b857528 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.144519 Jun 16 18:34:41.171047 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 708/1481] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:41 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:41.192254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:41.199934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:41.230446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.236882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.241461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.245718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.262466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:41.279054 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-272b851c-27b1-4dd7-a16a-5ec97b4c4e73 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1292 microversion: 2.1 time: 1.125372 Jun 16 18:34:41.288171 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 774/1482] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:40 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1292 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:41.298633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:41.302954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:41.316855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.321323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.323419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.327223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.387234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:41.586412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:41.773341 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d3994a79-e90d-4d8f-9b15-e65163ac28be tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 204 len: 0 microversion: 2.1 time: 0.593656 Jun 16 18:34:41.774452 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 709/1483] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:41 2022] DELETE /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:41.786625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:41.803332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:41.840324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.841671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.843821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.844414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:42.392851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:42.410759 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4163fc8-5b7c-443d-8db9-f87b9991ce17 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 1.119704 Jun 16 18:34:42.413728 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 775/1484] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:41 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:42.572334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:42.611436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d326e91-2c31-4178-8bac-7df25f6323f9 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1473 microversion: 2.1 time: 0.829400 Jun 16 18:34:42.637562 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 710/1485] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:41 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1473 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:42.660103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:42.664258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:42.717662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:42.720165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:42.724433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:42.734466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:43.090901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93debbda-74aa-4426-9ccd-58d9e2f5b2e8 tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] Calling method '.version_select at 0x7f866edd58b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:43.092859 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:34:43.092859 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:34:43.156300 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-93debbda-74aa-4426-9ccd-58d9e2f5b2e8 tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.727609 Jun 16 18:34:43.166008 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 776/1486] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Jun 16 18:34:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:43.192495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9530285c-308a-4c46-afe1-0caea440380c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f113f70>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:43.333723 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9530285c-308a-4c46-afe1-0caea440380c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.166451 Jun 16 18:34:43.335023 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 777/1487] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:43 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:43.343214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:43.350847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:43.381306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:43.387678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:43.399922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:43.403475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:43.766569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:43.786194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:43.791722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:43.795039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-86080500-c93d-478e-be1e-c1af0f20ac7d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 1.154580 Jun 16 18:34:43.803163 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 711/1488] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:42 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:43.840251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d72a041-4d3b-47d8-a672-12c14084f1c2 tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] Action: 'update', calling method: .version_select at 0x7f866f128790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:43.843584 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:34:43.843584 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:34:44.105134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:44.125165 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-11c09a7c-1956-4286-ac72-b318e00989d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1292 microversion: 2.1 time: 0.776260 Jun 16 18:34:44.130148 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 778/1489] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:43 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1292 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:44.142195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:44.142835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:44.255231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.256172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:44.258806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.265417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:44.566114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d72a041-4d3b-47d8-a672-12c14084f1c2 tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.759808 Jun 16 18:34:44.568563 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 712/1490] 10.222.0.27 () {60 vars in 1205 bytes} [Thu Jun 16 18:34:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:44.578677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:44.580518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:44.598915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.600464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:44.602291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.603742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:45.913387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:45.932230 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e00a0aba-33ca-4d79-a153-3a8c7cb69a0a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 1.799738 Jun 16 18:34:45.933155 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 779/1491] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:44 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:45.944223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88e970e0-e8e1-4043-a1d5-7f75e2bde242 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866edd5940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:46.057482 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88e970e0-e8e1-4043-a1d5-7f75e2bde242 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.122498 Jun 16 18:34:46.058689 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 780/1492] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:45 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:46.074526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-79581e3a-1abe-46b5-81f2-c1f163c35d7c tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] Calling method '.version_select at 0x7f866f4f3430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:46.075790 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:34:46.075790 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:34:46.110722 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-79581e3a-1abe-46b5-81f2-c1f163c35d7c tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.048277 Jun 16 18:34:46.113476 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 781/1493] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Jun 16 18:34:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:46.119302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:46.120561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:46.132869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.133722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.134949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.135651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.197503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.256097 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1335c5f-f6e8-4c5c-9428-88716caa9b51 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1473 microversion: 2.1 time: 1.685240 Jun 16 18:34:46.257206 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 713/1494] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:44 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1473 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:46.279938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:46.282450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:46.312441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.313258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.314740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.316131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.384217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:46.593294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.627396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.631326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.634390 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c139a1c6-2989-49b7-86f4-caa23ef8e798 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.518631 Jun 16 18:34:46.647178 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 782/1495] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:46 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:46.654745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c39ef2c6-0445-4a4e-a1bc-ac822136a6f7 tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] Action: 'update', calling method: .version_select at 0x7f866f4fa700>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:46.657544 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:34:46.657544 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:34:46.922446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c39ef2c6-0445-4a4e-a1bc-ac822136a6f7 tempest-QuotaClassesAdminTestJSON-764252452 tempest-QuotaClassesAdminTestJSON-764252452-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.271886 Jun 16 18:34:46.949123 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 783/1496] 10.222.0.27 () {60 vars in 1205 bytes} [Thu Jun 16 18:34:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:46.964919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-abe18e38-8776-4deb-a88a-01091994ccec req-d246562b-39b6-47c0-8879-6f0dcfaaaf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47fbd7d-f805-4344-a460-290bb5446846", "name": "network-vif-deleted", "tag": "d2024d90-2975-4da0-a55d-361d7d8a78b3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:47.009191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-abe18e38-8776-4deb-a88a-01091994ccec req-d246562b-39b6-47c0-8879-6f0dcfaaaf19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.015604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-abe18e38-8776-4deb-a88a-01091994ccec req-d246562b-39b6-47c0-8879-6f0dcfaaaf19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.060887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:47.080508 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e827bd3f-7fd2-42b0-8fff-eee611c1ffd6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1292 microversion: 2.1 time: 0.821656 Jun 16 18:34:47.080840 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-abe18e38-8776-4deb-a88a-01091994ccec req-d246562b-39b6-47c0-8879-6f0dcfaaaf19 service nova] Creating event network-vif-deleted:d2024d90-2975-4da0-a55d-361d7d8a78b3 for instance a47fbd7d-f805-4344-a460-290bb5446846 on n-h1-846209-2 Jun 16 18:34:47.092758 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 714/1497] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:46 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1292 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:47.101077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f241f8b4-5a8f-4a51-9a5e-ce090beca11b req-76de3f70-12c8-4b66-97e4-35498d27b947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa", "name": "network-vif-plugged", "status": "completed", "tag": "e9fb4dde-f4d4-44f7-9761-1b447219da30"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:47.109451 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-abe18e38-8776-4deb-a88a-01091994ccec req-d246562b-39b6-47c0-8879-6f0dcfaaaf19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150302 Jun 16 18:34:47.110811 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 784/1498] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:47.134195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:47.144210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:47.145127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f241f8b4-5a8f-4a51-9a5e-ce090beca11b req-76de3f70-12c8-4b66-97e4-35498d27b947 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.147536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f241f8b4-5a8f-4a51-9a5e-ce090beca11b req-76de3f70-12c8-4b66-97e4-35498d27b947 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.175676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.177136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.181842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.184880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.198407 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f241f8b4-5a8f-4a51-9a5e-ce090beca11b req-76de3f70-12c8-4b66-97e4-35498d27b947 service nova] Creating event network-vif-plugged:e9fb4dde-f4d4-44f7-9761-1b447219da30 for instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa on n-h1-846209-2 Jun 16 18:34:47.220668 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f241f8b4-5a8f-4a51-9a5e-ce090beca11b req-76de3f70-12c8-4b66-97e4-35498d27b947 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131137 Jun 16 18:34:47.224772 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 715/1499] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:47.242637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a57a7e3-9a10-447d-a416-95491f0c4bfb tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1500d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:47.417367 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a57a7e3-9a10-447d-a416-95491f0c4bfb tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.190598 Jun 16 18:34:47.423494 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 716/1500] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:47 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:47.475391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:47.495832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:47.542075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.547116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.549182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.550400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.692422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.695323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.696696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lazy-loading 'fault' on Instance uuid a47fbd7d-f805-4344-a460-290bb5446846 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:49.059161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3951b78564ed40e09eba285f35e4db6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79372073be7047c1a4b57c6a7c9921e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:49.111406 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e61cb03-3863-466c-a97b-cd5be4f3b867 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 200 len: 1308 microversion: 2.1 time: 1.679376 Jun 16 18:34:49.132996 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 717/1501] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:47 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 1308 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:49.164381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:49.171312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:49.223124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.223807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:49.224732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.225190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:49.625213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:49.635903 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b6a8482-7373-4de1-a7ef-acc9a0a1f241 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 2.523726 Jun 16 18:34:49.652126 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 785/1502] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:47 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 2541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:49.671794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:49.679017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:49.702182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.704412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:49.709956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.715176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:50.869386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.889494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.900557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.906050 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6118bb3b-2c39-47fd-a4b8-17c9009bc97f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 1.767268 Jun 16 18:34:50.918684 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 718/1503] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:49 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:50.927972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a19c641d-5589-4bc9-9767-5dd40c78b49f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1268b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:51.050924 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a19c641d-5589-4bc9-9767-5dd40c78b49f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.130782 Jun 16 18:34:51.061893 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 719/1504] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:50 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:51.074784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:51.077015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] [instance: a47fbd7d-f805-4344-a460-290bb5446846] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:51.087249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=14,nova_api:INSERT=7 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:51.089284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.090010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.091524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.092185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.124471 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] HTTP exception thrown: Instance a47fbd7d-f805-4344-a460-290bb5446846 could not be found. Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Request method failure captured: Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 HTTP/1.1 Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3doF9MjxxkJjWQin07sI9SUiAvJxcvIpeTVdg9sJeMlg5ga3KQlAlQURKHhjnsvGHomrN2p_W62-uCD7S9iY4bKUHcMiq4_K8-hJ5OvL2TaagfwHpIFPREuh75Gc6LMzCFnBAvUP5OikJUZfkvSX7RxapHDtv2knd2oPWtpCN3vJ5w Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 79372073be7047c1a4b57c6a7c9921e3 Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-LiveMigrationNegativeTest-354821352 Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:34:51.141678 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79372073be7047c1a4b57c6a7c9921e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79372073be7047c1a4b57c6a7c9921e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79372073be7047c1a4b57c6a7c9921e3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79372073be7047c1a4b57c6a7c9921e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-LiveMigrationNegativeTest-354821352 Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 79372073be7047c1a4b57c6a7c9921e3 Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-354821352 Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-LiveMigrationNegativeTest-354821352-project Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 3951b78564ed40e09eba285f35e4db6b Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-LiveMigrationNegativeTest-354821352-project Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a47fbd7d-f805-4344-a460-290bb5446846 could not be found. Jun 16 18:34:51.143646 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a47fbd7d-f805-4344-a460-290bb5446846'} Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47fbd7d-f805-4344-a460-290bb5446846 could not be found. Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:51.145019 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47fbd7d-f805-4344-a460-290bb5446846 could not be found. Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47fbd7d-f805-4344-a460-290bb5446846 could not be found. Jun 16 18:34:51.146711 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:34:51.149288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] Returning 404 to user: Instance a47fbd7d-f805-4344-a460-290bb5446846 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:51.154842 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-009e6054-5fe2-4f94-99b6-bc2e7f0be209 tempest-LiveMigrationNegativeTest-354821352 tempest-LiveMigrationNegativeTest-354821352-project] 10.222.0.27 "GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846" status: 404 len: 111 microversion: 2.1 time: 0.090627 Jun 16 18:34:51.156458 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 720/1505] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:51 2022] GET /compute/v2.1/servers/a47fbd7d-f805-4344-a460-290bb5446846 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:51.215714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:51.255623 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6e517da-5f2a-42e6-a323-e47889d96db9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1292 microversion: 2.1 time: 1.596560 Jun 16 18:34:51.259941 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 786/1506] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:49 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1292 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:51.280979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:51.283205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:51.303795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.304264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.311745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.312613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:52.000582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:52.005154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:52.033762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1025562536", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:52.075545 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b5f8a583-0d36-4d2f-ae9e-573278642a13 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.803703 Jun 16 18:34:52.088831 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 787/1507] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:51 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:52.119783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:52.127220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:52.153460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:52.170618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:52.173477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:52.183416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:52.188801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:34:53.343263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.379601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.382429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.390748 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ec25bdd-8187-43ec-9208-77f17c1fcbd6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 1.286916 Jun 16 18:34:53.394493 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 788/1508] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:52 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:53.406270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c46317d-5f4b-40bb-a002-e3cdef56be67 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1a4160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:53.411030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:34:53.412897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:34:53.413694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:34:53.414475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:34:53.415531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:34:53.460548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.476865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.485589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.487832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.514595 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c46317d-5f4b-40bb-a002-e3cdef56be67 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.118852 Jun 16 18:34:53.515504 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 789/1509] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:53 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:53.530416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Getting quotas for project 22faed45f96e4f129f8f35d01f836f22. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:53.536574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:53.537244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:53.540254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Getting quotas for user d469eedff61d49158ea934377d95d24d and project 22faed45f96e4f129f8f35d01f836f22. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:53.557696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:34:53.563481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.563938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.564898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.567048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:34:53.572034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.694487 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-801d9786-d2bd-471f-8e49-c360c34d392b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.528096 Jun 16 18:34:53.697533 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 721/1510] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:34:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:34:53.718790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:53.722989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:53.746908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.751347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.759135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.791611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.714399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:54.727941 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f1e0cdf-b458-41e6-8569-1e478795d818 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1472 microversion: 2.1 time: 1.208959 Jun 16 18:34:54.730531 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 790/1511] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:53 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1472 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:54.741608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0804ead7-d613-4422-98ce-b345b095af8a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:54.748077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0804ead7-d613-4422-98ce-b345b095af8a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:54.890044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:54.920968 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd346056-592c-4f92-bcec-b02703ae2983 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 1.214746 Jun 16 18:34:54.923149 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 722/1512] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:53 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:54.966114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:54.974449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:55.005738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.014657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.016442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.019448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.160769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0804ead7-d613-4422-98ce-b345b095af8a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:55.179814 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0804ead7-d613-4422-98ce-b345b095af8a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1217 microversion: 2.1 time: 0.447454 Jun 16 18:34:55.207965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 791/1513] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:54 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1217 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:55.258638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5cbe65ac-777b-49c9-afca-0326234a56e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866edd5ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:55.559194 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5cbe65ac-777b-49c9-afca-0326234a56e2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.342102 Jun 16 18:34:55.563019 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 792/1514] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:55 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:55.594977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1000972465", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:55.806338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:34:55.892442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:55.915451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:55.918921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:55.920200 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cad32882-7ce6-4e89-b9ea-a84060e914dc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.982977 Jun 16 18:34:55.920788 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 723/1515] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:54 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:55.965335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-124489e9-8fbb-42ad-bd0c-cd01f7d5f4d4 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Action: 'create', calling method: .version_select at 0x7f866f128700>, body: {"keypair": {"name": "tempest-keypair-1633317157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPts2X7bMhDekukqwiPQKyFjdwVzmUYtlfuQ1pTj7yG5F342oWiFjKjA/kxwEu/DfngEFEQiRBIZWGTM9VBAFx/nUtVQz69L0jkJG3oIJdOKZEUGV1COfSEZbiVsEVW5pg=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:56.048255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-124489e9-8fbb-42ad-bd0c-cd01f7d5f4d4 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Getting quotas for project 8153ca9ca7ea4d0381215928fc7c0900. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:56.067572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-124489e9-8fbb-42ad-bd0c-cd01f7d5f4d4 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Getting quotas for user 1560b6858b144a0397ad4ee7da636d8b and project 8153ca9ca7ea4d0381215928fc7c0900. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:56.152001 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-124489e9-8fbb-42ad-bd0c-cd01f7d5f4d4 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.205042 Jun 16 18:34:56.153166 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 724/1516] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:34:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:34:56.164036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:56.166695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:56.191794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:56.193129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:56.194980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:56.198335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.070762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:57.103389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c4e98469-8fda-46b3-9ea2-b8680542b2ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.948917 Jun 16 18:34:57.109423 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 725/1517] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:56 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:57.118814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:57.127017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:57.158602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.162762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.166283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.174152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.900660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:57.917766 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-877376ba-4d34-441a-9839-05aea2936e6a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1277 microversion: 2.1 time: 0.805691 Jun 16 18:34:57.919397 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 726/1518] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:57 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1277 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:57.936482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22a2d47f-2b48-45d4-a001-fefc0c640432 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f126670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:58.119515 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22a2d47f-2b48-45d4-a001-fefc0c640432 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1453 microversion: 2.1 time: 0.198223 Jun 16 18:34:58.120602 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 727/1519] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:34:57 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:58.138086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:58.140640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:58.171133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.171644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:58.172581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.181888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:58.410511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:34:58.414984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:34:58.415932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:34:58.416594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:34:58.417214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:34:58.443303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.444917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:58.453599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.455364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:58.504948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:58.527517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:58.573598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:34:58.599753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 6e29326b-fb6e-40ad-8e3b-ad2f7a711575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:34:58.716740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c680442-c8f8-4aa6-865d-63052d530ae6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.148818 Jun 16 18:34:58.717342 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 793/1520] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:34:59.584240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b180e3b1-64a7-4cd5-922d-b518222ecf2e tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Calling method '.version_select at 0x7f866ed5e820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:59.680863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:59.691768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:59.704705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:59.713360 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-538d0012-61de-48e9-9765-3294c85a210b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 1.585654 Jun 16 18:34:59.719598 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 728/1521] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:58 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:59.730864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:59.744895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:59.777668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:59.792569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:59.793535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:59.794996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:59.803195 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b180e3b1-64a7-4cd5-922d-b518222ecf2e tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd" status: 200 len: 371 microversion: 2.1 time: 1.082231 Jun 16 18:34:59.803806 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 794/1522] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:34:58 2022] GET /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd => generated 371 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:59.826533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23eb9e79-957a-4486-a1a5-e054b8a83c65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:59.827163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-23eb9e79-957a-4486-a1a5-e054b8a83c65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 6e29326b-fb6e-40ad-8e3b-ad2f7a711575] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:59.829362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=12,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:59.916856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-23eb9e79-957a-4486-a1a5-e054b8a83c65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 6e29326b-fb6e-40ad-8e3b-ad2f7a711575] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:35:00.395756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:00.434661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8e2c39b-eae8-4139-bb38-f918f6724d3b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.711931 Jun 16 18:35:00.443102 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 729/1523] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:59 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:00.459225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:00.464710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:00.492701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.498518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.499446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.504759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.889516 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.scheduler.client.report [None req-23eb9e79-957a-4486-a1a5-e054b8a83c65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Deleted allocations for instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 Jun 16 18:35:00.918614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:00.934877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-38501e37-4a3e-4fab-8b2f-d0726ee0e261 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1317 microversion: 2.1 time: 0.488150 Jun 16 18:35:00.937976 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 730/1524] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:00 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:00.947327 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-23eb9e79-957a-4486-a1a5-e054b8a83c65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575" status: 204 len: 0 microversion: 2.1 time: 1.141646 Jun 16 18:35:00.947995 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 795/1525] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:59 2022] DELETE /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575 => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:35:00.959235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fac6a492-b0b4-4a30-b189-adea25fc595d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Action: 'update', calling method: .version_select at 0x7f866edd5ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:00.961045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bbb5cd4-ea26-4713-9e7f-3e56d9b06bf3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f0ee1f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:01.067067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bbb5cd4-ea26-4713-9e7f-3e56d9b06bf3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1462 microversion: 2.1 time: 0.116903 Jun 16 18:35:01.068025 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 731/1526] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:00 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1462 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:01.074945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:01.077042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:01.091154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.092304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.097285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.098704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.591502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:01.606065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fac6a492-b0b4-4a30-b189-adea25fc595d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.606537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fac6a492-b0b4-4a30-b189-adea25fc595d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.608172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fac6a492-b0b4-4a30-b189-adea25fc595d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.609059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fac6a492-b0b4-4a30-b189-adea25fc595d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.619375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:01.621294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:01.635050 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-15b6275e-86f6-47f3-800a-5df31d52ca50 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.565179 Jun 16 18:35:01.644228 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 732/1527] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:01 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:01.669566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:01.671995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 6e29326b-fb6e-40ad-8e3b-ad2f7a711575] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:01.701036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.701547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.702438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.702889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.741461 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575 HTTP/1.1 Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:35:01.749454 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '6e29326b-fb6e-40ad-8e3b-ad2f7a711575'} Jun 16 18:35:01.751418 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:01.752675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:35:01.754843 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:01.757382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:01.758632 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-198840ed-f611-45fd-afa8-d772609c256f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575" status: 404 len: 111 microversion: 2.1 time: 0.112859 Jun 16 18:35:01.759788 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 733/1528] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:01 2022] GET /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:01.773022 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fac6a492-b0b4-4a30-b189-adea25fc595d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd" status: 200 len: 328 microversion: 2.1 time: 0.821266 Jun 16 18:35:01.778110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf903700-ea3c-4d5d-90d5-59336260de47 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1285e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:01.779263 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 796/1529] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:35:00 2022] PUT /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd => generated 328 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:01.796279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1500458182", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9a32d7ee-4120-4c70-bd0f-d2cbec85f884"}, {"port": "13200571-8aad-437e-ab86-6afa58231640", "tag": "port-1"}, {"port": "cd439c57-faec-4942-b7aa-ee4fd941b807", "tag": "port-2"}, {"uuid": "dce7a4d2-ab91-4d47-94d9-90dd2c97cb9b", "tag": "net-1"}, {"uuid": "dce7a4d2-ab91-4d47-94d9-90dd2c97cb9b"}, {"uuid": "64dfcc03-64b2-439f-8494-36ec6242c108", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "64dfcc03-64b2-439f-8494-36ec6242c108", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "61c18d86-919a-49b2-9d79-15fecd3f4d48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4ad1841c-c762-4b43-87b1-b1306ea38e26", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ee25703c-0156-4433-8864-ac460cb1afa7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1466479767"}], "key_name": "tempest-keypair-1633317157", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:01.864957 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf903700-ea3c-4d5d-90d5-59336260de47 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 200 len: 1462 microversion: 2.1 time: 0.102735 Jun 16 18:35:01.884121 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 734/1530] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:01 2022] GET /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 1462 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:01.910056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:01.913334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:01.946390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.949094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.956871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.962796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.316502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] validate_networks() for [('9a32d7ee-4120-4c70-bd0f-d2cbec85f884', None, None, None, None, None), (None, None, '13200571-8aad-437e-ab86-6afa58231640', None, None, None), (None, None, 'cd439c57-faec-4942-b7aa-ee4fd941b807', None, None, None), ('dce7a4d2-ab91-4d47-94d9-90dd2c97cb9b', None, None, None, None, None), ('dce7a4d2-ab91-4d47-94d9-90dd2c97cb9b', None, None, None, None, None), ('64dfcc03-64b2-439f-8494-36ec6242c108', '10.2.2.100', None, None, None, None), ('64dfcc03-64b2-439f-8494-36ec6242c108', '10.2.2.200', None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:35:02.736363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:02.746237 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19b8599b-702b-4522-818e-755cf41e2369 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.860710 Jun 16 18:35:02.754758 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 735/1531] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:01 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:02.768330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d3d2a06a-0f4f-4c19-a285-b37081f1125f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:02.788071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d3d2a06a-0f4f-4c19-a285-b37081f1125f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd" status: 202 len: 0 microversion: 2.1 time: 0.024875 Jun 16 18:35:02.789428 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 736/1532] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:35:02 2022] DELETE /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:35:02.794308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:02.795272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:02.803357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.803908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.804875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.805664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.482234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:03.492367 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5021e97a-89f8-4f1e-8f51-6a315133ac6b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 200 len: 1466 microversion: 2.1 time: 0.702360 Jun 16 18:35:03.494115 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 737/1533] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:02 2022] GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 1466 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:03.499023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:03.500817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:03.509136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.510034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.511058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.512024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.512912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:03.781389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:03.790698 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b5b967c4-ba4e-486b-82cb-bba1767194e2 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1317 microversion: 2.1 time: 0.296029 Jun 16 18:35:03.801418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 738/1534] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:03 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:03.807415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-898f31c3-a3f1-412f-b574-a9047fdeee97 req-90721add-f038-43bf-a444-a9aa420ce53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e31fb33-1093-4058-bdf4-aed87d21bf61", "tag": "fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:03.821291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-898f31c3-a3f1-412f-b574-a9047fdeee97 req-90721add-f038-43bf-a444-a9aa420ce53b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.822058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-898f31c3-a3f1-412f-b574-a9047fdeee97 req-90721add-f038-43bf-a444-a9aa420ce53b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.835388 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-898f31c3-a3f1-412f-b574-a9047fdeee97 req-90721add-f038-43bf-a444-a9aa420ce53b service nova] Creating event network-changed:fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f for instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 on n-h1-846209-2 Jun 16 18:35:03.844845 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-898f31c3-a3f1-412f-b574-a9047fdeee97 req-90721add-f038-43bf-a444-a9aa420ce53b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042034 Jun 16 18:35:03.846185 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 739/1535] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:03.858527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-7431256", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "06a9a0f4-e2e7-4b09-9d3d-fea8950fac70"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:03.926542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:35:04.625410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:35:04.626854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:35:04.627050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:35:04.627713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:35:04.629393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:35:04.641111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=34,nova_cell0:UPDATE=7 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:04.646697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.647144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.647948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.648521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.670840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:35:04.678261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:35:04.692035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:35:04.694493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:35:04.744510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a4dd5ae-5d60-4783-9c44-9a7fd671a0bd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890172 Jun 16 18:35:04.750087 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 740/1536] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:35:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:35:04.755774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:04.756388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:04.762931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.763530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.764562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.764994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.073039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:05.079219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:05.095587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:05.097895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:05.099293 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8fb97550-349d-4db1-8319-636e414cb700 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.347694 Jun 16 18:35:05.100088 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 741/1537] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:04 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:05.107442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1884a078-7f67-4a37-b50a-bd4af6523f7a tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Calling method '.version_select at 0x7f866f128d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:05.360782 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1884a078-7f67-4a37-b50a-bd4af6523f7a tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd" status: 200 len: 371 microversion: 2.1 time: 0.258965 Jun 16 18:35:05.361535 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 742/1538] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:35:05 2022] GET /compute/v2.1/os-quota-sets/8f862b20622249e1b315d96fd78404fd => generated 371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:05.378719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e4ff4327-47bf-4c2b-8066-cabf1ebdc643 req-90d885e4-3bd3-4ff8-9200-82238a819286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0271c7ba-7672-4448-8a5f-33e3150857fd", "name": "network-vif-unplugged", "status": "completed", "tag": "c6d88fb8-bcea-40fb-9158-9244e91ce3f1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:05.391641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e4ff4327-47bf-4c2b-8066-cabf1ebdc643 req-90d885e4-3bd3-4ff8-9200-82238a819286 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.392521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e4ff4327-47bf-4c2b-8066-cabf1ebdc643 req-90d885e4-3bd3-4ff8-9200-82238a819286 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.409363 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e4ff4327-47bf-4c2b-8066-cabf1ebdc643 req-90d885e4-3bd3-4ff8-9200-82238a819286 service nova] Creating event network-vif-unplugged:c6d88fb8-bcea-40fb-9158-9244e91ce3f1 for instance 0271c7ba-7672-4448-8a5f-33e3150857fd on n-h2-846209-2 Jun 16 18:35:05.417456 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e4ff4327-47bf-4c2b-8066-cabf1ebdc643 req-90d885e4-3bd3-4ff8-9200-82238a819286 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047941 Jun 16 18:35:05.423015 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 743/1539] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:05.435404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6cf034ec-0d5e-4096-b21a-26fdedbdda9c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-473212272"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:05.437011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6cf034ec-0d5e-4096-b21a-26fdedbdda9c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:05.446652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cf034ec-0d5e-4096-b21a-26fdedbdda9c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.450174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cf034ec-0d5e-4096-b21a-26fdedbdda9c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.451614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cf034ec-0d5e-4096-b21a-26fdedbdda9c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.452297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cf034ec-0d5e-4096-b21a-26fdedbdda9c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.869721 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6cf034ec-0d5e-4096-b21a-26fdedbdda9c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "POST /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac/action" status: 202 len: 0 microversion: 2.1 time: 0.444717 Jun 16 18:35:05.870582 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 744/1540] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:35:05 2022] POST /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:35:05.879411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:05.880482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:05.900864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.901936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.905032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.905653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.379380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:06.388297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94f5ea57-6823-423b-9e50-b67e743f3be0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.516680 Jun 16 18:35:06.389982 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 745/1541] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:05 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:06.395527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:06.396290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:06.403338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.403807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.404618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.405062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.508498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:06.518673 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9d1afe65-b3fe-444e-ab24-ce0d82f5f087 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1270 microversion: 2.1 time: 0.127349 Jun 16 18:35:06.520326 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 746/1542] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:06 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:06.525542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:06.526469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:06.533180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.533633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.534513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.535319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.771045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:35:06.771876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:35:06.772128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:35:06.772665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:35:06.773185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:35:06.781403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=27 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:06.787285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.787907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.788841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.789386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.802243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:06.809498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Getting quotas for project 8153ca9ca7ea4d0381215928fc7c0900. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:35:06.812672 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eb564fd3-385a-4568-bf9c-1f3fbf4dfc34 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1317 microversion: 2.1 time: 0.291211 Jun 16 18:35:06.815980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Getting quotas for user 1560b6858b144a0397ad4ee7da636d8b and project 8153ca9ca7ea4d0381215928fc7c0900. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:35:06.825996 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 747/1543] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:06 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:06.836804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4294fb1b-8311-459d-94a2-065347729f5c tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Calling method '.version_select at 0x7f866f126ca0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.045232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:35:07.052256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='61c18d86-919a-49b2-9d79-15fecd3f4d48',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4ad1841c-c762-4b43-87b1-b1306ea38e26',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee25703c-0156-4433-8864-ac460cb1afa7',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:35:07.128779 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4294fb1b-8311-459d-94a2-065347729f5c tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19/defaults" status: 200 len: 371 microversion: 2.1 time: 0.300442 Jun 16 18:35:07.131380 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 748/1544] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:35:06 2022] GET /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19/defaults => generated 371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:07.141449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bf2a9ab-b055-465d-aeed-06be4d4be887 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f0ee940>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.253614 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bf2a9ab-b055-465d-aeed-06be4d4be887 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.116715 Jun 16 18:35:07.257461 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 749/1545] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:07 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:07.588203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.589361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:07.597982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.598897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.599965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.600624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.702300 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aeb0161d-3b22-47bd-864d-55703f574b3d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.921605 Jun 16 18:35:07.709813 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 797/1546] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Jun 16 18:35:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 5930 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:35:07.715534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.716567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:07.728598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.729484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.730644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.731338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.823674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:07.837530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:07.839113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:07.840590 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b42ee47-ef94-4b5c-92c8-9d4d9d8f2edd tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.578753 Jun 16 18:35:07.841153 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 750/1547] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:07 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:07.860962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.861589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:07.889095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.889804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.890647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.891117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.987195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:08.001879 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d089b6cd-901d-40ce-8f33-91eeb1d1dd8b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.289809 Jun 16 18:35:08.012830 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 798/1548] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:07 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:08.017982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-024098e5-e433-468c-a707-28e031e243c2 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Action: 'update', calling method: .version_select at 0x7f866f4ff820>, body: {"quota_set": {"ram": "5120"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:08.209263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:08.236986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bbc53b68-ed8c-438e-b8e1-831154438ad6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1318 microversion: 2.1 time: 0.391481 Jun 16 18:35:08.241429 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 751/1549] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:07 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:08.258527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ba9bb2f-59a2-4323-8c2c-ded65325554b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:08.259438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2ba9bb2f-59a2-4323-8c2c-ded65325554b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:08.276467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024098e5-e433-468c-a707-28e031e243c2 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.277290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024098e5-e433-468c-a707-28e031e243c2 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.278448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024098e5-e433-468c-a707-28e031e243c2 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.279169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024098e5-e433-468c-a707-28e031e243c2 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.370963 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-024098e5-e433-468c-a707-28e031e243c2 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa" status: 200 len: 328 microversion: 2.1 time: 0.352148 Jun 16 18:35:08.383189 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 799/1550] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:35:08 2022] PUT /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa => generated 328 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:08.388841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:08.390095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:08.403269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.404082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.405661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.406673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.488552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2ba9bb2f-59a2-4323-8c2c-ded65325554b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:08.496811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2ba9bb2f-59a2-4323-8c2c-ded65325554b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:08.499588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2ba9bb2f-59a2-4323-8c2c-ded65325554b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:08.500783 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2ba9bb2f-59a2-4323-8c2c-ded65325554b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1286 microversion: 2.32 time: 0.258011 Jun 16 18:35:08.501359 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 752/1551] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:08 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1286 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:08.506990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b4c7336c-6a11-41ae-b392-e3f98f2fa8b6 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f0e5ee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:08.571987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b4c7336c-6a11-41ae-b392-e3f98f2fa8b6 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.068984 Jun 16 18:35:08.572656 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 753/1552] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:08 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:08.590953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a495772-48fd-4379-86be-e96d3ee4d352 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Calling method '.version_select at 0x7f866f0eeb80>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:08.672106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:08.684709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a495772-48fd-4379-86be-e96d3ee4d352 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.685363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a495772-48fd-4379-86be-e96d3ee4d352 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.686697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a495772-48fd-4379-86be-e96d3ee4d352 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.687534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a495772-48fd-4379-86be-e96d3ee4d352 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.720197 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a495772-48fd-4379-86be-e96d3ee4d352 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa/detail" status: 200 len: 916 microversion: 2.1 time: 0.146329 Jun 16 18:35:08.727123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:08.732429 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 754/1553] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:35:08 2022] GET /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa/detail => generated 916 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:08.738686 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-862ca13f-048e-4dd3-baa4-2ffeff7826b3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1317 microversion: 2.1 time: 0.353380 Jun 16 18:35:08.739813 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 800/1554] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:08 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:08.860026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:08.860865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:08.869499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.870248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.871393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.872270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.996696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Action: 'update', calling method: .version_select at 0x7f866ed59040>, body: {"quota_set": {"ram": "2048"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:09.114390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.115805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.116953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.117680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.184181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.197970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.203087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.208340 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3530bde-ab77-4b35-a84e-029a785da88b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.352703 Jun 16 18:35:09.211026 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 755/1555] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:08 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:09.222650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.224014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.225639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.226728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.227604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:09.229809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:09.245336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.248299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.249615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.256229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.353629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7f0afa35-d573-4bf7-9e66-5e8539aaf15f tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa?user_id=66f68ab56c8f4af5a42b12d3028d88c2" status: 200 len: 328 microversion: 2.1 time: 0.359756 Jun 16 18:35:09.357120 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 801/1556] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:35:08 2022] PUT /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa?user_id=66f68ab56c8f4af5a42b12d3028d88c2 => generated 328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:09.370877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:09.372725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:09.393052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.394844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.395855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.396305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.598707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.614438 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5013c5ae-a6f5-41ba-a38e-ed31a06a3360 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.395335 Jun 16 18:35:09.615597 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 756/1557] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:09 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:09.642307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daf7ead8-6c1d-4ba3-9101-224bed0a3d5d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Calling method '.version_select at 0x7f866f0e5820>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:09.753855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.760878 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-161bda10-fe6b-4b87-a4f0-7d2052c6d9b2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1318 microversion: 2.1 time: 0.402132 Jun 16 18:35:09.775582 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 802/1558] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:09 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:09.788259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:09.789142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:09.799741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.807794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.809199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.809658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.880725 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-daf7ead8-6c1d-4ba3-9101-224bed0a3d5d tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa?user_id=66f68ab56c8f4af5a42b12d3028d88c2" status: 200 len: 370 microversion: 2.1 time: 0.263976 Jun 16 18:35:09.881324 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 757/1559] 10.222.0.27 () {58 vars in 1322 bytes} [Thu Jun 16 18:35:09 2022] GET /compute/v2.1/os-quota-sets/bfc5b5d85d93415ca8ea9feb2f0c1afa?user_id=66f68ab56c8f4af5a42b12d3028d88c2 => generated 370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:09.896357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23c7d9fd-f9f0-4763-b1f0-dcb863ba6104 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f128430>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:09.975129 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-23c7d9fd-f9f0-4763-b1f0-dcb863ba6104 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.086967 Jun 16 18:35:09.977977 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 758/1560] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:09 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:10.005227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-310e55f2-0794-49a8-9a52-1a20757adaa3 req-56011530-0799-4af9-820f-0680770a7f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71636c96-2206-4a76-9f30-5f0db5ecc7b7", "tag": "f04cc549-e376-4e06-bda3-30135f49180f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:10.030858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-310e55f2-0794-49a8-9a52-1a20757adaa3 req-56011530-0799-4af9-820f-0680770a7f40 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.032803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-310e55f2-0794-49a8-9a52-1a20757adaa3 req-56011530-0799-4af9-820f-0680770a7f40 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.060121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-310e55f2-0794-49a8-9a52-1a20757adaa3 req-56011530-0799-4af9-820f-0680770a7f40 service nova] Creating event network-changed:f04cc549-e376-4e06-bda3-30135f49180f for instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 on n-h2-846209-2 Jun 16 18:35:10.075098 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-310e55f2-0794-49a8-9a52-1a20757adaa3 req-56011530-0799-4af9-820f-0680770a7f40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083476 Jun 16 18:35:10.077233 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 759/1561] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:10.114887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.119630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.152252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.155124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.163430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.164499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.172608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.210619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.212505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.214963 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3f0f5536-be49-4fc5-a10f-c9395512b465 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1520 microversion: 2.32 time: 0.438030 Jun 16 18:35:10.215559 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 803/1562] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:09 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:10.247509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.248920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.274342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.275138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.279791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.280601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.700864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.725151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.729488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.732499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7439428f-84f2-4098-bbc7-5987ac1782f6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.499899 Jun 16 18:35:10.734623 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 804/1563] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:10 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:10.742207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f265401d-38c7-4721-acac-7d39e0ba6b7c req-b77dd81c-2a9d-4b62-9b52-0fe5c0974f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e31fb33-1093-4058-bdf4-aed87d21bf61", "name": "network-vif-plugged", "status": "completed", "tag": "fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:10.751876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f265401d-38c7-4721-acac-7d39e0ba6b7c req-b77dd81c-2a9d-4b62-9b52-0fe5c0974f07 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.752705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f265401d-38c7-4721-acac-7d39e0ba6b7c req-b77dd81c-2a9d-4b62-9b52-0fe5c0974f07 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.773056 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f265401d-38c7-4721-acac-7d39e0ba6b7c req-b77dd81c-2a9d-4b62-9b52-0fe5c0974f07 service nova] Creating event network-vif-plugged:fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f for instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 on n-h1-846209-2 Jun 16 18:35:10.781360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.797155 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3956218a-a241-4314-8005-2235bcaba545 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1317 microversion: 2.1 time: 0.718529 Jun 16 18:35:10.797923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f265401d-38c7-4721-acac-7d39e0ba6b7c req-b77dd81c-2a9d-4b62-9b52-0fe5c0974f07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057769 Jun 16 18:35:10.804007 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 760/1564] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:10 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:10.810124 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 805/1565] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:10.835563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.837177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.838066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.840399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.852116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.856995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.860109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.860802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.869121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.869892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.872831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.880110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.430123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:11.451166 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-62aaaca1-d8b9-4f49-8b4d-cd6c4a0576da tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1318 microversion: 2.1 time: 0.639208 Jun 16 18:35:11.451763 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 806/1566] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:10 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1318 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:11.459314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-65118846-3213-4c90-a59d-5b602e7c9dae tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Calling method '.version_select at 0x7f866ed9f940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.536936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:11.549745 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-093507d1-cf53-44c2-8efc-23a198c3fb84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.736834 Jun 16 18:35:11.567197 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 761/1567] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:10 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:11.589276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-742f307e-0644-4cd7-84bb-308a5f30c857 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f150790>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.774252 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-742f307e-0644-4cd7-84bb-308a5f30c857 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.205544 Jun 16 18:35:11.775146 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 762/1568] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:11 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:11.795890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.796606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:11.830101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.830705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.832312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.832776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.081039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:12.087215 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-65118846-3213-4c90-a59d-5b602e7c9dae tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19/defaults" status: 200 len: 371 microversion: 2.1 time: 0.629555 Jun 16 18:35:12.089064 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 807/1569] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:35:11 2022] GET /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19/defaults => generated 371 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:12.104509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:12.106032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:12.129169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.146410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.147703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.149654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.149896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:12.168101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:12.169660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:12.170902 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50120795-97b3-46d6-ae5f-b1bfc309b875 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1594 microversion: 2.32 time: 0.394996 Jun 16 18:35:12.171474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 763/1570] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:11 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1594 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:12.194835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:12.198677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:12.219053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.232895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.234189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.235741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.905888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:12.924021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:12.936503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:12.941382 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bae5e2f0-fc65-46ff-aba3-7e2b213e3769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.844135 Jun 16 18:35:12.953925 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 808/1571] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:12 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:12.973188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d28901b-dc59-437a-885b-37442aba2252 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Action: 'update', calling method: .version_select at 0x7f866ed80ee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:13.033388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:13.058090 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a13192f5-542f-45e9-a514-62c125169471 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1317 microversion: 2.1 time: 0.869352 Jun 16 18:35:13.063446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 764/1572] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:12 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1317 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:13.069733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b9a3f01e-7bc1-4025-8304-5a7f447ad592 req-cec0cc62-ef76-4df3-89b6-8a294befa849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "name": "network-vif-unplugged", "status": "completed", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}, {"name": "network-changed", "server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:13.082633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b9a3f01e-7bc1-4025-8304-5a7f447ad592 req-cec0cc62-ef76-4df3-89b6-8a294befa849 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.083474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b9a3f01e-7bc1-4025-8304-5a7f447ad592 req-cec0cc62-ef76-4df3-89b6-8a294befa849 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.101458 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b9a3f01e-7bc1-4025-8304-5a7f447ad592 req-cec0cc62-ef76-4df3-89b6-8a294befa849 service nova] Creating event network-vif-unplugged:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h1-846209-2 Jun 16 18:35:13.102314 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b9a3f01e-7bc1-4025-8304-5a7f447ad592 req-cec0cc62-ef76-4df3-89b6-8a294befa849 service nova] Creating event network-changed:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h1-846209-2 Jun 16 18:35:13.119442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b9a3f01e-7bc1-4025-8304-5a7f447ad592 req-cec0cc62-ef76-4df3-89b6-8a294befa849 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.054014 Jun 16 18:35:13.120432 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 765/1573] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:13.126660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d28901b-dc59-437a-885b-37442aba2252 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.127706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-35db0d6e-a420-4f45-a4a8-9f91e3fb8129 req-6be5b259-0f1f-4917-9e69-8548f17d4739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "name": "network-vif-unplugged", "status": "completed", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:13.128981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d28901b-dc59-437a-885b-37442aba2252 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.130042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d28901b-dc59-437a-885b-37442aba2252 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.130645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d28901b-dc59-437a-885b-37442aba2252 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.138885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-35db0d6e-a420-4f45-a4a8-9f91e3fb8129 req-6be5b259-0f1f-4917-9e69-8548f17d4739 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.139342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-35db0d6e-a420-4f45-a4a8-9f91e3fb8129 req-6be5b259-0f1f-4917-9e69-8548f17d4739 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.152314 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-35db0d6e-a420-4f45-a4a8-9f91e3fb8129 req-6be5b259-0f1f-4917-9e69-8548f17d4739 service nova] Creating event network-vif-unplugged:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h2-846209-2 Jun 16 18:35:13.170982 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-35db0d6e-a420-4f45-a4a8-9f91e3fb8129 req-6be5b259-0f1f-4917-9e69-8548f17d4739 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048781 Jun 16 18:35:13.172374 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 766/1574] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:13.181299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:13.182499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:13.199226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.200400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.201472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.202154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.694598 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2d28901b-dc59-437a-885b-37442aba2252 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19" status: 200 len: 329 microversion: 2.1 time: 0.737011 Jun 16 18:35:13.702160 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 809/1575] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Jun 16 18:35:12 2022] PUT /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19 => generated 329 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:13.727900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:13.729995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:13.764076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.770498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.776211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.779545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.875583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:13.895202 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-370eb26c-2735-4511-a137-3becf6d75ad2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1318 microversion: 2.1 time: 0.718598 Jun 16 18:35:13.896577 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 767/1576] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:13 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:13.909928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2969a763-bd7b-486d-8a02-8fbd8821e396 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f0cb4c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:14.027846 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2969a763-bd7b-486d-8a02-8fbd8821e396 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.128013 Jun 16 18:35:14.029661 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 768/1577] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:13 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:14.045387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-12cf1ed9-39ec-4c05-8e30-32f7f9afa528 req-845c7686-98ff-42b8-ac28-44051e406e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5779c9c3-e87d-4f34-927f-80dcc658a1ac", "name": "network-vif-plugged", "status": "completed", "tag": "15a9a46d-c311-4249-9ee6-e83453d113e4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:14.102819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-12cf1ed9-39ec-4c05-8e30-32f7f9afa528 req-845c7686-98ff-42b8-ac28-44051e406e60 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:14.103892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-12cf1ed9-39ec-4c05-8e30-32f7f9afa528 req-845c7686-98ff-42b8-ac28-44051e406e60 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:14.160883 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-12cf1ed9-39ec-4c05-8e30-32f7f9afa528 req-845c7686-98ff-42b8-ac28-44051e406e60 service nova] Creating event network-vif-plugged:15a9a46d-c311-4249-9ee6-e83453d113e4 for instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac on n-h2-846209-2 Jun 16 18:35:14.183889 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-12cf1ed9-39ec-4c05-8e30-32f7f9afa528 req-845c7686-98ff-42b8-ac28-44051e406e60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152799 Jun 16 18:35:14.197262 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 769/1578] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:14.219356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:14.219862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:14.240497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:14.240969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:14.247840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:14.248365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:14.324215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:14.461804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:14.478983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a0ff73b5-616c-4ad3-bc46-97c2c6807fb0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.773187 Jun 16 18:35:14.484538 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 810/1579] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:13 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:14.498438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5a5b3aed-2870-475d-8f09-76630c2f3cd6 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Action: 'update', calling method: .version_select at 0x7f866f113940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:14.627219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a5b3aed-2870-475d-8f09-76630c2f3cd6 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:14.632838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a5b3aed-2870-475d-8f09-76630c2f3cd6 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:14.643769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a5b3aed-2870-475d-8f09-76630c2f3cd6 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:14.646622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a5b3aed-2870-475d-8f09-76630c2f3cd6 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:14.692969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:14.710212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:14.711678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:14.718881 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5aa43c2c-a045-4bbe-9eb5-a0ff0a1504df tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1662 microversion: 2.32 time: 0.519682 Jun 16 18:35:14.733254 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 770/1580] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:14 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1662 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:14.746086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:14.747538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:14.774013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:14.775168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:14.778528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:14.778826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:15.232035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=26,nova_api:UPDATE=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:15.247372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:15.266815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:15.269683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:15.271126 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5f228965-58f4-40de-b5c2-8baf849d0e34 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.536606 Jun 16 18:35:15.281963 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 771/1581] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:14 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:15.281963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:15.288175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:15.306229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:15.306644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:15.307436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:15.307881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:15.372159 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5a5b3aed-2870-475d-8f09-76630c2f3cd6 tempest-QuotasAdminTestJSON-703113325 tempest-QuotasAdminTestJSON-703113325-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19" status: 200 len: 329 microversion: 2.1 time: 0.885754 Jun 16 18:35:15.373107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 811/1582] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Jun 16 18:35:14 2022] PUT /compute/v2.1/os-quota-sets/4b1ac42ff9ce413cb23ab375272d8f19 => generated 329 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:15.378912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:15.379569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:15.411932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:15.412499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:15.413623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:15.414538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:15.611466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:15.625314 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c45fedb3-b1f0-4b0b-9905-f65ce9888297 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1467 microversion: 2.1 time: 0.352177 Jun 16 18:35:15.631006 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 772/1583] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:15 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1467 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:15.642175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fe93ee74-e178-413b-9a56-8857d008b4b2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f153430>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:15.810504 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fe93ee74-e178-413b-9a56-8857d008b4b2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.178248 Jun 16 18:35:15.811094 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 773/1584] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:15 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:15.822773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c92cd174-b6d5-4bcf-97cc-d09e62ad59c6 req-839e0b0d-644e-4e6d-b74e-dc6f457baae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:15.842489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c92cd174-b6d5-4bcf-97cc-d09e62ad59c6 req-839e0b0d-644e-4e6d-b74e-dc6f457baae1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:15.842960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c92cd174-b6d5-4bcf-97cc-d09e62ad59c6 req-839e0b0d-644e-4e6d-b74e-dc6f457baae1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:15.874987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c92cd174-b6d5-4bcf-97cc-d09e62ad59c6 req-839e0b0d-644e-4e6d-b74e-dc6f457baae1 service nova] Creating event network-changed:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h2-846209-2 Jun 16 18:35:15.887078 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c92cd174-b6d5-4bcf-97cc-d09e62ad59c6 req-839e0b0d-644e-4e6d-b74e-dc6f457baae1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074732 Jun 16 18:35:15.895387 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 774/1585] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:15.916358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:15.917098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:15.942013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:15.945529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:15.946081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:15.946541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:16.185895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:16.195506 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-188e149c-736f-4353-bf5a-ddd8b9218ff1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.303364 Jun 16 18:35:16.203039 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 775/1586] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:15 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:16.209676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:16.225975 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-62c64050-0d12-4331-b94d-852f567e97d4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1318 microversion: 2.1 time: 0.851089 Jun 16 18:35:16.227739 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 812/1587] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:15 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:16.234017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2061681049", "metadata": {"image_type": "test"}}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:16.236008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:16.241887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:16.243284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:16.262553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:16.267407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:16.267407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:16.267407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:16.267407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:16.270490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:16.271614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:16.276882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:16.391821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Getting quotas for project 22faed45f96e4f129f8f35d01f836f22. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:35:16.407090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Getting quotas for user d469eedff61d49158ea934377d95d24d and project 22faed45f96e4f129f8f35d01f836f22. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:35:16.578703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:16.601945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:16.609374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:16.610658 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e275fe8-2d64-4b55-8b01-c4da61115e8e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1662 microversion: 2.32 time: 0.380653 Jun 16 18:35:16.630891 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 813/1588] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:16 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1662 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:16.637675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:16.638329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:16.679343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:16.679818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:16.680632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:16.681082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:17.270018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:17.332743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:17.333082 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-129a5afd-98bc-47e9-9400-8cf9ba7a6560 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "POST /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61/action" status: 202 len: 0 microversion: 2.1 time: 1.122540 Jun 16 18:35:17.333931 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 776/1589] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:35:16 2022] POST /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61/action => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:35:17.362256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:17.387271 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-984bdc2b-b1f8-4888-a0c6-1869c890c37f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.754701 Jun 16 18:35:17.388850 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 814/1590] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:16 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:17.403552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c47a878c-46f7-44f3-89a6-826527579c46 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ed9f280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:17.531328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c47a878c-46f7-44f3-89a6-826527579c46 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.140117 Jun 16 18:35:17.540739 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 815/1591] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:17 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:17.557713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:17.559131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:17.601708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:17.609783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:17.616987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:17.617737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:17.664055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:17.822644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-25d4bec1-8171-40a0-ad4c-1ebc0144a3a8 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Action: 'update', calling method: .version_select at 0x7f867819d430>, body: {"quota_set": {"ram": "5120"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:17.965105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25d4bec1-8171-40a0-ad4c-1ebc0144a3a8 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:17.965862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25d4bec1-8171-40a0-ad4c-1ebc0144a3a8 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:17.967521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25d4bec1-8171-40a0-ad4c-1ebc0144a3a8 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:17.968646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25d4bec1-8171-40a0-ad4c-1ebc0144a3a8 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:18.109585 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-25d4bec1-8171-40a0-ad4c-1ebc0144a3a8 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb" status: 200 len: 148 microversion: 2.57 time: 0.773542 Jun 16 18:35:18.116107 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 777/1592] 10.222.0.27 () {62 vars in 1302 bytes} [Thu Jun 16 18:35:17 2022] PUT /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb => generated 148 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:35:18.133735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:18.134584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:18.154504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:18.169947 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-73ef75cf-6903-4602-ada6-15fa433127c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.631948 Jun 16 18:35:18.172992 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 816/1593] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:17 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:18.178699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:18.179633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:18.180895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:18.181664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:18.182976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e5e87c7-3db8-45b3-9341-e33c40520177 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866ed9f160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:18.323466 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e5e87c7-3db8-45b3-9341-e33c40520177 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 0.144479 Jun 16 18:35:18.331956 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 817/1594] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:18 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:18.345451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:18.348171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:18.370659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:18.371532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:18.378972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:18.382956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:18.795972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:18.812262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:18.813216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:18.815110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:18.817786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8edb52fb-fc15-4410-acbf-7f2ce4f7c9b0 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1709 microversion: 2.32 time: 0.484015 Jun 16 18:35:18.820831 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 818/1595] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:18 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1709 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:18.827964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33ea7b7a-5314-4d1e-bbfd-419e1fbea82f tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Calling method '.version_select at 0x7f866ed9f940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:18.846537 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9171c52d-66f4-4f58-addc-858d898ef669 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1318 microversion: 2.1 time: 0.723555 Jun 16 18:35:18.848515 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 778/1596] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:18 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:18.864865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:18.873485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:18.888341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:18.888942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:18.891733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:18.893001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:19.358754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:19.411118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:19.442593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:19.447983 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a553d59-5566-4125-84ab-f3beff48bb85 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.596424 Jun 16 18:35:19.454077 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 779/1597] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:18 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:19.495859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16b94a87-0e42-4326-845d-23c5e6fe9826 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f0e5f70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:19.595822 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16b94a87-0e42-4326-845d-23c5e6fe9826 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.136792 Jun 16 18:35:19.604132 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 780/1598] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:19 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:19.605895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:19.616678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:19.650852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:19.656640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:19.658708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:19.660668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:19.734706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33ea7b7a-5314-4d1e-bbfd-419e1fbea82f tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:19.735631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33ea7b7a-5314-4d1e-bbfd-419e1fbea82f tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:19.735973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33ea7b7a-5314-4d1e-bbfd-419e1fbea82f tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:19.744787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33ea7b7a-5314-4d1e-bbfd-419e1fbea82f tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:19.791266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=18 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:19.840927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33ea7b7a-5314-4d1e-bbfd-419e1fbea82f tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb/detail" status: 200 len: 463 microversion: 2.57 time: 1.018229 Jun 16 18:35:19.845224 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 819/1599] 10.222.0.27 () {60 vars in 1303 bytes} [Thu Jun 16 18:35:18 2022] GET /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb/detail => generated 463 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:35:19.864858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdfd1d0d-3363-4a1d-b104-c5390844bd9d tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866eba09d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:19.963070 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bdfd1d0d-3363-4a1d-b104-c5390844bd9d tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 0.114131 Jun 16 18:35:19.982853 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 820/1600] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:19 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:19.997854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e5791936-582b-42da-bf3b-d6e53a9183a1 req-4143a0a2-04f4-4bc6-afdc-0fcdf15b8cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71636c96-2206-4a76-9f30-5f0db5ecc7b7", "name": "network-vif-plugged", "status": "completed", "tag": "f04cc549-e376-4e06-bda3-30135f49180f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:20.042825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e5791936-582b-42da-bf3b-d6e53a9183a1 req-4143a0a2-04f4-4bc6-afdc-0fcdf15b8cf7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:20.043298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e5791936-582b-42da-bf3b-d6e53a9183a1 req-4143a0a2-04f4-4bc6-afdc-0fcdf15b8cf7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:20.082297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e5791936-582b-42da-bf3b-d6e53a9183a1 req-4143a0a2-04f4-4bc6-afdc-0fcdf15b8cf7 service nova] Creating event network-vif-plugged:f04cc549-e376-4e06-bda3-30135f49180f for instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 on n-h2-846209-2 Jun 16 18:35:20.094760 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e5791936-582b-42da-bf3b-d6e53a9183a1 req-4143a0a2-04f4-4bc6-afdc-0fcdf15b8cf7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108976 Jun 16 18:35:20.098627 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 821/1601] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:20.110390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:20.121989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:20.122757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:20.151355 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69266110-21c9-48c2-8adf-3c494c6bf0dd tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.549510 Jun 16 18:35:20.154595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:20.155060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:20.155986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:20.156678 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 781/1602] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:19 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:20.161855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:20.180614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:20.188556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:20.220716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:20.230488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:20.258309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:20.261558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:20.797073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:20.837841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:20.839555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:20.840786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-73b23e0f-a699-42f0-8a2a-927f88e69311 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1756 microversion: 2.32 time: 0.731584 Jun 16 18:35:20.852958 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 822/1603] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:20 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1756 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:20.858738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Action: 'update', calling method: .version_select at 0x7f866eba04c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:20.920048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:20.935595 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-18c9443c-f8c3-4564-b212-472dc400ec6f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1318 microversion: 2.1 time: 0.774064 Jun 16 18:35:20.936734 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 782/1604] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:20 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1318 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:20.956659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:20.966724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:20.993074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:20.994870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:20.996405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:20.997799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:21.249396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:21.256956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:21.273509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:21.282674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:21.344867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:21.386845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:21.389159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:21.396711 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a97471ab-7d04-4408-b3c2-e837d6bd59fb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.458624 Jun 16 18:35:21.416025 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 783/1605] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:20 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:21.433476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0749e3cd-2a64-455e-99ff-690dcd3baa4d tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f0e5e50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:21.539623 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0749e3cd-2a64-455e-99ff-690dcd3baa4d tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1452 microversion: 2.1 time: 0.121032 Jun 16 18:35:21.543066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:21.543933 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 784/1606] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:21 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:21.555708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-476a83e3-4c0e-4aa1-9533-2643ed2447af tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f867819a0d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:21.557538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:21.563312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:21.566828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:21.572150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:21.689073 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-476a83e3-4c0e-4aa1-9533-2643ed2447af tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 0.143554 Jun 16 18:35:21.692308 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 785/1607] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:21 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:21.705236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:21.711723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:21.721272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:21.725639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:21.731387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:21.733742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:21.747947 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d0bd9fd-60d2-4b47-9873-74ca90a3ff18 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb?user_id=6c8db9f055ca406490a27c1fefa1870a" status: 200 len: 148 microversion: 2.57 time: 0.893520 Jun 16 18:35:21.757074 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 823/1608] 10.222.0.27 () {62 vars in 1383 bytes} [Thu Jun 16 18:35:20 2022] PUT /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb?user_id=6c8db9f055ca406490a27c1fefa1870a => generated 148 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:35:21.764073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-84311aab-01eb-47de-956a-0bfd3817bb65 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] Calling method '.version_select at 0x7f866ebaa5e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:22.229158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:22.259008 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a62a3176-1334-47b0-a52f-f58b07400e86 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1717 microversion: 2.1 time: 0.565387 Jun 16 18:35:22.268154 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 786/1609] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:21 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1717 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:22.291863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:22.295696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:22.327701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:22.337781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:22.339225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:22.342577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:22.623835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-84311aab-01eb-47de-956a-0bfd3817bb65 tempest-QuotasAdminTestV257-1234016737 tempest-QuotasAdminTestV257-1234016737-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb?user_id=6c8db9f055ca406490a27c1fefa1870a" status: 200 len: 190 microversion: 2.57 time: 0.864035 Jun 16 18:35:22.633994 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 824/1610] 10.222.0.27 () {60 vars in 1363 bytes} [Thu Jun 16 18:35:21 2022] GET /compute/v2.1/os-quota-sets/8e7d65369e774cdda761236694414cdb?user_id=6c8db9f055ca406490a27c1fefa1870a => generated 190 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:35:22.639473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:22.651522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:22.660169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:22.663997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:22.665481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:22.673008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:23.016521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:23.036101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:23.042960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:23.054836 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d57e23da-8a85-4ad6-8647-3f40b531cf50 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1803 microversion: 2.32 time: 0.783166 Jun 16 18:35:23.055623 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 787/1611] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:22 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1803 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:23.086376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:23.088787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:23.121211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:23.129108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:23.133208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:23.134602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:23.184794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:23.200829 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-696d9f0f-150f-4b9d-85e8-b1b8ac87bac0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1498 microversion: 2.1 time: 0.565369 Jun 16 18:35:23.203552 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 825/1612] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:22 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1498 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:23.218931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-47d7e5c9-af84-4a53-a9da-b8ae5d869684 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f5da550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:23.459414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:23.477277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:23.482639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:23.484186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62b42c2b-ce87-4457-a8d3-9615facafaca tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1814 microversion: 2.25 time: 0.413192 Jun 16 18:35:23.490091 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 788/1613] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:23 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1814 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:23.499207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d41082cf-c025-4c93-860e-f796e4806b79 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f8678197790>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:28.000780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:28.089363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=23 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:31.588228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:32.600871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=11 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:32.659528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:33.107445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:33.191638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=31 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:33.467207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:38.995035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-47d7e5c9-af84-4a53-a9da-b8ae5d869684 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1461 microversion: 2.1 time: 15.789790 Jun 16 18:35:38.995642 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 826/1614] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:23 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1461 bytes in 15791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:39.016813 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d41082cf-c025-4c93-860e-f796e4806b79 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 15.525378 Jun 16 18:35:39.024581 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 789/1615] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:23 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 15534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:39.038352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:39.039019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:39.062549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:39.067233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:39.070780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:39.071255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:39.514094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:39.514754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:39.536038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:39.536499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:39.538660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:39.543405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:39.557704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:39.583201 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-457d523e-521b-4342-bb3f-64b15ec55d71 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1498 microversion: 2.1 time: 0.583896 Jun 16 18:35:39.594842 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 827/1616] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:38 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1498 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:39.613587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fb6b2598-96b4-4cfb-a509-f207cb13173a req-7b868e9d-aae7-4ab5-9145-cffd6827cd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "name": "network-vif-unplugged", "status": "completed", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:39.649588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb6b2598-96b4-4cfb-a509-f207cb13173a req-7b868e9d-aae7-4ab5-9145-cffd6827cd6b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:39.651799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb6b2598-96b4-4cfb-a509-f207cb13173a req-7b868e9d-aae7-4ab5-9145-cffd6827cd6b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:39.701573 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fb6b2598-96b4-4cfb-a509-f207cb13173a req-7b868e9d-aae7-4ab5-9145-cffd6827cd6b service nova] Creating event network-vif-unplugged:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h1-846209-2 Jun 16 18:35:39.715442 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fb6b2598-96b4-4cfb-a509-f207cb13173a req-7b868e9d-aae7-4ab5-9145-cffd6827cd6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118561 Jun 16 18:35:39.723836 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 828/1617] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:39.743695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:39.744886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:39.754759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:39.755596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:39.765524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:39.771799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:40.830912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:40.841332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:40.859486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:40.874885 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e722906b-0d3e-4fa5-a066-79b480cd2861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 1.140208 Jun 16 18:35:40.877737 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 829/1618] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:39 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:40.899280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:40.903344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:40.928388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:40.936370 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aecd8281-1633-46db-8f18-d05e99e204df tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1707 microversion: 2.1 time: 1.904997 Jun 16 18:35:40.939548 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 790/1619] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:39 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1707 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:40.971501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0a6fc89b-3a9c-4840-a357-fcd2d243ec19 req-3aa1f55f-6e87-4805-9e61-b10ae24b74ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "060fd62e-c274-4002-82ff-d6c21be38ac5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:40.980198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:40.986596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:40.988414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:40.989751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:41.007511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0a6fc89b-3a9c-4840-a357-fcd2d243ec19 req-3aa1f55f-6e87-4805-9e61-b10ae24b74ed service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:41.014851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0a6fc89b-3a9c-4840-a357-fcd2d243ec19 req-3aa1f55f-6e87-4805-9e61-b10ae24b74ed service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:41.040639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0a6fc89b-3a9c-4840-a357-fcd2d243ec19 req-3aa1f55f-6e87-4805-9e61-b10ae24b74ed service nova] Creating event network-changed:060fd62e-c274-4002-82ff-d6c21be38ac5 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:35:41.057925 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0a6fc89b-3a9c-4840-a357-fcd2d243ec19 req-3aa1f55f-6e87-4805-9e61-b10ae24b74ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108363 Jun 16 18:35:41.063001 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 791/1620] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:41.225202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5ddeb83-9c15-42cc-a86a-38655fd1d652 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Calling method '.version_select at 0x7f866f0cb3a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:41.362986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5ddeb83-9c15-42cc-a86a-38655fd1d652 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 371 microversion: 2.1 time: 0.298172 Jun 16 18:35:41.364554 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 792/1621] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:35:41 2022] GET /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:41.378884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-36c03a85-253f-4abb-9dd2-24e1f213e02a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1bc940>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:41.528228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-36c03a85-253f-4abb-9dd2-24e1f213e02a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 200 len: 1461 microversion: 2.1 time: 0.162317 Jun 16 18:35:41.530881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 793/1622] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:41 2022] GET /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 1461 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:41.544680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:41.545617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:41.571372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:41.572520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:41.573590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:41.574243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:41.639833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:35:41.862351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62860532-089d-4fa5-a564-56651903206d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 204 len: 0 microversion: 2.1 time: 0.329677 Jun 16 18:35:41.866369 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 794/1623] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:35:41 2022] DELETE /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:35:41.881113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0dfdd7d7-d91f-4d40-ac71-04d57c5bf8cb tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866f0cb670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:41.992447 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0dfdd7d7-d91f-4d40-ac71-04d57c5bf8cb tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 0.127140 Jun 16 18:35:41.993222 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 795/1624] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:41 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:42.004748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41c2f674-55f6-41f0-bd5d-dc916d82557a tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '.version_select at 0x7f866f150940>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:42.008223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41c2f674-55f6-41f0-bd5d-dc916d82557a tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.008726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41c2f674-55f6-41f0-bd5d-dc916d82557a tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:42.049981 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-41c2f674-55f6-41f0-bd5d-dc916d82557a tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2321 microversion: 2.1 time: 0.055509 Jun 16 18:35:42.050788 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 796/1625] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:35:41 2022] GET /compute/v2.1/os-migrations => generated 2321 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:42.077209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62feb065-97d5-4dc5-a939-1d3d4b0d87c5 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Action: 'update', calling method: .version_select at 0x7f86781974c0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:42.243819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62feb065-97d5-4dc5-a939-1d3d4b0d87c5 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.259593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62feb065-97d5-4dc5-a939-1d3d4b0d87c5 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:42.264760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62feb065-97d5-4dc5-a939-1d3d4b0d87c5 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.266544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62feb065-97d5-4dc5-a939-1d3d4b0d87c5 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:42.277721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:42.297894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:42.299410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:42.300970 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4188bf29-7881-4a9f-b02c-51908c6bcd88 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1804 microversion: 2.25 time: 1.419600 Jun 16 18:35:42.320066 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 830/1626] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:40 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1804 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:42.343661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:42.358367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:42.378279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.381237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:42.382528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.385531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:42.476499 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62feb065-97d5-4dc5-a939-1d3d4b0d87c5 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 328 microversion: 2.1 time: 0.424585 Jun 16 18:35:42.480312 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 797/1627] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:35:42 2022] PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 328 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:42.486946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c2d92132-cf38-4335-b903-4f2aa2a116d6 req-d59e7fef-e7c1-4396-87a8-8b7ef37d2558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e31fb33-1093-4058-bdf4-aed87d21bf61", "name": "network-vif-plugged", "status": "completed", "tag": "fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f"}, {"server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "name": "network-vif-unplugged", "status": "completed", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:42.519981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2d92132-cf38-4335-b903-4f2aa2a116d6 req-d59e7fef-e7c1-4396-87a8-8b7ef37d2558 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.521157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2d92132-cf38-4335-b903-4f2aa2a116d6 req-d59e7fef-e7c1-4396-87a8-8b7ef37d2558 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:42.557808 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c2d92132-cf38-4335-b903-4f2aa2a116d6 req-d59e7fef-e7c1-4396-87a8-8b7ef37d2558 service nova] Creating event network-vif-plugged:fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f for instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 on n-h1-846209-2 Jun 16 18:35:42.558896 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c2d92132-cf38-4335-b903-4f2aa2a116d6 req-d59e7fef-e7c1-4396-87a8-8b7ef37d2558 service nova] Creating event network-vif-unplugged:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h2-846209-2 Jun 16 18:35:42.591795 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c2d92132-cf38-4335-b903-4f2aa2a116d6 req-d59e7fef-e7c1-4396-87a8-8b7ef37d2558 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.108491 Jun 16 18:35:42.605484 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 798/1628] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:42.624761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:42.630002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:42.657000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.657663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:42.659490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:42.663198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:43.486521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:43.491990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:43.518699 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c59a095-e2eb-4254-b939-e20059ae2863 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1466 microversion: 2.1 time: 1.196843 Jun 16 18:35:43.518937 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6afb5774-b8ac-4dfe-899b-872fc18ce13e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 200 len: 1504 microversion: 2.1 time: 0.911046 Jun 16 18:35:43.532570 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 831/1629] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:42 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1466 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:43.532820 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 799/1630] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:42 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 1504 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:43.533358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:43.537019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:43.542559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e27e3a6e-a150-4d85-8279-19317ad92dbd tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:43.543192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e27e3a6e-a150-4d85-8279-19317ad92dbd tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:43.562386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:43.564707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e27e3a6e-a150-4d85-8279-19317ad92dbd tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:43.565342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:43.565521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e27e3a6e-a150-4d85-8279-19317ad92dbd tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:43.566752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:43.567331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:43.575942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e27e3a6e-a150-4d85-8279-19317ad92dbd tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:43.576696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e27e3a6e-a150-4d85-8279-19317ad92dbd tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:44.127996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e27e3a6e-a150-4d85-8279-19317ad92dbd tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1858 microversion: 2.1 time: 0.596349 Jun 16 18:35:44.135060 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 800/1631] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:43 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1858 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:44.144635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e70ec8cf-015a-400b-b2b0-25f07daebcc1 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '.version_select at 0x7f866f1533a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:44.147634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e70ec8cf-015a-400b-b2b0-25f07daebcc1 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:44.156914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:44.180518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e70ec8cf-015a-400b-b2b0-25f07daebcc1 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:44.217626 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e70ec8cf-015a-400b-b2b0-25f07daebcc1 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2537 microversion: 2.25 time: 0.080938 Jun 16 18:35:44.220844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:44.227314 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 801/1632] 10.222.0.27 () {60 vars in 1183 bytes} [Thu Jun 16 18:35:44 2022] GET /compute/v2.1/os-migrations => generated 2537 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:44.239722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:44.241165 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b97e18d8-9d53-4bd2-9983-958b70614e37 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 0.717072 Jun 16 18:35:44.248176 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 832/1633] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:43 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:44.274334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7afe5cf-416f-4be4-ac28-fab1c8b5f9cd tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866eb9cc10>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:44.345345 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7afe5cf-416f-4be4-ac28-fab1c8b5f9cd tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 0.095959 Jun 16 18:35:44.354837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 833/1634] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:44 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:44.371977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-406895776", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:44.390245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "13200571-8aad-437e-ab86-6afa58231640"}, {"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "cd439c57-faec-4942-b7aa-ee4fd941b807"}, {"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "e50658e2-b980-4977-bf2a-fc925e9bb8ac"}, {"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "aa145fe7-4192-4143-91ea-a0ab1f38677e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:44.417260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:44.417722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:44.461531 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] Creating event network-changed:13200571-8aad-437e-ab86-6afa58231640 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:35:44.471359 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] Creating event network-changed:cd439c57-faec-4942-b7aa-ee4fd941b807 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:35:44.472075 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] Creating event network-changed:e50658e2-b980-4977-bf2a-fc925e9bb8ac for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:35:44.473167 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] Creating event network-changed:aa145fe7-4192-4143-91ea-a0ab1f38677e for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:35:44.499244 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-315e76d9-1c45-41cf-8224-e07768e0c9b7 req-984e1286-044d-422a-8730-0685187d86d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.139654 Jun 16 18:35:44.503995 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 834/1635] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:44.526298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-960a66e2-3915-4403-84ca-026ab803a0d2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-33704955"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:44.541433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-960a66e2-3915-4403-84ca-026ab803a0d2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:44.547211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:35:44.560204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-960a66e2-3915-4403-84ca-026ab803a0d2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:44.560668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-960a66e2-3915-4403-84ca-026ab803a0d2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:44.572074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-960a66e2-3915-4403-84ca-026ab803a0d2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:44.572551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-960a66e2-3915-4403-84ca-026ab803a0d2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:45.378932 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-960a66e2-3915-4403-84ca-026ab803a0d2 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "POST /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd/action" status: 202 len: 0 microversion: 2.1 time: 0.872273 Jun 16 18:35:45.389856 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 835/1636] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:35:44 2022] POST /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd/action => generated 0 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:35:45.397937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15e90805-2bec-420d-82ac-e1379e0e962f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:45.399594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15e90805-2bec-420d-82ac-e1379e0e962f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:45.407466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15e90805-2bec-420d-82ac-e1379e0e962f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:45.408859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15e90805-2bec-420d-82ac-e1379e0e962f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:45.411641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15e90805-2bec-420d-82ac-e1379e0e962f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:45.412379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15e90805-2bec-420d-82ac-e1379e0e962f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.241853 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15e90805-2bec-420d-82ac-e1379e0e962f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1858 microversion: 2.1 time: 0.849829 Jun 16 18:35:46.256492 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 836/1637] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:45 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1858 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:46.264475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:46.267122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:46.277484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.278053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.278931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.279447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.570267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:35:46.570812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:35:46.571506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:35:46.572032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:35:46.572562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:35:46.594653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.595290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.607363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.608133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.660788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Getting quotas for project 54586b6d8d64486bba20eb1d9b7b8477. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:35:46.668993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Getting quotas for user 107cfc82e51f4143a0517a186d3e1bf3 and project 54586b6d8d64486bba20eb1d9b7b8477. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:35:46.689795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.utils [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] cores quota exceeded for 54586b6d8d64486bba20eb1d9b7b8477, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119207) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 16 18:35:46.691309 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Request method failure captured: Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 144 Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3f0V8s1H7ZY94peNCUqq0-xSe2XtDJ0Zix0eO7jpPpsC8A_LXdAjSGpXrZkFHVXW-g3e-Kk6DdR83NdkeWEstaR-sln4mqWxuSzMjbYBpe5FPeDIh4mbGGAjwW2hQnwrqGVrONmkIWDGlCVVTpPZjQv-ZANKze-tW1dl5GZjF4pxx0 Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:35:46.743473 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54586b6d8d64486bba20eb1d9b7b8477", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 107cfc82e51f4143a0517a186d3e1bf3 Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-406895776", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} Jun 16 18:35:46.745693 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-406895776', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452'}}} Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 18:35:46.746755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:46.748140 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.751688 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-45775a2f-cc37-4234-988a-09887f01621a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.518013 Jun 16 18:35:46.755212 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 802/1638] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:35:44 2022] POST /compute/v2.1/servers => generated 111 bytes in 2524 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:46.776189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 39d14e76-7250-4441-98dc-a361072f16a9 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:35:46.776449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:46.782477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:46.814752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.817244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.818391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.824759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.830083 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a2a5603-7b0f-4c3e-9078-11057cab07c7 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 2423 microversion: 2.25 time: 0.581624 Jun 16 18:35:46.834874 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 837/1639] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:46 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 2423 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:46.861435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2c181815-7198-4374-b457-34676bb2bea2 req-15d0b17c-842a-4d36-baf4-e1a470572f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5779c9c3-e87d-4f34-927f-80dcc658a1ac", "name": "network-vif-unplugged", "status": "completed", "tag": "15a9a46d-c311-4249-9ee6-e83453d113e4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:46.864587 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 HTTP/1.1 Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:35:46.866211 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '71636c96-2206-4a76-9f30-5f0db5ecc7b7'} Jun 16 18:35:46.867845 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:46.868814 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:35:46.870982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:35:46.873199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:46.873199 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-47049ec4-7735-4770-96d6-21049552fd70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 404 len: 111 microversion: 2.1 time: 0.114640 Jun 16 18:35:46.873199 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 803/1640] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:46 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:46.873727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:46.874724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:46.882549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.883344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.884380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.885282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.899636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2c181815-7198-4374-b457-34676bb2bea2 req-15d0b17c-842a-4d36-baf4-e1a470572f4a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:46.908155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2c181815-7198-4374-b457-34676bb2bea2 req-15d0b17c-842a-4d36-baf4-e1a470572f4a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:46.949470 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2c181815-7198-4374-b457-34676bb2bea2 req-15d0b17c-842a-4d36-baf4-e1a470572f4a service nova] Creating event network-vif-unplugged:15a9a46d-c311-4249-9ee6-e83453d113e4 for instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac on n-h2-846209-2 Jun 16 18:35:46.973448 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2c181815-7198-4374-b457-34676bb2bea2 req-15d0b17c-842a-4d36-baf4-e1a470572f4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136508 Jun 16 18:35:46.977787 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 838/1641] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:46.990743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4ba1d8c4-a0cf-450e-87ea-0c47b5f0b275 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866f329160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:47.119293 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4ba1d8c4-a0cf-450e-87ea-0c47b5f0b275 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 0.139480 Jun 16 18:35:47.122973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 839/1642] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:46 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:47.147362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9a01dc30-9317-4718-aebd-906f92cf0259 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ebbd790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:47.243013 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9a01dc30-9317-4718-aebd-906f92cf0259 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.116790 Jun 16 18:35:47.263660 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 840/1643] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:47 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:47.288110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:47.288767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:47.322070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:47.322453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:47.323274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:47.323725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:47.757034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lazy-loading 'services' on Instance uuid 49c0df03-5e10-4077-b47c-d7600c7800da {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:35:48.223335 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-205076d6-3178-4243-9e53-f3bbea9c94d5 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "DELETE /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments/3dd71fa1-3a12-4fcb-9e7b-60d6a78d1b98" status: 202 len: 0 microversion: 2.1 time: 0.956688 Jun 16 18:35:48.232754 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 841/1644] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:35:47 2022] DELETE /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments/3dd71fa1-3a12-4fcb-9e7b-60d6a78d1b98 => generated 0 bytes in 969 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:35:48.252432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2accabdb-aa35-4dcb-9e54-5346179c4cdd req-66f217da-75cb-4c0e-8629-d2e2d8097fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71636c96-2206-4a76-9f30-5f0db5ecc7b7", "name": "network-vif-deleted", "tag": "f04cc549-e376-4e06-bda3-30135f49180f"}, {"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "81274976-813c-4c06-b3c6-a7e8aea88f15"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:48.287309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2accabdb-aa35-4dcb-9e54-5346179c4cdd req-66f217da-75cb-4c0e-8629-d2e2d8097fd7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:48.290819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2accabdb-aa35-4dcb-9e54-5346179c4cdd req-66f217da-75cb-4c0e-8629-d2e2d8097fd7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:48.329519 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2accabdb-aa35-4dcb-9e54-5346179c4cdd req-66f217da-75cb-4c0e-8629-d2e2d8097fd7 service nova] Creating event network-vif-deleted:f04cc549-e376-4e06-bda3-30135f49180f for instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 on n-h2-846209-2 Jun 16 18:35:48.333736 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2accabdb-aa35-4dcb-9e54-5346179c4cdd req-66f217da-75cb-4c0e-8629-d2e2d8097fd7 service nova] Creating event network-changed:81274976-813c-4c06-b3c6-a7e8aea88f15 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:35:48.352320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:48.361552 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2accabdb-aa35-4dcb-9e54-5346179c4cdd req-66f217da-75cb-4c0e-8629-d2e2d8097fd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.114340 Jun 16 18:35:48.370218 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 842/1645] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:48.375349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:48.376563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:48.380490 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4bfb07a-bafe-452e-8de1-020c5cfb3362 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 1.510294 Jun 16 18:35:48.381072 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 804/1646] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:46 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:48.383577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-602da1d2-3f51-4d7a-bdfc-b6239077096b tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Action: 'update', calling method: .version_select at 0x7f866f5da310>, body: {"quota_set": {"cores": 20}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:48.393860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:48.395939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:48.422260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:48.423630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:48.424455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:48.424899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:48.681447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 39d14e76-7250-4441-98dc-a361072f16a9 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:35:48.697381 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-178c02b9-7dad-4524-94f7-dcb91baf21b8 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 2423 microversion: 2.25 time: 0.315222 Jun 16 18:35:48.719097 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 805/1647] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:48 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 2423 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:48.727344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a832029-5ffb-4c6f-8500-8b9037d4ecff tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: .version_select at 0x7f86781979d0>, body: {"keypair": {"name": "tempest-key-1687327433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLPNkipn5w+ZrlMYWqLSPZPrCIOgRSFEw6oU/vASdDXDBEEBbnWkTh3UN1QfrImyAQvRr5N+hZtpzhZxRsdvuqfLPfFSkn0i3jXIpeEeKkP8trvPtO/3GNjKyyuAkfMew=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:48.748617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4a832029-5ffb-4c6f-8500-8b9037d4ecff tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:35:48.759719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4a832029-5ffb-4c6f-8500-8b9037d4ecff tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:35:48.799857 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a832029-5ffb-4c6f-8500-8b9037d4ecff tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.078724 Jun 16 18:35:48.801231 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 806/1648] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:35:48 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:48.827949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ddfcf134-1b8f-4498-aabc-00ac111ee48a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f86780a0dc0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:48.962230 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ddfcf134-1b8f-4498-aabc-00ac111ee48a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1424 microversion: 2.1 time: 0.159515 Jun 16 18:35:48.975734 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 807/1649] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:48 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1424 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:49.005624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53d54ee7-61dd-419d-b7f9-ff91f7d8d967 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:49.007803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53d54ee7-61dd-419d-b7f9-ff91f7d8d967 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:49.043754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53d54ee7-61dd-419d-b7f9-ff91f7d8d967 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.046450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53d54ee7-61dd-419d-b7f9-ff91f7d8d967 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.048606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53d54ee7-61dd-419d-b7f9-ff91f7d8d967 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.052160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53d54ee7-61dd-419d-b7f9-ff91f7d8d967 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.100453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-602da1d2-3f51-4d7a-bdfc-b6239077096b tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.101118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-602da1d2-3f51-4d7a-bdfc-b6239077096b tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.102053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-602da1d2-3f51-4d7a-bdfc-b6239077096b tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.102502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-602da1d2-3f51-4d7a-bdfc-b6239077096b tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.159322 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53d54ee7-61dd-419d-b7f9-ff91f7d8d967 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180796 Jun 16 18:35:49.161175 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 808/1650] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:35:48 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:49.168268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a35d141-70f7-42b9-afff-880b1435e902 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f86780adaf0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:49.254600 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-602da1d2-3f51-4d7a-bdfc-b6239077096b tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 329 microversion: 2.1 time: 0.880880 Jun 16 18:35:49.262776 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 843/1651] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:35:48 2022] PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 329 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:49.270092 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a35d141-70f7-42b9-afff-880b1435e902 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.106935 Jun 16 18:35:49.273044 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 809/1652] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:49 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:49.279225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7292f78-89b8-419e-8bd5-6d2c8cd941cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '.version_select at 0x7f866f1131f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:49.289402 n-d-846209-2 devstack@n-api.service[119206]: WARNING oslo_db.sqlalchemy.utils [None req-a7292f78-89b8-419e-8bd5-6d2c8cd941cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 18:35:49.293276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:49.296670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:49.306618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.307713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.309258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.309743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a7292f78-89b8-419e-8bd5-6d2c8cd941cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.043675 Jun 16 18:35:49.310263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.313863 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 844/1653] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:35:49 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:49.324548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cfc6b330-740f-4bd7-97fb-acf404aecda4 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Calling method '.version_select at 0x7f866f1133a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:49.735322 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cfc6b330-740f-4bd7-97fb-acf404aecda4 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 371 microversion: 2.1 time: 0.420143 Jun 16 18:35:49.735926 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 845/1654] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:35:49 2022] GET /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:49.754933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:49.755697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:49.781514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.781955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.783733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.787397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:50.374106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:50.395001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:50.397430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:50.404751 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8ccf5aaa-35e9-47eb-b087-4858fd4b78dc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 0.657315 Jun 16 18:35:50.405734 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 846/1655] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:49 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:50.414376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1020403147", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-key-1687327433", "networks": [{"uuid": "06a9a0f4-e2e7-4b09-9d3d-fea8950fac70"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:50.584158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:35:51.702253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:35:51.702942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:35:51.703172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:35:51.711300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:35:51.711740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:35:51.741351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:51.745929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:51.747439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:51.748147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:51.793957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:35:51.813233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:35:51.851202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:35:51.860735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:35:51.970551 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a9c45ca4-b009-4dd6-b9fd-ef5109fd7d6b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562807 Jun 16 18:35:51.971749 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 847/1656] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:35:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:35:51.982667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab109614-ff3b-4eea-9ffd-78c454058263 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Action: 'update', calling method: .version_select at 0x7f866ebaa5e0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:52.219207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab109614-ff3b-4eea-9ffd-78c454058263 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:52.220239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab109614-ff3b-4eea-9ffd-78c454058263 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:52.222037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab109614-ff3b-4eea-9ffd-78c454058263 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:52.224085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab109614-ff3b-4eea-9ffd-78c454058263 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:52.454215 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab109614-ff3b-4eea-9ffd-78c454058263 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 328 microversion: 2.1 time: 0.479410 Jun 16 18:35:52.478274 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 848/1657] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:35:51 2022] PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 328 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:52.487779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-307a97df-d739-4bef-9615-6873dcbaf207 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866ebbd280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:52.615703 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-307a97df-d739-4bef-9615-6873dcbaf207 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1433 microversion: 2.1 time: 0.136019 Jun 16 18:35:52.618275 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 849/1658] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:52 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1433 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:52.630735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8953d7b9-93c1-4ad2-bcf3-08e98967ab15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:52.640195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8953d7b9-93c1-4ad2-bcf3-08e98967ab15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:52.651259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8953d7b9-93c1-4ad2-bcf3-08e98967ab15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:52.651921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8953d7b9-93c1-4ad2-bcf3-08e98967ab15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:52.652758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8953d7b9-93c1-4ad2-bcf3-08e98967ab15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:52.653202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8953d7b9-93c1-4ad2-bcf3-08e98967ab15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:52.788202 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8953d7b9-93c1-4ad2-bcf3-08e98967ab15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169511 Jun 16 18:35:52.788754 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 850/1659] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:35:52 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:52.815338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fe666a4f-4b7c-4856-91c3-e34264f980b4 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866eba2040>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:52.941038 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fe666a4f-4b7c-4856-91c3-e34264f980b4 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.151230 Jun 16 18:35:52.944374 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 851/1660] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:52 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:52.967408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-082f9823-966f-4673-8d04-72d0e64789be req-45bc55dc-b0f9-4c46-a010-d374ce21ba1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "dcba32f5-5668-4977-9a51-5d6e60fa9c4f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:52.982262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-082f9823-966f-4673-8d04-72d0e64789be req-45bc55dc-b0f9-4c46-a010-d374ce21ba1e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:52.983425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-082f9823-966f-4673-8d04-72d0e64789be req-45bc55dc-b0f9-4c46-a010-d374ce21ba1e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.009084 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-082f9823-966f-4673-8d04-72d0e64789be req-45bc55dc-b0f9-4c46-a010-d374ce21ba1e service nova] Creating event network-changed:dcba32f5-5668-4977-9a51-5d6e60fa9c4f for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:35:53.035030 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-082f9823-966f-4673-8d04-72d0e64789be req-45bc55dc-b0f9-4c46-a010-d374ce21ba1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088592 Jun 16 18:35:53.041786 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 852/1661] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:53.057172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:53.060297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:53.073140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:53.073871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.074948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:53.075703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.165081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:55.038623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:55.096079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:55.112359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:55.121719 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-57cc06c3-4778-43c1-9122-b7f5c24dcaf5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 2.077148 Jun 16 18:35:55.146451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 853/1662] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:53 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:55.163561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:55.167689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:55.196086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:55.196889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:55.199692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:55.202836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:55.616300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:55.661181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9cb5430-adea-4ebf-b7ee-1bde03835f2b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1287 microversion: 2.1 time: 0.508565 Jun 16 18:35:55.664379 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 854/1663] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:55 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1287 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:55.672322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3632351-2e96-4894-9992-9189a823506f tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866eac1310>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:55.832132 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3632351-2e96-4894-9992-9189a823506f tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 200 len: 1433 microversion: 2.1 time: 0.165832 Jun 16 18:35:55.840294 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 855/1664] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:55 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 1433 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:55.850598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-852292075", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:55.989637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:35:56.637307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:56.789742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:35:56.790838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:35:56.791603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:35:56.792328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:35:56.793004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:35:56.821533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:56.824731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:56.826001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:56.827622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:56.898738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Getting quotas for project 54586b6d8d64486bba20eb1d9b7b8477. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:35:56.914824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Getting quotas for user 107cfc82e51f4143a0517a186d3e1bf3 and project 54586b6d8d64486bba20eb1d9b7b8477. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:35:56.925807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:56.970145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.utils [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] instances quota exceeded for 54586b6d8d64486bba20eb1d9b7b8477, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119206) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 16 18:35:56.971401 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Request method failure captured: Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 144 Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3f0V8s1H7ZY94peNCUqq0-xSe2XtDJ0Zix0eO7jpPpsC8A_LXdAjSGpXrZkFHVXW-g3e-Kk6DdR83NdkeWEstaR-sln4mqWxuSzMjbYBpe5FPeDIh4mbGGAjwW2hQnwrqGVrONmkIWDGlCVVTpPZjQv-ZANKze-tW1dl5GZjF4pxx0 Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:35:56.981347 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54586b6d8d64486bba20eb1d9b7b8477", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 107cfc82e51f4143a0517a186d3e1bf3 Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-852292075", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} Jun 16 18:35:56.982934 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-852292075', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452'}}} Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 18:35:56.983881 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:56.985100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:35:56.989110 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:56.990660 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:56.990660 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:56.990660 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:56.990660 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:56.990660 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 18:35:56.990660 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.002277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:57.004956 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e178f243-4a8f-49f4-80a0-5ce71db04685 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.162821 Jun 16 18:35:57.009754 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 856/1665] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:35:55 2022] POST /compute/v2.1/servers => generated 119 bytes in 1168 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:57.023563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c429e496-b331-4b37-b82f-62d1e0c23aa3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:57.027064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c429e496-b331-4b37-b82f-62d1e0c23aa3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:57.041733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c429e496-b331-4b37-b82f-62d1e0c23aa3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.054523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c429e496-b331-4b37-b82f-62d1e0c23aa3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.059189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c429e496-b331-4b37-b82f-62d1e0c23aa3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.063653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c429e496-b331-4b37-b82f-62d1e0c23aa3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.169311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c429e496-b331-4b37-b82f-62d1e0c23aa3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157622 Jun 16 18:35:57.170924 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 857/1666] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:35:57 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:57.177405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3ef5354c-4517-495a-9783-3d1a4b1d5ee0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866edd5af0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:57.291055 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3ef5354c-4517-495a-9783-3d1a4b1d5ee0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.118609 Jun 16 18:35:57.292073 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 858/1667] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:35:57 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:57.305822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-83fb2721-a5c9-49f9-bb05-3c7525eaf440 req-76b897bc-43c5-41ef-b6f9-76e29a9d5a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e31fb33-1093-4058-bdf4-aed87d21bf61", "name": "network-vif-unplugged", "status": "completed", "tag": "fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:57.327703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-83fb2721-a5c9-49f9-bb05-3c7525eaf440 req-76b897bc-43c5-41ef-b6f9-76e29a9d5a6c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.335951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-83fb2721-a5c9-49f9-bb05-3c7525eaf440 req-76b897bc-43c5-41ef-b6f9-76e29a9d5a6c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.393059 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-83fb2721-a5c9-49f9-bb05-3c7525eaf440 req-76b897bc-43c5-41ef-b6f9-76e29a9d5a6c service nova] Creating event network-vif-unplugged:fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f for instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 on n-h1-846209-2 Jun 16 18:35:57.407876 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-83fb2721-a5c9-49f9-bb05-3c7525eaf440 req-76b897bc-43c5-41ef-b6f9-76e29a9d5a6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114137 Jun 16 18:35:57.408831 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 859/1668] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:57.415960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:57.416310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:57.436273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.436780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.442276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.443152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:58.451465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:58.469704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-57b44267-b9b8-4ae3-8c61-5a05815a0662 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1467 microversion: 2.1 time: 1.058677 Jun 16 18:35:58.482916 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 860/1669] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:57 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1467 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:58.489722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:58.490701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:58.500470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:58.509525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:58.513782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:58.514293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:58.770777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=20 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:59.303934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:59.578362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:59.646961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:59.665609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:59.671244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:59.675270 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4546da38-00fa-4072-ae11-0b9a7bcb3275 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 1.190889 Jun 16 18:35:59.683997 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 861/1670] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:58 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:59.695305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:59.696552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:59.716409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:59.722714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:59.726612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:59.727589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:00.035879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:00.079203 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f8bac54e-7ad7-4aa9-b62e-9b732b85926a tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1329 microversion: 2.1 time: 0.392337 Jun 16 18:36:00.079931 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 862/1671] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:59 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1329 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:00.100572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c03c9bc-505b-423a-a11b-94e26305d9b9 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Action: 'update', calling method: .version_select at 0x7f866ea4cee0>, body: {"quota_set": {"instances": 10}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:00.312926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c03c9bc-505b-423a-a11b-94e26305d9b9 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:00.313380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c03c9bc-505b-423a-a11b-94e26305d9b9 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:00.314297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c03c9bc-505b-423a-a11b-94e26305d9b9 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:00.314736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c03c9bc-505b-423a-a11b-94e26305d9b9 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:00.469733 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c03c9bc-505b-423a-a11b-94e26305d9b9 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 329 microversion: 2.1 time: 0.386868 Jun 16 18:36:00.475275 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 863/1672] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:36:00 2022] PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 329 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:00.487012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59885ea4-c763-4de0-9172-fcdea1ca4441 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:00.492154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59885ea4-c763-4de0-9172-fcdea1ca4441 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:00.524691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59885ea4-c763-4de0-9172-fcdea1ca4441 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:00.529010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59885ea4-c763-4de0-9172-fcdea1ca4441 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:00.530156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59885ea4-c763-4de0-9172-fcdea1ca4441 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:00.530763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59885ea4-c763-4de0-9172-fcdea1ca4441 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:00.607792 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59885ea4-c763-4de0-9172-fcdea1ca4441 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130382 Jun 16 18:36:00.610830 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 864/1673] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:36:00 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:00.618584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44f6df7b-c1f8-4bba-8863-9c313c08933c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f21eca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:00.745964 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-44f6df7b-c1f8-4bba-8863-9c313c08933c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.130985 Jun 16 18:36:00.750244 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 865/1674] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:00 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:00.761716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa53c6d8-f0fe-4c6d-b5a9-ae58e88cbd95 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866eafbee0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:00.856597 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa53c6d8-f0fe-4c6d-b5a9-ae58e88cbd95 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72" status: 200 len: 784 microversion: 2.1 time: 0.104847 Jun 16 18:36:00.858244 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 866/1675] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:00 2022] GET /compute/v2.1/images/d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72 => generated 784 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:00.868471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-065b416f-a9d7-4759-a9b5-a62d204ca03d req-e8c5d1ea-a2c1-4068-96f3-d4dff5de2f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0271c7ba-7672-4448-8a5f-33e3150857fd", "name": "network-vif-plugged", "status": "completed", "tag": "c6d88fb8-bcea-40fb-9158-9244e91ce3f1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:00.897139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-065b416f-a9d7-4759-a9b5-a62d204ca03d req-e8c5d1ea-a2c1-4068-96f3-d4dff5de2f09 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:00.897608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-065b416f-a9d7-4759-a9b5-a62d204ca03d req-e8c5d1ea-a2c1-4068-96f3-d4dff5de2f09 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:00.928903 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-065b416f-a9d7-4759-a9b5-a62d204ca03d req-e8c5d1ea-a2c1-4068-96f3-d4dff5de2f09 service nova] Creating event network-vif-plugged:c6d88fb8-bcea-40fb-9158-9244e91ce3f1 for instance 0271c7ba-7672-4448-8a5f-33e3150857fd on n-h2-846209-2 Jun 16 18:36:00.952693 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-065b416f-a9d7-4759-a9b5-a62d204ca03d req-e8c5d1ea-a2c1-4068-96f3-d4dff5de2f09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092881 Jun 16 18:36:00.963254 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 867/1676] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:00.981712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1db01a8-eeb1-430b-9e5a-8088f59ca923 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Calling method '.version_select at 0x7f866ea4ca60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:01.275904 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1db01a8-eeb1-430b-9e5a-8088f59ca923 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 371 microversion: 2.1 time: 0.310426 Jun 16 18:36:01.277398 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 868/1677] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:36:00 2022] GET /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:01.290133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:01.292829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:01.337326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:01.353950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:01.363360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:01.375026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:02.174075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:02.195790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:02.197754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:02.204929 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88923bf4-7835-409e-aa79-fd5d8eb675e5 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 0.925745 Jun 16 18:36:02.205964 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 869/1678] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:01 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:02.227357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41a5327b-b211-4ca8-a7d1-db43f02da38d tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:02.244501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41a5327b-b211-4ca8-a7d1-db43f02da38d tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037074 Jun 16 18:36:02.252914 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 870/1679] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:36:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:02.269956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:02.272108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:02.285324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:02.306999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:02.308147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:02.308729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:03.236304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:03.287946 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85fcf60b-a038-42a4-bae3-092ce599b1cb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1329 microversion: 2.1 time: 1.021553 Jun 16 18:36:03.295044 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 871/1680] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:02 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1329 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:03.321481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f1fbbf2-dbdd-4c62-8ec1-10379ec3d657 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Action: 'update', calling method: .version_select at 0x7f866f6738b0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:03.592374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f1fbbf2-dbdd-4c62-8ec1-10379ec3d657 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:03.596214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f1fbbf2-dbdd-4c62-8ec1-10379ec3d657 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:03.598173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f1fbbf2-dbdd-4c62-8ec1-10379ec3d657 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:03.602789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f1fbbf2-dbdd-4c62-8ec1-10379ec3d657 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:03.836321 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6f1fbbf2-dbdd-4c62-8ec1-10379ec3d657 tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 325 microversion: 2.1 time: 0.535980 Jun 16 18:36:03.842542 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 872/1681] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:36:03 2022] PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:03.859712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a169ecda-e558-4538-b339-be280e2ecbf1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:03.861024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a169ecda-e558-4538-b339-be280e2ecbf1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:03.896236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a169ecda-e558-4538-b339-be280e2ecbf1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:03.897138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a169ecda-e558-4538-b339-be280e2ecbf1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:03.902930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a169ecda-e558-4538-b339-be280e2ecbf1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:03.910113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a169ecda-e558-4538-b339-be280e2ecbf1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:04.053562 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a169ecda-e558-4538-b339-be280e2ecbf1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208115 Jun 16 18:36:04.066018 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 873/1682] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:36:03 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:04.076849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8002a4c1-727d-462e-be78-9c462f0b6e4c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ea4ce50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:04.202120 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8002a4c1-727d-462e-be78-9c462f0b6e4c tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.128027 Jun 16 18:36:04.204737 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 874/1683] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:04 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:04.227341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8623c683-2dbb-41fc-a43b-8df34eaba77f tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866eac1670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:05.566879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lazy-loading 'services' on Instance uuid 39d14e76-7250-4441-98dc-a361072f16a9 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:36:05.854045 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8623c683-2dbb-41fc-a43b-8df34eaba77f tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "DELETE /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 204 len: 0 microversion: 2.1 time: 1.646124 Jun 16 18:36:05.856389 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 875/1684] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:04 2022] DELETE /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 0 bytes in 1650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:05.880415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-05593889-3191-4254-abca-b4e26939337b req-0904ba67-6b88-4696-8bd0-1d56ae84ac90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc46a4bd-aa35-4968-a855-9c7527528187", "tag": "406cf0b7-bda6-40a9-92a2-88e62c4ea87a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:05.919210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-05593889-3191-4254-abca-b4e26939337b req-0904ba67-6b88-4696-8bd0-1d56ae84ac90 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:05.920864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-05593889-3191-4254-abca-b4e26939337b req-0904ba67-6b88-4696-8bd0-1d56ae84ac90 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:05.966593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-05593889-3191-4254-abca-b4e26939337b req-0904ba67-6b88-4696-8bd0-1d56ae84ac90 service nova] Creating event network-changed:406cf0b7-bda6-40a9-92a2-88e62c4ea87a for instance dc46a4bd-aa35-4968-a855-9c7527528187 on n-h2-846209-2 Jun 16 18:36:05.974124 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-05593889-3191-4254-abca-b4e26939337b req-0904ba67-6b88-4696-8bd0-1d56ae84ac90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114881 Jun 16 18:36:05.979290 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 876/1685] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:05.982181 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-347964e1-6738-4134-8b39-fd8fa55691b4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments/8be85c53-5250-4280-a95a-350696059599" status: 202 len: 0 microversion: 2.25 time: 16.705092 Jun 16 18:36:05.984883 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 810/1686] 10.222.0.27 () {60 vars in 1456 bytes} [Thu Jun 16 18:35:49 2022] DELETE /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments/8be85c53-5250-4280-a95a-350696059599 => generated 0 bytes in 16709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:05.992704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:05.995325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:06.001106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-471946464", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:06.018534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:06.019936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:06.023159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:06.026553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:06.962184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:07.005891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:07.033882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:07.037338 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b183ffa5-f459-492b-8489-fd3f5afc8695 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1892 microversion: 2.32 time: 1.056017 Jun 16 18:36:07.065534 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 877/1687] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:05 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1892 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:07.105426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:07.108155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:07.146883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:07.155313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:07.157945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:07.160665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:07.764153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:07.804723 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-74ae08ad-3cd8-4a85-ab27-64784c287a54 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1329 microversion: 2.1 time: 0.727058 Jun 16 18:36:07.819293 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 878/1688] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:07 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1329 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:07.886939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e9eaa23-88af-44f5-9b1d-cc5471945524 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:07.893003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4e9eaa23-88af-44f5-9b1d-cc5471945524 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:07.923341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e9eaa23-88af-44f5-9b1d-cc5471945524 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:07.924113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e9eaa23-88af-44f5-9b1d-cc5471945524 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:07.927876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e9eaa23-88af-44f5-9b1d-cc5471945524 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:07.928536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e9eaa23-88af-44f5-9b1d-cc5471945524 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:08.044832 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4e9eaa23-88af-44f5-9b1d-cc5471945524 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.223732 Jun 16 18:36:08.045731 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 879/1689] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:36:07 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da/os-volume_attachments => generated 25 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:36:08.076111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5cfd710b-4bb8-4f37-a734-4794537c53ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ed9fd30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:11.587232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:36:11.803457 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5cfd710b-4bb8-4f37-a734-4794537c53ec tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 3.739736 Jun 16 18:36:11.809407 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 880/1690] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:08 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 3763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:11.815929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b752f34-c576-4d96-a1ba-05ff81120ef8 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866eafb8b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:11.893660 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8b752f34-c576-4d96-a1ba-05ff81120ef8 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] HTTP exception thrown: Image not found. Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b752f34-c576-4d96-a1ba-05ff81120ef8 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Request method failure captured: Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc HTTP/1.1 Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3fK2MPkpWqyqWbP3En9rWxaphIGESSobqVjTe84BIeM1Vw6iQlh8laMXSmL9C4WnZgDDpPKyZVTePPMPpU0v-jjqbmZEu03I7OLZqQUyxM1fOll9OM-Ux1E9Dgd6b4pTJA5V87YBFrMKYRz1bK6iB1Sd2VpTAqGxblDSpIdv3_SI2c Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 22faed45f96e4f129f8f35d01f836f22 Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:36:11.899930 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_22faed45f96e4f129f8f35d01f836f22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 22faed45f96e4f129f8f35d01f836f22 Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerTestJSON-2131598394-project Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: d469eedff61d49158ea934377d95d24d Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerTestJSON-2131598394-project Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '60ccc05f-ade5-4f1d-91bd-b5b3125255fc'} Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:11.902845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60ccc05f-ade5-4f1d-91bd-b5b3125255fc Jun 16 18:36:11.904629 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:36:11.907483 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60ccc05f-ade5-4f1d-91bd-b5b3125255fc could not be found. Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:36:11.911631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:36:11.916886 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.921408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b752f34-c576-4d96-a1ba-05ff81120ef8 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:11.925047 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b752f34-c576-4d96-a1ba-05ff81120ef8 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 404 len: 62 microversion: 2.1 time: 0.112015 Jun 16 18:36:11.972027 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 881/1691] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:11 2022] GET /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 62 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:36:12.013354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-601855b8-7176-4954-a0a5-9b1923113d22 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:12.026543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-601855b8-7176-4954-a0a5-9b1923113d22 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:12.079749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-601855b8-7176-4954-a0a5-9b1923113d22 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.088011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-601855b8-7176-4954-a0a5-9b1923113d22 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.091349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-601855b8-7176-4954-a0a5-9b1923113d22 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.095038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-601855b8-7176-4954-a0a5-9b1923113d22 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.209294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:36:12.210080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:36:12.210754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:36:12.211347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:36:12.211957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:36:12.219280 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-601855b8-7176-4954-a0a5-9b1923113d22 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.240667 Jun 16 18:36:12.224953 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 882/1692] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:36:11 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:36:12.233937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.242803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.243760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.244646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.249656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:12.264022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:12.298088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.299317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Getting quotas for project 54586b6d8d64486bba20eb1d9b7b8477. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:36:12.300702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.308771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.310283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.316224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Getting quotas for user 107cfc82e51f4143a0517a186d3e1bf3 and project 54586b6d8d64486bba20eb1d9b7b8477. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:36:12.361464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.utils [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] ram quota exceeded for 54586b6d8d64486bba20eb1d9b7b8477, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119207) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 16 18:36:12.362303 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Request method failure captured: Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 144 Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3f0V8s1H7ZY94peNCUqq0-xSe2XtDJ0Zix0eO7jpPpsC8A_LXdAjSGpXrZkFHVXW-g3e-Kk6DdR83NdkeWEstaR-sln4mqWxuSzMjbYBpe5FPeDIh4mbGGAjwW2hQnwrqGVrONmkIWDGlCVVTpPZjQv-ZANKze-tW1dl5GZjF4pxx0 Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:36:12.374964 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54586b6d8d64486bba20eb1d9b7b8477", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 107cfc82e51f4143a0517a186d3e1bf3 Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-471946464", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} Jun 16 18:36:12.376565 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-471946464', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452'}}} Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 18:36:12.377708 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:12.379368 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:12.380844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:12.382356 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:12.382356 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:12.382356 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:36:12.382356 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:36:12.382356 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 18:36:12.382356 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:12.395753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:12.397536 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1a79088-a42c-4c90-97d7-50d14571456a tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 6.410823 Jun 16 18:36:12.403213 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 811/1693] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:36:05 2022] POST /compute/v2.1/servers => generated 110 bytes in 6418 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:36:12.408563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:12.409670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:12.424506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.430584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.431827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.433104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:13.158679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:13.180745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:13.183400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:13.184734 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4993514-ede6-42f3-b0f4-cdd913b352aa tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.958054 Jun 16 18:36:13.190654 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 883/1694] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:12 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:13.192406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:13.198777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-26ed8d0b-288f-43c1-a600-843a68659d79 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '.version_select at 0x7f866ead9e50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:13.201107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-161d171e-7a4e-45f2-93e4-9f3a131fdb78 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1329 microversion: 2.1 time: 0.796384 Jun 16 18:36:13.214135 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [None req-26ed8d0b-288f-43c1-a600-843a68659d79 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [f56d8058-c723-40bc-a4c2-cfb002f8a101] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 18:36:13.215568 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 812/1695] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:12 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1329 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:13.227881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-64f8c7d1-dad7-4473-a9dd-707e815a8c50 req-b9bc7f79-2aea-4eb8-9b4b-91fe433dec0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc46a4bd-aa35-4968-a855-9c7527528187", "name": "network-vif-plugged", "status": "completed", "tag": "406cf0b7-bda6-40a9-92a2-88e62c4ea87a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:13.255472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-64f8c7d1-dad7-4473-a9dd-707e815a8c50 req-b9bc7f79-2aea-4eb8-9b4b-91fe433dec0f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:13.256362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-64f8c7d1-dad7-4473-a9dd-707e815a8c50 req-b9bc7f79-2aea-4eb8-9b4b-91fe433dec0f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:13.270985 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-64f8c7d1-dad7-4473-a9dd-707e815a8c50 req-b9bc7f79-2aea-4eb8-9b4b-91fe433dec0f service nova] Creating event network-vif-plugged:406cf0b7-bda6-40a9-92a2-88e62c4ea87a for instance dc46a4bd-aa35-4968-a855-9c7527528187 on n-h2-846209-2 Jun 16 18:36:13.279022 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-64f8c7d1-dad7-4473-a9dd-707e815a8c50 req-b9bc7f79-2aea-4eb8-9b4b-91fe433dec0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061202 Jun 16 18:36:13.281127 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 813/1696] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:13.291169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a4afb21-a11c-407a-908a-b9122e1dbba3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1712779152"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:13.292964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a4afb21-a11c-407a-908a-b9122e1dbba3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:13.303727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4afb21-a11c-407a-908a-b9122e1dbba3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:13.304933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4afb21-a11c-407a-908a-b9122e1dbba3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:13.320157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4afb21-a11c-407a-908a-b9122e1dbba3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:13.321514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4afb21-a11c-407a-908a-b9122e1dbba3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:13.629025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:13.804901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=48 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.129780 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a4afb21-a11c-407a-908a-b9122e1dbba3 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "POST /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61/action" status: 202 len: 0 microversion: 2.1 time: 0.843121 Jun 16 18:36:14.132639 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 814/1697] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:36:13 2022] POST /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 18:36:14.147276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4f6360f9-5230-4244-8029-0ce9f97f8dbb tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Action: 'update', calling method: .version_select at 0x7f8678099b80>, body: {"quota_set": {"ram": 51200}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:14.231581 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [None req-26ed8d0b-288f-43c1-a600-843a68659d79 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [f56d8058-c723-40bc-a4c2-cfb002f8a101] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40456. Jun 16 18:36:14.283995 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-26ed8d0b-288f-43c1-a600-843a68659d79 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-209082973" status: 202 len: 0 microversion: 2.1 time: 1.090955 Jun 16 18:36:14.285784 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 884/1698] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-209082973 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:36:14.310908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31a05908-75f1-4f2c-a79e-3fd9831a52f5 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ea6d940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:14.466917 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31a05908-75f1-4f2c-a79e-3fd9831a52f5 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.179564 Jun 16 18:36:14.478319 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 885/1699] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:14 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:14.493849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f6360f9-5230-4244-8029-0ce9f97f8dbb tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.493849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f6360f9-5230-4244-8029-0ce9f97f8dbb tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.494665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f6360f9-5230-4244-8029-0ce9f97f8dbb tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.495231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f6360f9-5230-4244-8029-0ce9f97f8dbb tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.514317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44e68ef0-4eca-4da0-b8ea-049b6196c22a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:14.518581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-44e68ef0-4eca-4da0-b8ea-049b6196c22a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:14.556285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44e68ef0-4eca-4da0-b8ea-049b6196c22a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.558554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44e68ef0-4eca-4da0-b8ea-049b6196c22a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.567947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44e68ef0-4eca-4da0-b8ea-049b6196c22a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.568501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44e68ef0-4eca-4da0-b8ea-049b6196c22a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.581568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.643013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4f6360f9-5230-4244-8029-0ce9f97f8dbb tempest-QuotasAdminNegativeTest-69199940 tempest-QuotasAdminNegativeTest-69199940-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 200 len: 329 microversion: 2.1 time: 0.505169 Jun 16 18:36:14.647817 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-44e68ef0-4eca-4da0-b8ea-049b6196c22a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.167449 Jun 16 18:36:14.656131 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 815/1700] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:36:14 2022] PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 329 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:14.658295 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 886/1701] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:36:14 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:36:14.671256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ec792513-2714-4e57-b885-cc2ce82c762f tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f867800eca0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:14.677658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:14.679254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:14.714915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.720134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.721277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.726911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.775996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ec792513-2714-4e57-b885-cc2ce82c762f tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 200 len: 1429 microversion: 2.1 time: 0.123546 Jun 16 18:36:14.786410 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 816/1702] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:14 2022] GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:14.802767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:14.807789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:14.828081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.829319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.830326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.830919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:15.090095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:15.116276 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a1aecec-f2d2-45b0-9842-76af9d335add tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1329 microversion: 2.1 time: 0.328346 Jun 16 18:36:15.122002 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 817/1703] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:14 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1329 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:15.130963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7c88157-eb7d-4d41-ac8f-bab6a2cd9042 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Action: 'update', calling method: .version_select at 0x7f8678031b80>, body: {"quota_set": {"ram": 0}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:15.144284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7c88157-eb7d-4d41-ac8f-bab6a2cd9042 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '107cfc82e51f4143a0517a186d3e1bf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54586b6d8d64486bba20eb1d9b7b8477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7c88157-eb7d-4d41-ac8f-bab6a2cd9042 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Request method failure captured: Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 HTTP/1.1 Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 25 Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3f0V8s1H7ZY94peNCUqq0-xSe2XtDJ0Zix0eO7jpPpsC8A_LXdAjSGpXrZkFHVXW-g3e-Kk6DdR83NdkeWEstaR-sln4mqWxuSzMjbYBpe5FPeDIh4mbGGAjwW2hQnwrqGVrONmkIWDGlCVVTpPZjQv-ZANKze-tW1dl5GZjF4pxx0 Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:36:15.154995 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_54586b6d8d64486bba20eb1d9b7b8477", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/54586b6d8d64486bba20eb1d9b7b8477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 54586b6d8d64486bba20eb1d9b7b8477 Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1856158049 Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 107cfc82e51f4143a0517a186d3e1bf3 Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-QuotasAdminNegativeTest-1856158049-project Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: {"quota_set": {"ram": 0}} Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 16 18:36:15.156887 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '54586b6d8d64486bba20eb1d9b7b8477', 'body': {'quota_set': {'ram': 0}}} Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:36:15.158101 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:15.159669 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:15.162543 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:15.162543 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:15.162543 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:36:15.162543 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:36:15.162543 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 16 18:36:15.162543 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:15.162543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7c88157-eb7d-4d41-ac8f-bab6a2cd9042 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:15.167971 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7c88157-eb7d-4d41-ac8f-bab6a2cd9042 tempest-QuotasAdminNegativeTest-1856158049 tempest-QuotasAdminNegativeTest-1856158049-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477" status: 403 len: 116 microversion: 2.1 time: 0.048561 Jun 16 18:36:15.173233 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 818/1704] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:36:15 2022] PUT /compute/v2.1/os-quota-sets/54586b6d8d64486bba20eb1d9b7b8477 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:36:15.487733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67ed8e27-eaaa-4264-b4e9-e75ac282588e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f8677fdc3a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:15.695283 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67ed8e27-eaaa-4264-b4e9-e75ac282588e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.203764 Jun 16 18:36:15.698503 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 819/1705] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:15 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:15.724145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3467de9a-c68b-4702-a789-de32595e850f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:15.725190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3467de9a-c68b-4702-a789-de32595e850f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:15.840055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3467de9a-c68b-4702-a789-de32595e850f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:15.840639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3467de9a-c68b-4702-a789-de32595e850f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:15.857860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3467de9a-c68b-4702-a789-de32595e850f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:15.862183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3467de9a-c68b-4702-a789-de32595e850f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:16.067724 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3467de9a-c68b-4702-a789-de32595e850f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.355974 Jun 16 18:36:16.081558 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 820/1706] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:36:15 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 197 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:36:16.106089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc8d54c5-dea2-4a1c-827c-a77c702de08a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f8678027a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:16.211761 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dc8d54c5-dea2-4a1c-827c-a77c702de08a tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 200 len: 1429 microversion: 2.1 time: 0.132151 Jun 16 18:36:16.216453 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 821/1707] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:16 2022] GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:16.251078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:16.251851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:16.284749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:16.284749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:16.291679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:16.295126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:16.311665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:16.337391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:16.342972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:16.343901 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-352b20df-4780-4f8b-8edc-a0c8a8d81cd8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 1.683282 Jun 16 18:36:16.359909 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 887/1708] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:14 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:16.715520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85b6768c-763f-4db4-b4bf-057ed25200da tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866eafb160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:16.862325 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85b6768c-763f-4db4-b4bf-057ed25200da tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.151614 Jun 16 18:36:16.863199 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 888/1709] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:16 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:17.091401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8fb1b79d-152d-4a26-b3fd-d3ba068401c8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:17.093021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8fb1b79d-152d-4a26-b3fd-d3ba068401c8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:17.122830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb1b79d-152d-4a26-b3fd-d3ba068401c8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:17.123276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb1b79d-152d-4a26-b3fd-d3ba068401c8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:17.133304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb1b79d-152d-4a26-b3fd-d3ba068401c8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:17.135180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb1b79d-152d-4a26-b3fd-d3ba068401c8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:17.280817 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8fb1b79d-152d-4a26-b3fd-d3ba068401c8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.194350 Jun 16 18:36:17.291559 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 889/1710] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:36:17 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:36:17.308144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bb959b89-d3b9-477c-b4ad-32ddb74593cd tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866eafb940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:17.473299 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bb959b89-d3b9-477c-b4ad-32ddb74593cd tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 200 len: 1429 microversion: 2.1 time: 0.168825 Jun 16 18:36:17.484593 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 890/1711] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:17 2022] GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 1429 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:17.495122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:17.500086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:17.521313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:17.523057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:17.524041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:17.524607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:18.556304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:18.578877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:18.590905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:18.593339 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-981e16fb-ac2d-4331-a40f-aa564e304403 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 1.106807 Jun 16 18:36:18.595091 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 891/1712] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:17 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:18.606603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-404e4c3b-76e2-4d71-ab8e-db4c069ae747 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866eafb820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:18.811984 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-404e4c3b-76e2-4d71-ab8e-db4c069ae747 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1451 microversion: 2.1 time: 0.214738 Jun 16 18:36:18.818841 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 892/1713] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:18 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:18.847560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8dbdb985-12ce-4362-8e60-2f8a45239447 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:18.847560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8dbdb985-12ce-4362-8e60-2f8a45239447 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:18.877763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8dbdb985-12ce-4362-8e60-2f8a45239447 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:18.881480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8dbdb985-12ce-4362-8e60-2f8a45239447 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:18.885145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8dbdb985-12ce-4362-8e60-2f8a45239447 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:18.893115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8dbdb985-12ce-4362-8e60-2f8a45239447 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.019507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:19.051393 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32cbce83-c64b-4f1f-9478-8c10501fb5fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1510 microversion: 2.1 time: 2.822871 Jun 16 18:36:19.065012 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8dbdb985-12ce-4362-8e60-2f8a45239447 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.238300 Jun 16 18:36:19.076219 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 893/1715] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:36:18 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:36:19.078290 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 822/1715] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:16 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1510 bytes in 2856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:19.101005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:19.104482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:19.114875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e077f788-48e4-4a56-b30e-1df094ffe744 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866ebbe160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:19.136184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:19.138389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.142911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:19.146670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.397551 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e077f788-48e4-4a56-b30e-1df094ffe744 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 200 len: 1429 microversion: 2.1 time: 0.316493 Jun 16 18:36:19.409506 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 894/1716] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:19 2022] GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 1429 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:19.619383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:19.620106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:19.651349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:19.661734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.666141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:19.677285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:20.538746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:20.562588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:20.565418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:20.573208 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5890480e-24ba-4486-aece-d5808c232918 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.960225 Jun 16 18:36:20.584551 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 895/1717] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:19 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:20.600972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cfc0402b-fcd2-4d42-9c89-1a5d17c2ff20 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ea4cc10>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:20.627510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:20.643781 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad29daab-e018-4d1c-88c6-bae0ba45ee94 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 200 len: 1510 microversion: 2.1 time: 1.564108 Jun 16 18:36:20.657320 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 823/1718] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:19 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 1510 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:20.676931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b87b5af0-9f35-40b5-8cb1-b4034376c148 req-1a443e3c-59ce-4e4c-a064-4e9c3b26548d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:20.715491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b87b5af0-9f35-40b5-8cb1-b4034376c148 req-1a443e3c-59ce-4e4c-a064-4e9c3b26548d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:20.724363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b87b5af0-9f35-40b5-8cb1-b4034376c148 req-1a443e3c-59ce-4e4c-a064-4e9c3b26548d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:20.775456 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b87b5af0-9f35-40b5-8cb1-b4034376c148 req-1a443e3c-59ce-4e4c-a064-4e9c3b26548d service nova] Creating event network-changed:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h1-846209-2 Jun 16 18:36:20.803216 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b87b5af0-9f35-40b5-8cb1-b4034376c148 req-1a443e3c-59ce-4e4c-a064-4e9c3b26548d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141018 Jun 16 18:36:20.817360 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 824/1719] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:20.841414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-701fd63c-dd88-4843-af9e-be995b112ae4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:20.857407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-701fd63c-dd88-4843-af9e-be995b112ae4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:20.882323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701fd63c-dd88-4843-af9e-be995b112ae4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:20.886974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701fd63c-dd88-4843-af9e-be995b112ae4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:20.896144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701fd63c-dd88-4843-af9e-be995b112ae4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:20.896759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701fd63c-dd88-4843-af9e-be995b112ae4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:21.041241 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-701fd63c-dd88-4843-af9e-be995b112ae4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.222112 Jun 16 18:36:21.046783 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 825/1720] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:36:20 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:36:21.151653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5f97b935-7e4c-4f60-b9e2-dc2330f2c5f4 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f8677fc2940>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:23.979143 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cfc0402b-fcd2-4d42-9c89-1a5d17c2ff20 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1460 microversion: 2.1 time: 3.392502 Jun 16 18:36:23.980326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 896/1721] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:20 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1460 bytes in 3395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:23.993267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:23.995964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:24.011786 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5f97b935-7e4c-4f60-b9e2-dc2330f2c5f4 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 200 len: 1429 microversion: 2.1 time: 2.961053 Jun 16 18:36:24.019627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.019627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.022383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.023025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.025747 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 826/1722] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:21 2022] GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 1429 bytes in 2978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:24.035953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-efb16f89-e0f6-4c65-9eec-265f8706f308 req-28573e82-f42f-4915-bd6a-90011125a156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e31fb33-1093-4058-bdf4-aed87d21bf61", "name": "network-vif-plugged", "status": "completed", "tag": "fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:24.050550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-efb16f89-e0f6-4c65-9eec-265f8706f308 req-28573e82-f42f-4915-bd6a-90011125a156 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.051088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-efb16f89-e0f6-4c65-9eec-265f8706f308 req-28573e82-f42f-4915-bd6a-90011125a156 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.071298 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-efb16f89-e0f6-4c65-9eec-265f8706f308 req-28573e82-f42f-4915-bd6a-90011125a156 service nova] Creating event network-vif-plugged:fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f for instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 on n-h1-846209-2 Jun 16 18:36:24.076039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-efb16f89-e0f6-4c65-9eec-265f8706f308 req-28573e82-f42f-4915-bd6a-90011125a156 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048837 Jun 16 18:36:24.080749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:36:24.084342 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 827/1723] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:24.096320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:24.099801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:24.108941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.110002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.111229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.111906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.292083 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5fb57db0-68c1-42a0-bc45-56ab61c6746d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 204 len: 0 microversion: 2.1 time: 0.307807 Jun 16 18:36:24.293651 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 897/1724] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:36:23 2022] DELETE /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:24.304696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-13a41400-6ea4-4521-8be6-f2715f70b7de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:24.306527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-13a41400-6ea4-4521-8be6-f2715f70b7de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:24.315483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13a41400-6ea4-4521-8be6-f2715f70b7de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.316140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13a41400-6ea4-4521-8be6-f2715f70b7de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.317185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13a41400-6ea4-4521-8be6-f2715f70b7de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.318030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13a41400-6ea4-4521-8be6-f2715f70b7de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.362324 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-13a41400-6ea4-4521-8be6-f2715f70b7de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.062434 Jun 16 18:36:24.363247 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 898/1725] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:36:24 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:24.444937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:24.460247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:24.465314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:24.471071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-251370db-478a-4ead-b162-1fca60a0c894 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.380015 Jun 16 18:36:24.472230 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 828/1726] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:24 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:24.501032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a23f866f-e5cb-4005-8983-c9b8825b559b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f8677fc2dc0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:24.515802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:24.581263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1010288768", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:24.621616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.177970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:36:33.187805 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a23f866f-e5cb-4005-8983-c9b8825b559b tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 200 len: 1460 microversion: 2.1 time: 8.712645 Jun 16 18:36:33.197707 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 829/1727] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:24 2022] GET /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 1460 bytes in 8725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:33.223660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:33.224297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:33.228997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.257829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.258335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.259688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.260984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.281581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.283738 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 HTTP/1.1 Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:36:33.287787 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'dc46a4bd-aa35-4968-a855-9c7527528187'} Jun 16 18:36:33.289626 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:33.290898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:36:33.292589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:36:33.295527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:33.297229 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a809b0ed-fcae-438d-b412-fcdb377b25af tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 404 len: 111 microversion: 2.1 time: 0.098400 Jun 16 18:36:33.298024 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 830/1728] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:33 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:36:33.304849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-108b99cc-6321-47de-9bf4-adf70b418241 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '.version_select at 0x7f86780278b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:33.346146 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-108b99cc-6321-47de-9bf4-adf70b418241 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1246039555" status: 204 len: 0 microversion: 2.25 time: 0.046611 Jun 16 18:36:33.347414 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 831/1729] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:36:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1246039555 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:36:33.355952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-550f2867-71b7-4550-a7d6-59110829e2ae tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866f0e50d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:33.416012 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-550f2867-71b7-4550-a7d6-59110829e2ae tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 200 len: 1438 microversion: 2.1 time: 0.066280 Jun 16 18:36:33.417521 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 832/1730] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:33 2022] GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 1438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:33.422946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:33.423828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:33.433298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.434253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.435271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.436028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.494817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:36:33.495559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:36:33.496256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:36:33.496677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:36:33.497277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:36:33.499958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.523693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.526097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.528523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.529174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.598798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Getting quotas for project 283e375f03104021bdf7a756af5bdcce. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:36:33.621376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Getting quotas for user 8dd7fc37c6a04f5da2aca97532bcf84b and project 283e375f03104021bdf7a756af5bdcce. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:36:33.652155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:36:33.662342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:36:33.792153 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33fc6506-3492-4f78-ba62-019ae2e378ad tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.427323 Jun 16 18:36:33.798659 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 899/1731] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 9435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:36:33.815239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fb7196d5-0ccc-4626-898a-d6dc8302733a req-57f05c5d-810c-404b-89b5-bb29a8bc3b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc46a4bd-aa35-4968-a855-9c7527528187", "name": "network-vif-deleted", "tag": "406cf0b7-bda6-40a9-92a2-88e62c4ea87a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:33.829591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb7196d5-0ccc-4626-898a-d6dc8302733a req-57f05c5d-810c-404b-89b5-bb29a8bc3b52 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.830278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb7196d5-0ccc-4626-898a-d6dc8302733a req-57f05c5d-810c-404b-89b5-bb29a8bc3b52 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.843732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fb7196d5-0ccc-4626-898a-d6dc8302733a req-57f05c5d-810c-404b-89b5-bb29a8bc3b52 service nova] Creating event network-vif-deleted:406cf0b7-bda6-40a9-92a2-88e62c4ea87a for instance dc46a4bd-aa35-4968-a855-9c7527528187 on n-h2-846209-2 Jun 16 18:36:33.853845 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fb7196d5-0ccc-4626-898a-d6dc8302733a req-57f05c5d-810c-404b-89b5-bb29a8bc3b52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053084 Jun 16 18:36:33.855592 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 900/1732] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:33.867016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:33.868674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:33.878685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.880131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.881096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:33.881694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:33.956900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:33.979584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:33.981135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:33.982841 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3580d3e-12b4-4696-9e1d-4a2eb1d9d632 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.564108 Jun 16 18:36:33.983818 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 833/1733] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:33 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:33.989267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e48ce6ff-d35d-4594-b2be-eb257baddbd3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '.version_select at 0x7f8678027280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:34.016957 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e48ce6ff-d35d-4594-b2be-eb257baddbd3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-1687327433" status: 202 len: 0 microversion: 2.1 time: 0.031868 Jun 16 18:36:34.017702 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 834/1734] 10.222.0.27 () {58 vars in 1208 bytes} [Thu Jun 16 18:36:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1687327433 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:36:34.024037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cba49427-292b-4253-b683-78ab10c6bc4e tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866f0e5a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:34.100669 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cba49427-292b-4253-b683-78ab10c6bc4e tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 200 len: 1438 microversion: 2.1 time: 0.081510 Jun 16 18:36:34.101846 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 835/1735] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:34 2022] GET /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:34.118739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1717066530", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:34.284598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:36:34.290725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:34.303476 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-17a69013-cedc-4eed-9a9c-fb9583c93f23 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 200 len: 1466 microversion: 2.1 time: 0.441862 Jun 16 18:36:34.310932 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 901/1736] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:33 2022] GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 1466 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:34.328294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:34.328858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:34.361545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:34.374416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:34.380241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:34.380720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:35.014389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:36:35.015184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:36:35.016277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:36:35.016916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:36:35.017670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:36:35.033672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:35.037558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:35.039239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:35.042937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:35.043775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:35.049869 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7818e48e-7c6e-4086-b06f-4e7f9030f494 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1467 microversion: 2.1 time: 0.734949 Jun 16 18:36:35.053261 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 902/1737] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:34 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1467 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:35.073392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b16b1643-736e-4e0b-b549-72d47340be00 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f2d1280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:35.090363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Getting quotas for project 283e375f03104021bdf7a756af5bdcce. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:36:35.103205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Getting quotas for user 8dd7fc37c6a04f5da2aca97532bcf84b and project 283e375f03104021bdf7a756af5bdcce. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:36:35.148911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:36:35.156310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:36:35.283987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b8be666-b52d-4a65-a98c-5410437d69ab tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178738 Jun 16 18:36:35.288565 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 836/1738] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:36:35.311350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-305247326", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "06a9a0f4-e2e7-4b09-9d3d-fea8950fac70"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:37.790136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:36:37.828991 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b16b1643-736e-4e0b-b549-72d47340be00 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-06-16T18%3A33%3A41Z" status: 200 len: 2798 microversion: 2.1 time: 2.772848 Jun 16 18:36:37.832533 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 903/1739] 10.222.0.27 () {58 vars in 1198 bytes} [Thu Jun 16 18:36:35 2022] GET /compute/v2.1/images?changes-since=2022-06-16T18%3A33%3A41Z => generated 2798 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:37.847326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:37.851306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:37.874611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:37.875194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:37.886927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:37.887619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:38.470989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:38.503271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:38.505244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:38.507843 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61a030fe-7983-4ced-9a1d-0078cc36ef59 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.673715 Jun 16 18:36:38.513094 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 904/1740] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:37 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:38.518802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7bf78953-b5ab-4885-8cfc-cfee7a8f1d53 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f86781beb80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:38.933683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:36:38.937349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:36:38.938194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:36:38.938792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:36:38.939410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:36:38.960603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:38.961068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:38.962232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:38.962469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:38.995523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:36:39.001887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:36:39.016656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:36:39.021000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:36:39.082553 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f493e24b-f99f-4f01-bfba-5f42136a56b4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.791707 Jun 16 18:36:39.083513 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 837/1741] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:36:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:36:39.094822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:39.096571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:39.107062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:39.110714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:39.112546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:39.119708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:39.255527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:39.274660 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3dc6f430-cf47-47c3-8980-35de7ee25b1d tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1272 microversion: 2.1 time: 0.189521 Jun 16 18:36:39.283221 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 838/1742] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:39 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:39.285596 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7bf78953-b5ab-4885-8cfc-cfee7a8f1d53 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "DELETE /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c" status: 204 len: 0 microversion: 2.1 time: 0.771034 Jun 16 18:36:39.286415 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 905/1743] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:38 2022] DELETE /compute/v2.1/images/2180e724-8e32-4da3-b1dd-7c4511b4909c => generated 0 bytes in 772 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:39.290434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6fda4bce-2cf9-40b2-9e74-d66aee4788ce req-d37029fe-9805-42a2-aaa5-9015c319b658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:39.303875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6fda4bce-2cf9-40b2-9e74-d66aee4788ce req-d37029fe-9805-42a2-aaa5-9015c319b658 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:39.304556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6fda4bce-2cf9-40b2-9e74-d66aee4788ce req-d37029fe-9805-42a2-aaa5-9015c319b658 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:39.341458 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6fda4bce-2cf9-40b2-9e74-d66aee4788ce req-d37029fe-9805-42a2-aaa5-9015c319b658 service nova] Creating event network-changed:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h2-846209-2 Jun 16 18:36:39.374527 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6fda4bce-2cf9-40b2-9e74-d66aee4788ce req-d37029fe-9805-42a2-aaa5-9015c319b658 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088539 Jun 16 18:36:39.376934 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 839/1744] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:39.402605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-06053ba4-31dc-4675-80bd-98844ba575c4 req-9726e738-301e-429f-bd5b-e90323737867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0271c7ba-7672-4448-8a5f-33e3150857fd", "name": "network-vif-unplugged", "status": "completed", "tag": "c6d88fb8-bcea-40fb-9158-9244e91ce3f1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:39.419415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-06053ba4-31dc-4675-80bd-98844ba575c4 req-9726e738-301e-429f-bd5b-e90323737867 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:39.419914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-06053ba4-31dc-4675-80bd-98844ba575c4 req-9726e738-301e-429f-bd5b-e90323737867 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:39.467179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-06053ba4-31dc-4675-80bd-98844ba575c4 req-9726e738-301e-429f-bd5b-e90323737867 service nova] Creating event network-vif-unplugged:c6d88fb8-bcea-40fb-9158-9244e91ce3f1 for instance 0271c7ba-7672-4448-8a5f-33e3150857fd on n-h2-846209-2 Jun 16 18:36:39.487295 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-06053ba4-31dc-4675-80bd-98844ba575c4 req-9726e738-301e-429f-bd5b-e90323737867 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107939 Jun 16 18:36:39.497211 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 840/1745] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:39.513387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-beee48e1-5de2-49c5-8bcf-e11e6f14f664 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f8678027d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:39.657981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7188b380-311e-4c10-bb9a-814d2ef8f372 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Action: 'create', calling method: .version_select at 0x7f866ea6dca0>, body: {"keypair": {"name": "tempest-keypair-1920096483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwg98eEgSa782ZHtzzq2Srqmz9b8Vty4+dP5UkXke4m66rnc2B87y9p1Rtx+wt8TfR19yjSWwDhQ3Z0F9v/m4WcnK6A3UIHP+8Vsnxg9K3WXxsbyejhkddiDZsGHlKsmQ=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:39.699257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7188b380-311e-4c10-bb9a-814d2ef8f372 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Getting quotas for project 8ce4ebda17f641c4a782a2893a7e9cfa. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:36:39.725348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7188b380-311e-4c10-bb9a-814d2ef8f372 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Getting quotas for user 88ec705254474a2797ff413d97ce669e and project 8ce4ebda17f641c4a782a2893a7e9cfa. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:36:39.773443 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-beee48e1-5de2-49c5-8bcf-e11e6f14f664 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1283183967" status: 200 len: 485 microversion: 2.1 time: 0.273385 Jun 16 18:36:39.780874 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 841/1746] 10.222.0.27 () {58 vars in 1230 bytes} [Thu Jun 16 18:36:39 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1283183967 => generated 485 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:39.797116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b92213eb-5804-41ba-9c98-d96b1ee00522 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:39.799326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b92213eb-5804-41ba-9c98-d96b1ee00522 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:39.807637 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7188b380-311e-4c10-bb9a-814d2ef8f372 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.519742 Jun 16 18:36:39.808551 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 906/1747] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:36:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:39.822002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1be2bb5d-03b1-4824-9789-9d0a738b477b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '.version_select at 0x7f866ea7b790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:40.219501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b92213eb-5804-41ba-9c98-d96b1ee00522 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:40.240456 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b92213eb-5804-41ba-9c98-d96b1ee00522 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1208 microversion: 2.1 time: 0.460837 Jun 16 18:36:40.242921 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 842/1748] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:39 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1208 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:40.251500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:40.253245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:40.272307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:40.274468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:40.276589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:40.281381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:40.718654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:40.731919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:40.737312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:40.738972 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8fcae33f-8f00-48a4-a259-413d5154ef42 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.493760 Jun 16 18:36:40.742535 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 843/1749] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:40 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:40.753274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92e15786-9a5c-41fc-9056-d1a322a631be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f0ee8b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:43.563648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.476985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.976273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.748626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.796816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.224631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.269425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.724321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=27 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.554599 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1be2bb5d-03b1-4824-9789-9d0a738b477b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] HTTP exception thrown: Image not found. Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1be2bb5d-03b1-4824-9789-9d0a738b477b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Request method failure captured: Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc HTTP/1.1 Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3fK2MPkpWqyqWbP3En9rWxaphIGESSobqVjTe84BIeM1Vw6iQlh8laMXSmL9C4WnZgDDpPKyZVTePPMPpU0v-jjqbmZEu03I7OLZqQUyxM1fOll9OM-Ux1E9Dgd6b4pTJA5V87YBFrMKYRz1bK6iB1Sd2VpTAqGxblDSpIdv3_SI2c Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 22faed45f96e4f129f8f35d01f836f22 Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:36:52.556466 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_22faed45f96e4f129f8f35d01f836f22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 22faed45f96e4f129f8f35d01f836f22 Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerTestJSON-2131598394-project Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: d469eedff61d49158ea934377d95d24d Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerTestJSON-2131598394-project Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '60ccc05f-ade5-4f1d-91bd-b5b3125255fc'} Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:52.558340 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 60ccc05f-ade5-4f1d-91bd-b5b3125255fc to delete Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:52.559391 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60ccc05f-ade5-4f1d-91bd-b5b3125255fc could not be found. Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:52.560789 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1be2bb5d-03b1-4824-9789-9d0a738b477b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:52.563322 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1be2bb5d-03b1-4824-9789-9d0a738b477b tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "DELETE /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc" status: 404 len: 62 microversion: 2.1 time: 12.741688 Jun 16 18:36:52.566376 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 907/1750] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:39 2022] DELETE /compute/v2.1/images/60ccc05f-ade5-4f1d-91bd-b5b3125255fc => generated 62 bytes in 12747 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:36:52.571870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:52.572496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:52.582794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.583829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.584711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.585622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.658531 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92e15786-9a5c-41fc-9056-d1a322a631be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?server=0271c7ba-7672-4448-8a5f-33e3150857fd" status: 200 len: 956 microversion: 2.1 time: 11.914049 Jun 16 18:36:52.659578 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 844/1751] 10.222.0.27 () {58 vars in 1208 bytes} [Thu Jun 16 18:36:40 2022] GET /compute/v2.1/images?server=0271c7ba-7672-4448-8a5f-33e3150857fd => generated 956 bytes in 11916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:52.665713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:52.666484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:52.673375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.673938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.674838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.675662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.754995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:52.763611 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-37af313a-f348-4240-ab79-b1dc1e80a7b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1314 microversion: 2.1 time: 0.196007 Jun 16 18:36:52.764460 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 908/1752] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:52 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:52.771426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2a521821-3176-4b7b-a4e1-4eaf978d79a9 req-dbc594d0-be70-4948-a467-04f262120b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec9541c-3218-401f-b314-dc00a192ec98", "tag": "18afa003-668c-46ac-8cb1-4db3a3c6c075"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:52.785014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2a521821-3176-4b7b-a4e1-4eaf978d79a9 req-dbc594d0-be70-4948-a467-04f262120b89 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.785798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2a521821-3176-4b7b-a4e1-4eaf978d79a9 req-dbc594d0-be70-4948-a467-04f262120b89 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.800717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2a521821-3176-4b7b-a4e1-4eaf978d79a9 req-dbc594d0-be70-4948-a467-04f262120b89 service nova] Creating event network-changed:18afa003-668c-46ac-8cb1-4db3a3c6c075 for instance 0ec9541c-3218-401f-b314-dc00a192ec98 on n-h2-846209-2 Jun 16 18:36:52.807276 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2a521821-3176-4b7b-a4e1-4eaf978d79a9 req-dbc594d0-be70-4948-a467-04f262120b89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040929 Jun 16 18:36:52.808335 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 909/1753] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:52.814435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f3ddccff-9d65-490c-9e60-aa458300b6e8 req-6088fc1f-1d86-41a6-b16b-d7b8b9f13767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-plugged", "status": "completed", "tag": "13200571-8aad-437e-ab86-6afa58231640"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:52.824683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f3ddccff-9d65-490c-9e60-aa458300b6e8 req-6088fc1f-1d86-41a6-b16b-d7b8b9f13767 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.825455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f3ddccff-9d65-490c-9e60-aa458300b6e8 req-6088fc1f-1d86-41a6-b16b-d7b8b9f13767 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.838846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f3ddccff-9d65-490c-9e60-aa458300b6e8 req-6088fc1f-1d86-41a6-b16b-d7b8b9f13767 service nova] Creating event network-vif-plugged:13200571-8aad-437e-ab86-6afa58231640 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:36:52.845065 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f3ddccff-9d65-490c-9e60-aa458300b6e8 req-6088fc1f-1d86-41a6-b16b-d7b8b9f13767 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034676 Jun 16 18:36:52.846269 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 910/1754] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:52.855962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-797e4e63-654c-45a8-9fbc-e757092d675b req-6f4393a0-ce87-48da-9ff6-1542a0551684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0861585c-f6be-40db-9c1a-d5b9bb022d4e", "tag": "49443c23-3d73-4790-8d09-420401ef5734"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:52.865544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:52.878557 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a0c1937-e5fd-41ca-bc30-60780bd5102d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1308 microversion: 2.1 time: 0.213835 Jun 16 18:36:52.883066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-797e4e63-654c-45a8-9fbc-e757092d675b req-6f4393a0-ce87-48da-9ff6-1542a0551684 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.883628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-797e4e63-654c-45a8-9fbc-e757092d675b req-6f4393a0-ce87-48da-9ff6-1542a0551684 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.889468 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 845/1755] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:52 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:52.894824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:52.896267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:52.900567 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-797e4e63-654c-45a8-9fbc-e757092d675b req-6f4393a0-ce87-48da-9ff6-1542a0551684 service nova] Creating event network-changed:49443c23-3d73-4790-8d09-420401ef5734 for instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e on n-h1-846209-2 Jun 16 18:36:52.903593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.904393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.905747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:52.906707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:52.907105 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-797e4e63-654c-45a8-9fbc-e757092d675b req-6f4393a0-ce87-48da-9ff6-1542a0551684 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054590 Jun 16 18:36:52.907790 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 911/1756] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:52.916703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1785797170", "imageRef": "9de216c5-9882-40a0-9ec8-dc2fe37e1713", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "400aa000-eaed-490d-b31f-1321fe5c2e0c"}], "security_groups": [{"name": "tempest-securitygroup--759802354"}], "key_name": "tempest-keypair-1920096483", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:53.256470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] validate_networks() for [('400aa000-eaed-490d-b31f-1321fe5c2e0c', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:36:53.596607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:53.613234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:53.616432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:53.618419 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a81605eb-7112-4ec2-b097-078cb45abd9d tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.727865 Jun 16 18:36:53.619716 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 846/1757] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:52 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:53.624488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:53.625070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:53.637140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:53.639647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:53.642181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:53.642881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:53.677231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:36:53.782374 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69a82215-b8a2-43fc-aadf-a9e042d5d262 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 204 len: 0 microversion: 2.1 time: 0.160337 Jun 16 18:36:53.783371 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 847/1758] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:36:53 2022] DELETE /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:53.790425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ac06f56-4b48-47fc-bb4a-e0af7871634a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f86741509d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:53.868442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ac06f56-4b48-47fc-bb4a-e0af7871634a tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 484 microversion: 2.1 time: 0.083485 Jun 16 18:36:53.869668 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 848/1759] 10.222.0.27 () {58 vars in 1316 bytes} [Thu Jun 16 18:36:53 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 484 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:53.874481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:53.875667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:53.884812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:53.885817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:53.887353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:53.888274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:54.072628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:36:54.073267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:36:54.073842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:36:54.074385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:36:54.074879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:36:54.086286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:54.086730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:54.087556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:54.088297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:54.099423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:54.109480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Getting quotas for project 8ce4ebda17f641c4a782a2893a7e9cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:36:54.113225 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cbae47f8-869b-47ab-9a59-e38898b62e9a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1314 microversion: 2.1 time: 0.239119 Jun 16 18:36:54.122573 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 849/1760] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:53 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:54.122573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:54.122573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:54.126365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Getting quotas for user 88ec705254474a2797ff413d97ce669e and project 8ce4ebda17f641c4a782a2893a7e9cfa. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:36:54.131491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:54.132405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:54.133697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:54.134557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:54.146149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:36:54.149018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9de216c5-9882-40a0-9ec8-dc2fe37e1713',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:36:54.203797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1338dd0c-02e1-498e-8a52-2ce1f2039909 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.294382 Jun 16 18:36:54.209957 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 912/1761] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:36:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:36:54.216119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890ec7a1-f31b-480c-bc7a-f5b0c7e2afb0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ebaa5e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:54.320657 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-890ec7a1-f31b-480c-bc7a-f5b0c7e2afb0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 484 microversion: 2.1 time: 0.115413 Jun 16 18:36:54.322266 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 913/1762] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Jun 16 18:36:54 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 484 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:54.327300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:54.341244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:54.363945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:54.365207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:54.367925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:54.369423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:54.749899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:54.765136 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d1f128d-cbfa-4e49-b59a-d9a7a9372a35 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1473 microversion: 2.1 time: 0.646651 Jun 16 18:36:54.766291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 850/1763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:54 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1473 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:54.780813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-926872b7-f522-41b8-890a-bd92605ccc81 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:54.782504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-926872b7-f522-41b8-890a-bd92605ccc81 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:54.795855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:54.812437 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6bf8dd07-66e4-4fbc-bcf8-aa5b8c944c7e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1308 microversion: 2.1 time: 0.488848 Jun 16 18:36:54.826320 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 914/1764] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:54 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1308 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:54.832573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4df7d0be-f401-4b24-bd4f-8bd18282660f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866eae8e50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:54.967902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-926872b7-f522-41b8-890a-bd92605ccc81 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:54.991007 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-926872b7-f522-41b8-890a-bd92605ccc81 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1246 microversion: 2.1 time: 0.220150 Jun 16 18:36:55.004286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4df7d0be-f401-4b24-bd4f-8bd18282660f tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3704 microversion: 2.1 time: 0.174723 Jun 16 18:36:55.004286 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 915/1765] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:36:54 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3704 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:55.006523 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 851/1766] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:54 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1246 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:55.009666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:55.012092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:55.020918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-fc31247e-4ee4-462b-9fbe-7a78a1c96237 req-f374a1d3-bbcf-4379-a5dd-23c5508e6998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c6c7ab-0c3f-422f-b198-897c7700caa8", "tag": "4fbb6278-55b1-46ea-93a8-eb60a17a45ad"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:55.022227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:55.022695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:55.023891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:55.024517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:55.034279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fc31247e-4ee4-462b-9fbe-7a78a1c96237 req-f374a1d3-bbcf-4379-a5dd-23c5508e6998 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:55.035851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fc31247e-4ee4-462b-9fbe-7a78a1c96237 req-f374a1d3-bbcf-4379-a5dd-23c5508e6998 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:55.060020 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-fc31247e-4ee4-462b-9fbe-7a78a1c96237 req-f374a1d3-bbcf-4379-a5dd-23c5508e6998 service nova] Creating event network-changed:4fbb6278-55b1-46ea-93a8-eb60a17a45ad for instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 on n-h2-846209-2 Jun 16 18:36:55.066342 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-fc31247e-4ee4-462b-9fbe-7a78a1c96237 req-f374a1d3-bbcf-4379-a5dd-23c5508e6998 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057723 Jun 16 18:36:55.067162 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 852/1767] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:55.087525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-plugged", "status": "completed", "tag": "aa145fe7-4192-4143-91ea-a0ab1f38677e"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-plugged", "status": "completed", "tag": "e50658e2-b980-4977-bf2a-fc925e9bb8ac"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-plugged", "status": "completed", "tag": "060fd62e-c274-4002-82ff-d6c21be38ac5"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-plugged", "status": "completed", "tag": "cd439c57-faec-4942-b7aa-ee4fd941b807"}, {"server_uuid": "0ec9541c-3218-401f-b314-dc00a192ec98", "name": "network-vif-plugged", "status": "completed", "tag": "18afa003-668c-46ac-8cb1-4db3a3c6c075"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-plugged", "status": "completed", "tag": "dcba32f5-5668-4977-9a51-5d6e60fa9c4f"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-plugged", "status": "completed", "tag": "81274976-813c-4c06-b3c6-a7e8aea88f15"}, {"server_uuid": "7e31fb33-1093-4058-bdf4-aed87d21bf61", "name": "network-vif-unplugged", "status": "completed", "tag": "fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f"}, {"server_uuid": "0861585c-f6be-40db-9c1a-d5b9bb022d4e", "name": "network-vif-plugged", "status": "completed", "tag": "49443c23-3d73-4790-8d09-420401ef5734"}, {"server_uuid": "65c6c7ab-0c3f-422f-b198-897c7700caa8", "name": "network-vif-plugged", "status": "completed", "tag": "4fbb6278-55b1-46ea-93a8-eb60a17a45ad"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:55.109701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:55.110200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:55.131893 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:aa145fe7-4192-4143-91ea-a0ab1f38677e for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:36:55.132748 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:e50658e2-b980-4977-bf2a-fc925e9bb8ac for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:36:55.133442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:060fd62e-c274-4002-82ff-d6c21be38ac5 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:36:55.134181 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:cd439c57-faec-4942-b7aa-ee4fd941b807 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:36:55.134876 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:18afa003-668c-46ac-8cb1-4db3a3c6c075 for instance 0ec9541c-3218-401f-b314-dc00a192ec98 on n-h2-846209-2 Jun 16 18:36:55.135570 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:dcba32f5-5668-4977-9a51-5d6e60fa9c4f for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:36:55.136250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:81274976-813c-4c06-b3c6-a7e8aea88f15 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:36:55.136952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-unplugged:fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f for instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 on n-h1-846209-2 Jun 16 18:36:55.137666 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:49443c23-3d73-4790-8d09-420401ef5734 for instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e on n-h1-846209-2 Jun 16 18:36:55.138439 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] Creating event network-vif-plugged:4fbb6278-55b1-46ea-93a8-eb60a17a45ad for instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 on n-h2-846209-2 Jun 16 18:36:55.161784 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c51230a9-8dbd-4947-8fd0-62d3cb60f268 req-32642916-84d2-4df9-8dd6-16cb951ed181 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1724 microversion: 2.1 time: 0.088403 Jun 16 18:36:55.163190 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 853/1768] 10.222.0.27 () {64 vars in 1318 bytes} [Thu Jun 16 18:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 1724 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:55.171041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-12919b26-1744-44e4-9932-ba800f1eed02 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f128700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:55.300086 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-12919b26-1744-44e4-9932-ba800f1eed02 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.135357 Jun 16 18:36:55.301051 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 854/1769] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:36:55 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:55.316707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:55.318434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:55.326106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:55.326957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:55.328003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:55.328690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:55.546598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:55.562175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:55.564289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:55.566229 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-417c7f73-e7a5-4771-9a9a-ae9487bd8302 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.561144 Jun 16 18:36:55.567534 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 916/1770] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:55 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:55.573335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7a6718cc-ce05-425d-ab44-e96364d40905 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f867816aa60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:55.722815 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7a6718cc-ce05-425d-ab44-e96364d40905 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.153618 Jun 16 18:36:55.730337 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 917/1771] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:36:55 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:55.759109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2b2d53c-1fd3-4bcc-ae94-51b61a51f039 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866eac10d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:56.020167 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2b2d53c-1fd3-4bcc-ae94-51b61a51f039 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-06-16T18%3A33%3A37Z" status: 200 len: 7013 microversion: 2.1 time: 0.280143 Jun 16 18:36:56.021385 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 918/1772] 10.222.0.27 () {58 vars in 1219 bytes} [Thu Jun 16 18:36:55 2022] GET /compute/v2.1/images/detail?changes-since=2022-06-16T18%3A33%3A37Z => generated 7013 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:56.031419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:56.038676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:56.061490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.064714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.066240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:56.068503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.079118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.084378 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8add01f-e645-4687-af52-ddf636ca4b08 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1314 microversion: 2.1 time: 0.773621 Jun 16 18:36:56.097508 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 855/1773] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:55 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:56.110840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:56.118218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:56.129471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.130925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.133647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.134354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.780821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:56.791992 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9429140d-b32b-48bb-a3c5-a644c8401b9d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1308 microversion: 2.1 time: 0.692210 Jun 16 18:36:56.793253 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 856/1774] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:56 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1308 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:56.801073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:56.802671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:56.809593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:56.811463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.812054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.813018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.813718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.822260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0024604e-62e3-4a7e-857b-246936bd847c tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1473 microversion: 2.1 time: 0.795428 Jun 16 18:36:56.822874 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 919/1775] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:56 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1473 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:56.840505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f7484bbb-f041-4dee-b361-1d3285ede22e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f86781dcd30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:56.941339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:56.951395 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8db62332-d06e-4986-af7c-f72abbb6e990 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1316 microversion: 2.1 time: 0.155172 Jun 16 18:36:56.952042 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 857/1776] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:56 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:56.958329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:56.959167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:56.968073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.968864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.969813 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f7484bbb-f041-4dee-b361-1d3285ede22e tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1283183967" status: 200 len: 665 microversion: 2.1 time: 0.145558 Jun 16 18:36:56.970009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:56.970355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:56.971958 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 920/1777] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Jun 16 18:36:56 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1283183967 => generated 665 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:56.986356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3e909ba-5e73-494c-ab46-a58af7fdb823 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866eac15e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:57.093777 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3e909ba-5e73-494c-ab46-a58af7fdb823 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1464 microversion: 2.1 time: 0.112068 Jun 16 18:36:57.106384 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 921/1778] 10.222.0.27 () {58 vars in 1337 bytes} [Thu Jun 16 18:36:56 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1464 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:57.113179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e2a10544-ae9d-404c-82ce-6d6a7df574cf tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866eba0a60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:57.212771 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e2a10544-ae9d-404c-82ce-6d6a7df574cf tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1464 microversion: 2.1 time: 0.104750 Jun 16 18:36:57.213611 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 922/1779] 10.222.0.27 () {58 vars in 1323 bytes} [Thu Jun 16 18:36:57 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:57.229025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:57.229955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:57.237896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.238384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.239748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.240254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.295751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:57.309894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:57.320261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:57.321506 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6107deca-cc44-4167-bd93-202171d24d2a tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1880 microversion: 2.32 time: 0.368240 Jun 16 18:36:57.322113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 858/1780] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:56 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1880 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:57.370601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7bb5bc08-249a-4af9-977c-53503d846379 req-fb067ccf-ab7d-465d-85ce-c22388784a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e31fb33-1093-4058-bdf4-aed87d21bf61", "name": "network-vif-deleted", "tag": "fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:57.388657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7bb5bc08-249a-4af9-977c-53503d846379 req-fb067ccf-ab7d-465d-85ce-c22388784a11 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.391439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7bb5bc08-249a-4af9-977c-53503d846379 req-fb067ccf-ab7d-465d-85ce-c22388784a11 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.424865 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7bb5bc08-249a-4af9-977c-53503d846379 req-fb067ccf-ab7d-465d-85ce-c22388784a11 service nova] Creating event network-vif-deleted:fb8b6eb7-4a63-458f-9a9a-0dc758d79d8f for instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 on n-h1-846209-2 Jun 16 18:36:57.437847 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7bb5bc08-249a-4af9-977c-53503d846379 req-fb067ccf-ab7d-465d-85ce-c22388784a11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086011 Jun 16 18:36:57.456673 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 859/1781] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:57.477510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c557a5b4-6ced-4b72-b598-20b06324daac tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1651f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:57.779778 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c557a5b4-6ced-4b72-b598-20b06324daac tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7788 microversion: 2.1 time: 0.319508 Jun 16 18:36:57.785708 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 860/1782] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jun 16 18:36:57 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7788 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:57.822067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:57.826989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:57.846960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.848213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:57.852152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.855146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.857839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.862261 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e7ebd375-8cff-41c9-89f7-cc1e58d40f9f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1314 microversion: 2.1 time: 0.636746 Jun 16 18:36:57.863429 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 923/1783] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:57 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:57.877209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-779ca4f9-1cf0-4243-8c16-05460cc7cad7 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f86781dc280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:58.259566 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-779ca4f9-1cf0-4243-8c16-05460cc7cad7 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.392419 Jun 16 18:36:58.260540 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 924/1784] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jun 16 18:36:57 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:58.271095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:58.271833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:58.293597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:58.295443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.300539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:58.304131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.417460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:58.431794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-676e625e-9bc6-4821-a4b1-ebc6c0325db2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1488 microversion: 2.1 time: 0.624648 Jun 16 18:36:58.446003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:58.446003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.446003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lazy-loading 'fault' on Instance uuid 7e31fb33-1093-4058-bdf4-aed87d21bf61 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:36:58.447272 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 861/1785] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:57 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1488 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:58.463122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:58.464034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:58.473063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:58.474512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.476042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:58.477954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.657796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:58.682225 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9fedb50f-16ea-4064-8d31-61e4a25e3606 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1304 microversion: 2.1 time: 0.231752 Jun 16 18:36:58.686816 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 862/1786] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:58 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1304 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:58.689068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd469eedff61d49158ea934377d95d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22faed45f96e4f129f8f35d01f836f22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:58.705710 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-02cd286f-9077-4c1a-8135-76fe1f6d2229 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 200 len: 1307 microversion: 2.1 time: 0.443996 Jun 16 18:36:58.706343 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 925/1787] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:58 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 1307 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:58.708478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4696657b-afc4-420f-83fe-da93071585b9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f867802ec10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:58.718089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:58.719010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:58.739911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:58.740374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.741180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:58.741625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.867852 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4696657b-afc4-420f-83fe-da93071585b9 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72" status: 200 len: 784 microversion: 2.1 time: 0.177112 Jun 16 18:36:58.869378 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 863/1788] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:36:58 2022] GET /compute/v2.1/images/d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72 => generated 784 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:58.891707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-305247326", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "06a9a0f4-e2e7-4b09-9d3d-fea8950fac70"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:59.006815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:36:59.180035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:59.197651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:59.203420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:59.207450 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-16f0a145-8b44-4cbe-9e5f-5b42204309bf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 2830 microversion: 2.32 time: 0.499616 Jun 16 18:36:59.211139 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 926/1789] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:58 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 2830 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:36:59.220319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2655b4f-5ac1-4be5-b4e3-922fb7a164ea tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866ead98b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:59.457156 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2655b4f-5ac1-4be5-b4e3-922fb7a164ea tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 844 microversion: 2.1 time: 0.244401 Jun 16 18:36:59.463116 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 927/1790] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:36:59 2022] GET /compute/v2.1/images/detail?limit=1 => generated 844 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:59.468878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:59.473103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:59.488450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:59.490009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:59.493707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:59.499686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:00.162185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:00.188932 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8ca8dca-fae6-473c-966f-a76eaa319302 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1464 microversion: 2.1 time: 0.724266 Jun 16 18:37:00.189729 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 928/1791] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:59 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1464 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:00.195095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f022e37c-e1f8-4f00-8c9f-095b4f4e02b8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:00.195593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f022e37c-e1f8-4f00-8c9f-095b4f4e02b8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:00.223201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f022e37c-e1f8-4f00-8c9f-095b4f4e02b8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:00.226382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f022e37c-e1f8-4f00-8c9f-095b4f4e02b8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:00.228932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f022e37c-e1f8-4f00-8c9f-095b4f4e02b8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:00.229595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f022e37c-e1f8-4f00-8c9f-095b4f4e02b8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:00.935510 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f022e37c-e1f8-4f00-8c9f-095b4f4e02b8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.740965 Jun 16 18:37:00.937544 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 929/1792] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:37:00 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295/os-interface => generated 1828 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:00.962701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68a59a88-d696-457b-9699-67c55013fbd1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f6738b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:01.095639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:01.097350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:01.098406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:01.100105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:01.100849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:01.139247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:01.140970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:01.154855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:01.154855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:01.215803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:01.231616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:01.289493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:01.298601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:01.508790 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3e93f5ee-487c-4378-8d91-8de124289138 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.637510 Jun 16 18:37:01.509934 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 864/1793] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:36:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:37:01.528714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:01.531812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:01.575359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:01.576891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:01.580294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:01.581270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:02.326236 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-68a59a88-d696-457b-9699-67c55013fbd1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616" status: 204 len: 0 microversion: 2.1 time: 1.377295 Jun 16 18:37:02.327194 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 930/1794] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:00 2022] DELETE /compute/v2.1/images/e62a14a9-8cf2-4369-8ce8-e58e57718616 => generated 0 bytes in 1379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:02.336449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:02.338999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] [instance: 7e31fb33-1093-4058-bdf4-aed87d21bf61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:02.361269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:02.363140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:02.382102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:02.383910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:02.456779 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] HTTP exception thrown: Instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 could not be found. Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Request method failure captured: Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 HTTP/1.1 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3fK2MPkpWqyqWbP3En9rWxaphIGESSobqVjTe84BIeM1Vw6iQlh8laMXSmL9C4WnZgDDpPKyZVTePPMPpU0v-jjqbmZEu03I7OLZqQUyxM1fOll9OM-Ux1E9Dgd6b4pTJA5V87YBFrMKYRz1bK6iB1Sd2VpTAqGxblDSpIdv3_SI2c Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 22faed45f96e4f129f8f35d01f836f22 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_22faed45f96e4f129f8f35d01f836f22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/22faed45f96e4f129f8f35d01f836f22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 22faed45f96e4f129f8f35d01f836f22 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2131598394 Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesOneServerTestJSON-2131598394-project Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: d469eedff61d49158ea934377d95d24d Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesOneServerTestJSON-2131598394-project Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 could not be found. Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '7e31fb33-1093-4058-bdf4-aed87d21bf61'} Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 could not be found. Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 could not be found. Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:02.491486 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:02.496411 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:02.496411 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:02.496411 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:02.496411 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:02.496411 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:02.496411 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 could not be found. Jun 16 18:37:02.496411 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:02.498360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] Returning 404 to user: Instance 7e31fb33-1093-4058-bdf4-aed87d21bf61 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:02.499637 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b5ca355-0ffd-468d-b5ee-ff11ef3f5e28 tempest-ImagesOneServerTestJSON-2131598394 tempest-ImagesOneServerTestJSON-2131598394-project] 10.222.0.27 "GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61" status: 404 len: 111 microversion: 2.1 time: 0.170963 Jun 16 18:37:02.504944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 931/1795] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:02 2022] GET /compute/v2.1/servers/7e31fb33-1093-4058-bdf4-aed87d21bf61 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:37:02.519899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:02.521740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:02.535247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:02.538247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:02.540792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:02.541757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:02.890623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:02.919081 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-053867b1-04ff-4db6-8b75-e4b766546714 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 1.402406 Jun 16 18:37:02.920302 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 865/1796] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:01 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:02.925615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:02.927112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:02.943118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:02.943928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:02.944967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:02.947205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:03.392419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:03.394615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:03.413058 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab611854-0332-4d87-afff-f5eb43dd35f3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1464 microversion: 2.1 time: 0.907474 Jun 16 18:37:03.430463 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7dae5113-e334-4aa7-833b-cd5a19cf6c5b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1204 microversion: 2.1 time: 0.508463 Jun 16 18:37:03.431323 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 866/1797] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:02 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1204 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:03.440719 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 932/1798] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:02 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1464 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:03.451925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfc71653-e95c-43e1-8cbc-ecad75b23837 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f8678027670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:03.805363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-240397128", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0ec9541c-3218-401f-b314-dc00a192ec98"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:04.099118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:04.139038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:05.537509 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfc71653-e95c-43e1-8cbc-ecad75b23837 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f" status: 204 len: 0 microversion: 2.1 time: 2.102265 Jun 16 18:37:05.541750 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 867/1799] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:03 2022] DELETE /compute/v2.1/images/195211ee-8e2c-438a-b828-2d7295ed894f => generated 0 bytes in 2107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:05.559566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1445da74-ae9e-4572-bd61-da90e078fb7d req-264b0b31-aa7e-40a8-992e-d78364e3b7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f131bf-1702-4acf-b73a-2327d0c9315e", "tag": "3dcc4f7f-2603-43fa-a995-4e5f6a27819a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:05.601947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1445da74-ae9e-4572-bd61-da90e078fb7d req-264b0b31-aa7e-40a8-992e-d78364e3b7b1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:05.603493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1445da74-ae9e-4572-bd61-da90e078fb7d req-264b0b31-aa7e-40a8-992e-d78364e3b7b1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:05.635784 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1445da74-ae9e-4572-bd61-da90e078fb7d req-264b0b31-aa7e-40a8-992e-d78364e3b7b1 service nova] Creating event network-changed:3dcc4f7f-2603-43fa-a995-4e5f6a27819a for instance a4f131bf-1702-4acf-b73a-2327d0c9315e on n-h1-846209-2 Jun 16 18:37:05.643131 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1445da74-ae9e-4572-bd61-da90e078fb7d req-264b0b31-aa7e-40a8-992e-d78364e3b7b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099826 Jun 16 18:37:05.644335 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 868/1800] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:05.652152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:05.653188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:05.663481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:05.664321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:05.665422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:05.666294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:05.717935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:06.225084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:06.357944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:06.379604 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-673bcc44-baa6-4a6e-8a22-315dfbac897b tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 0.729969 Jun 16 18:37:06.403673 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 869/1801] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:05 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:06.416871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:06.418085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:06.449671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:06.450519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:06.451954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:06.452856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:06.919357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:06.942853 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8c78885-2900-465f-9304-29ca5fa87265 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1266 microversion: 2.1 time: 0.534708 Jun 16 18:37:06.945016 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 870/1802] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:06 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1266 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:06.977669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c2ada09e-ff4d-4b2d-aa1a-7258965910ac tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1284c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:07.787428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:07.788140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:07.789058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:07.790453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:07.796706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:07.825445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:07.830699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:07.837894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:07.839109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:07.904336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Getting quotas for project 283e375f03104021bdf7a756af5bdcce. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:07.919195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Getting quotas for user 8dd7fc37c6a04f5da2aca97532bcf84b and project 283e375f03104021bdf7a756af5bdcce. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:07.959376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:07.963219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:08.095497 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12344144-d8f5-4abf-b1fa-aab5bb5f9b04 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.297383 Jun 16 18:37:08.103770 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 933/1803] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:37:08.124981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5a1f1833-b689-4906-bdc7-9fbe27981d92 req-36201b5e-e8d8-48c4-836e-f0e9a3a96d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "tag": "060fd62e-c274-4002-82ff-d6c21be38ac5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:08.152609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5a1f1833-b689-4906-bdc7-9fbe27981d92 req-36201b5e-e8d8-48c4-836e-f0e9a3a96d97 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:08.155226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5a1f1833-b689-4906-bdc7-9fbe27981d92 req-36201b5e-e8d8-48c4-836e-f0e9a3a96d97 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:08.221549 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5a1f1833-b689-4906-bdc7-9fbe27981d92 req-36201b5e-e8d8-48c4-836e-f0e9a3a96d97 service nova] Creating event network-changed:060fd62e-c274-4002-82ff-d6c21be38ac5 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:37:08.263038 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5a1f1833-b689-4906-bdc7-9fbe27981d92 req-36201b5e-e8d8-48c4-836e-f0e9a3a96d97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157119 Jun 16 18:37:08.264142 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 934/1804] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:08.304868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2035564708", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "652e1c69-530a-4824-b271-fd75e40c3e31"}], "block_device_mapping_v2": [{"uuid": "b16c3ff4-5fcf-497c-a41a-3e61e561f2d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:08.523342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] validate_networks() for [('652e1c69-530a-4824-b271-fd75e40c3e31', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:08.865213 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c2ada09e-ff4d-4b2d-aa1a-7258965910ac tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227" status: 204 len: 0 microversion: 2.1 time: 1.913130 Jun 16 18:37:08.866893 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 871/1805] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:06 2022] DELETE /compute/v2.1/images/55b3eeac-eeb8-4b55-a60a-3fbcaf805227 => generated 0 bytes in 1921 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:08.875790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:08.878111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:08.903320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:08.905516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:08.907458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:08.909031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:10.643845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:10.684683 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28055865-bc0e-42ce-bb8e-052a1f50dba0 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 1.815360 Jun 16 18:37:10.687388 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 872/1806] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:08 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:10.775562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:10.777621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:10.793464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:10.795691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:10.798853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:10.802440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:11.176148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.264305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.162606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:12.181713 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-54f75368-4b96-4490-8676-f9261dfce655 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1308 microversion: 2.1 time: 1.457979 Jun 16 18:37:12.183391 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 873/1807] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:10 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1308 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:12.196442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:12.199079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:12.218489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:12.219632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:12.225292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:12.228995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:12.750208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:12.752434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:12.753594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:12.757419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:12.759018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:12.818116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:12.820361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:12.824923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:12.832584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:12.966098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:12.987330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Getting quotas for user 6483600a33ef407d9071cd24d84f6ee6 and project 3d84e38d180849e98a2222aede57177d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:13.169624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:13.176217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b16c3ff4-5fcf-497c-a41a-3e61e561f2d8',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:13.381545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:13.397239 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5012fd52-f32f-42dc-97d3-db698de600b6 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1313 microversion: 2.1 time: 1.206697 Jun 16 18:37:13.398145 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 874/1808] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:12 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1313 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:13.406159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:13.407153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:13.415231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.415993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.417336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.417984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.502233 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2aac7af-4ba5-48f7-8383-f33ba1df8102 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.230707 Jun 16 18:37:13.503837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 935/1809] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:37:13.507398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:37:13.664517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9eef063-7bb3-40dd-8912-852e0c118c63 tempest-ListImageFiltersNegativeTestJSON-544250649 tempest-ListImageFiltersNegativeTestJSON-544250649-project] Calling method '.version_select at 0x7f86781bee50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:13.694881 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-645b6a17-6d44-4ec7-a21e-4581a6993562 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 204 len: 0 microversion: 2.1 time: 0.294360 Jun 16 18:37:13.696672 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 875/1810] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:37:13 2022] DELETE /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:13.712282 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-b9eef063-7bb3-40dd-8912-852e0c118c63 tempest-ListImageFiltersNegativeTestJSON-544250649 tempest-ListImageFiltersNegativeTestJSON-544250649-project] HTTP exception thrown: Image not found. Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9eef063-7bb3-40dd-8912-852e0c118c63 tempest-ListImageFiltersNegativeTestJSON-544250649 tempest-ListImageFiltersNegativeTestJSON-544250649-project] Request method failure captured: Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/images/495722b4-3ebc-4539-bba6-9830eef2d61c HTTP/1.1 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hUOWRzflu6_f0mTglslnFYedjYsFu7FiWTJHdQLLk3ILtKow3JQ6NempvyrCC_5NWLuzavNzwiFVh67gRodu_UI1pClsrE2eAk3HEq7TbC1nR6aODPqrdLkfUrFr1GvnrbIQamUbpVq_w8iaqTtCCHuTM37P99mrm83bppUcgU1mY Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: daf1aaeb658b43acb63b30d4e8c1b1d5 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-544250649 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daf1aaeb658b43acb63b30d4e8c1b1d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/daf1aaeb658b43acb63b30d4e8c1b1d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_daf1aaeb658b43acb63b30d4e8c1b1d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daf1aaeb658b43acb63b30d4e8c1b1d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-544250649 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: daf1aaeb658b43acb63b30d4e8c1b1d5 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-544250649 Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ListImageFiltersNegativeTestJSON-544250649-project Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: a3eb7197ad264271affe0ff880aebf6d Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-544250649-project Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '495722b4-3ebc-4539-bba6-9830eef2d61c'} Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 495722b4-3ebc-4539-bba6-9830eef2d61c Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 18:37:13.714855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 495722b4-3ebc-4539-bba6-9830eef2d61c could not be found. Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:37:13.722788 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:13.729946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9eef063-7bb3-40dd-8912-852e0c118c63 tempest-ListImageFiltersNegativeTestJSON-544250649 tempest-ListImageFiltersNegativeTestJSON-544250649-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:13.729946 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9eef063-7bb3-40dd-8912-852e0c118c63 tempest-ListImageFiltersNegativeTestJSON-544250649 tempest-ListImageFiltersNegativeTestJSON-544250649-project] 10.222.0.27 "GET /compute/v2.1/images/495722b4-3ebc-4539-bba6-9830eef2d61c" status: 404 len: 62 microversion: 2.1 time: 0.223256 Jun 16 18:37:13.729946 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 936/1811] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:37:13 2022] GET /compute/v2.1/images/495722b4-3ebc-4539-bba6-9830eef2d61c => generated 62 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:37:13.733670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:13.750212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:13.764860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:13.766868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:13.787322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.790160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.792848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.793790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.803515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.811067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.819122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.819976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.342576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:14.393547 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-899e315a-0ee6-42be-b8a6-c953afc08b19 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 0.676719 Jun 16 18:37:14.407268 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 876/1812] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:13 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:14.417075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5752222-eddd-41e1-af34-5d98d4617d88 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:14.422694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b5752222-eddd-41e1-af34-5d98d4617d88 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:14.485821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:14.505575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cc83d92a-6f37-4c30-b157-78d995c64562 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1308 microversion: 2.1 time: 0.772906 Jun 16 18:37:14.507867 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 937/1813] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:13 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1308 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:14.525983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:14.526978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:14.550059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.550807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.551407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.552110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.634972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b5752222-eddd-41e1-af34-5d98d4617d88 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:14.658015 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b5752222-eddd-41e1-af34-5d98d4617d88 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1053 microversion: 2.1 time: 0.259043 Jun 16 18:37:14.660484 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 877/1814] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:14 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1053 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:14.682244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:14.682790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:14.698733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.698733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.702383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.702969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.022517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:15.062749 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f3424ea7-ef81-4bf7-a62d-a753e83b08ab tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1472 microversion: 2.1 time: 0.551099 Jun 16 18:37:15.064245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 938/1815] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:14 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1472 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:15.079673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2123f232-92d0-4de6-be3c-9a00e69cc835 req-e00fef50-2b9f-4069-9c99-f3d8da0e21ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8343c561-437a-4648-9b2c-f3d2e3edb2cf", "tag": "fbff0805-7d03-4cd0-9a43-1792095000da"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:15.097506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2123f232-92d0-4de6-be3c-9a00e69cc835 req-e00fef50-2b9f-4069-9c99-f3d8da0e21ab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.099495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2123f232-92d0-4de6-be3c-9a00e69cc835 req-e00fef50-2b9f-4069-9c99-f3d8da0e21ab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.122041 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2123f232-92d0-4de6-be3c-9a00e69cc835 req-e00fef50-2b9f-4069-9c99-f3d8da0e21ab service nova] Creating event network-changed:fbff0805-7d03-4cd0-9a43-1792095000da for instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf on n-h2-846209-2 Jun 16 18:37:15.130215 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2123f232-92d0-4de6-be3c-9a00e69cc835 req-e00fef50-2b9f-4069-9c99-f3d8da0e21ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063188 Jun 16 18:37:15.131354 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 939/1816] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:15.143084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0cb91637-e3a6-44af-ad28-f5abf38f6b42 req-1817eb5d-4c0c-4ea4-867c-05946a96dc95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f1a338-34e1-46a7-9a44-a4e6b1c3618e", "tag": "82a250be-30eb-4ed5-9328-a70bdd97085e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:15.145555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:15.162327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0cb91637-e3a6-44af-ad28-f5abf38f6b42 req-1817eb5d-4c0c-4ea4-867c-05946a96dc95 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.163153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0cb91637-e3a6-44af-ad28-f5abf38f6b42 req-1817eb5d-4c0c-4ea4-867c-05946a96dc95 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.163726 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94981566-d8d0-46ca-9f2c-00259cf12972 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1313 microversion: 2.1 time: 0.483565 Jun 16 18:37:15.164417 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 878/1817] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:14 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:15.178396 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0cb91637-e3a6-44af-ad28-f5abf38f6b42 req-1817eb5d-4c0c-4ea4-867c-05946a96dc95 service nova] Creating event network-changed:82a250be-30eb-4ed5-9328-a70bdd97085e for instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e on n-h2-846209-2 Jun 16 18:37:15.192191 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0cb91637-e3a6-44af-ad28-f5abf38f6b42 req-1817eb5d-4c0c-4ea4-867c-05946a96dc95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049952 Jun 16 18:37:15.192892 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 940/1818] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:15.414570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:15.415375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:15.423955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.424782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.425830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.426335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.534815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:15.535545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:15.545655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.546148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.547865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.548348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.232705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:16.251340 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16b23b8a-6375-4d72-84ff-9de7cc574cf8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 0.840703 Jun 16 18:37:16.251943 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 879/1819] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:15 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:16.258017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2032960220", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "71375809-7321-4c5f-9d11-1e2aadbe705f"}], "block_device_mapping_v2": [{"uuid": "2cd92bbb-1ca3-4077-ae81-48b7562a544e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:16.302253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:16.321625 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c45d2fc3-1a5b-4419-ad56-ae785d2716fd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1308 microversion: 2.1 time: 0.798955 Jun 16 18:37:16.322274 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 941/1820] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:15 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1308 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:16.330096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:16.338441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:16.363599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.365153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.375043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.375833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.391430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.437501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] validate_networks() for [('71375809-7321-4c5f-9d11-1e2aadbe705f', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:16.574680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:16.596787 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a8412f58-26c4-47a3-8b89-b918b7a420ac tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1169 microversion: 2.1 time: 0.269139 Jun 16 18:37:16.599702 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 942/1821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:16 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1169 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:16.611959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:16.613768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:16.641178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.642931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.645131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.646752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.813588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:16.844226 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-119ff8e8-e8d9-4dec-9b5d-f0d04ffb3df0 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 200 len: 1430 microversion: 2.1 time: 0.240190 Jun 16 18:37:16.844872 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 943/1822] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:16 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 1430 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:16.863921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:16.866463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:16.889669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.891713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.896957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.898713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.566806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:17.577595 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fd19079b-4d6c-4612-8c3a-d3078ebf0e41 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1313 microversion: 2.1 time: 0.729710 Jun 16 18:37:17.578525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 944/1823] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:16 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:17.915729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-86a4e758-9c39-41b6-94b0-76da8af06c57 req-9b6cff5a-46a9-437b-90d2-a8b8aed8c972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5779c9c3-e87d-4f34-927f-80dcc658a1ac", "name": "network-vif-deleted", "tag": "15a9a46d-c311-4249-9ee6-e83453d113e4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:17.922120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.942971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-86a4e758-9c39-41b6-94b0-76da8af06c57 req-9b6cff5a-46a9-437b-90d2-a8b8aed8c972 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:17.947886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-86a4e758-9c39-41b6-94b0-76da8af06c57 req-9b6cff5a-46a9-437b-90d2-a8b8aed8c972 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.985464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-86a4e758-9c39-41b6-94b0-76da8af06c57 req-9b6cff5a-46a9-437b-90d2-a8b8aed8c972 service nova] Creating event network-vif-deleted:15a9a46d-c311-4249-9ee6-e83453d113e4 for instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac on n-h2-846209-2 Jun 16 18:37:17.998341 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-86a4e758-9c39-41b6-94b0-76da8af06c57 req-9b6cff5a-46a9-437b-90d2-a8b8aed8c972 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418076 Jun 16 18:37:17.999387 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 945/1824] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:18.099786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48e82819-1a6a-4cea-a2ab-6fee92eb9721 tempest-AbsoluteLimitsTestJSON-1339439738 tempest-AbsoluteLimitsTestJSON-1339439738-project] Calling method '.version_select at 0x7f866eba2820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:18.127935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48e82819-1a6a-4cea-a2ab-6fee92eb9721 tempest-AbsoluteLimitsTestJSON-1339439738 tempest-AbsoluteLimitsTestJSON-1339439738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.128686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48e82819-1a6a-4cea-a2ab-6fee92eb9721 tempest-AbsoluteLimitsTestJSON-1339439738 tempest-AbsoluteLimitsTestJSON-1339439738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.132048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48e82819-1a6a-4cea-a2ab-6fee92eb9721 tempest-AbsoluteLimitsTestJSON-1339439738 tempest-AbsoluteLimitsTestJSON-1339439738-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.140366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48e82819-1a6a-4cea-a2ab-6fee92eb9721 tempest-AbsoluteLimitsTestJSON-1339439738 tempest-AbsoluteLimitsTestJSON-1339439738-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.188773 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48e82819-1a6a-4cea-a2ab-6fee92eb9721 tempest-AbsoluteLimitsTestJSON-1339439738 tempest-AbsoluteLimitsTestJSON-1339439738-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.188010 Jun 16 18:37:18.198143 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 946/1825] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 18:37:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:18.209596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:18.210326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:18.246085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.248552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.249745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.253030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.322202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:18.322735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:18.323121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:18.323644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:18.324076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:18.352049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.352524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.353356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.353807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.420616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:18.441230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Getting quotas for user 4060431577d14c5198872173d8375e26 and project d1d8ae8c43284fde8e49276c9e1faa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:18.476991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.656254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:18.658728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2cd92bbb-1ca3-4077-ae81-48b7562a544e',volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:18.749153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:18.781338 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4bd33e9e-3606-411b-b872-26dcadb37200 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 0.575516 Jun 16 18:37:18.786591 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 947/1826] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:18 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:18.816865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:18.818440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:18.842501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.845681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.848183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.849720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.944848 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-daba6a7c-44a2-40b8-92c9-c3fa063cfdfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.691542 Jun 16 18:37:18.946810 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 880/1827] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:37:18.956154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:18.957159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:18.968609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.969866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.971072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.971920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.397526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:19.426062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-944e8690-0ed9-4d97-aaf7-aed1b3fbfc90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1308 microversion: 2.1 time: 0.634503 Jun 16 18:37:19.427093 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 948/1828] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:18 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1308 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:19.454527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:19.455739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 5779c9c3-e87d-4f34-927f-80dcc658a1ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:19.480660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.484223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.486647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.487686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.516184 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] HTTP exception thrown: Instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac could not be found. Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Request method failure captured: Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac HTTP/1.1 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3eA4fSYu6qIpXHuZVZTbjkJbid0GUaIXy1k8rIIYul1VDySK1loRTVP0pNaYGow2fBc4KpqPQqS3h4RYgi61EZUjke63F511x4FvZck0ZnPqzDI-GXH_2PxBNGx4s_ejGzb3iiSa-1KS5QnUAzPbmebMowQ0C1Xl-mGJTV34dgUsfk Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 9052d541d3ef42d7922200d19150f9b9 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ListImageFiltersTestJSON-328914208 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9052d541d3ef42d7922200d19150f9b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9052d541d3ef42d7922200d19150f9b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9052d541d3ef42d7922200d19150f9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9052d541d3ef42d7922200d19150f9b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ListImageFiltersTestJSON-328914208 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 9052d541d3ef42d7922200d19150f9b9 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-328914208 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ListImageFiltersTestJSON-328914208-project Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 16aaf7f1bd5c4e8491f60046adb9e0a5 Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ListImageFiltersTestJSON-328914208-project Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac could not be found. Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5779c9c3-e87d-4f34-927f-80dcc658a1ac'} Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac could not be found. Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac could not be found. Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:19.520069 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac could not be found. Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Returning 404 to user: Instance 5779c9c3-e87d-4f34-927f-80dcc658a1ac could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4908bd4-93eb-4d23-861f-adc7975af210 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac" status: 404 len: 111 microversion: 2.1 time: 0.074591 Jun 16 18:37:19.538434 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 949/1829] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:19 2022] GET /compute/v2.1/servers/5779c9c3-e87d-4f34-927f-80dcc658a1ac => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:37:19.545724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:19.547045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:19.557138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.558147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.560659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.561896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.672418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:19.705203 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-354abb9c-f6da-43dd-a027-7bf15089060e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1211 microversion: 2.1 time: 0.751903 Jun 16 18:37:19.707560 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 881/1830] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:18 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1211 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:19.715612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a431cc2-38ad-48ad-ae37-f6b293aac532 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:19.716490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a431cc2-38ad-48ad-ae37-f6b293aac532 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:19.820579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a431cc2-38ad-48ad-ae37-f6b293aac532 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:19.836577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a431cc2-38ad-48ad-ae37-f6b293aac532 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:19.839125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a431cc2-38ad-48ad-ae37-f6b293aac532 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:19.840336 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a431cc2-38ad-48ad-ae37-f6b293aac532 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1104 microversion: 2.25 time: 0.130468 Jun 16 18:37:19.841026 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 882/1831] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:19 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1104 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:19.846396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:19.847284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:19.858008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.858955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.860023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.861100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.905350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:37:20.072903 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a1d5b3c-e5f5-4dbf-b816-7743fe27d7be tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 204 len: 0 microversion: 2.1 time: 0.226939 Jun 16 18:37:20.079932 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 883/1832] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:37:19 2022] DELETE /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:20.094925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-223ca871-04bc-4652-8d1b-a56688be23e5 req-5ecc5e96-61de-4c97-8bd3-c7f71751efce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f131bf-1702-4acf-b73a-2327d0c9315e", "name": "network-vif-plugged", "status": "completed", "tag": "3dcc4f7f-2603-43fa-a995-4e5f6a27819a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:20.106592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-223ca871-04bc-4652-8d1b-a56688be23e5 req-5ecc5e96-61de-4c97-8bd3-c7f71751efce service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.107631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-223ca871-04bc-4652-8d1b-a56688be23e5 req-5ecc5e96-61de-4c97-8bd3-c7f71751efce service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.125039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-223ca871-04bc-4652-8d1b-a56688be23e5 req-5ecc5e96-61de-4c97-8bd3-c7f71751efce service nova] Creating event network-vif-plugged:3dcc4f7f-2603-43fa-a995-4e5f6a27819a for instance a4f131bf-1702-4acf-b73a-2327d0c9315e on n-h1-846209-2 Jun 16 18:37:20.134424 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-223ca871-04bc-4652-8d1b-a56688be23e5 req-5ecc5e96-61de-4c97-8bd3-c7f71751efce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052317 Jun 16 18:37:20.150911 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 884/1833] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:20.191228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:20.191974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:20.203853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.204315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.205121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.205569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.501820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:20.516852 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6dcfccd5-a2a7-46f2-871d-d99dbf0e3b52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1313 microversion: 2.1 time: 0.977707 Jun 16 18:37:20.517463 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 950/1834] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:19 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1313 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:20.534656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:20.535562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:20.543648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.544432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.545419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.546081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.088601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:21.108832 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca3fc962-bc68-494f-b69c-de16ee1220e8 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 0.950862 Jun 16 18:37:21.109761 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 885/1835] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:20 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:21.131960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:21.132615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:21.160091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:21.169486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.175159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.182989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.184002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.201471 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-03afe1b0-89c5-40dd-afac-658e853f0c92 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 200 len: 1472 microversion: 2.1 time: 0.670264 Jun 16 18:37:21.203119 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 951/1836] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:20 2022] GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 1472 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:21.213557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:21.222407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:21.245929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.246956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.248066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.248644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.124437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.128167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.134028 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3609080c-0d53-4ee8-a42b-d24ee442dbd5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1308 microversion: 2.1 time: 1.011572 Jun 16 18:37:22.145805 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 886/1837] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:21 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1308 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:22.151392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:22.152028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:22.173632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.178129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.178658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.179515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.179963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.188521 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6245e8ee-55c8-4b4b-97cf-4e0749cef644 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1211 microversion: 2.1 time: 0.983434 Jun 16 18:37:22.189364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 952/1838] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:21 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1211 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:22.234175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2e22cf03-19df-4dae-bf16-4743b829a0b0 req-fced4b8d-b178-4474-949e-72e1f33161a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a153bd-218b-41ee-9610-3994098b06f0", "tag": "8515cd67-37fa-4c99-b944-46c6ffdd74a9"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:22.256325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2e22cf03-19df-4dae-bf16-4743b829a0b0 req-fced4b8d-b178-4474-949e-72e1f33161a1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.257168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2e22cf03-19df-4dae-bf16-4743b829a0b0 req-fced4b8d-b178-4474-949e-72e1f33161a1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.282248 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2e22cf03-19df-4dae-bf16-4743b829a0b0 req-fced4b8d-b178-4474-949e-72e1f33161a1 service nova] Creating event network-changed:8515cd67-37fa-4c99-b944-46c6ffdd74a9 for instance 70a153bd-218b-41ee-9610-3994098b06f0 on n-h1-846209-2 Jun 16 18:37:22.318909 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2e22cf03-19df-4dae-bf16-4743b829a0b0 req-fced4b8d-b178-4474-949e-72e1f33161a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105447 Jun 16 18:37:22.324669 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 953/1839] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:22.330980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:22.332841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:22.354695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.354695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.355481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.356135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.396115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.406992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.418207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.431180 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7a1a4c6-7d9d-421b-944d-a306f0702f9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1251 microversion: 2.25 time: 0.284049 Jun 16 18:37:22.437279 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 887/1840] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:22 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1251 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:22.443397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:22.443707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:22.472204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.472581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.473430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.474631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.857170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.875372 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-efc30ed9-0008-424c-9f3e-03bd59e73800 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1313 microversion: 2.1 time: 0.548914 Jun 16 18:37:22.888796 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 954/1841] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:22 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:22.897161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:22.904556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:22.923644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.926007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.927687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.928418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.017833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:23.034581 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b510bbef-1466-41fd-92a5-0e8fb0bd9d61 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1371 microversion: 2.1 time: 0.595750 Jun 16 18:37:23.048599 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 888/1842] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:22 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:23.066959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e1d98347-d037-42a7-83d1-4f456b3d8a5e req-6f4cb061-f045-47fb-bfdc-aef94a6ab12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f1a338-34e1-46a7-9a44-a4e6b1c3618e", "name": "network-vif-plugged", "status": "completed", "tag": "82a250be-30eb-4ed5-9328-a70bdd97085e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:23.087696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e1d98347-d037-42a7-83d1-4f456b3d8a5e req-6f4cb061-f045-47fb-bfdc-aef94a6ab12b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.088153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e1d98347-d037-42a7-83d1-4f456b3d8a5e req-6f4cb061-f045-47fb-bfdc-aef94a6ab12b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.108055 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e1d98347-d037-42a7-83d1-4f456b3d8a5e req-6f4cb061-f045-47fb-bfdc-aef94a6ab12b service nova] Creating event network-vif-plugged:82a250be-30eb-4ed5-9328-a70bdd97085e for instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e on n-h2-846209-2 Jun 16 18:37:23.116878 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e1d98347-d037-42a7-83d1-4f456b3d8a5e req-6f4cb061-f045-47fb-bfdc-aef94a6ab12b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066369 Jun 16 18:37:23.118128 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 889/1843] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:23.154236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:23.155785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:23.169950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.182160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.183348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.185583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.503722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:23.512664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:23.532017 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3198e81d-c96f-4869-9281-19ca4f8c062c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1308 microversion: 2.1 time: 0.381107 Jun 16 18:37:23.533145 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab3e33c5-9f0e-4f1d-943a-b53534b346e1 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 200 len: 1472 microversion: 2.1 time: 0.641572 Jun 16 18:37:23.533746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 955/1844] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:22 2022] GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 1472 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:23.534383 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 890/1845] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:23 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:23.556786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:23.559326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:23.560401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:23.561285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:23.572914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.575314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.576148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.576698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.577841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.578433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.579248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.579682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.268297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:24.272364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:24.283339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f35c9c5-da58-41bd-b6d3-334cd8a959f8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1211 microversion: 2.1 time: 0.745281 Jun 16 18:37:24.292943 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 891/1846] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:23 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1211 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:24.300783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:24.302155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:24.310702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:24.313820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:24.316091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.321639 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-159e5bd3-3a9a-451e-af18-9d1d27e2f3b7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1293 microversion: 2.25 time: 0.782948 Jun 16 18:37:24.322774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.322922 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 956/1847] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:23 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1293 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:24.324083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.324700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.344895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:24.349780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:24.387641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.389051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.390870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.395885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.815082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:24.825539 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e824b850-7041-4250-9180-6e84e5fa204a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1313 microversion: 2.1 time: 0.530764 Jun 16 18:37:24.827248 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 892/1848] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:24 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:24.847334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:24.848970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:24.871850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.872209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.874777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.875254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.089091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:25.104682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-91953528-2281-4eff-9ba3-8d9c7717d462 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1556 microversion: 2.1 time: 0.779958 Jun 16 18:37:25.117405 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 957/1849] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:24 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1556 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:25.151182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:25.151919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:25.172719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.173723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.174812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.175561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.236561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.237313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.238017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lazy-loading 'fault' on Instance uuid 0271c7ba-7672-4448-8a5f-33e3150857fd {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:25.577447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16aaf7f1bd5c4e8491f60046adb9e0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052d541d3ef42d7922200d19150f9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:25.594876 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14a6dcc3-17ae-4a6e-bfe8-f4a59ca95ec3 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 200 len: 1307 microversion: 2.1 time: 0.475542 Jun 16 18:37:25.609400 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 958/1850] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:25 2022] GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 1307 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:25.612279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5d2c2543-566b-4db3-aa87-9561e6540507 req-ec2fbf7a-bbe5-4751-b996-ffb532054a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0271c7ba-7672-4448-8a5f-33e3150857fd", "name": "network-vif-deleted", "tag": "c6d88fb8-bcea-40fb-9158-9244e91ce3f1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:25.643821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:25.655462 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8bca9dea-368e-42f5-92cc-50f0dcbdf593 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1308 microversion: 2.1 time: 0.825545 Jun 16 18:37:25.670750 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 893/1851] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:24 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:25.678952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5d2c2543-566b-4db3-aa87-9561e6540507 req-ec2fbf7a-bbe5-4751-b996-ffb532054a86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.679607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5d2c2543-566b-4db3-aa87-9561e6540507 req-ec2fbf7a-bbe5-4751-b996-ffb532054a86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.681740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-51c22490-bf8b-4775-ac83-fd0972a28a6e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:25.682286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-51c22490-bf8b-4775-ac83-fd0972a28a6e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:25.699409 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5d2c2543-566b-4db3-aa87-9561e6540507 req-ec2fbf7a-bbe5-4751-b996-ffb532054a86 service nova] Creating event network-vif-deleted:c6d88fb8-bcea-40fb-9158-9244e91ce3f1 for instance 0271c7ba-7672-4448-8a5f-33e3150857fd on n-h2-846209-2 Jun 16 18:37:25.707066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51c22490-bf8b-4775-ac83-fd0972a28a6e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.707537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51c22490-bf8b-4775-ac83-fd0972a28a6e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.709568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51c22490-bf8b-4775-ac83-fd0972a28a6e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.710879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51c22490-bf8b-4775-ac83-fd0972a28a6e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.711759 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5d2c2543-566b-4db3-aa87-9561e6540507 req-ec2fbf7a-bbe5-4751-b996-ffb532054a86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113815 Jun 16 18:37:25.712397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 959/1852] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:25.730917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ba3c585a-7c88-4409-abf5-f8ba36480fe6 req-573c68fd-1da4-459d-806f-8d08f3a6af9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8343c561-437a-4648-9b2c-f3d2e3edb2cf", "name": "network-vif-plugged", "status": "completed", "tag": "fbff0805-7d03-4cd0-9a43-1792095000da"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:25.778571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ba3c585a-7c88-4409-abf5-f8ba36480fe6 req-573c68fd-1da4-459d-806f-8d08f3a6af9b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.780600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ba3c585a-7c88-4409-abf5-f8ba36480fe6 req-573c68fd-1da4-459d-806f-8d08f3a6af9b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.816153 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ba3c585a-7c88-4409-abf5-f8ba36480fe6 req-573c68fd-1da4-459d-806f-8d08f3a6af9b service nova] Creating event network-vif-plugged:fbff0805-7d03-4cd0-9a43-1792095000da for instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf on n-h2-846209-2 Jun 16 18:37:25.830274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ba3c585a-7c88-4409-abf5-f8ba36480fe6 req-573c68fd-1da4-459d-806f-8d08f3a6af9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114045 Jun 16 18:37:25.832745 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 960/1853] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:25.844219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:25.850544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:25.861862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.866989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.868137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.868792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.139533 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-51c22490-bf8b-4775-ac83-fd0972a28a6e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.466937 Jun 16 18:37:26.149627 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 894/1854] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:37:25 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-interface => generated 284 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:26.155036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:26.155755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:26.170520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.171737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.172848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.175236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.589011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:26.597956 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b46c36ad-4f19-42ab-b965-2768d0c717d8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.762596 Jun 16 18:37:26.604735 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 961/1855] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:25 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:26.622677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:26.624212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:26.641560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.642676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.643894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.644625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.677235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.874001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:26.887341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:26.890523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:26.892279 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-575140a1-70e9-496c-b2f0-1cc11ed38c58 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1293 microversion: 2.25 time: 0.741326 Jun 16 18:37:26.893490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 895/1856] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:26 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1293 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:26.900044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:26.901269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] [instance: 0271c7ba-7672-4448-8a5f-33e3150857fd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:26.910369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.912775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.914006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.914732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.939194 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] HTTP exception thrown: Instance 0271c7ba-7672-4448-8a5f-33e3150857fd could not be found. Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Request method failure captured: Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd HTTP/1.1 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3eA4fSYu6qIpXHuZVZTbjkJbid0GUaIXy1k8rIIYul1VDySK1loRTVP0pNaYGow2fBc4KpqPQqS3h4RYgi61EZUjke63F511x4FvZck0ZnPqzDI-GXH_2PxBNGx4s_ejGzb3iiSa-1KS5QnUAzPbmebMowQ0C1Xl-mGJTV34dgUsfk Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 9052d541d3ef42d7922200d19150f9b9 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ListImageFiltersTestJSON-328914208 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9052d541d3ef42d7922200d19150f9b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9052d541d3ef42d7922200d19150f9b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9052d541d3ef42d7922200d19150f9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9052d541d3ef42d7922200d19150f9b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ListImageFiltersTestJSON-328914208 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 9052d541d3ef42d7922200d19150f9b9 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-328914208 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ListImageFiltersTestJSON-328914208-project Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 16aaf7f1bd5c4e8491f60046adb9e0a5 Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ListImageFiltersTestJSON-328914208-project Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 0271c7ba-7672-4448-8a5f-33e3150857fd could not be found. Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '0271c7ba-7672-4448-8a5f-33e3150857fd'} Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0271c7ba-7672-4448-8a5f-33e3150857fd could not be found. Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0271c7ba-7672-4448-8a5f-33e3150857fd could not be found. Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:26.941730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:37:26.948940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:26.948940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:26.948940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:26.948940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:26.948940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:26.948940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0271c7ba-7672-4448-8a5f-33e3150857fd could not be found. Jun 16 18:37:26.948940 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:37:26.952775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Returning 404 to user: Instance 0271c7ba-7672-4448-8a5f-33e3150857fd could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:26.956085 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f597d2d7-2af4-4efb-bcad-a08b1a6d5177 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd" status: 404 len: 111 microversion: 2.1 time: 0.059344 Jun 16 18:37:26.961539 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 896/1857] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:26 2022] GET /compute/v2.1/servers/0271c7ba-7672-4448-8a5f-33e3150857fd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:37:26.967254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:26.969571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:26.986738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.987979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.989961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.991193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:27.172436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:27.182254 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4de12f9-33c0-418c-8065-023b754c03b7 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1313 microversion: 2.1 time: 0.576031 Jun 16 18:37:27.183108 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 962/1858] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:26 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:27.188262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-42cd16a0-1a24-4b7b-b383-4c2ccdaa01ca tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f8678178e50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:27.843863 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-42cd16a0-1a24-4b7b-b383-4c2ccdaa01ca tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/images/1e4aaee4-cd3a-4bee-b967-58dac8d5cf7e" status: 204 len: 0 microversion: 2.1 time: 0.659426 Jun 16 18:37:27.845076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 963/1859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:27 2022] DELETE /compute/v2.1/images/1e4aaee4-cd3a-4bee-b967-58dac8d5cf7e => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:27.851528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:27.852146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:27.859324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:27.860377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:27.861315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:27.861826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:27.982380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:27.994077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-82c0c746-67cb-4628-80a2-425b4fb64629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1488 microversion: 2.1 time: 1.033746 Jun 16 18:37:27.995116 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 897/1860] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:26 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1488 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:28.013220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1b2f832a-dd08-4d16-b228-1f05c290b69e req-bb0f2ce0-e10e-45a2-bbce-249a2a5f36d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be179f1-c859-45c9-a96c-f7f25f126546", "tag": "f925959e-95a7-48a3-b183-5dd22c6a2665"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:28.029585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1b2f832a-dd08-4d16-b228-1f05c290b69e req-bb0f2ce0-e10e-45a2-bbce-249a2a5f36d4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.030520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1b2f832a-dd08-4d16-b228-1f05c290b69e req-bb0f2ce0-e10e-45a2-bbce-249a2a5f36d4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.047851 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1b2f832a-dd08-4d16-b228-1f05c290b69e req-bb0f2ce0-e10e-45a2-bbce-249a2a5f36d4 service nova] Creating event network-changed:f925959e-95a7-48a3-b183-5dd22c6a2665 for instance 4be179f1-c859-45c9-a96c-f7f25f126546 on n-h1-846209-2 Jun 16 18:37:28.055683 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1b2f832a-dd08-4d16-b228-1f05c290b69e req-bb0f2ce0-e10e-45a2-bbce-249a2a5f36d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046276 Jun 16 18:37:28.057244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 898/1861] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:28.067860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-76a77b86-b7fe-415b-b4d6-da4d69b21f08 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f8678027670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:28.125720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=14 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.165646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.373557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.609796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:28.618722 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-675d836f-eca2-4c24-9ce1-374a2c492f60 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.772408 Jun 16 18:37:28.623047 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 964/1862] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:27 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:28.641400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:28.653233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:28.679163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.679834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.680860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.681275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.687235 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-76a77b86-b7fe-415b-b4d6-da4d69b21f08 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/images/607a8946-95bc-4345-be89-ce6a825da235" status: 204 len: 0 microversion: 2.1 time: 0.628030 Jun 16 18:37:28.688278 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 899/1863] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:28 2022] DELETE /compute/v2.1/images/607a8946-95bc-4345-be89-ce6a825da235 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:28.694023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:28.694791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:28.712589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.713463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.714987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.716941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.086601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:29.096423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:29.098317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:29.100644 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-577c1c54-bb2c-45c3-ab57-e52846233bf4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1293 microversion: 2.25 time: 0.473845 Jun 16 18:37:29.102049 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 965/1864] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:28 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1293 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:29.107583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:29.108568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:29.120027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.120907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.122066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.122792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.298076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:29.311937 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-505f50a9-7eeb-474c-99a8-ecff61171a16 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1488 microversion: 2.1 time: 0.622454 Jun 16 18:37:29.312914 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 900/1865] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:28 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1488 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:29.330281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7e654f9-3d36-4435-89ef-8ce638b89ac5 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] Calling method '.version_select at 0x7f866f1bc790>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:29.625724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:29.642718 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-57286a31-564c-43f6-ac05-947debc41e65 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1463 microversion: 2.1 time: 0.534799 Jun 16 18:37:29.645590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 966/1866] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:29 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1463 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:29.662713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:29.663561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:29.682706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.685082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.687948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.689498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.700248 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7e654f9-3d36-4435-89ef-8ce638b89ac5 tempest-ListImageFiltersTestJSON-328914208 tempest-ListImageFiltersTestJSON-328914208-project] 10.222.0.27 "DELETE /compute/v2.1/images/f70a53e8-1a3b-4897-8876-dc0e6ca0e6a7" status: 204 len: 0 microversion: 2.1 time: 0.373891 Jun 16 18:37:29.700911 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 901/1867] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:29 2022] DELETE /compute/v2.1/images/f70a53e8-1a3b-4897-8876-dc0e6ca0e6a7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:29.707761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:29.711091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:29.722326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.723255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.725075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.726242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.835124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.443871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:30.493594 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6a21bc81-ab65-4ab9-88d6-e38d01530267 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1488 microversion: 2.1 time: 0.812935 Jun 16 18:37:30.496538 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 967/1868] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:29 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1488 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:30.627887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:30.660296 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-30180986-22ce-4861-8bd5-3462e9f743a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.956080 Jun 16 18:37:30.673947 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 902/1869] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:29 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:30.704249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:30.714506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:30.727070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:30.728463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:30.729767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:30.730627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.036961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6c1af5ee-6b7d-483b-b6d5-210d048f1473 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:31.046651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c1af5ee-6b7d-483b-b6d5-210d048f1473 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Searching by: {'deleted': False, 'project_id': 'fc1ba316fddf4f1fbd2ec6b989685d2a'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:31.066705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1af5ee-6b7d-483b-b6d5-210d048f1473 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.068259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1af5ee-6b7d-483b-b6d5-210d048f1473 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.070717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1af5ee-6b7d-483b-b6d5-210d048f1473 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.071789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1af5ee-6b7d-483b-b6d5-210d048f1473 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.149614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:31.166589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:31.168355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:31.169559 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35455579-5fcb-4c86-8eb4-1e7476ffe585 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1293 microversion: 2.25 time: 0.489774 Jun 16 18:37:31.170185 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 903/1870] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:30 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1293 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:31.187016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:31.190108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:31.212141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.212469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.213271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.213786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.273961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:37:31.330986 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6c1af5ee-6b7d-483b-b6d5-210d048f1473 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.827617 Jun 16 18:37:31.347783 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 968/1871] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:37:30 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:37:31.495026 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-efc7e4ad-cf76-4b36-9873-95467a9c69e6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 204 len: 0 microversion: 2.1 time: 0.323368 Jun 16 18:37:31.495784 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 904/1872] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:37:31 2022] DELETE /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:31.507746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:31.518264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Searching by: {'deleted': False} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:31.536643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.537554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.538698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.544388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.682319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b413ae0a-efd3-4361-864a-c2eb5062cbba req-ecfc7de9-beed-4f3c-b054-6512e1fce7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f131bf-1702-4acf-b73a-2327d0c9315e", "tag": "3dcc4f7f-2603-43fa-a995-4e5f6a27819a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:31.705922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b413ae0a-efd3-4361-864a-c2eb5062cbba req-ecfc7de9-beed-4f3c-b054-6512e1fce7c0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.706797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b413ae0a-efd3-4361-864a-c2eb5062cbba req-ecfc7de9-beed-4f3c-b054-6512e1fce7c0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.750091 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b413ae0a-efd3-4361-864a-c2eb5062cbba req-ecfc7de9-beed-4f3c-b054-6512e1fce7c0 service nova] Creating event network-changed:3dcc4f7f-2603-43fa-a995-4e5f6a27819a for instance a4f131bf-1702-4acf-b73a-2327d0c9315e on n-h1-846209-2 Jun 16 18:37:31.760807 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b413ae0a-efd3-4361-864a-c2eb5062cbba req-ecfc7de9-beed-4f3c-b054-6512e1fce7c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409213 Jun 16 18:37:31.763877 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 969/1873] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:31.770926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:31.771798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:31.781685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.782309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.783124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.783661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.826525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:37:31.973456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.034762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.035495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:32.091642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:32.102613 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a9941f53-c903-487c-98c0-4f2a40ebf52c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1494 microversion: 2.1 time: 0.337280 Jun 16 18:37:32.103208 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 970/1874] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:31 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1494 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:32.116822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:32.123238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:32.131279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.131732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:32.134375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.134832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:32.641089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:32.671889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d0b1d92-5263-4d04-a122-c11d76370380 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.566313 Jun 16 18:37:32.684719 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 971/1875] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:32 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:32.702993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:32.704011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:32.715698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.717361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:32.719830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.721475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.103343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:33.121579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:33.124242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:33.125450 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e17abda3-794c-4840-971a-fb1ca12ccf21 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.430668 Jun 16 18:37:33.131415 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 972/1876] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:32 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:33.164283 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-05f97069-72e4-4b38-ad01-babeaf67f08e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 26991 microversion: 2.1 time: 1.666843 Jun 16 18:37:33.173465 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 905/1877] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Jun 16 18:37:31 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 26991 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:37:33.173465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.173465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:33.181243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.181243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.181633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.182427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.419703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:33.421584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2598095f-0dbf-4eea-af16-daaa3024621e tempest-ListImagesTestJSON-284254209 tempest-ListImagesTestJSON-284254209-project] Calling method '.version_select at 0x7f8678167790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.428666 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1062624c-d58e-4719-a30b-181b92965891 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1494 microversion: 2.1 time: 0.261294 Jun 16 18:37:33.429982 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 906/1878] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1494 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:33.435791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2aeade1b-5819-445d-b457-c798e0119ced tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.440632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2aeade1b-5819-445d-b457-c798e0119ced tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Searching by: {'deleted': False, 'project_id': 'fc1ba316fddf4f1fbd2ec6b989685d2a'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:33.446561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aeade1b-5819-445d-b457-c798e0119ced tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.447099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aeade1b-5819-445d-b457-c798e0119ced tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.448020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aeade1b-5819-445d-b457-c798e0119ced tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.448527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aeade1b-5819-445d-b457-c798e0119ced tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.498757 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2598095f-0dbf-4eea-af16-daaa3024621e tempest-ListImagesTestJSON-284254209 tempest-ListImagesTestJSON-284254209-project] 10.222.0.27 "GET /compute/v2.1/images/d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72" status: 200 len: 784 microversion: 2.1 time: 0.361696 Jun 16 18:37:33.499712 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 973/1879] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/images/d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72 => generated 784 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:33.525761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e70210d-a6b1-4953-abd9-69a87409eab4 tempest-ListImagesTestJSON-284254209 tempest-ListImagesTestJSON-284254209-project] Calling method '.version_select at 0x7f86781beaf0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.603831 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2aeade1b-5819-445d-b457-c798e0119ced tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=283e375f03104021bdf7a756af5bdcce" status: 200 len: 15 microversion: 2.1 time: 0.172307 Jun 16 18:37:33.604764 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 907/1880] 10.222.0.27 () {58 vars in 1230 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/servers/detail?tenant_id=283e375f03104021bdf7a756af5bdcce => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:37:33.620835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e70210d-a6b1-4953-abd9-69a87409eab4 tempest-ListImagesTestJSON-284254209 tempest-ListImagesTestJSON-284254209-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.112041 Jun 16 18:37:33.621192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.622721 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 974/1881] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/images => generated 871 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:37:33.634656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Searching by: {'tenant_id': '283e375f03104021bdf7a756af5bdcce', 'deleted': False} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:33.636102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-001a3907-f5aa-48d4-8490-46d406f54e0c tempest-ListImagesTestJSON-284254209 tempest-ListImagesTestJSON-284254209-project] Calling method '.version_select at 0x7f866ea4ca60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.641898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.642762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.643871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.644548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.702807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:37:33.716382 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-001a3907-f5aa-48d4-8490-46d406f54e0c tempest-ListImagesTestJSON-284254209 tempest-ListImagesTestJSON-284254209-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.084107 Jun 16 18:37:33.717258 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 975/1882] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:33.730417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.740505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:33.841449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.842427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.850319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.871094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.881704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.882377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.211738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.225358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e401ae63-ffb1-48f1-9778-d5e47672d474 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.503169 Jun 16 18:37:34.226061 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 976/1883] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:34.263291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.263934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:34.282078 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-04d6a790-6534-48a2-9208-50e18691170a tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=283e375f03104021bdf7a756af5bdcce" status: 200 len: 4827 microversion: 2.1 time: 0.664782 Jun 16 18:37:34.283191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.297868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.297868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.297868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.321394 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 908/1884] 10.222.0.27 () {58 vars in 1256 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=283e375f03104021bdf7a756af5bdcce => generated 4827 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:34.321394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aaeb171a-da14-4beb-9b92-49c6d362742c tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.325975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aaeb171a-da14-4beb-9b92-49c6d362742c tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Searching by: {'tenant_id': 'fc1ba316fddf4f1fbd2ec6b989685d2a', 'deleted': False} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:34.340102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaeb171a-da14-4beb-9b92-49c6d362742c tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.343016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaeb171a-da14-4beb-9b92-49c6d362742c tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.345426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaeb171a-da14-4beb-9b92-49c6d362742c tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.346430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aaeb171a-da14-4beb-9b92-49c6d362742c tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.409629 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aaeb171a-da14-4beb-9b92-49c6d362742c tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fc1ba316fddf4f1fbd2ec6b989685d2a" status: 200 len: 15 microversion: 2.1 time: 0.104669 Jun 16 18:37:34.422867 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 909/1885] 10.222.0.27 () {58 vars in 1256 bytes} [Thu Jun 16 18:37:34 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fc1ba316fddf4f1fbd2ec6b989685d2a => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:37:34.430260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6215c4b5-7e81-4d5e-87aa-ad21dea5eee8 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.438091 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6215c4b5-7e81-4d5e-87aa-ad21dea5eee8 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012280 Jun 16 18:37:34.450701 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 910/1886] 10.222.0.27 () {58 vars in 1188 bytes} [Thu Jun 16 18:37:34 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:37:34.466236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.468092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:34.500505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.502201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.503518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.504273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.738356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.760280 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-899a0c0d-1bdb-46ed-8a69-6a2e1e0e0483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 200 len: 1293 microversion: 2.1 time: 0.308064 Jun 16 18:37:34.761359 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 911/1887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:34 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 1293 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:34.775822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d63e0d11-3d6b-4c83-a15e-50a1a8f0c091 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:34.777294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d63e0d11-3d6b-4c83-a15e-50a1a8f0c091 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:34.791114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d63e0d11-3d6b-4c83-a15e-50a1a8f0c091 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.791303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d63e0d11-3d6b-4c83-a15e-50a1a8f0c091 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.792112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d63e0d11-3d6b-4c83-a15e-50a1a8f0c091 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.792570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d63e0d11-3d6b-4c83-a15e-50a1a8f0c091 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.865712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.876906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.878825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.880807 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-123d02a2-336e-4e94-8181-95f79381cef6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.631598 Jun 16 18:37:34.882097 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 977/1888] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:34 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:34.887248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c31732a0-1a98-4a8c-b0bf-0b0e90ae51bf req-a458c3bd-2864-4a05-bdfb-b8546ea20ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f1a338-34e1-46a7-9a44-a4e6b1c3618e", "name": "network-vif-deleted", "tag": "82a250be-30eb-4ed5-9328-a70bdd97085e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:34.901245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c31732a0-1a98-4a8c-b0bf-0b0e90ae51bf req-a458c3bd-2864-4a05-bdfb-b8546ea20ba9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.901696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c31732a0-1a98-4a8c-b0bf-0b0e90ae51bf req-a458c3bd-2864-4a05-bdfb-b8546ea20ba9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.916595 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c31732a0-1a98-4a8c-b0bf-0b0e90ae51bf req-a458c3bd-2864-4a05-bdfb-b8546ea20ba9 service nova] Creating event network-vif-deleted:82a250be-30eb-4ed5-9328-a70bdd97085e for instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e on n-h2-846209-2 Jun 16 18:37:34.922116 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c31732a0-1a98-4a8c-b0bf-0b0e90ae51bf req-a458c3bd-2864-4a05-bdfb-b8546ea20ba9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038464 Jun 16 18:37:34.923272 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 978/1889] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:34.955863 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d63e0d11-3d6b-4c83-a15e-50a1a8f0c091 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action" status: 202 len: 0 microversion: 2.1 time: 0.193331 Jun 16 18:37:34.957291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 912/1890] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:34 2022] POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:34.969556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.976609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.977419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '283e375f03104021bdf7a756af5bdcce'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:34.986531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.987618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.989246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.990449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.133594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:37:35.254749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:35.257374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:35.266733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.268720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.277610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.278904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.280403 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6a230145-4de5-4647-b304-2b21f7999f7a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.318309 Jun 16 18:37:35.281067 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 979/1891] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Jun 16 18:37:34 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:35.293354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7bbf51d8-90cc-4177-b468-94aea361face tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:35.305874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7bbf51d8-90cc-4177-b468-94aea361face tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:35.318954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bbf51d8-90cc-4177-b468-94aea361face tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.323138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bbf51d8-90cc-4177-b468-94aea361face tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.324148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bbf51d8-90cc-4177-b468-94aea361face tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.325615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bbf51d8-90cc-4177-b468-94aea361face tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.446255 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7bbf51d8-90cc-4177-b468-94aea361face tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action" status: 202 len: 0 microversion: 2.1 time: 0.155842 Jun 16 18:37:35.449988 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 980/1892] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:35 2022] POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:35.460757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6bdb9204-01de-49b9-955e-94203180adb7 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:35.462420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6bdb9204-01de-49b9-955e-94203180adb7 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:35.472051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bdb9204-01de-49b9-955e-94203180adb7 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.472516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bdb9204-01de-49b9-955e-94203180adb7 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.473327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bdb9204-01de-49b9-955e-94203180adb7 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.474318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bdb9204-01de-49b9-955e-94203180adb7 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.598867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:35.608651 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7a4c6f41-7d07-4e52-8e9e-77dcb6bcbc84 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.368770 Jun 16 18:37:35.624654 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 913/1893] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:35 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:35.771970 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6bdb9204-01de-49b9-955e-94203180adb7 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1615 microversion: 2.1 time: 0.317575 Jun 16 18:37:35.773001 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 981/1894] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:35 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1615 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:35.796703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:35.801045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:35.820583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.821220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.824178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.826316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.858183 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e HTTP/1.1 Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b5f1a338-34e1-46a7-9a44-a4e6b1c3618e'} Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:35.862088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:35.870369 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:35.870369 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:35.870369 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:35.870369 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:35.870369 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:37:35.870369 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:35.894529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:35.901819 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a7b12d9-ce6e-423a-a316-17888d76f11b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 404 len: 111 microversion: 2.1 time: 0.120676 Jun 16 18:37:35.908624 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 982/1895] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:35 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:37:35.929466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-804cf726-9ed5-4f77-a995-9fa9746e2847 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:35.937888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-804cf726-9ed5-4f77-a995-9fa9746e2847 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:35.951249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-804cf726-9ed5-4f77-a995-9fa9746e2847 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.951795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-804cf726-9ed5-4f77-a995-9fa9746e2847 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.952707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-804cf726-9ed5-4f77-a995-9fa9746e2847 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.953852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-804cf726-9ed5-4f77-a995-9fa9746e2847 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.144392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e198b53f-f916-45a4-bfda-21e80af8204d req-0022d90c-8f67-4f35-b0f8-7ebf35da926c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a153bd-218b-41ee-9610-3994098b06f0", "name": "network-vif-plugged", "status": "completed", "tag": "8515cd67-37fa-4c99-b944-46c6ffdd74a9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:36.167132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e198b53f-f916-45a4-bfda-21e80af8204d req-0022d90c-8f67-4f35-b0f8-7ebf35da926c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.167572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e198b53f-f916-45a4-bfda-21e80af8204d req-0022d90c-8f67-4f35-b0f8-7ebf35da926c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.206237 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e198b53f-f916-45a4-bfda-21e80af8204d req-0022d90c-8f67-4f35-b0f8-7ebf35da926c service nova] Creating event network-vif-plugged:8515cd67-37fa-4c99-b944-46c6ffdd74a9 for instance 70a153bd-218b-41ee-9610-3994098b06f0 on n-h1-846209-2 Jun 16 18:37:36.212983 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e198b53f-f916-45a4-bfda-21e80af8204d req-0022d90c-8f67-4f35-b0f8-7ebf35da926c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.586482 Jun 16 18:37:36.214581 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 914/1896] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:36.221880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:36.222929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:36.231478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.232341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.233487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.234273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.338319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-804cf726-9ed5-4f77-a995-9fa9746e2847 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1615 microversion: 2.1 time: 0.431257 Jun 16 18:37:36.353530 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 983/1897] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:35 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1615 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:36.358111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:36.359182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:36.369505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.370235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.371344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.372006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.431002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.440410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:37:36.594717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:36.613024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:36.626956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:36.631393 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dfdf1096-ab52-43d6-8421-b3a596b58607 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.415161 Jun 16 18:37:36.638610 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 915/1898] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:36 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:36.654497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:36.669747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Searching by: {'host': 'n-h2-846209-2', 'deleted': False} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:36.680387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87abb84f-4cd8-457b-b9d9-903c1421be9e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 204 len: 0 microversion: 2.1 time: 0.334023 Jun 16 18:37:36.681725 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 984/1899] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:37:36 2022] DELETE /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:36.689968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:36.691011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:36.691148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.691550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.699271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.701390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.707058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.708783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.710924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.711671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.864012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:37:36.970115 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c655e388-6bb0-4481-b39e-0abb3b30240d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h2-846209-2&all_tenants=1" status: 200 len: 1978 microversion: 2.1 time: 0.326109 Jun 16 18:37:36.971515 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 916/1900] 10.222.0.27 () {58 vars in 1189 bytes} [Thu Jun 16 18:37:36 2022] GET /compute/v2.1/servers?host=n-h2-846209-2&all_tenants=1 => generated 1978 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:36.988509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:36.995442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:37.004552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.005925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.007209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.008360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.061852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:37.073118 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fc8dcbee-251f-461f-83a7-dc5bf60db632 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.389511 Jun 16 18:37:37.085249 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 985/1901] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:36 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:37.091195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-21c6ce54-37f4-4411-b590-9e5d4424211e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:37.097652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-21c6ce54-37f4-4411-b590-9e5d4424211e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:37:37.108832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c6ce54-37f4-4411-b590-9e5d4424211e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.109814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c6ce54-37f4-4411-b590-9e5d4424211e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.110868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c6ce54-37f4-4411-b590-9e5d4424211e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.111560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21c6ce54-37f4-4411-b590-9e5d4424211e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.237023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:37.242095 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-21c6ce54-37f4-4411-b590-9e5d4424211e tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.154963 Jun 16 18:37:37.242845 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 986/1902] 10.222.0.27 () {58 vars in 1195 bytes} [Thu Jun 16 18:37:37 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:37:37.257495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-efe6900e-660c-409f-ada3-9f51cd76774b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1494 microversion: 2.1 time: 0.284447 Jun 16 18:37:37.265929 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 917/1903] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:36 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1494 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:37.273019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ec1d9cc9-f414-4973-bc26-290926442c80 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:37.274437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ec1d9cc9-f414-4973-bc26-290926442c80 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:37.281019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec1d9cc9-f414-4973-bc26-290926442c80 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.281714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec1d9cc9-f414-4973-bc26-290926442c80 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.282656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec1d9cc9-f414-4973-bc26-290926442c80 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.283170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec1d9cc9-f414-4973-bc26-290926442c80 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.388964 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ec1d9cc9-f414-4973-bc26-290926442c80 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action" status: 202 len: 0 microversion: 2.1 time: 0.121165 Jun 16 18:37:37.390000 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 918/1904] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:37 2022] POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:37.401164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:37.402400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3004b91e-116f-4468-8354-3938de8116d1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f86781798b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1060161818", "description": "tempest-description-1529549132"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:37.402745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:37.409879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.411029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.412793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.413284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.537924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.545901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:37.546417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:37.547183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:37.548009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:37.548694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:37.607761 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3004b91e-116f-4468-8354-3938de8116d1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.362381 Jun 16 18:37:37.608563 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 987/1905] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:37:37 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:37.620986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5431bb4c-4e29-44a7-88c5-888c011a9018 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f867813b940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-791457213", "description": "tempest-description-1638455885"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:37.626750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.650525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:37.658727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.659654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.660589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.661438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.707078 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c56eea48-dcb3-464d-94ed-ea740f29d4fa tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action" status: 202 len: 1068 microversion: 2.1 time: 0.312680 Jun 16 18:37:37.707745 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 919/1906] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:37 2022] POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action => generated 1068 bytes in 314 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 16 18:37:37.720200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:37.720721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:37.728119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.729352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.730375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.730980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.032451 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5431bb4c-4e29-44a7-88c5-888c011a9018 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.415355 Jun 16 18:37:38.033313 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 988/1907] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:37:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:37:38.038617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:38.039448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:38.050460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.051132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.052774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.053452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.128265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:38.138603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:38.140376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:38.156654 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-36f74754-8617-401d-9e03-964a2cbc7668 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.445698 Jun 16 18:37:38.156654 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 920/1908] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:37 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:38.168598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:38.170112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:38.189345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.189950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.190958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.191410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.434891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:38.451441 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61f62ea5-e221-4670-b1e4-cba158300833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.416555 Jun 16 18:37:38.464816 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 989/1909] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:38 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:38.470403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-581028176", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "ed42c0a2-d429-4e3f-b196-bb39340e5518"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:38.485137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:38.496277 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e32a3b2d-d6fb-495f-a090-d913e4059d0b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1199 microversion: 2.1 time: 0.339353 Jun 16 18:37:38.496981 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 921/1910] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:38 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1199 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:38.514440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:38.515065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:38.532067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.532067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.532605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.533265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.652528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] validate_networks() for [('ed42c0a2-d429-4e3f-b196-bb39340e5518', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:39.196073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:39.209253 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a886e4c-0a50-474c-b5aa-40daf53d6807 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 200 len: 1494 microversion: 2.1 time: 0.709059 Jun 16 18:37:39.210065 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 922/1911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:38 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 1494 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:39.226460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-abd79501-895d-4016-9583-576377bd1aa0 req-308d2ab9-ea4c-452c-8680-79de45c19377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c6c7ab-0c3f-422f-b198-897c7700caa8", "name": "network-vif-deleted", "tag": "4fbb6278-55b1-46ea-93a8-eb60a17a45ad"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:39.241206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-abd79501-895d-4016-9583-576377bd1aa0 req-308d2ab9-ea4c-452c-8680-79de45c19377 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:39.241641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-abd79501-895d-4016-9583-576377bd1aa0 req-308d2ab9-ea4c-452c-8680-79de45c19377 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:39.261816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-abd79501-895d-4016-9583-576377bd1aa0 req-308d2ab9-ea4c-452c-8680-79de45c19377 service nova] Creating event network-vif-deleted:4fbb6278-55b1-46ea-93a8-eb60a17a45ad for instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 on n-h2-846209-2 Jun 16 18:37:39.269366 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-abd79501-895d-4016-9583-576377bd1aa0 req-308d2ab9-ea4c-452c-8680-79de45c19377 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057508 Jun 16 18:37:39.271984 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 923/1912] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:39.283336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:39.284223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:39.294884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:39.295583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:39.297892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:39.299457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:39.742482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:39.754791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:39.757503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:39.758866 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-70125939-4d72-462c-be2d-3772dd98012f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.484960 Jun 16 18:37:39.760284 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 924/1913] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:39 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:39.765460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:39.766433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:39.774582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:39.775494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:39.776504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:39.777180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.158030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:40.158784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:40.159327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:40.160085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:40.160847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:40.198443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.198913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.199865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.200267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.236920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:40.244691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Getting quotas for project 6b1d785ba63d406a82b75393e89230de. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:40.253771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Getting quotas for user fc290259c264400aad950993f0a1d9d9 and project 6b1d785ba63d406a82b75393e89230de. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:40.254554 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3f3effb-75f7-496b-b7ce-80628fe3d833 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.492933 Jun 16 18:37:40.260082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.265480 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 925/1914] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:39 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:40.274868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:40.275516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:40.282767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:40.285157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:40.290243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.293160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.294738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.295604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.396955 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-94e65120-d162-48cf-af53-206ced6ced40 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.930286 Jun 16 18:37:40.402096 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 990/1915] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:37:40.418564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:40.419674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:40.434832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.435504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.436688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.437332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.460659 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 HTTP/1.1 Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '65c6c7ab-0c3f-422f-b198-897c7700caa8'} Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:40.462863 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:40.467597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:40.467597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:40.467597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:40.467597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:40.467597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:37:40.467597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:40.469836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:40.471221 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19f45b7f-7d2e-4d29-a881-a5a8428b597c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 404 len: 111 microversion: 2.1 time: 0.071340 Jun 16 18:37:40.472335 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 991/1916] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:40 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:37:40.478560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-79fc2357-fb85-49d1-8b80-9cef05b1129f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:40.479850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-79fc2357-fb85-49d1-8b80-9cef05b1129f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:40.692026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-79fc2357-fb85-49d1-8b80-9cef05b1129f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:40.706756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-79fc2357-fb85-49d1-8b80-9cef05b1129f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1215 microversion: 2.1 time: 0.233055 Jun 16 18:37:40.710666 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 992/1917] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:40 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:40.735676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2099806080", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "06a9a0f4-e2e7-4b09-9d3d-fea8950fac70"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:40.849378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:41.191372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:41.207830 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-709ae3d8-7ce3-4b7e-a410-80197f5523a8 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1383 microversion: 2.1 time: 0.940997 Jun 16 18:37:41.209689 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 926/1918] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:40 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1383 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:41.219078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:41.225878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:41.246565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:41.248578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:41.250613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:41.254982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:41.958242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:41.982665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:41.987397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:41.998805 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-76c28ebb-c685-4433-9b8c-0eb38146be00 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.783716 Jun 16 18:37:42.006950 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 927/1919] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:41 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:42.259005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-93bc8acc-2b47-49f2-ae75-e3746baee009 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:42.259727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-93bc8acc-2b47-49f2-ae75-e3746baee009 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:42.293158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93bc8acc-2b47-49f2-ae75-e3746baee009 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:42.295781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93bc8acc-2b47-49f2-ae75-e3746baee009 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:42.296854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93bc8acc-2b47-49f2-ae75-e3746baee009 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:42.303258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93bc8acc-2b47-49f2-ae75-e3746baee009 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.016756 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-93bc8acc-2b47-49f2-ae75-e3746baee009 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1534 microversion: 2.1 time: 1.007848 Jun 16 18:37:43.017397 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 928/1920] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:42 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1534 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:43.030893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:43.031803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:43.053437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.053937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.058030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.058503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.213455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:43.215515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:43.217224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:43.218394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:43.219254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:43.240810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.241624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.243039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.244066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.343599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:43.375017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:43.410885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:43.416183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:43.479036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:43.494086 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50e62cbd-8c90-4fb1-9c5b-a5c0bc2ba596 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.474668 Jun 16 18:37:43.498933 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 929/1921] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:43 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:43.512295 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-818422c9-f726-4644-af35-248f8dd8b2bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.787503 Jun 16 18:37:43.513314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 993/1922] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:37:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:37:43.524528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:43.525159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:43.528806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:43.529441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:43.544756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.550519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.554529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.555315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.567106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.569785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.570671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.571216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.870624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.013738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:44.025186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d7c44560-10cf-48d3-a192-83186877c88d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1315 microversion: 2.1 time: 0.524544 Jun 16 18:37:44.026734 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 930/1923] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:43 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:44.031989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-db90cd13-7832-4152-acc1-eac6db0af28f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:44.034690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-db90cd13-7832-4152-acc1-eac6db0af28f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:44.048953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:44.051349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db90cd13-7832-4152-acc1-eac6db0af28f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.057816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db90cd13-7832-4152-acc1-eac6db0af28f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.060216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db90cd13-7832-4152-acc1-eac6db0af28f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.062383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db90cd13-7832-4152-acc1-eac6db0af28f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.064905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:44.066922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:44.070399 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85b3640c-4aa7-47fe-9106-6d9a83799dbb tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.555769 Jun 16 18:37:44.076590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 994/1924] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:43 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:44.082169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c12503ee-1872-4a45-951f-0f3eaa4a1498 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:44.086667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c12503ee-1872-4a45-951f-0f3eaa4a1498 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:44.196045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c12503ee-1872-4a45-951f-0f3eaa4a1498 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:44.211422 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c12503ee-1872-4a45-951f-0f3eaa4a1498 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1209 microversion: 2.1 time: 0.133214 Jun 16 18:37:44.222927 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 995/1925] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:44 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:44.516187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:44.516818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:44.525414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.525872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.541146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.543914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.551383 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-db90cd13-7832-4152-acc1-eac6db0af28f tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1534 microversion: 2.1 time: 0.514930 Jun 16 18:37:44.554145 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 931/1926] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:44 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1534 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:44.578276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-84df8a84-a1e6-468a-b544-f392e5e57d78 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:44.582411 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:37:44.582411 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:37:44.586956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84df8a84-a1e6-468a-b544-f392e5e57d78 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.589151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84df8a84-a1e6-468a-b544-f392e5e57d78 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.590295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84df8a84-a1e6-468a-b544-f392e5e57d78 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.591426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84df8a84-a1e6-468a-b544-f392e5e57d78 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.668169 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-84df8a84-a1e6-468a-b544-f392e5e57d78 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.098472 Jun 16 18:37:44.668831 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 932/1927] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 18:37:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:44.690409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846209-2", "block_migration": false, "disk_over_commit": false}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:44.717260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:44.736105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.736911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.741106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.742477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.794666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lazy-loading 'flavor' on Instance uuid 70a153bd-218b-41ee-9610-3994098b06f0 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:44.817046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Going to try to live migrate instance to n-h2-846209-2 {{(pid=119207) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:37:45.008264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:45.021528 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf4fc8a3-b9a8-4470-b32b-b4ba7ba42d51 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.508671 Jun 16 18:37:45.023054 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 996/1928] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:44 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:45.028283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-53e22a13-0277-4162-ac46-9e7c1d04d47a req-2dee022e-0182-49f1-b96c-84a03f3ecd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be179f1-c859-45c9-a96c-f7f25f126546", "name": "network-vif-plugged", "status": "completed", "tag": "f925959e-95a7-48a3-b183-5dd22c6a2665"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:45.061949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-53e22a13-0277-4162-ac46-9e7c1d04d47a req-2dee022e-0182-49f1-b96c-84a03f3ecd2d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:45.073039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-53e22a13-0277-4162-ac46-9e7c1d04d47a req-2dee022e-0182-49f1-b96c-84a03f3ecd2d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:45.108414 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-53e22a13-0277-4162-ac46-9e7c1d04d47a req-2dee022e-0182-49f1-b96c-84a03f3ecd2d service nova] Creating event network-vif-plugged:f925959e-95a7-48a3-b183-5dd22c6a2665 for instance 4be179f1-c859-45c9-a96c-f7f25f126546 on n-h1-846209-2 Jun 16 18:37:45.126616 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-53e22a13-0277-4162-ac46-9e7c1d04d47a req-2dee022e-0182-49f1-b96c-84a03f3ecd2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102121 Jun 16 18:37:45.129618 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 997/1929] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:45.143598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4a3b0b22-5133-4ed0-97fc-2e578ad634c1 req-8697881d-cdc4-4316-9c7e-2e9a4695791c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5", "tag": "020cf015-0cf4-4d3e-be29-6245fb5fc6c3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:45.181164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4a3b0b22-5133-4ed0-97fc-2e578ad634c1 req-8697881d-cdc4-4316-9c7e-2e9a4695791c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:45.181632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4a3b0b22-5133-4ed0-97fc-2e578ad634c1 req-8697881d-cdc4-4316-9c7e-2e9a4695791c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:45.207586 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4a3b0b22-5133-4ed0-97fc-2e578ad634c1 req-8697881d-cdc4-4316-9c7e-2e9a4695791c service nova] Creating event network-changed:020cf015-0cf4-4d3e-be29-6245fb5fc6c3 for instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 on n-h2-846209-2 Jun 16 18:37:45.220394 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4a3b0b22-5133-4ed0-97fc-2e578ad634c1 req-8697881d-cdc4-4316-9c7e-2e9a4695791c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087501 Jun 16 18:37:45.225768 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 998/1930] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:45.240590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:45.242957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:45.264648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:45.265191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:45.266160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:45.266607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:45.654788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:45.668420 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2fab1ba-858e-4349-8486-309156928f39 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1315 microversion: 2.1 time: 0.440329 Jun 16 18:37:45.679021 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 999/1931] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:45 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:45.691149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:45.691786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:45.711656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:45.712389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:45.713532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:45.714160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:45.985437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:45.998995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:46.000962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:46.005961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9c0a2b6-b0f1-48a7-a001-8110ec4b32ce tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1281 microversion: 2.25 time: 0.325527 Jun 16 18:37:46.007882 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1000/1932] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:45 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1281 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:46.019409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:46.020194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:46.033383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.036434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:46.040025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.040664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:46.155740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:46.174220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12030644-75d0-4565-93b6-2569f162c805 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1267 microversion: 2.1 time: 0.162824 Jun 16 18:37:46.175548 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1001/1933] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:46 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:46.181737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:46.182495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:46.209737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.213246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:46.216118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.216873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:46.639864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:46.661635 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2576fb98-c356-4263-820b-7cfecf9a41cf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.483207 Jun 16 18:37:46.663875 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1002/1934] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:46 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:46.693823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:46.702504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:46.726119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.728192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:46.729537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.731206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:47.153417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:47.163913 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc42aa35-9ebd-489a-98df-accb082cf32d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1315 microversion: 2.1 time: 0.480827 Jun 16 18:37:47.165383 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1003/1935] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:46 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:47.171502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:47.173279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:47.181642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:47.182700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:47.183858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:47.184542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:47.602567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:47.612534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:47.624131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:47.625866 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-938e08b0-53e0-4dd6-8153-c0f954123441 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1477 microversion: 2.25 time: 0.459032 Jun 16 18:37:47.629527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1004/1936] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:47 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1477 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:47.636604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:47.637472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:47.647480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:47.648834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:47.649814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:47.650637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:48.693214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:48.719317 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-104d2759-b47e-4f2c-89e8-bbee6f5afef3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1309 microversion: 2.1 time: 1.087446 Jun 16 18:37:48.734779 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1005/1937] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:47 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1309 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:48.934720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:48.935348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:48.949987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:48.952810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:48.957487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:48.958493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.119725 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bd6616b5-7b5a-41b9-85d0-652f157bf61e tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0/action" status: 202 len: 0 microversion: 2.1 time: 4.439319 Jun 16 18:37:49.121304 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 933/1938] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:44 2022] POST /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0/action => generated 0 bytes in 4444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:49.128291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:49.130740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:49.165752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.166344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.173100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.174917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.360529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4be179f1-c859-45c9-a96c-f7f25f126546 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:49.370783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.414133 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ccdbf4f-714b-42aa-a132-2879d1f52c5f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1970 microversion: 2.25 time: 0.677802 Jun 16 18:37:49.415467 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1006/1939] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:48 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1970 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:49.430803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:49.433601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:49.452084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.454269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.455371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.457410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.501782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:49.513954 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-11e1d3f3-d37a-4e71-a5ed-34e7dcf17d2e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.391340 Jun 16 18:37:49.515583 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 934/1940] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:49 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:49.529272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-648abd85-1236-44ac-a1cc-32d15b44fa55 req-1f85812d-d294-415d-a27a-ed09052f9c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12755d5c-a24e-48ce-a3d1-a2f062d2a29f", "tag": "918a6bc1-39cb-4c6a-9673-a8920c2cca51"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:49.543529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-648abd85-1236-44ac-a1cc-32d15b44fa55 req-1f85812d-d294-415d-a27a-ed09052f9c20 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.544852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-648abd85-1236-44ac-a1cc-32d15b44fa55 req-1f85812d-d294-415d-a27a-ed09052f9c20 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.553984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.566694 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-648abd85-1236-44ac-a1cc-32d15b44fa55 req-1f85812d-d294-415d-a27a-ed09052f9c20 service nova] Creating event network-changed:918a6bc1-39cb-4c6a-9673-a8920c2cca51 for instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f on n-h2-846209-2 Jun 16 18:37:49.574398 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-648abd85-1236-44ac-a1cc-32d15b44fa55 req-1f85812d-d294-415d-a27a-ed09052f9c20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056197 Jun 16 18:37:49.576693 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 935/1941] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:49.589582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:49.591063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:49.601705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.602469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.603476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.604098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.639881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:49.654868 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-989ec2a3-0d58-48cd-9a10-9c7fc7711e85 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1315 microversion: 2.1 time: 0.237919 Jun 16 18:37:49.657946 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1007/1942] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:49 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:49.668164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:49.670620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:49.683791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.684597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.685853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.686540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.891049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:49.909040 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9758d1a-7c1c-4f82-bc12-2d0b475ed032 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.328602 Jun 16 18:37:49.912303 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 936/1943] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:49 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:49.964696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4be179f1-c859-45c9-a96c-f7f25f126546 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:49.981866 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2797d0c-ddae-40de-9f8f-0fab3d3d37c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1970 microversion: 2.25 time: 0.321979 Jun 16 18:37:49.982477 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1008/1944] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:49 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1970 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:49.994784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:49.995420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:50.002055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.002503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.003583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.004085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.015132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a2e6e48-3661-42ea-a4b6-29078d02a20e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Action: 'create', calling method: .version_select at 0x7f8674125a60>, body: {"keypair": {"name": "tempest-keypair-69486199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDM+gopTp4CQ37I1YW9gbWeCRLdIWvahjbPuC6tVC/e7Ug8tJnZ6zir74qIyRp6zv1Qt2VG75X97fWSsrNDQl6wG6R9BYEfC9EY0MymyeRu7kbrc3LHK+uAVqiGK+s9jw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:50.030839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-6a2e6e48-3661-42ea-a4b6-29078d02a20e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Getting quotas for project 863792ec29f746f3a811e43f63660e11. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:50.037126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-6a2e6e48-3661-42ea-a4b6-29078d02a20e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Getting quotas for user 87bba0a64194440f8bb6f4839f751db9 and project 863792ec29f746f3a811e43f63660e11. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:50.066514 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a2e6e48-3661-42ea-a4b6-29078d02a20e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.151805 Jun 16 18:37:50.070115 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 937/1945] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:37:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:50.076773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98201445-93cb-44e4-99f0-b57997999fcf tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:50.078335 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:37:50.078335 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:37:50.080044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98201445-93cb-44e4-99f0-b57997999fcf tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.080552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98201445-93cb-44e4-99f0-b57997999fcf tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.081584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98201445-93cb-44e4-99f0-b57997999fcf tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.082050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98201445-93cb-44e4-99f0-b57997999fcf tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.118123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98201445-93cb-44e4-99f0-b57997999fcf tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046705 Jun 16 18:37:50.119108 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 938/1946] 10.222.0.27 () {60 vars in 1216 bytes} [Thu Jun 16 18:37:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:37:50.137754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846209-2", "block_migration": "auto"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:50.149257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:50.159375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.160894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.162368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.163106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.187289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:50.196293 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8aef61c9-5b55-4ea2-ab7e-83a2e7d4be33 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1309 microversion: 2.1 time: 0.209058 Jun 16 18:37:50.197267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1009/1947] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:49 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1309 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:50.205014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'flavor' on Instance uuid 4be179f1-c859-45c9-a96c-f7f25f126546 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:50.219829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Going to try to live migrate instance to n-h2-846209-2 {{(pid=119207) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 18:37:50.531990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:50.532611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:50.549705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.551153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.552041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.552645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.871091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:50.880630 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b5b2c281-b4f2-42c6-89cd-b61b29bbd405 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.352124 Jun 16 18:37:50.881341 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1010/1948] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:50 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:50.893717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b4659c84-b1dd-45c4-8305-22445899fbe6 req-b8b78b96-29b8-43cd-ad60-8e2d13f4882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "020cf015-0cf4-4d3e-be29-6245fb5fc6c3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:50.894633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b4659c84-b1dd-45c4-8305-22445899fbe6 req-b8b78b96-29b8-43cd-ad60-8e2d13f4882d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.895381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b4659c84-b1dd-45c4-8305-22445899fbe6 req-b8b78b96-29b8-43cd-ad60-8e2d13f4882d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.914434 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b4659c84-b1dd-45c4-8305-22445899fbe6 req-b8b78b96-29b8-43cd-ad60-8e2d13f4882d service nova] Creating event network-vif-plugged:020cf015-0cf4-4d3e-be29-6245fb5fc6c3 for instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 on n-h2-846209-2 Jun 16 18:37:50.919594 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b4659c84-b1dd-45c4-8305-22445899fbe6 req-b8b78b96-29b8-43cd-ad60-8e2d13f4882d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037098 Jun 16 18:37:50.920751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1011/1949] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:50.928719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:50.929740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:50.937270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.938070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.939065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.939889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.262240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:51.280597 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b67b45af-798e-43f5-b29f-91e9e8e1c728 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1315 microversion: 2.1 time: 0.358119 Jun 16 18:37:51.284720 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1012/1950] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:50 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:51.314205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:51.316138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:51.344953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.345895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.346721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.347215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.611845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:51.623438 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a7ce85fe-1fd6-4f63-9c3b-f9e6aae626a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.335345 Jun 16 18:37:51.624129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1013/1951] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:51 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:51.630614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:51.638697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:51.638697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.639176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.640464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.641581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.837099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:51.846822 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d29f7eb-6eb7-4cc1-93b4-264f027c8660 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1309 microversion: 2.1 time: 0.221138 Jun 16 18:37:51.857845 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1014/1952] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:51 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1309 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:51.904662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:51.905633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:51.919738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.921819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.924274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.926574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.138939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:52.150179 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-770ceaaf-05e6-450d-af27-8e33f2b943e3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.255390 Jun 16 18:37:52.165709 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1015/1953] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:51 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:52.306262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:52.310434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:52.321684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:52.322430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.324265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:52.324960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.533596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a33684e7-63da-4ef8-9f40-e3993b8425c2 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546/action" status: 202 len: 0 microversion: 2.25 time: 2.400880 Jun 16 18:37:52.538074 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 939/1954] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:37:50 2022] POST /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546/action => generated 0 bytes in 2411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:52.545363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:52.546022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:52.558788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:52.559563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.575392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:52.577010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.750581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:52.785101 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9853dc8-cb76-41a6-ad27-ca9b8e1a9ebe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1315 microversion: 2.1 time: 0.486210 Jun 16 18:37:52.786523 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1016/1955] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:52 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:52.808133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:52.809056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:52.819304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:52.821212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.825752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:52.826639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.998876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:53.041190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:53.057302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:53.059444 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26e22f7a-3d88-4f8c-98ef-b8f1783ed7ac tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.518786 Jun 16 18:37:53.061567 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 940/1956] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:52 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:53.069145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:53.070237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:53.085453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:53.085762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.086546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.088326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.088771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.099076 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b8d6b7e0-fe1b-4eb3-a993-78d58d2aeb63 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.310519 Jun 16 18:37:53.110168 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1017/1957] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:52 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:53.166952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:53.168139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:53.181810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.182314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.183112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.183560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.307488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.504467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:53.518993 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ba361dbf-fc7b-46cc-8d90-9a88845612e3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1309 microversion: 2.1 time: 0.455873 Jun 16 18:37:53.519595 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 941/1958] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:53 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1309 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:53.540150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-650518140", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "38230fda-6975-4002-b5c0-f82cac679e57"}], "security_groups": [{"name": "tempest-securitygroup--402173970"}], "key_name": "tempest-keypair-69486199", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:53.572211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:53.584568 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-973df8b4-8ada-41e0-acd7-08f9090e260e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1472 microversion: 2.1 time: 0.421244 Jun 16 18:37:53.596129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1018/1959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:53 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:53.667885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] validate_networks() for [('38230fda-6975-4002-b5c0-f82cac679e57', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:53.810902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:53.812277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:53.827076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.827975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.829438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.830390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.090148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:54.101358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50b54cf3-da7f-4190-9d39-a00942f04b98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1503 microversion: 2.1 time: 0.300659 Jun 16 18:37:54.101969 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1019/1960] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:53 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:54.107958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:54.108806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:54.121251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.122066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.123095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.123539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.209524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.257865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Getting quotas for project 863792ec29f746f3a811e43f63660e11. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:54.264674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Getting quotas for user 87bba0a64194440f8bb6f4839f751db9 and project 863792ec29f746f3a811e43f63660e11. Resources: dict_keys(['metadata_items']) {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:54.282406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:54.283140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:54.283828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:54.284435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:54.285039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:54.295783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.296552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.297564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.298277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.319559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Getting quotas for project 863792ec29f746f3a811e43f63660e11. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:54.326103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Getting quotas for user 87bba0a64194440f8bb6f4839f751db9 and project 863792ec29f746f3a811e43f63660e11. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:54.337472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:54.346325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:54.348789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:54.350407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:54.351030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:54.357054 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d96f726-89ac-47dc-891a-bb2593bfe00b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.248809 Jun 16 18:37:54.358190 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1020/1961] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:54 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:54.364932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:54.365341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:54.378240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.379589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.381617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.382236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.426516 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8568777b-c746-4014-a390-8cfe09e621d1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.891438 Jun 16 18:37:54.428025 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 942/1962] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:37:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:37:54.434681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1060161818"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:54.435588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:54.447989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.448847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.450009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.450724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.691520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:54.704016 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.network.security_group_api [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Adding security group 8ad4b153-9a57-4205-b50a-505e2fcee75a to port 020cf015-0cf4-4d3e-be29-6245fb5fc6c3 Jun 16 18:37:54.714398 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c920bce7-c61e-426c-9e3a-ba4a9f098b8a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.353086 Jun 16 18:37:54.716802 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1021/1963] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:54 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:54.726712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-378bd0d4-2a6d-45f4-bc74-55d7a0f4ebdd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:54.729625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-378bd0d4-2a6d-45f4-bc74-55d7a0f4ebdd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:54.824676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-378bd0d4-2a6d-45f4-bc74-55d7a0f4ebdd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:54.836475 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-378bd0d4-2a6d-45f4-bc74-55d7a0f4ebdd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1275 microversion: 2.1 time: 0.116923 Jun 16 18:37:54.837191 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1022/1964] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:54 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:54.850764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-67811a88-0120-4a46-8077-aadb2497a195 req-a94528f1-07c7-4eb1-8a1e-667b83ec8665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12755d5c-a24e-48ce-a3d1-a2f062d2a29f", "name": "network-vif-plugged", "status": "completed", "tag": "918a6bc1-39cb-4c6a-9673-a8920c2cca51"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:54.870650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67811a88-0120-4a46-8077-aadb2497a195 req-a94528f1-07c7-4eb1-8a1e-667b83ec8665 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.870650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67811a88-0120-4a46-8077-aadb2497a195 req-a94528f1-07c7-4eb1-8a1e-667b83ec8665 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.897625 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-67811a88-0120-4a46-8077-aadb2497a195 req-a94528f1-07c7-4eb1-8a1e-667b83ec8665 service nova] Creating event network-vif-plugged:918a6bc1-39cb-4c6a-9673-a8920c2cca51 for instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f on n-h2-846209-2 Jun 16 18:37:54.904946 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-67811a88-0120-4a46-8077-aadb2497a195 req-a94528f1-07c7-4eb1-8a1e-667b83ec8665 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064144 Jun 16 18:37:54.931339 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1023/1965] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:54.944866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:54.948261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:54.980284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.981470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.984992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.986422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.263438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:55.273637 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-17889393-4c5e-40dc-80b3-7519a3e2e968 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1309 microversion: 2.1 time: 0.339174 Jun 16 18:37:55.274274 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1024/1966] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:54 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:55.278835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:55.279641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:55.291812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.292528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.293331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.293769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.319351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:55.401463 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e6a7927-8b96-41f5-b6ab-e962b6999c1b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5/action" status: 202 len: 0 microversion: 2.1 time: 0.970017 Jun 16 18:37:55.403007 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 943/1967] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:54 2022] POST /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:55.419728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:55.421309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:55.430171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.431475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.432586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.433460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.634803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:55.643592 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9eaf8eeb-941b-4fca-bb5d-4ce9bf4f7344 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1478 microversion: 2.1 time: 0.368245 Jun 16 18:37:55.644433 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1025/1968] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:55 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1478 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:55.660049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-791457213"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:55.660768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:55.675681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.676301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.679264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.679991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.687238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:55.697043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:55.698674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:55.699882 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9c48a4b-9c4e-4677-9705-934bfb4007de tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.295123 Jun 16 18:37:55.700457 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 944/1969] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:55 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:55.715860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a36eaaaa-92c3-43d3-b6b8-f9565924d2c6 req-935ab106-311f-4385-91f0-3a6ff201dc1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5", "tag": "020cf015-0cf4-4d3e-be29-6245fb5fc6c3"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:55.727613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a36eaaaa-92c3-43d3-b6b8-f9565924d2c6 req-935ab106-311f-4385-91f0-3a6ff201dc1a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.728373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a36eaaaa-92c3-43d3-b6b8-f9565924d2c6 req-935ab106-311f-4385-91f0-3a6ff201dc1a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.749813 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a36eaaaa-92c3-43d3-b6b8-f9565924d2c6 req-935ab106-311f-4385-91f0-3a6ff201dc1a service nova] Creating event network-changed:020cf015-0cf4-4d3e-be29-6245fb5fc6c3 for instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 on n-h2-846209-2 Jun 16 18:37:55.762661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a36eaaaa-92c3-43d3-b6b8-f9565924d2c6 req-935ab106-311f-4385-91f0-3a6ff201dc1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055588 Jun 16 18:37:55.763473 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 945/1970] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:55.772564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:55.773500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:55.783496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.784292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.788403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.789960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.930957 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.network.security_group_api [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Adding security group 7e8c0aed-5afa-45fa-a357-9c90755194ab to port 020cf015-0cf4-4d3e-be29-6245fb5fc6c3 Jun 16 18:37:56.098749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:56.109365 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a00c7791-c9a8-41e2-a42d-d938cb84a3a7 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.344569 Jun 16 18:37:56.110301 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 946/1971] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:55 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:56.116707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:56.117330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:56.121993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.127617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.128026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.129103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.129738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.235251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:56.249538 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9133db5-1ee3-4bb2-9243-2fc00a48a3a6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1279 microversion: 2.1 time: 0.137323 Jun 16 18:37:56.253809 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 947/1972] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:56 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1279 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:56.295161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:56.297386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:56.312533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.313268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.314554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.315303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.552483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:56.570661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0eb83daa-59ad-4cde-8ab8-33080d5d25d9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1309 microversion: 2.1 time: 0.280376 Jun 16 18:37:56.574318 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 948/1973] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:56 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:56.669035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:56.669700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:56.683297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6430eb5d-733e-4cd0-b745-1870b50ea7b3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5/action" status: 202 len: 0 microversion: 2.1 time: 1.037951 Jun 16 18:37:56.685773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1026/1974] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:55 2022] POST /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:56.694413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.694801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.695679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.696198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.700216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-56cb3ad1-85b0-42af-8d9c-3b7aa0c486d9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:56.707781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-56cb3ad1-85b0-42af-8d9c-3b7aa0c486d9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:56.740815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.742395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56cb3ad1-85b0-42af-8d9c-3b7aa0c486d9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.742847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56cb3ad1-85b0-42af-8d9c-3b7aa0c486d9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.746030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56cb3ad1-85b0-42af-8d9c-3b7aa0c486d9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.746485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56cb3ad1-85b0-42af-8d9c-3b7aa0c486d9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.927479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:56.936723 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5485b8bf-0b02-4f7a-bf1f-8e22faa9bbee tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1478 microversion: 2.1 time: 0.277020 Jun 16 18:37:56.941630 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 949/1975] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:56 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1478 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:56.952172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:56.969043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:56.980261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.980996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:56.982037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:56.982659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.047900 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-56cb3ad1-85b0-42af-8d9c-3b7aa0c486d9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.356811 Jun 16 18:37:57.048636 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1027/1976] 10.222.0.27 () {58 vars in 1292 bytes} [Thu Jun 16 18:37:56 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5/os-security-groups => generated 1158 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:57.065110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-951ed24f-3559-43c4-b052-84a640684419 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f8677f6f040>, body: {"security_group": {"name": " tempest-securitygroup -1637381506 ", "description": "tempest-description-265256702"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:57.190142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:57.206293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:57.212019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:57.213839 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-84bd07b2-c6ab-46ef-8364-9203f6561d97 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.265649 Jun 16 18:37:57.216479 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 950/1977] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:56 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:57.226588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:57.229563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:57.245218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.245997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.247229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.247917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.412593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-951ed24f-3559-43c4-b052-84a640684419 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.352347 Jun 16 18:37:57.413783 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1028/1978] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:37:57 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:57.420387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:57.422434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:57.430778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.431495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.432532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.433214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.469847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:57.478625 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-199153ea-e613-4c51-9831-4c3ea533a82d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.260208 Jun 16 18:37:57.479858 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 951/1979] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:57 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:57.484809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-29480157-51ad-4468-a619-5a69f23c2fa5 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f1d7790>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:57.521675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:57.530885 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d368770a-b0d6-4a99-8c75-f3264075799f tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1327 microversion: 2.1 time: 0.115233 Jun 16 18:37:57.531402 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1029/1980] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:57 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:57.560945 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-29480157-51ad-4468-a619-5a69f23c2fa5 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97" status: 200 len: 223 microversion: 2.1 time: 0.079700 Jun 16 18:37:57.561563 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 952/1981] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:37:57 2022] GET /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97 => generated 223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:57.573241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ff38d16c-ee38-44ca-894e-efa87d6c4f17 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f8677f6f550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:57.589283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:57.589936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:57.596485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.597437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.598065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.598787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.829103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:57.844096 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0558eac6-a449-4b8a-b145-9435748ca7c8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1309 microversion: 2.1 time: 0.257833 Jun 16 18:37:57.848357 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 953/1982] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:57 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1309 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:57.874983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-50e24440-7a26-4229-91a8-2771a8a7d81d req-4de3a508-366f-416f-90dc-d053afa0d962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5", "tag": "020cf015-0cf4-4d3e-be29-6245fb5fc6c3"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:57.887311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ff38d16c-ee38-44ca-894e-efa87d6c4f17 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97" status: 202 len: 0 microversion: 2.1 time: 0.317723 Jun 16 18:37:57.888091 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1030/1983] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:37:57 2022] DELETE /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:37:57.897793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45dd1084-6556-47e1-879d-3115722f5af9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f8677f87550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:57.898638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-50e24440-7a26-4229-91a8-2771a8a7d81d req-4de3a508-366f-416f-90dc-d053afa0d962 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.899092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-50e24440-7a26-4229-91a8-2771a8a7d81d req-4de3a508-366f-416f-90dc-d053afa0d962 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.920107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-50e24440-7a26-4229-91a8-2771a8a7d81d req-4de3a508-366f-416f-90dc-d053afa0d962 service nova] Creating event network-changed:020cf015-0cf4-4d3e-be29-6245fb5fc6c3 for instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 on n-h2-846209-2 Jun 16 18:37:57.925998 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-50e24440-7a26-4229-91a8-2771a8a7d81d req-4de3a508-366f-416f-90dc-d053afa0d962 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075031 Jun 16 18:37:57.927045 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 954/1984] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:57.935537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-45dd1084-6556-47e1-879d-3115722f5af9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:37:57.936828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-45dd1084-6556-47e1-879d-3115722f5af9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 161f46e0-75c1-45e3-b73e-581795045a97 not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:37:57.937881 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-45dd1084-6556-47e1-879d-3115722f5af9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:37:57.937881 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-2b3164ac-a912-4a61-b73e-75a57ec5acf4'] Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45dd1084-6556-47e1-879d-3115722f5af9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97 HTTP/1.1 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-2b3164ac-a912-4a61-b73e-75a57ec5acf4'] Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '161f46e0-75c1-45e3-b73e-581795045a97'} Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:37:57.951388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b3164ac-a912-4a61-b73e-75a57ec5acf4'] Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b3164ac-a912-4a61-b73e-75a57ec5acf4'] Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b3164ac-a912-4a61-b73e-75a57ec5acf4'] Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b3164ac-a912-4a61-b73e-75a57ec5acf4'] Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45dd1084-6556-47e1-879d-3115722f5af9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-2b3164ac-a912-4a61-b73e-75a57ec5acf4'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-45dd1084-6556-47e1-879d-3115722f5af9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97" status: 404 len: 194 microversion: 2.1 time: 0.059835 Jun 16 18:37:57.956975 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1031/1985] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:37:57 2022] GET /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:37:57.963637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:57.964081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:57.969861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9304e42e-6874-442f-83de-7dbf102c0bbe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f866e5133a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1791979046", "description": "tempest-description-1314686783"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:57.971916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.972382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.973287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:57.974585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:57.999688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.178093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:58.189788 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-862a447c-45df-4d40-9e39-2d22e64990c5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1478 microversion: 2.1 time: 0.231526 Jun 16 18:37:58.190654 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 955/1986] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:57 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1478 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:58.217231 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9304e42e-6874-442f-83de-7dbf102c0bbe tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.251457 Jun 16 18:37:58.219252 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1032/1987] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:37:57 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:58.239031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a710abf-0ecc-4be1-8c9c-6b9ae532a233 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f866f2b7700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-960008888", "description": "tempest-description-274130794"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:58.245709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:58.246360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:58.258857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:58.259419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:58.260485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:58.261326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:58.550020 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a710abf-0ecc-4be1-8c9c-6b9ae532a233 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.320233 Jun 16 18:37:58.556590 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 956/1988] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:37:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:58.557159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:58.558125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:58.575656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:58.585895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:58.587552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:58.588603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:58.589058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:58.590010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:58.590519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:58.595951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc7fe32c-91d0-4599-9179-c0557cf6e8c9 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.364524 Jun 16 18:37:58.597086 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1033/1989] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:58 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:37:58.610362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:58.610973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:58.622672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:58.623101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:58.627383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:58.628394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:58.764756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:58.780995 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9278c23f-068b-4cc5-8bf3-f1611f19cfec tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1345 microversion: 2.1 time: 0.182637 Jun 16 18:37:58.793717 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1034/1990] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:58 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:58.800663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a9fbbc2-5e37-46f6-bb20-0cf1e336276e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f866e535700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-748772949", "description": "tempest-description-964332378"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:58.921672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:58.939737 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2c8c1a02-6f2b-4bad-b385-bb52dcaa7beb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.386159 Jun 16 18:37:58.950859 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 957/1991] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:58 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:58.950859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1b3dfaff-d0f4-4b76-ab74-cb7135515543 req-70239d9d-12c0-40be-b872-bbcc494260f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9541c-3218-401f-b314-dc00a192ec98", "name": "network-vif-unplugged", "status": "completed", "tag": "18afa003-668c-46ac-8cb1-4db3a3c6c075"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:59.003015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1b3dfaff-d0f4-4b76-ab74-cb7135515543 req-70239d9d-12c0-40be-b872-bbcc494260f8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:59.010733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1b3dfaff-d0f4-4b76-ab74-cb7135515543 req-70239d9d-12c0-40be-b872-bbcc494260f8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:59.042660 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1b3dfaff-d0f4-4b76-ab74-cb7135515543 req-70239d9d-12c0-40be-b872-bbcc494260f8 service nova] Creating event network-vif-unplugged:18afa003-668c-46ac-8cb1-4db3a3c6c075 for instance 0ec9541c-3218-401f-b314-dc00a192ec98 on n-h2-846209-2 Jun 16 18:37:59.057269 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1b3dfaff-d0f4-4b76-ab74-cb7135515543 req-70239d9d-12c0-40be-b872-bbcc494260f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112933 Jun 16 18:37:59.058393 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 958/1992] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:59.071820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:59.073794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:59.084368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:59.084919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:59.085746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:59.086198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:59.154658 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a9fbbc2-5e37-46f6-bb20-0cf1e336276e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.368937 Jun 16 18:37:59.155896 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1035/1993] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:37:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:59.162767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:59.163593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:59.175836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:59.177433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:59.179071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:59.180295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:59.805787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:59.817121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-157091a5-7203-4d70-b9b0-2d40e97419f5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1489 microversion: 2.1 time: 0.756734 Jun 16 18:37:59.820746 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 959/1994] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:59 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1489 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:59.835050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8d87cb1-095c-4dfc-ac2d-c49317d02890 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f1d75e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.033189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.044340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.046194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.047597 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7260d0e0-38ff-40bc-a534-e08ed50fcd78 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 2949 microversion: 2.32 time: 0.890140 Jun 16 18:38:00.058465 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1036/1995] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:37:59 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 2949 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:00.070477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.071166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.078144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.078602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.079565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.079958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.226121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8d87cb1-095c-4dfc-ac2d-c49317d02890 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.397899 Jun 16 18:38:00.227075 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 960/1996] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:37:59 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:00.234872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.235825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.244968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.245194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.245999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.246597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.409265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.450700 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eacb10ff-40d9-4124-aed0-e22a31631769 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1464 microversion: 2.1 time: 0.381174 Jun 16 18:38:00.452473 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1037/1997] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:00 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1464 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:00.464279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.465757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.483670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.485276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.487224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.488296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.591403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.606889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.613230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.615228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-15d37f6b-0876-4a1a-9039-24cf67fdf248 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.386173 Jun 16 18:38:00.615863 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 961/1998] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:00 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:00.625458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c3e9841-5257-4283-b2cc-94f8e57cda60 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:00.627398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c3e9841-5257-4283-b2cc-94f8e57cda60 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.638353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3e9841-5257-4283-b2cc-94f8e57cda60 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.639211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3e9841-5257-4283-b2cc-94f8e57cda60 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.640459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3e9841-5257-4283-b2cc-94f8e57cda60 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.641138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c3e9841-5257-4283-b2cc-94f8e57cda60 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.828066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:00.845263 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c3e9841-5257-4283-b2cc-94f8e57cda60 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "PUT /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1084 microversion: 2.1 time: 0.224759 Jun 16 18:38:00.846345 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 962/1999] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:38:00 2022] PUT /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1084 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:00.860636 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b23cf9d-c19d-40b3-8291-6b6df778381e tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1400 microversion: 2.1 time: 0.405638 Jun 16 18:38:00.870954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.870954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.871477 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1038/2000] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:00 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1400 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:00.877325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-79fd5ce2-84d1-4d8c-9389-1fabe69d7233 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.877325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-79fd5ce2-84d1-4d8c-9389-1fabe69d7233 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.890118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fd5ce2-84d1-4d8c-9389-1fabe69d7233 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.892338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fd5ce2-84d1-4d8c-9389-1fabe69d7233 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.893586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fd5ce2-84d1-4d8c-9389-1fabe69d7233 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.894241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79fd5ce2-84d1-4d8c-9389-1fabe69d7233 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.899908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.901261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.902335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.903216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.233714 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-79fd5ce2-84d1-4d8c-9389-1fabe69d7233 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.364137 Jun 16 18:38:01.234923 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1039/2001] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:38:00 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295/os-interface => generated 1828 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:01.240376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b88f4b29-1e3d-437f-ae3c-096b575bb647 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866e535280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:01.316024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:01.328401 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-768278e1-3787-46f3-8790-50b04364022b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.473469 Jun 16 18:38:01.329000 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 963/2002] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:00 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:01.335461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:01.336533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:01.345603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.346535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.349006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.350004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.620751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:01.631512 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a5a8239-d281-445a-ab17-6d9120c3792e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1464 microversion: 2.1 time: 0.301224 Jun 16 18:38:01.631750 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b88f4b29-1e3d-437f-ae3c-096b575bb647 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb" status: 202 len: 0 microversion: 2.1 time: 0.394753 Jun 16 18:38:01.633201 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1040/2003] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:01 2022] DELETE /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:01.633676 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 964/2004] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:01 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1464 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:01.639194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:01.641358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:01.642377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-088cfc4f-e365-4d6d-b906-1fe6c4159709 req-2312d1e3-688f-4806-a310-f459bcae656b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9541c-3218-401f-b314-dc00a192ec98", "name": "network-vif-plugged", "status": "completed", "tag": "18afa003-668c-46ac-8cb1-4db3a3c6c075"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:01.656970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-088cfc4f-e365-4d6d-b906-1fe6c4159709 req-2312d1e3-688f-4806-a310-f459bcae656b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.657309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.657605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-088cfc4f-e365-4d6d-b906-1fe6c4159709 req-2312d1e3-688f-4806-a310-f459bcae656b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.658772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.660579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.666835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.678449 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-088cfc4f-e365-4d6d-b906-1fe6c4159709 req-2312d1e3-688f-4806-a310-f459bcae656b service nova] Creating event network-vif-plugged:18afa003-668c-46ac-8cb1-4db3a3c6c075 for instance 0ec9541c-3218-401f-b314-dc00a192ec98 on n-h2-846209-2 Jun 16 18:38:01.689970 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-088cfc4f-e365-4d6d-b906-1fe6c4159709 req-2312d1e3-688f-4806-a310-f459bcae656b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054058 Jun 16 18:38:01.691245 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 965/2005] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:01.697328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb3dde3a-bf44-4c32-a615-893d78176cd8 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f5d6310>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:01.807136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-eb3dde3a-bf44-4c32-a615-893d78176cd8 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:01.810897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-eb3dde3a-bf44-4c32-a615-893d78176cd8 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:01.812739 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-eb3dde3a-bf44-4c32-a615-893d78176cd8 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:01.812739 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-87e80f9c-690b-44ca-ba94-1551143c11e4'] Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb3dde3a-bf44-4c32-a615-893d78176cd8 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb HTTP/1.1 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: exception: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-87e80f9c-690b-44ca-ba94-1551143c11e4'] Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '610f8dcd-d193-42e3-a0b1-dbe38e408ffb'} Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:01.831502 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87e80f9c-690b-44ca-ba94-1551143c11e4'] Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87e80f9c-690b-44ca-ba94-1551143c11e4'] Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87e80f9c-690b-44ca-ba94-1551143c11e4'] Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87e80f9c-690b-44ca-ba94-1551143c11e4'] Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb3dde3a-bf44-4c32-a615-893d78176cd8 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:01.840248 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-87e80f9c-690b-44ca-ba94-1551143c11e4'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:01.848117 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eb3dde3a-bf44-4c32-a615-893d78176cd8 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb" status: 404 len: 194 microversion: 2.1 time: 0.145398 Jun 16 18:38:01.848117 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 966/2006] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:38:01 2022] GET /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:01.867712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:01.868931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:01.884163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.885481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.887348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.888388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.919237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:01.932732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b7b545ae-130c-4100-a5f3-f6da45bf4ac5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1510 microversion: 2.1 time: 0.297519 Jun 16 18:38:01.933350 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1041/2007] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:01 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:01.939632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:01.941692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:01.952464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.953083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.954439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:01.955441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.065248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:38:02.066376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:38:02.067155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:38:02.068316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:38:02.068964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:38:02.115206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:02.126160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:02.127774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:02.129047 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a5f4389b-f2d6-431a-a74a-ecb0aa8878e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.278137 Jun 16 18:38:02.130534 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 967/2008] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:01 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:02.136298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9c0371c3-25ed-4271-8022-a5dc1cdc9624 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f867418c040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:02.170172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:02.183388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.184543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.186053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.187174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.259061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14e274be-aa44-40e0-ad43-856d7741d967 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action" status: 202 len: 1068 microversion: 2.1 time: 0.324275 Jun 16 18:38:02.260090 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1042/2009] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:38:01 2022] POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action => generated 1068 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 16 18:38:02.264977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:02.265601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:02.274260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.274716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.275756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.276392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.547398 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9c0371c3-25ed-4271-8022-a5dc1cdc9624 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe" status: 202 len: 0 microversion: 2.1 time: 0.415479 Jun 16 18:38:02.551350 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 968/2010] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:02 2022] DELETE /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:02.562318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:02.578876 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69d93887-ac5b-41d5-b628-70dd4adedff3 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1400 microversion: 2.1 time: 0.317202 Jun 16 18:38:02.580436 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1043/2011] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:02 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1400 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:02.587524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-dff44d76-b02a-4c35-b5fb-1b2c1670ffca req-5e30b8b7-cea7-4998-8e74-214f5914c6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd3683c-d609-4a28-ad33-3d6223b2ea3f", "tag": "060bc235-92c1-46cd-b174-7dc186de42e1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:02.600581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:02.605589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dff44d76-b02a-4c35-b5fb-1b2c1670ffca req-5e30b8b7-cea7-4998-8e74-214f5914c6b0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.607336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:02.609677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dff44d76-b02a-4c35-b5fb-1b2c1670ffca req-5e30b8b7-cea7-4998-8e74-214f5914c6b0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.622206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.622845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.624002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.624608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.645271 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-dff44d76-b02a-4c35-b5fb-1b2c1670ffca req-5e30b8b7-cea7-4998-8e74-214f5914c6b0 service nova] Creating event network-changed:060bc235-92c1-46cd-b174-7dc186de42e1 for instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f on n-h2-846209-2 Jun 16 18:38:02.671532 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-dff44d76-b02a-4c35-b5fb-1b2c1670ffca req-5e30b8b7-cea7-4998-8e74-214f5914c6b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088746 Jun 16 18:38:02.673088 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1044/2012] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:02.684011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:02.685684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:02.695617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.696854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.698618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.699667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.950555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:02.960800 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a671cf7c-50b4-4b3e-bd7f-78d15ffe8bcc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1510 microversion: 2.1 time: 0.403657 Jun 16 18:38:02.961473 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 969/2013] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:02 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:02.969977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:02.971100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:02.994080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.995078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.996508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.997572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.377247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:03.387020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:03.392723 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1324dfb5-9c55-451f-99a3-c934deae5ce1 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.429440 Jun 16 18:38:03.393338 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 970/2014] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:02 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:03.398889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-86cd3846-d185-4bc2-8ba4-bd534600e0b2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.723124 Jun 16 18:38:03.408182 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1045/2015] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:02 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:03.408540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-68faeb07-7935-414a-b9c8-0bf39639a2fa tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f2e40d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:03.408723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:03.408723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:03.421888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.422450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.423218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.423678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.446821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-68faeb07-7935-414a-b9c8-0bf39639a2fa tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:03.447551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-68faeb07-7935-414a-b9c8-0bf39639a2fa tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 7e531238-bfe4-476b-be19-0177a9eeedbe not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:03.448980 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-68faeb07-7935-414a-b9c8-0bf39639a2fa tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:03.448980 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-ce3c015f-c712-4c43-be73-92a3a124b341'] Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-68faeb07-7935-414a-b9c8-0bf39639a2fa tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe HTTP/1.1 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: exception: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-ce3c015f-c712-4c43-be73-92a3a124b341'] Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '7e531238-bfe4-476b-be19-0177a9eeedbe'} Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:03.452552 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce3c015f-c712-4c43-be73-92a3a124b341'] Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce3c015f-c712-4c43-be73-92a3a124b341'] Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce3c015f-c712-4c43-be73-92a3a124b341'] Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce3c015f-c712-4c43-be73-92a3a124b341'] Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-68faeb07-7935-414a-b9c8-0bf39639a2fa tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-ce3c015f-c712-4c43-be73-92a3a124b341'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-68faeb07-7935-414a-b9c8-0bf39639a2fa tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe" status: 404 len: 194 microversion: 2.1 time: 0.060343 Jun 16 18:38:03.460593 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 971/2016] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:38:03 2022] GET /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:03.470413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:03.470413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:03.477658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:03.478015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.478691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.480137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.480915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.541848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.635734 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a25f3776-1768-46ba-ac43-d0293b929c9c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 204 len: 0 microversion: 2.1 time: 0.233322 Jun 16 18:38:03.636996 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1046/2017] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:03 2022] DELETE /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:03.645146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52506ee5-ee84-4179-b668-5b9be6556c3d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866e4ce5e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:03.746842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:03.758022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:03.760329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:03.761705 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9b1d68b-9077-488d-9dc0-c6708c05979d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.304278 Jun 16 18:38:03.762349 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 972/2018] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:03 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:03.769313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:03.769985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:03.780893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.781655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.784044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.784044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.045176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:04.056126 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a32b7116-0797-48e3-a90f-075a7d313acd tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1400 microversion: 2.1 time: 0.292442 Jun 16 18:38:04.057113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 973/2019] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:03 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1400 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:04.062555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:04.063184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:04.071611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.072072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.072938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.073584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.082728 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-52506ee5-ee84-4179-b668-5b9be6556c3d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d" status: 202 len: 0 microversion: 2.1 time: 0.444681 Jun 16 18:38:04.085331 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1047/2020] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:03 2022] DELETE /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:04.095155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7111e4b-71fb-4931-8baf-2ad43af2bbd4 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f8677fef940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:04.158360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-b7111e4b-71fb-4931-8baf-2ad43af2bbd4 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:04.158966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-b7111e4b-71fb-4931-8baf-2ad43af2bbd4 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:04.159500 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-b7111e4b-71fb-4931-8baf-2ad43af2bbd4 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:04.159500 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-75203f70-97c0-4cc2-af2e-a48b1743a9ca'] Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7111e4b-71fb-4931-8baf-2ad43af2bbd4 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d HTTP/1.1 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-75203f70-97c0-4cc2-af2e-a48b1743a9ca'] Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '4bfe5e3b-8260-4796-bb08-6ca82dd2a00d'} Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:04.171937 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75203f70-97c0-4cc2-af2e-a48b1743a9ca'] Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75203f70-97c0-4cc2-af2e-a48b1743a9ca'] Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75203f70-97c0-4cc2-af2e-a48b1743a9ca'] Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75203f70-97c0-4cc2-af2e-a48b1743a9ca'] Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7111e4b-71fb-4931-8baf-2ad43af2bbd4 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-75203f70-97c0-4cc2-af2e-a48b1743a9ca'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b7111e4b-71fb-4931-8baf-2ad43af2bbd4 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d" status: 404 len: 194 microversion: 2.1 time: 0.082798 Jun 16 18:38:04.184592 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1048/2021] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:38:04 2022] GET /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:04.231706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ada2256-defe-4270-bdcd-8caeff8dced0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866e4ce280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:04.309270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=16 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.337707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.403617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:04.439583 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e72b1013-2282-4949-b728-6e6ccd9a8739 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1516 microversion: 2.1 time: 0.380759 Jun 16 18:38:04.445044 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 974/2022] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:04 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1516 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:04.461669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:04.463241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:04.482759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.483923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.485632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.486556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.653757 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ada2256-defe-4270-bdcd-8caeff8dced0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.466335 Jun 16 18:38:04.654660 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1049/2023] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:38:04 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:04.662993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:04.665467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:04.675999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.676643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.678055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.678787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.831335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.872693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:04.889391 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d5dd19f0-a4fd-47d4-a5fb-6dc4d9eb10cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.441983 Jun 16 18:38:04.891041 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 975/2024] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:04 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:04.912925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-841e9c93-49c1-4e67-b376-471e3d626c36 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f866f26a550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1700417469", "description": "tempest-description-1763220431"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:05.023974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:05.041765 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d7aa2959-5c0b-47f5-baa7-510639907eb4 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.385119 Jun 16 18:38:05.043934 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1050/2025] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:04 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:05.074197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:05.075541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:05.088369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.089459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.090429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.091087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.241382 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-841e9c93-49c1-4e67-b376-471e3d626c36 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.348171 Jun 16 18:38:05.243546 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 976/2026] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:38:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:05.266860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:05.267806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:05.278926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.279453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.280320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.280945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.325400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:05.336816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:05.338630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:05.339927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c005bec-36ca-4e61-863f-7ea80d3e3976 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.294208 Jun 16 18:38:05.340519 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1051/2027] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:05 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:05.346072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-595e8b47-f404-4fa5-9ab0-dd865b7c7303 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f86781674c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1369396130", "description": "tempest-description-697292620"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:05.535710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:05.552722 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e13ee4d7-7c77-44d3-bd2a-7f676c803d0d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1400 microversion: 2.1 time: 0.306983 Jun 16 18:38:05.553440 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 977/2028] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:05 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1400 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:05.558623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:05.559473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:05.566736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.567198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.569236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.572204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.737939 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-595e8b47-f404-4fa5-9ab0-dd865b7c7303 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.395939 Jun 16 18:38:05.741209 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1052/2029] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:38:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:05.847197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:05.852369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.853359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-158361054", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "ed42c0a2-d429-4e3f-b196-bb39340e5518"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:05.863517 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a4119e7-8828-49a9-a53b-dca4adaa187e tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1516 microversion: 2.1 time: 0.308474 Jun 16 18:38:05.887329 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 978/2030] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:05 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:05.916976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:05.919069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:05.946594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] validate_networks() for [('ed42c0a2-d429-4e3f-b196-bb39340e5518', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:38:05.977171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.977635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.978482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.979008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:06.410453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:06.421668 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-15c0953e-625d-422a-aa92-f360a779327a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.510001 Jun 16 18:38:06.422487 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 979/2031] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:05 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:06.429460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:06.430387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:06.438092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:06.438974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:06.439927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:06.440547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:06.865532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:06.879340 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37f672fa-201d-4ddf-b07a-0b08008ec5dd tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.455407 Jun 16 18:38:06.879942 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 980/2032] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:06 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:06.899049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:06.902356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:06.921253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:06.921984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:06.922992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:06.923586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:07.035462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:38:07.037547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:38:07.038500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:38:07.039497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:38:07.040188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:38:07.066240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:07.067113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:07.069571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:07.070456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:07.145627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Getting quotas for project 6b1d785ba63d406a82b75393e89230de. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:38:07.156018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Getting quotas for user fc290259c264400aad950993f0a1d9d9 and project 6b1d785ba63d406a82b75393e89230de. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:38:07.193723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:38:07.196078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:38:07.294294 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3bbd6b1-f283-445c-8513-370cdd0ed7c1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444580 Jun 16 18:38:07.297961 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1053/2033] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:38:07.325008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:07.325935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:07.335388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:07.336028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:07.336987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:07.337829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:07.338505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:07.350284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:07.353325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:07.355007 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-781f0473-3701-4bdf-9024-a4b3e48da587 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.468038 Jun 16 18:38:07.356786 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 981/2034] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:06 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:07.362733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:07.363689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:07.405482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:07.409206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:07.413057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:07.414889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:07.882166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:07.891397 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-60048ec7-2964-4eee-ab69-1fd1ce10a433 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1516 microversion: 2.1 time: 0.533123 Jun 16 18:38:07.892620 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 982/2035] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:07 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1516 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:07.899086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85fb2b18-8a6b-45f5-8774-0b2d13864ad3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:07.900460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-85fb2b18-8a6b-45f5-8774-0b2d13864ad3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:08.012772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-85fb2b18-8a6b-45f5-8774-0b2d13864ad3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:08.023297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-85fb2b18-8a6b-45f5-8774-0b2d13864ad3 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1215 microversion: 2.1 time: 0.128840 Jun 16 18:38:08.035796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 983/2036] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:07 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:08.042181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:08.043084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:08.043653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:08.056029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.056645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:08.057700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.058334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:08.072675 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3513de2-f708-4daa-96b6-201f18dac7bc tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1400 microversion: 2.1 time: 0.758094 Jun 16 18:38:08.075808 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1054/2037] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:07 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1400 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:08.090482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:08.092365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:08.113569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.116791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:08.119306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.120714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:08.746864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:08.764099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:08.766248 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3e2643fb-d1dc-46d0-a143-1cb7c50a3012 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.685752 Jun 16 18:38:08.775362 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b4481e60-5615-4554-92c1-e47d0e561707 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.737944 Jun 16 18:38:08.783912 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1055/2038] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:08 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:08.788027 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 984/2039] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:08 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:08.794980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-add9061a-e1e1-4dfa-b12a-c0204c8030c5 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8312bb2-fdfa-437f-8ac6-09b4550ca7fc"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:08.796627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-add9061a-e1e1-4dfa-b12a-c0204c8030c5 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:08.797125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:08.799708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:08.810174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-add9061a-e1e1-4dfa-b12a-c0204c8030c5 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.811603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-add9061a-e1e1-4dfa-b12a-c0204c8030c5 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:08.814737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-add9061a-e1e1-4dfa-b12a-c0204c8030c5 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.821091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.822110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-add9061a-e1e1-4dfa-b12a-c0204c8030c5 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:08.824428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:08.825471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:08.828435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.169947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:09.185858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:09.188652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:09.190629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9f2c407-399e-4c67-800a-731b584c846e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.405160 Jun 16 18:38:09.191887 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1056/2040] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:08 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:09.197334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-03721796-1983-4ead-bd0b-37e759f72d0f req-3a44fbe4-839f-4a73-b495-66a66c344695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12755d5c-a24e-48ce-a3d1-a2f062d2a29f", "name": "network-vif-deleted", "tag": "918a6bc1-39cb-4c6a-9673-a8920c2cca51"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:09.209989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-03721796-1983-4ead-bd0b-37e759f72d0f req-3a44fbe4-839f-4a73-b495-66a66c344695 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.210938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-03721796-1983-4ead-bd0b-37e759f72d0f req-3a44fbe4-839f-4a73-b495-66a66c344695 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.256440 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-03721796-1983-4ead-bd0b-37e759f72d0f req-3a44fbe4-839f-4a73-b495-66a66c344695 service nova] Creating event network-vif-deleted:918a6bc1-39cb-4c6a-9673-a8920c2cca51 for instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f on n-h2-846209-2 Jun 16 18:38:09.279280 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-03721796-1983-4ead-bd0b-37e759f72d0f req-3a44fbe4-839f-4a73-b495-66a66c344695 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079427 Jun 16 18:38:09.280345 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1057/2041] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:09.291702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fb65e28c-083e-448a-b82e-5ea30c128402 req-5ee6461c-dc09-4557-9747-28146a96470a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a153bd-218b-41ee-9610-3994098b06f0", "name": "network-vif-unplugged", "status": "completed", "tag": "8515cd67-37fa-4c99-b944-46c6ffdd74a9"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:09.312294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb65e28c-083e-448a-b82e-5ea30c128402 req-5ee6461c-dc09-4557-9747-28146a96470a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.312861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb65e28c-083e-448a-b82e-5ea30c128402 req-5ee6461c-dc09-4557-9747-28146a96470a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.341358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fb65e28c-083e-448a-b82e-5ea30c128402 req-5ee6461c-dc09-4557-9747-28146a96470a service nova] Creating event network-vif-unplugged:8515cd67-37fa-4c99-b944-46c6ffdd74a9 for instance 70a153bd-218b-41ee-9610-3994098b06f0 on n-h1-846209-2 Jun 16 18:38:09.380689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fb65e28c-083e-448a-b82e-5ea30c128402 req-5ee6461c-dc09-4557-9747-28146a96470a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079302 Jun 16 18:38:09.382597 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1058/2042] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:09.397341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:09.400292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:09.415533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.417483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.419782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.420921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.519472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.521552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.522877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lazy-loading 'fault' on Instance uuid 12755d5c-a24e-48ce-a3d1-a2f062d2a29f {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:09.551465 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-add9061a-e1e1-4dfa-b12a-c0204c8030c5 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "POST /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761688 Jun 16 18:38:09.555296 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 985/2043] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:38:08 2022] POST /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:09.594582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:09.604333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:09.635844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.637198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.639740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.640603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.654294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:09.668058 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e88a7a5-0a00-45b9-9c26-7092fb2dd8e1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 200 len: 1320 microversion: 2.1 time: 0.282988 Jun 16 18:38:09.668668 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1059/2044] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:09 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:09.687116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:09.687116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:09.716455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.717114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.718756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.719238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:09.919516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:09.937576 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6838e894-947c-4806-9b66-e884726e6eed tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1275 microversion: 2.1 time: 0.380005 Jun 16 18:38:09.939425 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 986/2045] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:09 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1275 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:09.948347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ab48de52-6726-4810-8a9d-8b69d9d565f3 req-b5324002-4c56-4ec5-8eb3-5d7b78930cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd3683c-d609-4a28-ad33-3d6223b2ea3f", "name": "network-vif-plugged", "status": "completed", "tag": "060bc235-92c1-46cd-b174-7dc186de42e1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:09.968095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ab48de52-6726-4810-8a9d-8b69d9d565f3 req-b5324002-4c56-4ec5-8eb3-5d7b78930cab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:09.969524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ab48de52-6726-4810-8a9d-8b69d9d565f3 req-b5324002-4c56-4ec5-8eb3-5d7b78930cab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.012139 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ab48de52-6726-4810-8a9d-8b69d9d565f3 req-b5324002-4c56-4ec5-8eb3-5d7b78930cab service nova] Creating event network-vif-plugged:060bc235-92c1-46cd-b174-7dc186de42e1 for instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f on n-h2-846209-2 Jun 16 18:38:10.019033 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ab48de52-6726-4810-8a9d-8b69d9d565f3 req-b5324002-4c56-4ec5-8eb3-5d7b78930cab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077374 Jun 16 18:38:10.062423 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 987/2046] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:10.093481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:10.108647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:10.148740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.151331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.153424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.154508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.231843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:10.249045 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31bb40f8-fb3e-4f15-a8a2-46d5eb69ccbe tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1400 microversion: 2.1 time: 0.578075 Jun 16 18:38:10.250362 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1060/2047] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:09 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1400 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:10.261055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:10.268694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:10.298830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.299974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.303170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.304338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.576838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:10.595532 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3ddb4a2d-742f-4087-b013-773d4e8cab52 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.530220 Jun 16 18:38:10.597952 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 988/2048] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:10 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:10.613237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:10.616791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:10.636662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.638438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.639751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.642258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.666395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:10.686169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5fa03658-df71-40eb-b840-8b154d79af01 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.431895 Jun 16 18:38:10.687167 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1061/2049] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:10 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:10.701635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:10.703054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:10.740254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.742228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.747356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:10.750632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:10.820670 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f HTTP/1.1 Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '12755d5c-a24e-48ce-a3d1-a2f062d2a29f'} Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:10.825754 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:10.830338 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:10.830338 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:10.830338 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:10.830338 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:10.830338 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:38:10.830338 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:10.833083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:10.836210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a6fcc594-8764-4ce7-95f1-3e79ced8f256 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 404 len: 111 microversion: 2.1 time: 0.140976 Jun 16 18:38:10.838690 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1062/2050] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:10 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:10.924070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1277011373", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "06a9a0f4-e2e7-4b09-9d3d-fea8950fac70"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:11.038631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] validate_networks() for [('06a9a0f4-e2e7-4b09-9d3d-fea8950fac70', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:38:11.086181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:11.112814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:11.120086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:11.126372 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa0a4e2b-8c95-4752-8ed0-f8c685bf7611 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.523658 Jun 16 18:38:11.129738 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 989/2051] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:10 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:11.147155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:11.148285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:11.170744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.171221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.178926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.179440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.313075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:11.341005 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ab29924-2f56-4d64-b1a3-8ce416d942af tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1273 microversion: 2.1 time: 0.208304 Jun 16 18:38:11.352369 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 990/2052] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:11 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:11.356046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:11.358647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:11.371494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.371971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.373687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.374209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.698307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:11.711259 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4bab4d57-667a-4898-b1a0-2931c676994d tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1400 microversion: 2.1 time: 0.366583 Jun 16 18:38:11.711872 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 991/2053] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:11 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1400 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:11.736394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0b8dbb08-1251-436a-b89b-ab5189145cb4 req-6a885aff-ddb2-4549-b683-09096ba749fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a153bd-218b-41ee-9610-3994098b06f0", "tag": "8515cd67-37fa-4c99-b944-46c6ffdd74a9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:11.764801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0b8dbb08-1251-436a-b89b-ab5189145cb4 req-6a885aff-ddb2-4549-b683-09096ba749fc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.765578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0b8dbb08-1251-436a-b89b-ab5189145cb4 req-6a885aff-ddb2-4549-b683-09096ba749fc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.772737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:38:11.773344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:38:11.773773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:38:11.774464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:38:11.774897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:38:11.791883 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0b8dbb08-1251-436a-b89b-ab5189145cb4 req-6a885aff-ddb2-4549-b683-09096ba749fc service nova] Creating event network-changed:8515cd67-37fa-4c99-b944-46c6ffdd74a9 for instance 70a153bd-218b-41ee-9610-3994098b06f0 on n-h1-846209-2 Jun 16 18:38:11.798138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.798607 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0b8dbb08-1251-436a-b89b-ab5189145cb4 req-6a885aff-ddb2-4549-b683-09096ba749fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075898 Jun 16 18:38:11.798829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.799566 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 992/2054] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:11.800813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.801733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.806651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:11.807444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:11.816939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.817953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.818884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:11.819351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:11.840151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:38:11.877570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Getting quotas for user 344b166b0b2f4af8b2c5db81eb5a658b and project 64f23c5552fe4c869ccd2f1145571f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:38:11.901460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:38:11.904727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:38:12.062344 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1f4841b6-94a2-4d4a-8877-9ba9dea93f86 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144404 Jun 16 18:38:12.064018 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1063/2055] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:38:12.077552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:12.079338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:12.094777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:12.108891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:12.112341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:12.115193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:12.820965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:12.837591 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a5cc2f9-a524-4590-8c42-1d032a32669a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 1.034818 Jun 16 18:38:12.842036 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 993/2056] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:11 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:12.852981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37c05614-df8a-4050-97f7-062de076d4d2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:12.853226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-37c05614-df8a-4050-97f7-062de076d4d2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:12.928198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:12.947599 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2b38e19-f0ab-4a3a-a837-e9efdf1bf33d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.878068 Jun 16 18:38:12.949979 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1064/2057] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:12 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:12.965587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:12.968436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:12.992001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:12.995180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.002445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.004488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.040520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-37c05614-df8a-4050-97f7-062de076d4d2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:13.047695 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37c05614-df8a-4050-97f7-062de076d4d2 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1209 microversion: 2.1 time: 0.204238 Jun 16 18:38:13.051148 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 994/2058] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:12 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1209 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:13.070939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:13.072200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:13.102200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.106683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.108478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.109128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.497839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:13.509777 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-23a2ed0a-0d87-413c-8758-75e6a8361503 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1315 microversion: 2.1 time: 0.455883 Jun 16 18:38:13.510424 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 995/2059] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:13 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:13.519332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:13.519960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:13.536473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.537474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.538789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:13.538990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.539595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.560742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:13.562907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:13.564782 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae0ff0b8-3d8e-4d24-a281-86825b6bcba5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.613369 Jun 16 18:38:13.565425 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1065/2060] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:12 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:13.864251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:13.867642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:13.872086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:13.878006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.878721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.880626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.881532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.888838 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e57d3be9-de98-4a39-b204-c030b706c7ae tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1587 microversion: 2.1 time: 0.373476 Jun 16 18:38:13.889765 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 996/2061] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:13 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1587 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:13.908406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0198422c-b89d-432d-8482-6a3b00fcb28a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:13.910149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0198422c-b89d-432d-8482-6a3b00fcb28a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:13.918806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0198422c-b89d-432d-8482-6a3b00fcb28a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.919886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0198422c-b89d-432d-8482-6a3b00fcb28a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.921053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0198422c-b89d-432d-8482-6a3b00fcb28a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.921792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0198422c-b89d-432d-8482-6a3b00fcb28a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.948760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.172601 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0198422c-b89d-432d-8482-6a3b00fcb28a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.269460 Jun 16 18:38:14.173623 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 997/2062] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:38:13 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:38:14.185555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:14.189366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:14.205852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.206849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.207942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.210365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.501883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:14.519046 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-767e5b3e-f164-45bd-9c8c-3c0835dc0ed9 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.663066 Jun 16 18:38:14.519364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1066/2063] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:13 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:14.531018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:14.531526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:14.534878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.556113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.556580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.557396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.557846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.751244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:14.765839 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-03ebc590-e00b-4ec7-9e4e-cb42d3f412ab tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1267 microversion: 2.1 time: 0.245111 Jun 16 18:38:14.773111 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1067/2064] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:14 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:14.786861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6038ec6a-f79b-4991-9e26-6f0fdd1a8e35 req-6a0d92a0-f1f0-49ed-ba3d-36977bb425f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4daffb6-108f-4637-bcc8-4d1c2e3062c7", "tag": "f8deac03-cc5b-4eb0-96cb-e769c6017c1c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:14.815112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6038ec6a-f79b-4991-9e26-6f0fdd1a8e35 req-6a0d92a0-f1f0-49ed-ba3d-36977bb425f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.817132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:14.820096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6038ec6a-f79b-4991-9e26-6f0fdd1a8e35 req-6a0d92a0-f1f0-49ed-ba3d-36977bb425f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.869354 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6038ec6a-f79b-4991-9e26-6f0fdd1a8e35 req-6a0d92a0-f1f0-49ed-ba3d-36977bb425f7 service nova] Creating event network-changed:f8deac03-cc5b-4eb0-96cb-e769c6017c1c for instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 on n-h1-846209-2 Jun 16 18:38:14.869757 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f0178be-72e7-42d8-a31e-4833d76dacd2 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.694335 Jun 16 18:38:14.882742 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6038ec6a-f79b-4991-9e26-6f0fdd1a8e35 req-6a0d92a0-f1f0-49ed-ba3d-36977bb425f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107431 Jun 16 18:38:14.884079 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1068/2065] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:14.888914 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 998/2066] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:14 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:14.897111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:14.898058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:14.899414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:14.905691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:14.907769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.908403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.911210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.914511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.924056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.927005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.929671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:14.933141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:15.350602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:15.372639 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8198416a-40a6-4398-8b79-f602d8a81e24 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1315 microversion: 2.1 time: 0.486366 Jun 16 18:38:15.383752 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1069/2067] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:14 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:15.538197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:15.539591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:15.562940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:15.563726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:15.564746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:15.566783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:15.568888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:15.597075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:15.604073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:15.607695 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a51b9171-24ff-492e-835c-86d06b030d64 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.715491 Jun 16 18:38:15.621757 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 999/2068] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:14 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:15.654421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.793563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:15.794110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:15.813713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:15.815843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:15.818977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:15.819416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:16.534524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:16.547577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:16.553699 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f37a1cae-1934-484b-b89f-b8a1989e6056 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1309 microversion: 2.1 time: 0.763710 Jun 16 18:38:16.556460 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1000/2069] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:15 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1309 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:16.572368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:16.573519 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3f480bc7-6663-4b76-9a40-2d6e7d7ce09a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 1.039715 Jun 16 18:38:16.575047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:16.587895 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1070/2070] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:15 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:16.593275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:16.595860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:16.597365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:16.597846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:16.603066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:16.606890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:16.632415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:16.633186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:16.647414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:16.648277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:17.783607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:17.797989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:17.811688 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ef38c39-ae33-4332-9184-7b424bf7f2c0 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1315 microversion: 2.1 time: 1.222419 Jun 16 18:38:17.813377 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f5b24df-b44a-4b71-a72e-dca891c1ab91 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 1.255611 Jun 16 18:38:17.815590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1071/2071] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:16 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1315 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:17.816607 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1001/2072] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:16 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:17.823427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:17.824312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:17.836548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6690f0a1-2460-4c21-a9c0-82c9484902cc req-c8d3ab16-580b-4b3e-b487-45f9d35add2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a153bd-218b-41ee-9610-3994098b06f0", "name": "network-vif-unplugged", "status": "completed", "tag": "8515cd67-37fa-4c99-b944-46c6ffdd74a9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:17.845681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:17.847763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.850096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:17.851914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:17.852825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:17.858490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6690f0a1-2460-4c21-a9c0-82c9484902cc req-c8d3ab16-580b-4b3e-b487-45f9d35add2a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:17.859044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6690f0a1-2460-4c21-a9c0-82c9484902cc req-c8d3ab16-580b-4b3e-b487-45f9d35add2a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:17.892657 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6690f0a1-2460-4c21-a9c0-82c9484902cc req-c8d3ab16-580b-4b3e-b487-45f9d35add2a service nova] Creating event network-vif-unplugged:8515cd67-37fa-4c99-b944-46c6ffdd74a9 for instance 70a153bd-218b-41ee-9610-3994098b06f0 on n-h1-846209-2 Jun 16 18:38:17.909276 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6690f0a1-2460-4c21-a9c0-82c9484902cc req-c8d3ab16-580b-4b3e-b487-45f9d35add2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089614 Jun 16 18:38:17.910776 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1002/2073] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:17.923123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-95092dce-41c4-4b3e-a260-9ca8769c27ec req-e8e65125-0035-4802-95fc-df798b97fa6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9316215-b4d6-4a88-a489-58555121da3a", "tag": "78eaf1ec-7d79-4a41-a03d-3b5afdab1839"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:17.940537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-95092dce-41c4-4b3e-a260-9ca8769c27ec req-e8e65125-0035-4802-95fc-df798b97fa6b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:17.941431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-95092dce-41c4-4b3e-a260-9ca8769c27ec req-e8e65125-0035-4802-95fc-df798b97fa6b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:17.967543 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-95092dce-41c4-4b3e-a260-9ca8769c27ec req-e8e65125-0035-4802-95fc-df798b97fa6b service nova] Creating event network-changed:78eaf1ec-7d79-4a41-a03d-3b5afdab1839 for instance c9316215-b4d6-4a88-a489-58555121da3a on n-h2-846209-2 Jun 16 18:38:17.976621 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-95092dce-41c4-4b3e-a260-9ca8769c27ec req-e8e65125-0035-4802-95fc-df798b97fa6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060987 Jun 16 18:38:17.977935 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1003/2074] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:17.988900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:17.991580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:18.000156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:18.000676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.001582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:18.002194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.321812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:18.347596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:18.350480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:18.351728 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b9e4d6e-f626-4b92-852b-1f2cdd3a4e62 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.532372 Jun 16 18:38:18.352484 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1072/2075] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:17 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:18.361670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:18.362579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:18.376458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:18.377599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.379663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:18.382565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.446539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:18.463547 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f09a840b-5736-476b-802b-d7b063995a0d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1309 microversion: 2.1 time: 0.483568 Jun 16 18:38:18.465730 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1004/2076] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:17 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1309 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:18.483190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:18.483881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:18.501928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:18.502376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.503317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:18.505515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.903109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:18.916538 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36b60698-2652-4c50-8006-8a38bb3cd737 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.562698 Jun 16 18:38:18.918209 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1073/2077] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:18 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:18.924475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9e937e3f-e5b9-4cc7-af0f-25a8d20e47a0 req-acaa4d86-778c-44db-b84d-c4054d6a04fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd3683c-d609-4a28-ad33-3d6223b2ea3f", "tag": "060bc235-92c1-46cd-b174-7dc186de42e1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:18.952079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9e937e3f-e5b9-4cc7-af0f-25a8d20e47a0 req-acaa4d86-778c-44db-b84d-c4054d6a04fc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:18.952886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9e937e3f-e5b9-4cc7-af0f-25a8d20e47a0 req-acaa4d86-778c-44db-b84d-c4054d6a04fc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.988654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9e937e3f-e5b9-4cc7-af0f-25a8d20e47a0 req-acaa4d86-778c-44db-b84d-c4054d6a04fc service nova] Creating event network-changed:060bc235-92c1-46cd-b174-7dc186de42e1 for instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f on n-h2-846209-2 Jun 16 18:38:18.995227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:19.007155 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3876dd07-1484-41bc-98b4-474535525723 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1587 microversion: 2.1 time: 0.536483 Jun 16 18:38:19.008141 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1005/2078] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:18 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1587 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:19.013998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:19.014773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:19.023222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.023947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.024778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.025305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.032541 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9e937e3f-e5b9-4cc7-af0f-25a8d20e47a0 req-acaa4d86-778c-44db-b84d-c4054d6a04fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108196 Jun 16 18:38:19.033868 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1074/2079] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:19.047427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:19.051087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:19.074034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.076560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.077647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.079189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.497211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:19.515419 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e4d0d88-cb3f-4b79-973e-0400941f6855 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.505305 Jun 16 18:38:19.526672 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1006/2080] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:19 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:19.532617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:19.535734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:19.543969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.544651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.545827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.558910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.754448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:19.772006 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc4834e8-e8a0-4a41-950e-6230b2799efd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1315 microversion: 2.1 time: 0.732880 Jun 16 18:38:19.773236 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1075/2081] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:19 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:19.798772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:19.798772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:19.820258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.820871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.824656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.826286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.984235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:20.006087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:20.012647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:20.017421 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-777be855-73e8-41e2-a21b-8a76ab441dc8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.487820 Jun 16 18:38:20.020834 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1007/2082] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:19 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:20.028385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:20.029717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:20.054961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.056285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.058323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.059898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.126299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:20.135588 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c913ec09-6fa7-404a-954f-0e54bf6432dd tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1309 microversion: 2.1 time: 0.360765 Jun 16 18:38:20.148592 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1076/2083] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:19 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:20.506076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:20.519145 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-148a851f-9d2e-42e2-84c6-98f332ad8fae tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.496296 Jun 16 18:38:20.519825 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1008/2084] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:20 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:20.538682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:20.539506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:20.551607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.552526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.554516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.556149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.792588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:20.793886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:20.807330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.808139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.810278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.813043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.883132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:20.897019 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8210b403-0400-444f-aadb-35feaa7995bb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1393 microversion: 2.1 time: 0.362380 Jun 16 18:38:20.901608 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1077/2085] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:20 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1393 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:21.037423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:21.038113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:21.057788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.058298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.059203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.059660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.104901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:21.138304 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b914056b-9342-4912-af1d-4b8874da37fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1315 microversion: 2.1 time: 0.350940 Jun 16 18:38:21.140714 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1009/2086] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:20 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:21.169404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:21.170259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:21.182791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.184283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.186564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.187497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.334911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:21.347342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:21.351656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:21.352786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88eb9c15-21e2-4394-9094-22de3810e9a8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.320057 Jun 16 18:38:21.355095 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1078/2087] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:21 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:38:21.376129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f65c5a27-87a5-4a52-b4c2-371fcb925281 req-9a4ef7f7-c91e-4265-b8ee-da8ab3243bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4daffb6-108f-4637-bcc8-4d1c2e3062c7", "name": "network-vif-plugged", "status": "completed", "tag": "f8deac03-cc5b-4eb0-96cb-e769c6017c1c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:21.404536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f65c5a27-87a5-4a52-b4c2-371fcb925281 req-9a4ef7f7-c91e-4265-b8ee-da8ab3243bda service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.405068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f65c5a27-87a5-4a52-b4c2-371fcb925281 req-9a4ef7f7-c91e-4265-b8ee-da8ab3243bda service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.433605 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f65c5a27-87a5-4a52-b4c2-371fcb925281 req-9a4ef7f7-c91e-4265-b8ee-da8ab3243bda service nova] Creating event network-vif-plugged:f8deac03-cc5b-4eb0-96cb-e769c6017c1c for instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 on n-h1-846209-2 Jun 16 18:38:21.451939 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f65c5a27-87a5-4a52-b4c2-371fcb925281 req-9a4ef7f7-c91e-4265-b8ee-da8ab3243bda service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094686 Jun 16 18:38:21.453421 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1079/2088] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:21.462914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:21.472119 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83b0a347-03a0-4472-b37b-a8a5d6ec3ba3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1309 microversion: 2.1 time: 0.314554 Jun 16 18:38:21.495004 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1010/2089] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:21 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:21.541205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:21.542181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:21.549550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.550163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.550960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.551587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.736658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:21.751743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3aad780d-38d4-497e-aaad-6626286eecc8 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.214921 Jun 16 18:38:21.753036 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1080/2090] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:21 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:21.918719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:21.919428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:21.928612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.929073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.930254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.930895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.104622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:22.116405 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b0807d3b-09f8-4e65-b952-58c2c38ace98 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1383 microversion: 2.1 time: 0.201990 Jun 16 18:38:22.117046 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1011/2091] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:21 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1383 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:22.134087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a6d130d1-eed2-4bd6-b916-930d2568685d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '.version_select at 0x7f866e51c9d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.137103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6d130d1-eed2-4bd6-b916-930d2568685d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.137813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6d130d1-eed2-4bd6-b916-930d2568685d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.139983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.140740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.155880 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a6d130d1-eed2-4bd6-b916-930d2568685d tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3086 microversion: 2.1 time: 0.025759 Jun 16 18:38:22.156604 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1081/2092] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/os-migrations => generated 3086 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:22.157514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.158177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.165145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.165605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.166423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.167064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.170919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7aa2588b-051b-40ae-aa60-92d9fab4ac88 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.171534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7aa2588b-051b-40ae-aa60-92d9fab4ac88 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.179150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7aa2588b-051b-40ae-aa60-92d9fab4ac88 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.179615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7aa2588b-051b-40ae-aa60-92d9fab4ac88 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.180431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7aa2588b-051b-40ae-aa60-92d9fab4ac88 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.181353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7aa2588b-051b-40ae-aa60-92d9fab4ac88 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.418810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:22.428401 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-863b38af-91bc-466b-bea6-8dfcf9c7ab44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1315 microversion: 2.1 time: 0.274027 Jun 16 18:38:22.440948 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1012/2093] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:22.441135 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7aa2588b-051b-40ae-aa60-92d9fab4ac88 tempest-LiveMigrationTest-408499342 tempest-LiveMigrationTest-408499342-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1534 microversion: 2.1 time: 0.263256 Jun 16 18:38:22.441135 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1082/2094] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1534 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:22.447773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.448400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.457198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.458511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.459476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.460111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.470509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.471017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.478955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.479414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.480284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.480757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.510973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:22.617818 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8fb0b6d4-3955-41fb-a2de-87131eca6649 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "DELETE /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 204 len: 0 microversion: 2.1 time: 0.151075 Jun 16 18:38:22.619165 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1083/2095] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:22 2022] DELETE /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:22.626696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.627434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.635691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.636168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.636964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.637580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.663255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:22.673282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:22.674975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:22.676173 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4804a71c-51e9-4bcc-b6e5-1aa82e41811e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.245591 Jun 16 18:38:22.677301 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1013/2096] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:22.682941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.683686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.692079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.693257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.694385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.694893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.920703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:22.932981 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cdab5249-71f4-4053-a725-7ca720f40e93 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1309 microversion: 2.1 time: 0.312676 Jun 16 18:38:22.937009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:22.937768 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1084/2097] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:22.950514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.951380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.955651 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a248076-d174-4f57-88a4-0a503006b760 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1389 microversion: 2.1 time: 0.277035 Jun 16 18:38:22.960472 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1014/2098] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1389 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:22.964244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.965285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.966331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.966893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.142622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:23.152260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5164140b-1515-4f93-84f6-14075b120edf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.213449 Jun 16 18:38:23.152869 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1085/2099] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:23.455918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:23.456668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:23.459216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.466271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:23.466731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.467665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:23.468102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.493748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6522d150-0d0b-4bc4-8a22-4584d55fc15b req-270c144a-91a8-4394-a973-81e4a0b6d037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9316215-b4d6-4a88-a489-58555121da3a", "name": "network-vif-plugged", "status": "completed", "tag": "78eaf1ec-7d79-4a41-a03d-3b5afdab1839"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:23.508205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6522d150-0d0b-4bc4-8a22-4584d55fc15b req-270c144a-91a8-4394-a973-81e4a0b6d037 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:23.509076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6522d150-0d0b-4bc4-8a22-4584d55fc15b req-270c144a-91a8-4394-a973-81e4a0b6d037 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.531472 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6522d150-0d0b-4bc4-8a22-4584d55fc15b req-270c144a-91a8-4394-a973-81e4a0b6d037 service nova] Creating event network-vif-plugged:78eaf1ec-7d79-4a41-a03d-3b5afdab1839 for instance c9316215-b4d6-4a88-a489-58555121da3a on n-h2-846209-2 Jun 16 18:38:23.543908 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6522d150-0d0b-4bc4-8a22-4584d55fc15b req-270c144a-91a8-4394-a973-81e4a0b6d037 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054036 Jun 16 18:38:23.555870 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1086/2100] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:23.702736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:23.703607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:23.718558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:23.719864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.722661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:23.725721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.745778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:23.750423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.761107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-efcf4e53-24ac-450c-87ef-dc20911ba77d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1315 microversion: 2.1 time: 0.309822 Jun 16 18:38:23.773282 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1015/2101] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:23 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:23.967162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:23.968310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:23.969203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:23.977767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:23.978654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.979398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:23.980291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:23.983188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:23.985075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:23.988017 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b3abb26-34e4-4939-8935-20806d0a3496 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.293499 Jun 16 18:38:24.000493 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1087/2102] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:23 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:24.007334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:24.008197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:24.015106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.015863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.016920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.017686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.022229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.124644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:24.154756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f84a9847-4534-4d94-b60f-6d31884ca666 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1347 microversion: 2.1 time: 0.152740 Jun 16 18:38:24.155870 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1088/2103] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:24 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1347 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:24.161667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e345e2d5-88af-48e3-9ab1-03e9f008fe69 req-f2a2016a-e1de-4c00-af5c-bd80fbd2fa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a153bd-218b-41ee-9610-3994098b06f0", "name": "network-vif-deleted", "tag": "8515cd67-37fa-4c99-b944-46c6ffdd74a9"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:24.176510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e345e2d5-88af-48e3-9ab1-03e9f008fe69 req-f2a2016a-e1de-4c00-af5c-bd80fbd2fa1f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.177686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e345e2d5-88af-48e3-9ab1-03e9f008fe69 req-f2a2016a-e1de-4c00-af5c-bd80fbd2fa1f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.193501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e345e2d5-88af-48e3-9ab1-03e9f008fe69 req-f2a2016a-e1de-4c00-af5c-bd80fbd2fa1f service nova] Creating event network-vif-deleted:8515cd67-37fa-4c99-b944-46c6ffdd74a9 for instance 70a153bd-218b-41ee-9610-3994098b06f0 on n-h2-846209-2 Jun 16 18:38:24.199152 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e345e2d5-88af-48e3-9ab1-03e9f008fe69 req-f2a2016a-e1de-4c00-af5c-bd80fbd2fa1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041662 Jun 16 18:38:24.200071 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1089/2104] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:24.207088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:24.208146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:24.220777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:24.224844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.225318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.226169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.227667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.234845 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1cd0b5e1-134d-4529-8f3f-412160f75ee5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1309 microversion: 2.1 time: 0.272337 Jun 16 18:38:24.245539 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1016/2105] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:23 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:24.419270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:24.430722 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef39b618-bdf9-4b2f-908e-264536a83c5c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.228882 Jun 16 18:38:24.440865 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1090/2106] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:24 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:24.781684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:24.782758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:24.790999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.791710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.792631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.793055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.965078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:24.973360 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97e67bd3-be07-4c79-9e6d-e68f5425a39d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1502 microversion: 2.1 time: 0.196679 Jun 16 18:38:24.974803 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1017/2107] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:24 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:24.994804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1700417469"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:24.995943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:25.008019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.008487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.009881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.010396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.010887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:25.011771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:25.020587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.022973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.024449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.025126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.261395 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.network.security_group_api [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Adding security group 19435e57-678d-4ab9-af33-3f14dbfec70b to port f8deac03-cc5b-4eb0-96cb-e769c6017c1c Jun 16 18:38:25.267509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:25.282767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:25.300042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:25.305214 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-65b4d596-4ed6-493d-b5a1-dea81a9b4a54 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.298630 Jun 16 18:38:25.307041 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1018/2108] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:25 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:38:25.326417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:25.328048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:25.338524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.340934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.343635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.352810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.744631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:25.769624 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3ed24d77-ce36-4805-9ed9-c61deb6d229a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1184 microversion: 2.1 time: 0.459399 Jun 16 18:38:25.770335 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1019/2109] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:25 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1184 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:25.776117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:25.776738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:25.785283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.785892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.787063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.787501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.197899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:26.211655 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-933b1679-a0e9-4f9f-a3fc-c932b1ff2185 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1490 microversion: 2.1 time: 0.438910 Jun 16 18:38:26.212835 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1020/2110] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:25 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1490 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:26.222356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:26.223274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:26.233708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.234596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.236438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.237430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.323897 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-49561131-ff86-452e-b718-a52aa6a069dd tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7/action" status: 202 len: 0 microversion: 2.1 time: 1.335796 Jun 16 18:38:26.334437 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1091/2111] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:38:24 2022] POST /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7/action => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:26.399705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3a49b0fb-ee0f-4340-88d1-e1c2f02ea483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1630361234"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:26.403553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3a49b0fb-ee0f-4340-88d1-e1c2f02ea483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:26.429639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a49b0fb-ee0f-4340-88d1-e1c2f02ea483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.430340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a49b0fb-ee0f-4340-88d1-e1c2f02ea483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.431204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a49b0fb-ee0f-4340-88d1-e1c2f02ea483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.431647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a49b0fb-ee0f-4340-88d1-e1c2f02ea483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.542783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:26.566843 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-877bec43-0206-42ca-b92c-d8ba61161f79 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.351850 Jun 16 18:38:26.569129 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1021/2112] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:26 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:26.592961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:26.594727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:26.619297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.619582 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3a49b0fb-ee0f-4340-88d1-e1c2f02ea483 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "PUT /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1075 microversion: 2.1 time: 0.281930 Jun 16 18:38:26.620061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.621396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.622214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.630525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1092/2113] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:38:26 2022] PUT /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1075 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:26.642569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55fa760a-7f2d-49a9-9c37-a7887045f65b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866ea548b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:26.852816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-55fa760a-7f2d-49a9-9c37-a7887045f65b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use.", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:26.853810 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-55fa760a-7f2d-49a9-9c37-a7887045f65b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use. Jun 16 18:38:26.853810 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-fc1a47c5-f68b-428a-b3c8-1324ab7cd5db'] Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55fa760a-7f2d-49a9-9c37-a7887045f65b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b HTTP/1.1 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: exception: Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use. Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-fc1a47c5-f68b-428a-b3c8-1324ab7cd5db'] Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '19435e57-678d-4ab9-af33-3f14dbfec70b'} Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:26.856144 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use. Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1a47c5-f68b-428a-b3c8-1324ab7cd5db'] Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use. Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1a47c5-f68b-428a-b3c8-1324ab7cd5db'] Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use. Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1a47c5-f68b-428a-b3c8-1324ab7cd5db'] Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use. Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc1a47c5-f68b-428a-b3c8-1324ab7cd5db'] Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55fa760a-7f2d-49a9-9c37-a7887045f65b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 400 to user: Security Group 19435e57-678d-4ab9-af33-3f14dbfec70b in use. Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-fc1a47c5-f68b-428a-b3c8-1324ab7cd5db'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55fa760a-7f2d-49a9-9c37-a7887045f65b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b" status: 400 len: 185 microversion: 2.1 time: 0.225258 Jun 16 18:38:26.862855 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1093/2114] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:26 2022] DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b => generated 185 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:38:26.873324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7e40b6a6-8b83-44e2-8b56-374418492b1a req-5b98d6b1-e7cf-47db-a28b-75acde48e576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4daffb6-108f-4637-bcc8-4d1c2e3062c7", "tag": "f8deac03-cc5b-4eb0-96cb-e769c6017c1c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:26.888567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7e40b6a6-8b83-44e2-8b56-374418492b1a req-5b98d6b1-e7cf-47db-a28b-75acde48e576 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.889308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7e40b6a6-8b83-44e2-8b56-374418492b1a req-5b98d6b1-e7cf-47db-a28b-75acde48e576 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.903240 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7e40b6a6-8b83-44e2-8b56-374418492b1a req-5b98d6b1-e7cf-47db-a28b-75acde48e576 service nova] Creating event network-changed:f8deac03-cc5b-4eb0-96cb-e769c6017c1c for instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 on n-h1-846209-2 Jun 16 18:38:26.912227 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7e40b6a6-8b83-44e2-8b56-374418492b1a req-5b98d6b1-e7cf-47db-a28b-75acde48e576 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046087 Jun 16 18:38:26.913137 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1094/2115] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:26.917227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:26.927593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:26.927906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:26.930110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:26.930728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:26.932019 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ee7206db-95cb-4df1-8fdd-4ca760c5a8a2 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.361492 Jun 16 18:38:26.943562 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1022/2116] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:26 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:26.943562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:26.943562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:26.950826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.951724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.952288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.952857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.953049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.953645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:26.953857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:26.954386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.071137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:27.083981 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca8db6ce-e4fe-49b1-94c5-c701511abe15 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1184 microversion: 2.1 time: 0.149200 Jun 16 18:38:27.088015 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1023/2117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:26 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1184 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:27.100230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e49674c3-0e5b-49ce-8e18-87862502db15 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:27.102315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e49674c3-0e5b-49ce-8e18-87862502db15 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:27.113856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e49674c3-0e5b-49ce-8e18-87862502db15 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.117565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e49674c3-0e5b-49ce-8e18-87862502db15 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.120670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e49674c3-0e5b-49ce-8e18-87862502db15 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.122369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e49674c3-0e5b-49ce-8e18-87862502db15 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.180576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:27.192435 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2abdde6b-52f1-4e6a-a28e-4d8331b9240c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1501 microversion: 2.1 time: 0.277841 Jun 16 18:38:27.194774 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1095/2118] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:26 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1501 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:27.237139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:27.237847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:27.256691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.257256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.258162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.258624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.327429 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e49674c3-0e5b-49ce-8e18-87862502db15 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7/action" status: 202 len: 0 microversion: 2.1 time: 0.236258 Jun 16 18:38:27.328308 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1024/2119] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:38:27 2022] POST /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:27.340469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:27.341478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:27.353476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.354016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.354876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.355710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.547551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:27.558194 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-47b6cb7a-727f-4145-a12c-d55f687083fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1501 microversion: 2.1 time: 0.350786 Jun 16 18:38:27.559400 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1096/2120] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:27 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1501 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:27.576711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55288a39-40cc-454a-b16b-ea58842c3550 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:27.586529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55288a39-40cc-454a-b16b-ea58842c3550 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.587291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55288a39-40cc-454a-b16b-ea58842c3550 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.617990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-55288a39-40cc-454a-b16b-ea58842c3550 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Going to try to stop instance {{(pid=119206) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:38:27.652573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:27.661668 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cc2165be-b5a5-4305-9ed7-8c9c8f648289 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1573 microversion: 2.1 time: 0.327897 Jun 16 18:38:27.662834 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1025/2121] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:27 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1573 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:27.676014 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55288a39-40cc-454a-b16b-ea58842c3550 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "POST /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a/action" status: 202 len: 0 microversion: 2.1 time: 0.102934 Jun 16 18:38:27.678999 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1097/2122] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:38:27 2022] POST /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:38:27.685183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:27.686478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:27.687296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:27.688023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:27.696391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.697027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.697837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.698321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.703805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.705069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.706718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.708368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.903845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:27.914575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9baa9419-9832-4cd4-a31b-f238a7bf5dba tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.231780 Jun 16 18:38:27.925489 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1098/2123] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:27 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:27.954423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:27.955927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:27.963682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.964236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.965111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.965605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.985179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:27.999412 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-77826dfa-888f-4470-94c6-9552acfc9bc1 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.334973 Jun 16 18:38:28.001212 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1026/2124] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:27 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:28.103529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:28.104421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:28.115554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:28.117004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:28.118695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:28.119312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:28.144774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:28.156324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:28.157927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:28.159174 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-923b9e3a-59e5-4698-9f83-8c7cbe8bd799 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.211838 Jun 16 18:38:28.159942 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1099/2125] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:27 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:28.221449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:28.231778 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bfd76a7e-2f9b-486f-be3c-64fb91bdb9cb tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1184 microversion: 2.1 time: 0.134424 Jun 16 18:38:28.232728 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1027/2126] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:28 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1184 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:28.682091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:28.682864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:28.690473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:28.690986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:28.692477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:28.693561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:28.857093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:28.866536 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-979cd816-1835-40ca-8a8e-6e011cc137fb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1573 microversion: 2.1 time: 0.189449 Jun 16 18:38:28.867128 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1100/2127] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:28 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:28.933303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:28.933823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:28.940562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:28.941013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:28.941777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:28.942256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.018788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:29.019586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:29.027384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.027968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.028749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.029184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.143865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:29.153859 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a625e568-6f84-4fc5-b215-7d057bf249d1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.224401 Jun 16 18:38:29.154779 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1028/2128] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:28 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:29.178272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:29.179128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:29.185548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.186038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.186880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.187319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.208429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:29.216610 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9e4c5e55-8720-471e-ba1e-4d0e6024810e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.201950 Jun 16 18:38:29.217392 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1101/2129] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:29 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:29.249608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:29.251224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:29.257944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.258396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.259170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.260244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.343660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:29.354270 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-60a5fe0d-4f19-4ade-b60e-accb1f777b7d tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 200 len: 1184 microversion: 2.1 time: 0.108324 Jun 16 18:38:29.363676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1102/2130] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:29 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 1184 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:29.367750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:29.376646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:29.378192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:29.379366 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1a22493-93e5-456a-90fe-4b4c80e5e87a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.205964 Jun 16 18:38:29.380033 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1029/2131] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:29 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:29.886034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:29.886664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:29.895084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.897262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:29.898263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:29.898859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.079371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:30.087625 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25e77640-1665-4a6b-a744-3f63b7f8426e tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1571 microversion: 2.1 time: 0.205700 Jun 16 18:38:30.088203 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1103/2132] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:29 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1571 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:30.104857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1369396130"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:30.105568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:30.113016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.113473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.114809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.115491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.173345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:30.174278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:30.182009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.182670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.183556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.184141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.282245 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.network.security_group_api [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Adding security group ac6557f8-7568-41db-b618-0d16ca0b76dd to port f8deac03-cc5b-4eb0-96cb-e769c6017c1c Jun 16 18:38:30.434569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:30.442662 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-184ef29c-54e0-4499-860a-379fe213528b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.273860 Jun 16 18:38:30.452492 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1104/2133] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:30 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:30.452492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:30.452492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:30.455903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.456365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.457150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.457592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.653380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:30.657066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.665080 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3d715e3-4b24-420d-becd-492910c5f164 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.220592 Jun 16 18:38:30.666046 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1105/2134] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:30 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:30.680421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:30.681048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 70a153bd-218b-41ee-9610-3994098b06f0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:30.688123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.688590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.689412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.689856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.710126 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] HTTP exception thrown: Instance 70a153bd-218b-41ee-9610-3994098b06f0 could not be found. Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Request method failure captured: Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 HTTP/1.1 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3agc7QBejQqVM1bWcSioM8ETzgX24ysbqgFHRgdAKWsxtmo9g4rkXbxY2Fw-GRB_jV_qHvPQDT46PsD0iDWEQYv_WBu3BM4leNp4hw0FX4tea5hFW0dupQlCMl97OJRaZaexIhuOCnvg2RL1d9mKWmNAnN4iz9TQVS78C5huK1DUCc Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d84e38d180849e98a2222aede57177d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d84e38d180849e98a2222aede57177d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveMigrationTest-623027432 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6483600a33ef407d9071cd24d84f6ee6 Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 70a153bd-218b-41ee-9610-3994098b06f0 could not be found. Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '70a153bd-218b-41ee-9610-3994098b06f0'} Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a153bd-218b-41ee-9610-3994098b06f0 could not be found. Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a153bd-218b-41ee-9610-3994098b06f0 could not be found. Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:30.713250 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:30.716737 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:30.716737 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:30.716737 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:30.716737 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:30.716737 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a153bd-218b-41ee-9610-3994098b06f0 could not be found. Jun 16 18:38:30.716737 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:30.716737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Returning 404 to user: Instance 70a153bd-218b-41ee-9610-3994098b06f0 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:30.717946 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24fd5aab-0823-45f2-a246-3230824d830b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0" status: 404 len: 111 microversion: 2.1 time: 0.040835 Jun 16 18:38:30.722522 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1106/2135] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:30 2022] GET /compute/v2.1/servers/70a153bd-218b-41ee-9610-3994098b06f0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:30.729466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:30.730114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:30.737464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.737978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.738920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:30.739931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:30.905168 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-491388e6-d2ec-4c58-bf95-51cab6067fe1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7/action" status: 202 len: 0 microversion: 2.1 time: 0.804316 Jun 16 18:38:30.905790 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1030/2136] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:38:30 2022] POST /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:30.914461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d3dff6d-e1e2-46c6-9f90-cc568710dcfb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f3785e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:31.201215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:31.212182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:31.214553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:31.215892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bac1ca83-3129-49a5-b66d-4e07ad32de4c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.490588 Jun 16 18:38:31.227093 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1107/2137] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:30 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:31.235381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-89ac6665-ec0a-4040-ad7c-46d81a15097c req-a00e99b3-36bf-4a3c-8c8b-6816630cfa26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4daffb6-108f-4637-bcc8-4d1c2e3062c7", "tag": "f8deac03-cc5b-4eb0-96cb-e769c6017c1c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:31.240205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-3d3dff6d-e1e2-46c6-9f90-cc568710dcfb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use.", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:31.241014 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-3d3dff6d-e1e2-46c6-9f90-cc568710dcfb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use. Jun 16 18:38:31.241014 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-fda3d8bd-3c78-4867-9601-07f5290cb53c'] Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d3dff6d-e1e2-46c6-9f90-cc568710dcfb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd HTTP/1.1 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: exception: Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use. Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-fda3d8bd-3c78-4867-9601-07f5290cb53c'] Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ac6557f8-7568-41db-b618-0d16ca0b76dd'} Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:31.243634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use. Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fda3d8bd-3c78-4867-9601-07f5290cb53c'] Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use. Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fda3d8bd-3c78-4867-9601-07f5290cb53c'] Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use. Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fda3d8bd-3c78-4867-9601-07f5290cb53c'] Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use. Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fda3d8bd-3c78-4867-9601-07f5290cb53c'] Jun 16 18:38:31.246730 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:31.248574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-89ac6665-ec0a-4040-ad7c-46d81a15097c req-a00e99b3-36bf-4a3c-8c8b-6816630cfa26 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.248574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-89ac6665-ec0a-4040-ad7c-46d81a15097c req-a00e99b3-36bf-4a3c-8c8b-6816630cfa26 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.250046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d3dff6d-e1e2-46c6-9f90-cc568710dcfb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 400 to user: Security Group ac6557f8-7568-41db-b618-0d16ca0b76dd in use. Jun 16 18:38:31.250046 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-fda3d8bd-3c78-4867-9601-07f5290cb53c'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:31.250932 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d3dff6d-e1e2-46c6-9f90-cc568710dcfb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd" status: 400 len: 185 microversion: 2.1 time: 0.340740 Jun 16 18:38:31.252471 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1031/2138] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:30 2022] DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd => generated 185 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:38:31.258442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d675d3fa-7cfd-473a-bddd-ad00ba95465e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:31.260449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d675d3fa-7cfd-473a-bddd-ad00ba95465e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:31.264020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-89ac6665-ec0a-4040-ad7c-46d81a15097c req-a00e99b3-36bf-4a3c-8c8b-6816630cfa26 service nova] Creating event network-changed:f8deac03-cc5b-4eb0-96cb-e769c6017c1c for instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 on n-h1-846209-2 Jun 16 18:38:31.267612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d675d3fa-7cfd-473a-bddd-ad00ba95465e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.268758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d675d3fa-7cfd-473a-bddd-ad00ba95465e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.269574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d675d3fa-7cfd-473a-bddd-ad00ba95465e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.270063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d675d3fa-7cfd-473a-bddd-ad00ba95465e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.270599 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-89ac6665-ec0a-4040-ad7c-46d81a15097c req-a00e99b3-36bf-4a3c-8c8b-6816630cfa26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041297 Jun 16 18:38:31.272370 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1108/2139] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:31.277939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:31.278644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:31.285540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.286029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.286896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.287343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.316179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:31.318480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:31.331185 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d675d3fa-7cfd-473a-bddd-ad00ba95465e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077561 Jun 16 18:38:31.343360 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1032/2140] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:38:31 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:31.348694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:31.349607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:31.360721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.363968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.365588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.366194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.445823 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-16a59bae-96a0-4d0b-8eae-eb0a7dc3a304 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 204 len: 0 microversion: 2.1 time: 0.171428 Jun 16 18:38:31.447951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1109/2141] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:31 2022] DELETE /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:31.465968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:31.465968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:31.476890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.477694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.484529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.485223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.518836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lazy-loading 'services' on Instance uuid a4f131bf-1702-4acf-b73a-2327d0c9315e {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:31.617484 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ccb0b0b3-8506-4614-96bf-7d37baec361e tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments/f8312bb2-fdfa-437f-8ac6-09b4550ca7fc" status: 202 len: 0 microversion: 2.1 time: 0.272348 Jun 16 18:38:31.618366 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1033/2142] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:38:31 2022] DELETE /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments/f8312bb2-fdfa-437f-8ac6-09b4550ca7fc => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:31.624725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:31.626625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:31.637638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.640034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.641273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.641971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.716635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:31.729147 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4d177602-475f-4e9d-b64d-84625c27997c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1646 microversion: 2.1 time: 0.274935 Jun 16 18:38:31.739257 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1110/2143] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:31 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1646 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:31.745786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:31.747227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:31.757410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.757971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.758798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:31.759777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:31.875867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:31.887073 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0699dac0-4371-454e-9718-e97e3ac3f94c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.267090 Jun 16 18:38:31.887664 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1034/2144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:31 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:31.944279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:31.952987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-daa01ecb-bd0c-4b19-ab23-7ee7a0a0e372 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.211863 Jun 16 18:38:31.959684 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1111/2145] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:31 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:32.235330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:32.236068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:32.243517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.243975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:32.244763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.245217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:32.390127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:32.399291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:32.400849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:32.402057 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35fda9b6-4f46-4387-8502-1e3e983d1a9e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.171235 Jun 16 18:38:32.402642 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1035/2146] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:32 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:32.746709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:32.747566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:32.755798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.756553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:32.757467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.758062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:32.904662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:32.905523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:32.913073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.913657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:32.914565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.915102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:32.930210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:32.938866 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6071aec9-e1fa-4d13-9406-05e573e1059a tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1646 microversion: 2.1 time: 0.196330 Jun 16 18:38:32.939705 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1112/2147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:32 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1646 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:32.970970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:32.971559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:32.974810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:32.979991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.980462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:32.981253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:32.981702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:33.118424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:33.126471 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c0e46349-7a81-40f5-88ed-d4b00bff94bb tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.225667 Jun 16 18:38:33.127583 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1036/2148] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:32 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:33.170783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:33.179632 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e20ca514-4218-4c2d-b0e0-3b8b32546899 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.212681 Jun 16 18:38:33.180233 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1113/2149] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:32 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:33.424496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:33.426213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:33.434562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:33.435233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:33.436641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:33.437453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:33.640732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:33.650222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:33.651723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:33.653064 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e82cd6f2-42f1-40bf-853a-6b36a570403b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.236305 Jun 16 18:38:33.653791 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1037/2150] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:33 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:33.957093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:33.958610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:33.975343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:33.976260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:33.977301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:33.978316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.163980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:34.165203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:34.174069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:34.175261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.176373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:34.177709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.323505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:34.334803 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0a9ffd2-c5f2-4cc3-bd3f-954e53a64287 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1646 microversion: 2.1 time: 0.381672 Jun 16 18:38:34.338168 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1114/2151] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:33 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1646 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:34.347226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:34.347866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:34.359636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:34.360099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.360895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:34.361347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.540209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:34.561590 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab35c552-2eb7-46e6-b119-d1c8b4b70e30 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.416483 Jun 16 18:38:34.571973 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1038/2152] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:34 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:34.615339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:34.624521 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-22fed494-fe41-40a6-b392-e6a775e42ab2 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1473 microversion: 2.1 time: 0.285228 Jun 16 18:38:34.626015 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1115/2153] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:34 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:34.671746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:34.672371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:34.685671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:34.686160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.686974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:34.687403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.931724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ab64a6f3-6f84-4ebc-bba0-d51dc6cc9475 req-4e81e66b-2a43-437a-914f-983beb1fedd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4daffb6-108f-4637-bcc8-4d1c2e3062c7", "name": "network-vif-deleted", "tag": "f8deac03-cc5b-4eb0-96cb-e769c6017c1c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:34.944722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ab64a6f3-6f84-4ebc-bba0-d51dc6cc9475 req-4e81e66b-2a43-437a-914f-983beb1fedd0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:34.945143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ab64a6f3-6f84-4ebc-bba0-d51dc6cc9475 req-4e81e66b-2a43-437a-914f-983beb1fedd0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:34.980373 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ab64a6f3-6f84-4ebc-bba0-d51dc6cc9475 req-4e81e66b-2a43-437a-914f-983beb1fedd0 service nova] Creating event network-vif-deleted:f8deac03-cc5b-4eb0-96cb-e769c6017c1c for instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 on n-h1-846209-2 Jun 16 18:38:34.995185 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ab64a6f3-6f84-4ebc-bba0-d51dc6cc9475 req-4e81e66b-2a43-437a-914f-983beb1fedd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066962 Jun 16 18:38:35.000651 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1116/2154] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:35.012391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:35.023272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:35.025088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:35.026520 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17352ab2-0dfb-4ed0-8d8d-9311d13dabfc tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.358787 Jun 16 18:38:35.042230 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1039/2155] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:34 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:35.352999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:35.353597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:35.360686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:35.361384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:35.362371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:35.362966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:35.405649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:35.406622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:35.407243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lazy-loading 'fault' on Instance uuid f4daffb6-108f-4637-bcc8-4d1c2e3062c7 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:35.475210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:35.485846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1cd61d7a-e039-448f-8970-1c55bda51dcc tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 200 len: 1305 microversion: 2.1 time: 0.137227 Jun 16 18:38:35.498525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1117/2156] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:35 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 1305 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:35.580537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:35.581504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:35.600312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:35.600918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:35.602936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:35.604198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:35.643802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:35.646206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:35.663035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:35.664972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:35.666465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:35.667453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:35.953219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:35.967216 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1534f5e4-3c66-414b-b5d8-3fd8d85b52fc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.390695 Jun 16 18:38:35.975497 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1040/2157] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:35 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:36.018926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:36.030654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-612c5380-71a8-44bb-8390-8d16509e2aea tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1479 microversion: 2.1 time: 0.390947 Jun 16 18:38:36.032243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1118/2158] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:35 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1479 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:36.055512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:36.056150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:36.084088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:36.084955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:36.085694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:36.086253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:36.304582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:36.317188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:36.321000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:36.322673 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cba429e7-8882-4906-abf5-1c99ca803f89 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.273395 Jun 16 18:38:36.323446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1041/2159] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:36 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:36.505400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:36.506203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:36.522995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:36.523363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:36.524204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:36.524643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:36.571908 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 HTTP/1.1 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f4daffb6-108f-4637-bcc8-4d1c2e3062c7'} Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:36.573593 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:36.578349 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-064e4656-c5d7-458c-a556-0423abaeca7d tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 404 len: 111 microversion: 2.1 time: 0.074234 Jun 16 18:38:36.578841 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1119/2160] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:36 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:36.588821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bcd0723b-fd00-4a7c-9939-5641c5decce5 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f150040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:36.887146 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bcd0723b-fd00-4a7c-9939-5641c5decce5 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b" status: 202 len: 0 microversion: 2.1 time: 0.306815 Jun 16 18:38:36.893045 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1042/2161] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:36 2022] DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:36.897631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e3443fd-2c51-4297-8383-b29fa2a0a8bb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866ea54280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:36.987168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:36.988244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:37.002415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.003075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.003957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.009214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.435717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:37.451392 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8e91bde-7c6f-4a62-bec9-17e18b7bd81c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.467846 Jun 16 18:38:37.454400 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1043/2162] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:36 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:37.462523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:37.463338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:37.464770 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e3443fd-2c51-4297-8383-b29fa2a0a8bb tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd" status: 202 len: 0 microversion: 2.1 time: 0.572204 Jun 16 18:38:37.465426 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1120/2163] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:36 2022] DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:38:37.470900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:37.471274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:37.483425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.485174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.488960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.490143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.498100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.498768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.499614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.500051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.575976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:37.774334 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-377fe95c-8b86-466f-a337-1dc107372f43 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "DELETE /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 204 len: 0 microversion: 2.1 time: 0.307137 Jun 16 18:38:37.775241 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1121/2164] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:37 2022] DELETE /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:37.781547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:37.782684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:37.791252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.792078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.793098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:37.793992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:37.814216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:37.838247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:37.848313 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2178bbe6-4bca-43f2-8774-7d22e591b62a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1479 microversion: 2.1 time: 0.392560 Jun 16 18:38:37.860381 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1044/2165] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:37 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1479 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:37.868619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53da8610-c36d-4768-bf9d-2bbd89584da9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'create', calling method: .version_select at 0x7f8677fdc820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-33057882", "description": "tempest-description-1608487381"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:38.179504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:38.194225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:38.198985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:38.203995 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34f20e37-57ba-4ee6-b881-ade7e70af481 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.427119 Jun 16 18:38:38.204681 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1122/2166] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:37 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:38.216070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:38.218574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:38.235422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:38.236226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:38.237865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:38.239335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:38.308609 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53da8610-c36d-4768-bf9d-2bbd89584da9 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.446505 Jun 16 18:38:38.309574 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1045/2167] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:38:37 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:38.329399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afda8b52-9b09-4e0b-9b10-89d366fe16bf tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Action: 'update', calling method: .version_select at 0x7f8677fdc160>, body: {"security_group": {"name": "tempest-sg-hth-1568152599", "description": "tempest-description-hth-209326064"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:38.561971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:38.579054 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2d70b0ca-c09d-4e6d-b5d7-db82465a70ad tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1548 microversion: 2.1 time: 0.370867 Jun 16 18:38:38.581294 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1123/2168] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:38 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1548 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:38.595986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:38.598595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:38.609230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:38.611342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:38.612865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:38.613895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.074300 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afda8b52-9b09-4e0b-9b10-89d366fe16bf tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/dcb01112-e01f-4728-b16a-f616ccc78bad" status: 200 len: 217 microversion: 2.1 time: 0.756717 Jun 16 18:38:39.075390 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1046/2169] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Jun 16 18:38:38 2022] PUT /compute/v2.1/os-security-groups/dcb01112-e01f-4728-b16a-f616ccc78bad => generated 217 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:39.081590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:39.082319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:39.094579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.095051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.095904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.096365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.150941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:39.159133 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9fd7ed69-58f8-46b8-8637-f292f680c3b7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.575702 Jun 16 18:38:39.159633 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1124/2170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:38 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:39.174179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f9b39d58-71ba-4a80-a760-e2e9eeca7875 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866ec21430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:39.357735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f9b39d58-71ba-4a80-a760-e2e9eeca7875 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/dcb01112-e01f-4728-b16a-f616ccc78bad" status: 200 len: 217 microversion: 2.1 time: 0.187351 Jun 16 18:38:39.375363 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1125/2171] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:38:39 2022] GET /compute/v2.1/os-security-groups/dcb01112-e01f-4728-b16a-f616ccc78bad => generated 217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:39.382595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-829393ff-5a64-4e05-a1d9-06792f9173bd req-f638e839-e8db-4125-bf9b-afc6f3b15706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9541c-3218-401f-b314-dc00a192ec98", "name": "network-vif-plugged", "status": "completed", "tag": "18afa003-668c-46ac-8cb1-4db3a3c6c075"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:39.404286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-829393ff-5a64-4e05-a1d9-06792f9173bd req-f638e839-e8db-4125-bf9b-afc6f3b15706 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.405007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-829393ff-5a64-4e05-a1d9-06792f9173bd req-f638e839-e8db-4125-bf9b-afc6f3b15706 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.409852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:39.419706 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-619ba9ca-3ecc-4c6e-a8e9-5e781128a16c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1464 microversion: 2.1 time: 0.342899 Jun 16 18:38:39.432548 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1047/2172] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:39 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:39.442032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:39.443434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:39.443632 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-829393ff-5a64-4e05-a1d9-06792f9173bd req-f638e839-e8db-4125-bf9b-afc6f3b15706 service nova] Creating event network-vif-plugged:18afa003-668c-46ac-8cb1-4db3a3c6c075 for instance 0ec9541c-3218-401f-b314-dc00a192ec98 on n-h2-846209-2 Jun 16 18:38:39.449142 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-829393ff-5a64-4e05-a1d9-06792f9173bd req-f638e839-e8db-4125-bf9b-afc6f3b15706 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071464 Jun 16 18:38:39.450535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.451217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.452737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.453674 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1126/2173] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:39.454116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.459537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4b3d586-10b8-42c2-a07e-2cd8c56b35d1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866ec21b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:39.751394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:39.765040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:39.770471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:39.773237 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c26144e9-a8f2-4031-9396-ac8e59c47732 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.339285 Jun 16 18:38:39.774408 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1048/2174] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:39 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:39.779427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9c4f86b8-915d-4791-adaf-bce4afbcd932 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:39.780732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9c4f86b8-915d-4791-adaf-bce4afbcd932 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:39.787927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c4f86b8-915d-4791-adaf-bce4afbcd932 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.788759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c4f86b8-915d-4791-adaf-bce4afbcd932 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.789707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c4f86b8-915d-4791-adaf-bce4afbcd932 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.790325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c4f86b8-915d-4791-adaf-bce4afbcd932 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.875159 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4b3d586-10b8-42c2-a07e-2cd8c56b35d1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/dcb01112-e01f-4728-b16a-f616ccc78bad" status: 202 len: 0 microversion: 2.1 time: 0.419501 Jun 16 18:38:39.876393 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1127/2175] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:39 2022] DELETE /compute/v2.1/os-security-groups/dcb01112-e01f-4728-b16a-f616ccc78bad => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:39.884357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:39.885498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:39.908084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.908637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.909797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.912443 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9c4f86b8-915d-4791-adaf-bce4afbcd932 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action" status: 202 len: 0 microversion: 2.1 time: 0.135925 Jun 16 18:38:39.913430 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1049/2176] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:38:39 2022] POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:39.916791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.918969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-72f46fe4-e898-4a41-bcae-f0322bbb23ed req-4f0026b5-0d80-4ac1-83f7-f05bafe5ba6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c0df03-5e10-4077-b47c-d7600c7800da", "name": "network-vif-deleted", "tag": "3d6de2d3-cf78-4416-a353-f4922093b46b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:39.929223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-72f46fe4-e898-4a41-bcae-f0322bbb23ed req-4f0026b5-0d80-4ac1-83f7-f05bafe5ba6d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.929708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-72f46fe4-e898-4a41-bcae-f0322bbb23ed req-4f0026b5-0d80-4ac1-83f7-f05bafe5ba6d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.945862 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-72f46fe4-e898-4a41-bcae-f0322bbb23ed req-4f0026b5-0d80-4ac1-83f7-f05bafe5ba6d service nova] Creating event network-vif-deleted:3d6de2d3-cf78-4416-a353-f4922093b46b for instance 49c0df03-5e10-4077-b47c-d7600c7800da on n-h1-846209-2 Jun 16 18:38:39.951248 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-72f46fe4-e898-4a41-bcae-f0322bbb23ed req-4f0026b5-0d80-4ac1-83f7-f05bafe5ba6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Jun 16 18:38:39.951875 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1050/2177] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:39.957890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:39.958762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:39.965549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.966454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.966582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.967484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.967591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:39.967955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:39.968484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lazy-loading 'fault' on Instance uuid 49c0df03-5e10-4077-b47c-d7600c7800da {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:39.976082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.989935 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 HTTP/1.1 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'f4daffb6-108f-4637-bcc8-4d1c2e3062c7'} Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:39.992079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00a7f8c7-36e1-426d-ab86-28adb7dca1e1 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 404 len: 111 microversion: 2.1 time: 0.040932 Jun 16 18:38:39.995423 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1051/2178] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:39 2022] DELETE /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:40.000883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.001854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.012889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.013573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.014702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.015323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.048634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:40.056530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.056862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.057550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lazy-loading 'fault' on Instance uuid 0ec9541c-3218-401f-b314-dc00a192ec98 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:40.062969 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6fa94ecd-b406-42b2-b056-9c762decbbf0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 200 len: 1324 microversion: 2.1 time: 0.184444 Jun 16 18:38:40.073900 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1128/2179] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:39 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 1324 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:40.081745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.084063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: f4daffb6-108f-4637-bcc8-4d1c2e3062c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.090848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.091506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.092427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.093029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.132151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 HTTP/1.1 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f4daffb6-108f-4637-bcc8-4d1c2e3062c7'} Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.134175 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.138332 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.138332 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.138332 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.138332 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:40.138332 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:40.138332 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. Jun 16 18:38:40.138332 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.140874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Instance f4daffb6-108f-4637-bcc8-4d1c2e3062c7 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:40.142270 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-93d7cbce-cdea-4b19-ba4f-a75d5f948e38 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7" status: 404 len: 111 microversion: 2.1 time: 0.066990 Jun 16 18:38:40.143289 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1129/2180] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:40 2022] GET /compute/v2.1/servers/f4daffb6-108f-4637-bcc8-4d1c2e3062c7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:40.157774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2810272d-ff1b-4681-9305-cd63be5c6464 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866ed804c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.198019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-2810272d-ff1b-4681-9305-cd63be5c6464 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:40.198878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-2810272d-ff1b-4681-9305-cd63be5c6464 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group ac6557f8-7568-41db-b618-0d16ca0b76dd not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:40.199482 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2810272d-ff1b-4681-9305-cd63be5c6464 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist Jun 16 18:38:40.199482 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-d7b19c2d-1193-4634-bafe-d77767d1316a'] Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2810272d-ff1b-4681-9305-cd63be5c6464 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd HTTP/1.1 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-d7b19c2d-1193-4634-bafe-d77767d1316a'] Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ac6557f8-7568-41db-b618-0d16ca0b76dd'} Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:40.202237 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7b19c2d-1193-4634-bafe-d77767d1316a'] Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7b19c2d-1193-4634-bafe-d77767d1316a'] Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7b19c2d-1193-4634-bafe-d77767d1316a'] Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7b19c2d-1193-4634-bafe-d77767d1316a'] Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2810272d-ff1b-4681-9305-cd63be5c6464 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group ac6557f8-7568-41db-b618-0d16ca0b76dd does not exist Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-d7b19c2d-1193-4634-bafe-d77767d1316a'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2810272d-ff1b-4681-9305-cd63be5c6464 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd" status: 404 len: 194 microversion: 2.1 time: 0.055080 Jun 16 18:38:40.206151 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1130/2181] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/os-security-groups/ac6557f8-7568-41db-b618-0d16ca0b76dd => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:40.217946 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-85954ab0-9dfe-4e1a-8195-b6b34e53b036 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1598 microversion: 2.1 time: 0.221673 Jun 16 18:38:40.218963 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1052/2182] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:39 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1598 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:40.224512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f853e006-7ab4-43ba-9a1b-9dadf2420e6b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f8678027d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.240869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.244329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.259428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-f853e006-7ab4-43ba-9a1b-9dadf2420e6b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:40.262902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.263720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-f853e006-7ab4-43ba-9a1b-9dadf2420e6b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 19435e57-678d-4ab9-af33-3f14dbfec70b not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:40.264388 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f853e006-7ab4-43ba-9a1b-9dadf2420e6b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist Jun 16 18:38:40.264388 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-e94ffa67-df51-4785-bc94-dbc4dacd7bbb'] Jun 16 18:38:40.264776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f853e006-7ab4-43ba-9a1b-9dadf2420e6b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b HTTP/1.1 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: exception: Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-e94ffa67-df51-4785-bc94-dbc4dacd7bbb'] Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '19435e57-678d-4ab9-af33-3f14dbfec70b'} Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:40.266615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e94ffa67-df51-4785-bc94-dbc4dacd7bbb'] Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e94ffa67-df51-4785-bc94-dbc4dacd7bbb'] Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e94ffa67-df51-4785-bc94-dbc4dacd7bbb'] Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e94ffa67-df51-4785-bc94-dbc4dacd7bbb'] Jun 16 18:38:40.270161 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.276087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.276698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.279511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f853e006-7ab4-43ba-9a1b-9dadf2420e6b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 19435e57-678d-4ab9-af33-3f14dbfec70b does not exist Jun 16 18:38:40.279511 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-e94ffa67-df51-4785-bc94-dbc4dacd7bbb'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:40.281336 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f853e006-7ab4-43ba-9a1b-9dadf2420e6b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b" status: 404 len: 194 microversion: 2.1 time: 0.061154 Jun 16 18:38:40.282466 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1053/2183] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/os-security-groups/19435e57-678d-4ab9-af33-3f14dbfec70b => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:40.288005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22639e00-b487-4c43-91f4-55b981bd631d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:40.289327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22639e00-b487-4c43-91f4-55b981bd631d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.297147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22639e00-b487-4c43-91f4-55b981bd631d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.297992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22639e00-b487-4c43-91f4-55b981bd631d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.299023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22639e00-b487-4c43-91f4-55b981bd631d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.299684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22639e00-b487-4c43-91f4-55b981bd631d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.485294 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22639e00-b487-4c43-91f4-55b981bd631d tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action" status: 202 len: 0 microversion: 2.1 time: 0.201396 Jun 16 18:38:40.486476 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1054/2184] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:38:40 2022] POST /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:40.492746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06055274-2c97-4d0f-baeb-028cad686893 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f150a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.533076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-06055274-2c97-4d0f-baeb-028cad686893 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:40.534354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-06055274-2c97-4d0f-baeb-028cad686893 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:40.537073 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-06055274-2c97-4d0f-baeb-028cad686893 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:40.537073 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-94271ae7-61e3-4fe7-9a2a-e7031af5da93'] Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06055274-2c97-4d0f-baeb-028cad686893 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d HTTP/1.1 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: exception: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-94271ae7-61e3-4fe7-9a2a-e7031af5da93'] Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '4bfe5e3b-8260-4796-bb08-6ca82dd2a00d'} Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:40.547756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94271ae7-61e3-4fe7-9a2a-e7031af5da93'] Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94271ae7-61e3-4fe7-9a2a-e7031af5da93'] Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94271ae7-61e3-4fe7-9a2a-e7031af5da93'] Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94271ae7-61e3-4fe7-9a2a-e7031af5da93'] Jun 16 18:38:40.551293 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.555140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:40.555721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06055274-2c97-4d0f-baeb-028cad686893 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 4bfe5e3b-8260-4796-bb08-6ca82dd2a00d does not exist Jun 16 18:38:40.555721 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-94271ae7-61e3-4fe7-9a2a-e7031af5da93'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:40.557614 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-06055274-2c97-4d0f-baeb-028cad686893 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d" status: 404 len: 194 microversion: 2.1 time: 0.069769 Jun 16 18:38:40.558382 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1055/2185] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/os-security-groups/4bfe5e3b-8260-4796-bb08-6ca82dd2a00d => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:40.563366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-594af11a-6692-4f8d-a73a-55321cf7ab26 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.564321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-594af11a-6692-4f8d-a73a-55321cf7ab26 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.568464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-952ea3e8-38a1-4aa8-a2fb-df9248272e18 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.361532 Jun 16 18:38:40.578551 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1131/2186] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:40 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:40.578551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d715bf3-8f2d-472f-b1c4-306dc8ab9a44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866ead95e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.585006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-594af11a-6692-4f8d-a73a-55321cf7ab26 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.585820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-594af11a-6692-4f8d-a73a-55321cf7ab26 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.586845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-594af11a-6692-4f8d-a73a-55321cf7ab26 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.587529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-594af11a-6692-4f8d-a73a-55321cf7ab26 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.600599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-0d715bf3-8f2d-472f-b1c4-306dc8ab9a44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:40.601310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-0d715bf3-8f2d-472f-b1c4-306dc8ab9a44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 7e531238-bfe4-476b-be19-0177a9eeedbe not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:40.601972 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0d715bf3-8f2d-472f-b1c4-306dc8ab9a44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:40.601972 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-72a2b385-05ea-4a61-a90c-aedac61e06cb'] Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d715bf3-8f2d-472f-b1c4-306dc8ab9a44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe HTTP/1.1 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-72a2b385-05ea-4a61-a90c-aedac61e06cb'] Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '7e531238-bfe4-476b-be19-0177a9eeedbe'} Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:40.604013 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a2b385-05ea-4a61-a90c-aedac61e06cb'] Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a2b385-05ea-4a61-a90c-aedac61e06cb'] Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a2b385-05ea-4a61-a90c-aedac61e06cb'] Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72a2b385-05ea-4a61-a90c-aedac61e06cb'] Jun 16 18:38:40.607712 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.610484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d715bf3-8f2d-472f-b1c4-306dc8ab9a44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 7e531238-bfe4-476b-be19-0177a9eeedbe does not exist Jun 16 18:38:40.610484 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-72a2b385-05ea-4a61-a90c-aedac61e06cb'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:40.611513 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d715bf3-8f2d-472f-b1c4-306dc8ab9a44 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe" status: 404 len: 194 microversion: 2.1 time: 0.040624 Jun 16 18:38:40.613299 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1132/2187] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/os-security-groups/7e531238-bfe4-476b-be19-0177a9eeedbe => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:40.623319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1358111f-b814-4f68-987f-662c8227b35f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866ebbdca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.658628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-1358111f-b814-4f68-987f-662c8227b35f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:40.659204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-1358111f-b814-4f68-987f-662c8227b35f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:40.659741 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1358111f-b814-4f68-987f-662c8227b35f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:40.659741 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-88ef94e1-ba0f-4647-aeca-551c4019bb35'] Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1358111f-b814-4f68-987f-662c8227b35f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb HTTP/1.1 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-88ef94e1-ba0f-4647-aeca-551c4019bb35'] Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '610f8dcd-d193-42e3-a0b1-dbe38e408ffb'} Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:40.662289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ef94e1-ba0f-4647-aeca-551c4019bb35'] Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ef94e1-ba0f-4647-aeca-551c4019bb35'] Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ef94e1-ba0f-4647-aeca-551c4019bb35'] Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88ef94e1-ba0f-4647-aeca-551c4019bb35'] Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1358111f-b814-4f68-987f-662c8227b35f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 610f8dcd-d193-42e3-a0b1-dbe38e408ffb does not exist Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-88ef94e1-ba0f-4647-aeca-551c4019bb35'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1358111f-b814-4f68-987f-662c8227b35f tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb" status: 404 len: 194 microversion: 2.1 time: 0.046184 Jun 16 18:38:40.665377 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1133/2188] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/os-security-groups/610f8dcd-d193-42e3-a0b1-dbe38e408ffb => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:40.675479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb6a128c-a09f-45ef-9bbf-712d644bba10 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866e4ce310>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.726789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-cb6a128c-a09f-45ef-9bbf-712d644bba10 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:38:40.727792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-cb6a128c-a09f-45ef-9bbf-712d644bba10 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Neutron security group 161f46e0-75c1-45e3-b73e-581795045a97 not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:38:40.728479 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-cb6a128c-a09f-45ef-9bbf-712d644bba10 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:38:40.728479 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-90f921cb-14f9-4f64-879c-6090325f0fba'] Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb6a128c-a09f-45ef-9bbf-712d644bba10 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97 HTTP/1.1 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-90f921cb-14f9-4f64-879c-6090325f0fba'] Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '161f46e0-75c1-45e3-b73e-581795045a97'} Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:38:40.730602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f921cb-14f9-4f64-879c-6090325f0fba'] Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f921cb-14f9-4f64-879c-6090325f0fba'] Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f921cb-14f9-4f64-879c-6090325f0fba'] Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90f921cb-14f9-4f64-879c-6090325f0fba'] Jun 16 18:38:40.734448 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:40.738919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb6a128c-a09f-45ef-9bbf-712d644bba10 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Security group 161f46e0-75c1-45e3-b73e-581795045a97 does not exist Jun 16 18:38:40.738919 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-90f921cb-14f9-4f64-879c-6090325f0fba'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:40.741789 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cb6a128c-a09f-45ef-9bbf-712d644bba10 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97" status: 404 len: 194 microversion: 2.1 time: 0.071392 Jun 16 18:38:40.743524 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1134/2189] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/os-security-groups/161f46e0-75c1-45e3-b73e-581795045a97 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:40.753538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.754368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.771655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.773562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.774421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.774866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.803834 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-594af11a-6692-4f8d-a73a-55321cf7ab26 tempest-ServersAdminTestJSON-557950164 tempest-ServersAdminTestJSON-557950164-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1615 microversion: 2.1 time: 0.244220 Jun 16 18:38:40.804412 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1056/2190] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:40 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1615 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:40.805116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:40.809572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.810378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.815970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:40.818614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.819441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.820440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.820869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.932719 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-328f695c-e972-4f06-bd46-f1667b731637 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 204 len: 0 microversion: 2.1 time: 0.182748 Jun 16 18:38:40.933318 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1135/2191] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:40.938948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:40.939539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:40.947042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.947492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.948439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:40.948879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:40.999399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:41.014543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:41.024417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:41.026387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:41.027745 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c392b7d8-a736-4030-a45b-734bb1a1f881 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.222243 Jun 16 18:38:41.028994 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1057/2192] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:40 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:41.034681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:41.035685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:41.043935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.044411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.045405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.046200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.136009 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2bdac319-2345-40fe-9afe-66912c6660b0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 204 len: 0 microversion: 2.1 time: 0.200540 Jun 16 18:38:41.137985 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1136/2193] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:40 2022] DELETE /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:41.146352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:41.148383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: 49c0df03-5e10-4077-b47c-d7600c7800da] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:41.158722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.159209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.160565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.161068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.192459 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] HTTP exception thrown: Instance 49c0df03-5e10-4077-b47c-d7600c7800da could not be found. Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Request method failure captured: Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da HTTP/1.1 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3agc7QBejQqVM1bWcSioM8ETzgX24ysbqgFHRgdAKWsxtmo9g4rkXbxY2Fw-GRB_jV_qHvPQDT46PsD0iDWEQYv_WBu3BM4leNp4hw0FX4tea5hFW0dupQlCMl97OJRaZaexIhuOCnvg2RL1d9mKWmNAnN4iz9TQVS78C5huK1DUCc Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d84e38d180849e98a2222aede57177d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d84e38d180849e98a2222aede57177d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveMigrationTest-623027432 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6483600a33ef407d9071cd24d84f6ee6 Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 49c0df03-5e10-4077-b47c-d7600c7800da could not be found. Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '49c0df03-5e10-4077-b47c-d7600c7800da'} Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c0df03-5e10-4077-b47c-d7600c7800da could not be found. Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c0df03-5e10-4077-b47c-d7600c7800da could not be found. Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:41.195271 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:41.199487 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:41.199487 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:41.199487 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:41.199487 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:41.199487 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c0df03-5e10-4077-b47c-d7600c7800da could not be found. Jun 16 18:38:41.199487 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:41.199487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Returning 404 to user: Instance 49c0df03-5e10-4077-b47c-d7600c7800da could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:41.201017 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f928e42a-c545-4c80-8855-e751719b49e0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da" status: 404 len: 111 microversion: 2.1 time: 0.061205 Jun 16 18:38:41.202163 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1137/2194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:41 2022] GET /compute/v2.1/servers/49c0df03-5e10-4077-b47c-d7600c7800da => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:41.207769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:41.210536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:41.219296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.220192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.221377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.222041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.268865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:41.282686 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-248e26d5-a840-4fd6-afc4-0d59a76d9c71 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1646 microversion: 2.1 time: 0.252134 Jun 16 18:38:41.292453 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1058/2195] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:41 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1646 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:41.292453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:41.292453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:41.297809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.298433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.299623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.300191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.344966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:41.395333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:41.405640 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dff107ef-c68c-4ae9-a12e-c6708bd2018a tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1469 microversion: 2.1 time: 0.202241 Jun 16 18:38:41.406325 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1138/2196] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:41 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:41.450507 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f486d7f-31ff-4f5e-ab00-7f72c10ca37e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 204 len: 0 microversion: 2.1 time: 0.164911 Jun 16 18:38:41.451355 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1059/2197] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:41 2022] DELETE /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:41.460025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:41.460655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:41.467431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.467889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.468681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.469121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.587303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:41.588958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:41.599713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.600763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.602241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:41.603162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:41.634812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:41.643005 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46abc8a7-c0a7-4e9a-85ed-2e61557eb1ee tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1484 microversion: 2.1 time: 0.187589 Jun 16 18:38:41.643635 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1139/2198] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:41 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1484 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:41.758461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:41.766470 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fca27c13-f700-478f-aa99-3c4a951b2393 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.184703 Jun 16 18:38:41.767064 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1060/2199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:41 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:42.049700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.050476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.075124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.075951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.076771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.077456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.221930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:42.231110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:42.232639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:42.233831 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb6244ac-64f9-4672-9c4f-ee519f501684 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.189027 Jun 16 18:38:42.234413 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1140/2200] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:42.300310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.300820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.308657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.309137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.310181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.310830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.422477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.423103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.430241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.430706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.431499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.431944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.491836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:42.500189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17620a9f-962d-4f29-95bc-a0bc72cd7032 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1646 microversion: 2.1 time: 0.203756 Jun 16 18:38:42.500787 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1061/2201] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1646 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:42.587102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:42.591113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aad6132d-6f87-46ce-88a4-ddd0c0a41581 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.592090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aad6132d-6f87-46ce-88a4-ddd0c0a41581 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.594813 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4300ab3e-9802-4fd2-b826-33b1903705af tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1469 microversion: 2.1 time: 0.176263 Jun 16 18:38:42.596315 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1141/2202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:42.601730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aad6132d-6f87-46ce-88a4-ddd0c0a41581 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.602290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aad6132d-6f87-46ce-88a4-ddd0c0a41581 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.603072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aad6132d-6f87-46ce-88a4-ddd0c0a41581 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.603507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aad6132d-6f87-46ce-88a4-ddd0c0a41581 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.634526 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aad6132d-6f87-46ce-88a4-ddd0c0a41581 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047406 Jun 16 18:38:42.635100 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1062/2203] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:38:42.660709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.662224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.668521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.669103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.669795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.670268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.696188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a3667ddf-88e2-491d-b490-185b0370bfcc tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.697242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a3667ddf-88e2-491d-b490-185b0370bfcc tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.703517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3667ddf-88e2-491d-b490-185b0370bfcc tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.703887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3667ddf-88e2-491d-b490-185b0370bfcc tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.704652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3667ddf-88e2-491d-b490-185b0370bfcc tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.705093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3667ddf-88e2-491d-b490-185b0370bfcc tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.736092 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a3667ddf-88e2-491d-b490-185b0370bfcc tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043831 Jun 16 18:38:42.736667 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1063/2204] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:38:42.785394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.786182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.793667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.794151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.794927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.795360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.817709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:42.826049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b7455328-4ccb-49b8-ad01-f08506df937b tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1484 microversion: 2.1 time: 0.169345 Jun 16 18:38:42.826638 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1142/2205] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1484 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:42.831320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.831827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.838743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.839212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.840004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.840519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.857432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:42.871056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:42.930987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:42.939124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6acbb01b-1972-42f4-be32-fef70116c8e7 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.157554 Jun 16 18:38:42.939773 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1064/2206] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:42.961879 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a89c534d-b686-40e1-b9f6-df834a175dba tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 204 len: 0 microversion: 2.1 time: 0.133989 Jun 16 18:38:42.962495 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1143/2207] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:42 2022] DELETE /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:42.970628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:42.971245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:42.978385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.978840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:42.979995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:42.980446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.116199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:43.124780 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b2e8435e-e0bb-43e5-af0a-9b1c37780527 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1681 microversion: 2.1 time: 0.157959 Jun 16 18:38:43.125357 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1065/2208] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:42 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:43.253809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:43.254542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:43.262270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.262718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.263490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.263921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.404897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:43.413497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:43.415344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:43.416562 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c853b1f-a105-40ca-9e0b-6509fca54e7f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.167150 Jun 16 18:38:43.417130 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1144/2209] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:43 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:43.517538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:43.518184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:43.525301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.525758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.526553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.526993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.611834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:43.612457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:43.620807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.621357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.622109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.622556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.719336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:43.722941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:43.728653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2080ccc2-c255-4ccd-9993-9688d1c64985 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1646 microversion: 2.1 time: 0.214964 Jun 16 18:38:43.729225 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1066/2210] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:43 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1646 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:43.796811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:43.807085 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-425e1563-1779-4d74-bc04-77de4603e81e tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1469 microversion: 2.1 time: 0.199188 Jun 16 18:38:43.807860 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1145/2211] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:43 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:43.844053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:43.844680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:43.852021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.852682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.853386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.853830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.956192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:43.956895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:43.964693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.965380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:43.966391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:43.967487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.133287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:44.144068 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd4c8039-1517-44d2-ad0e-49ab5b36a6d3 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1484 microversion: 2.1 time: 0.303003 Jun 16 18:38:44.145593 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1067/2212] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:43 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1484 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:44.151929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:44.152759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:44.159874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.160589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.161647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.162187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.279620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:44.305675 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2eabc62a-687f-41c9-b360-167ef5a78109 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.353481 Jun 16 18:38:44.306637 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1146/2213] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:43 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:44.400414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1912b32f-744b-4316-9e06-0677aae8ffd7 req-8774bd62-9a95-47c6-ada4-f8d189a6a832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5", "name": "network-vif-deleted", "tag": "020cf015-0cf4-4d3e-be29-6245fb5fc6c3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:44.416099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:44.422306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1912b32f-744b-4316-9e06-0677aae8ffd7 req-8774bd62-9a95-47c6-ada4-f8d189a6a832 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.423999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1912b32f-744b-4316-9e06-0677aae8ffd7 req-8774bd62-9a95-47c6-ada4-f8d189a6a832 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.434149 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37960c91-7a96-4f7a-8033-52d877374b12 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1681 microversion: 2.1 time: 0.287107 Jun 16 18:38:44.437103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1068/2214] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:44 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:44.442082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:44.442953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:44.447533 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1912b32f-744b-4316-9e06-0677aae8ffd7 req-8774bd62-9a95-47c6-ada4-f8d189a6a832 service nova] Creating event network-vif-deleted:020cf015-0cf4-4d3e-be29-6245fb5fc6c3 for instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 on n-h2-846209-2 Jun 16 18:38:44.453810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.455010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.456151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.456743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.474906 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1912b32f-744b-4316-9e06-0677aae8ffd7 req-8774bd62-9a95-47c6-ada4-f8d189a6a832 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063845 Jun 16 18:38:44.477779 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1147/2215] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:38:44.685805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-25939efe-6491-4999-b98b-2e5f3e8970a0 req-ef597ac7-9e39-4681-859e-08a40c2df650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb575fd4-0970-400b-913f-721aafd46e61", "name": "network-vif-deleted", "tag": "79471afd-118e-4f81-8fc5-5c6ef7b970c9"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:44.704788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-25939efe-6491-4999-b98b-2e5f3e8970a0 req-ef597ac7-9e39-4681-859e-08a40c2df650 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.709427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-25939efe-6491-4999-b98b-2e5f3e8970a0 req-ef597ac7-9e39-4681-859e-08a40c2df650 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.743589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:44.758500 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-25939efe-6491-4999-b98b-2e5f3e8970a0 req-ef597ac7-9e39-4681-859e-08a40c2df650 service nova] Creating event network-vif-deleted:79471afd-118e-4f81-8fc5-5c6ef7b970c9 for instance fb575fd4-0970-400b-913f-721aafd46e61 on n-h2-846209-2 Jun 16 18:38:44.760824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:44.764657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:44.771437 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d3e0b4b1-17a8-400a-b1ac-3329de8009f8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.332561 Jun 16 18:38:44.773676 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-25939efe-6491-4999-b98b-2e5f3e8970a0 req-ef597ac7-9e39-4681-859e-08a40c2df650 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105369 Jun 16 18:38:44.774823 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1069/2216] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:44 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:44.778600 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1148/2217] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:38:44.782311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:44.783368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:44.792230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.792959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.793984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.794623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.826834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:44.827937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:44.844841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.846926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.850049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.851190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.920028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:44.920733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:44.921343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lazy-loading 'fault' on Instance uuid ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:45.006837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc290259c264400aad950993f0a1d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d785ba63d406a82b75393e89230de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:45.023029 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-44e3cce5-e909-4b9e-849b-b18367c0fb7c tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 200 len: 1305 microversion: 2.1 time: 0.246696 Jun 16 18:38:45.023625 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1070/2218] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:44 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 1305 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:45.085031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:45.100056 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41c110b3-bf2a-44aa-a48e-b0ac7d230c9c tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 200 len: 1427 microversion: 2.1 time: 0.278054 Jun 16 18:38:45.101209 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1149/2219] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:44 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 1427 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:45.165168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:45.166071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:45.175606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.176422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.177794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.178606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.237582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.238927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.240881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lazy-loading 'fault' on Instance uuid fb575fd4-0970-400b-913f-721aafd46e61 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:45.305059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:45.313418 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7861487-5aee-47f3-8703-2a534699a1ce tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 200 len: 1300 microversion: 2.1 time: 0.154758 Jun 16 18:38:45.323942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:45.324465 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1071/2220] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:45 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 1300 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:45.325371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:45.333671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.334533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.335541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.336195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.453361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:45.454646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:45.468832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.469318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.472701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.473173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.744788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:45.753151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fe23d8e0-f8c5-4c31-8c95-58042ed6ff4f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.433127 Jun 16 18:38:45.754020 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1150/2221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:45 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:45.794036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:45.795040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:45.804381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.805370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.806556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:45.807310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:45.863554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:45.875401 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2efe49f1-deeb-4a75-82a9-6de03ff69fc1 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1681 microversion: 2.1 time: 0.426052 Jun 16 18:38:45.877364 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1072/2222] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:45 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1681 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:46.045845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:46.047321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] [instance: ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:46.060438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.061306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.064004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.065525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.073387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:46.085169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:46.091198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:46.094501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6b57094-3e03-40a0-95b2-3534c102b919 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.304468 Jun 16 18:38:46.097453 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1151/2223] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:45 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:46.105271 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] HTTP exception thrown: Instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 could not be found. Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Request method failure captured: Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 HTTP/1.1 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3hwRz7qJO5KcJV2BqxWot-8kHI3TCJ-3cYZxeDTEnavzr4tcAWIo6wzIZqqQ6PZKl2EyMnG7y1fHMZtLV2QXWqxDWf6carkbID03Q4VIsOUGN_26jrk3K1f6Xx_wimI-nhw7aNlK_S-CnZLEmbilHq-iAsprF1pxE7t79BZnjkvMOU Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1d785ba63d406a82b75393e89230de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1d785ba63d406a82b75393e89230de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6b1d785ba63d406a82b75393e89230de Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1156566296 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fc290259c264400aad950993f0a1d9d9 Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsTestJSON-1156566296-project Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 could not be found. Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5'} Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 could not be found. Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 could not be found. Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:46.108259 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.111613 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.111613 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:46.111613 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:46.111613 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:46.111613 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:46.111613 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 could not be found. Jun 16 18:38:46.111613 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.119740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:46.120754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 8343c561-437a-4648-9b2c-f3d2e3edb2cf] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:46.126446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Returning 404 to user: Instance ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:46.128913 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6813082a-d109-46c6-aff9-f0501eed3d98 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5" status: 404 len: 111 microversion: 2.1 time: 0.091722 Jun 16 18:38:46.135194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.136010 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1073/2224] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:46 2022] GET /compute/v2.1/servers/ce8f6294-d5aa-4555-96ea-f8c3d6f9dbb5 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:46.138122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.143326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.144460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.147868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c8d372b-22b2-4507-9ac5-a3c303efac7b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f78bca0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:46.190580 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] HTTP exception thrown: Instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf could not be found. Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Request method failure captured: Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf HTTP/1.1 Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3glEJo0mBFgxCsDZSE5mcmW-mSVHXogoB6riDSnmSGHZ3xhXba7rU22BmyH2rLYsq7X1dubtmLH1Ayx3a2IuaUipa71uuGfTu2f7_LEA4WMuUQRuO_wzYv4EUvbs8EhRsR2KjHzYWV_4cvbYKRaC57k899Tlnd6UTnsaLgrBgAXthU Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 283e375f03104021bdf7a756af5bdcce Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_283e375f03104021bdf7a756af5bdcce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 283e375f03104021bdf7a756af5bdcce Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAdminTestJSON-486282003-project Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 8dd7fc37c6a04f5da2aca97532bcf84b Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAdminTestJSON-486282003-project Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf could not be found. Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '8343c561-437a-4648-9b2c-f3d2e3edb2cf'} Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf could not be found. Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf could not be found. Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:46.201964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf could not be found. Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Returning 404 to user: Instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:46.205689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72811ceb-5ccd-4b00-8ba6-0a7fa4444034 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf" status: 404 len: 111 microversion: 2.1 time: 0.089538 Jun 16 18:38:46.207731 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1152/2225] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:46 2022] GET /compute/v2.1/servers/8343c561-437a-4648-9b2c-f3d2e3edb2cf => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:46.213046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:46.213641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:46.220666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.221394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.222390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.223024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.262456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:46.388174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:46.396468 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7eafb72c-bacb-4738-b74f-f2b74187b901 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 204 len: 0 microversion: 2.1 time: 0.187281 Jun 16 18:38:46.397718 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1153/2226] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:46 2022] DELETE /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:46.403703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:46.404460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: fb575fd4-0970-400b-913f-721aafd46e61] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:46.411065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.411524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.412618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.413221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.435475 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] HTTP exception thrown: Instance fb575fd4-0970-400b-913f-721aafd46e61 could not be found. Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Request method failure captured: Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 HTTP/1.1 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3agc7QBejQqVM1bWcSioM8ETzgX24ysbqgFHRgdAKWsxtmo9g4rkXbxY2Fw-GRB_jV_qHvPQDT46PsD0iDWEQYv_WBu3BM4leNp4hw0FX4tea5hFW0dupQlCMl97OJRaZaexIhuOCnvg2RL1d9mKWmNAnN4iz9TQVS78C5huK1DUCc Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d84e38d180849e98a2222aede57177d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d84e38d180849e98a2222aede57177d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveMigrationTest-623027432 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6483600a33ef407d9071cd24d84f6ee6 Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance fb575fd4-0970-400b-913f-721aafd46e61 could not be found. Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'fb575fd4-0970-400b-913f-721aafd46e61'} Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb575fd4-0970-400b-913f-721aafd46e61 could not be found. Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb575fd4-0970-400b-913f-721aafd46e61 could not be found. Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.437519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:46.441891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:46.441891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:46.441891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:46.441891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:46.441891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb575fd4-0970-400b-913f-721aafd46e61 could not be found. Jun 16 18:38:46.441891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:46.443602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Returning 404 to user: Instance fb575fd4-0970-400b-913f-721aafd46e61 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:46.444751 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90202d2a-0ced-45e1-a611-6827169686c0 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61" status: 404 len: 111 microversion: 2.1 time: 0.045584 Jun 16 18:38:46.445682 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1154/2227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:46 2022] GET /compute/v2.1/servers/fb575fd4-0970-400b-913f-721aafd46e61 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:46.450838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:46.451468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:46.460279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.460758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.461752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.462380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.924751 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8c8d372b-22b2-4507-9ac5-a3c303efac7b tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7e8c0aed-5afa-45fa-a357-9c90755194ab" status: 202 len: 0 microversion: 2.1 time: 0.787337 Jun 16 18:38:46.929499 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1074/2228] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:46 2022] DELETE /compute/v2.1/os-security-groups/7e8c0aed-5afa-45fa-a357-9c90755194ab => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:46.934733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:46.935118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:46.943548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.944000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.944798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:46.945401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:46.975342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:46.992342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:47.001495 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f47778b2-3dda-407d-b797-048c07b7fef5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1470 microversion: 2.1 time: 0.554560 Jun 16 18:38:47.002375 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1155/2229] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:46 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1470 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:47.009365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c35f4d6c-9cec-44bd-8baa-f3846ebda858 req-cc2ded16-fb9f-403f-9db6-e58e5838f50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8343c561-437a-4648-9b2c-f3d2e3edb2cf", "name": "network-vif-deleted", "tag": "fbff0805-7d03-4cd0-9a43-1792095000da"}, {"server_uuid": "4be179f1-c859-45c9-a96c-f7f25f126546", "name": "network-vif-unplugged", "status": "completed", "tag": "f925959e-95a7-48a3-b183-5dd22c6a2665"}, {"name": "network-changed", "server_uuid": "4be179f1-c859-45c9-a96c-f7f25f126546", "tag": "f925959e-95a7-48a3-b183-5dd22c6a2665"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:47.018741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c35f4d6c-9cec-44bd-8baa-f3846ebda858 req-cc2ded16-fb9f-403f-9db6-e58e5838f50f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.019187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c35f4d6c-9cec-44bd-8baa-f3846ebda858 req-cc2ded16-fb9f-403f-9db6-e58e5838f50f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.036887 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c35f4d6c-9cec-44bd-8baa-f3846ebda858 req-cc2ded16-fb9f-403f-9db6-e58e5838f50f service nova] Creating event network-vif-deleted:fbff0805-7d03-4cd0-9a43-1792095000da for instance 8343c561-437a-4648-9b2c-f3d2e3edb2cf on n-h2-846209-2 Jun 16 18:38:47.037769 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c35f4d6c-9cec-44bd-8baa-f3846ebda858 req-cc2ded16-fb9f-403f-9db6-e58e5838f50f service nova] Creating event network-vif-unplugged:f925959e-95a7-48a3-b183-5dd22c6a2665 for instance 4be179f1-c859-45c9-a96c-f7f25f126546 on n-h1-846209-2 Jun 16 18:38:47.038631 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c35f4d6c-9cec-44bd-8baa-f3846ebda858 req-cc2ded16-fb9f-403f-9db6-e58e5838f50f service nova] Creating event network-changed:f925959e-95a7-48a3-b183-5dd22c6a2665 for instance 4be179f1-c859-45c9-a96c-f7f25f126546 on n-h1-846209-2 Jun 16 18:38:47.048358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c35f4d6c-9cec-44bd-8baa-f3846ebda858 req-cc2ded16-fb9f-403f-9db6-e58e5838f50f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.044472 Jun 16 18:38:47.049324 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1156/2230] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:47.057422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:47.058547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:47.066035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.066489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.067422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.068467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.089384 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cb56acba-e131-42d5-9d5e-5be0456195e4 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 204 len: 0 microversion: 2.1 time: 0.158104 Jun 16 18:38:47.092542 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1075/2231] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:46 2022] DELETE /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:47.100466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:47.101483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:47.110076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.110827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.111841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.112664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.210318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:47.219026 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0064d076-2254-4dc1-bcda-d5a3f29f1df7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1614 microversion: 2.1 time: 0.124868 Jun 16 18:38:47.229979 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1076/2232] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:47 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1614 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:47.235306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2dc4f09d-641e-42e8-bbc9-77125f718aa6 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] Calling method '.version_select at 0x7f866f769670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:47.316602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:47.325608 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-afd7f85a-899d-413c-a34b-08fb1b4d579f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.274869 Jun 16 18:38:47.336304 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1157/2233] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:47 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:47.342040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ce5f4c80-902a-4f63-95e5-41bead52216b req-688d822f-66cf-44be-8f56-7cad46aa6e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f131bf-1702-4acf-b73a-2327d0c9315e", "name": "network-vif-deleted", "tag": "3dcc4f7f-2603-43fa-a995-4e5f6a27819a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:47.355193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ce5f4c80-902a-4f63-95e5-41bead52216b req-688d822f-66cf-44be-8f56-7cad46aa6e27 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.356159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ce5f4c80-902a-4f63-95e5-41bead52216b req-688d822f-66cf-44be-8f56-7cad46aa6e27 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.374785 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ce5f4c80-902a-4f63-95e5-41bead52216b req-688d822f-66cf-44be-8f56-7cad46aa6e27 service nova] Creating event network-vif-deleted:3dcc4f7f-2603-43fa-a995-4e5f6a27819a for instance a4f131bf-1702-4acf-b73a-2327d0c9315e on n-h1-846209-2 Jun 16 18:38:47.381204 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ce5f4c80-902a-4f63-95e5-41bead52216b req-688d822f-66cf-44be-8f56-7cad46aa6e27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043204 Jun 16 18:38:47.382136 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1158/2234] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:47.389306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:47.390769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:47.400129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.400891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.402358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.402995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.574539 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2dc4f09d-641e-42e8-bbc9-77125f718aa6 tempest-SecurityGroupsTestJSON-1156566296 tempest-SecurityGroupsTestJSON-1156566296-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8ad4b153-9a57-4205-b50a-505e2fcee75a" status: 202 len: 0 microversion: 2.1 time: 0.347949 Jun 16 18:38:47.579187 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1077/2235] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:38:47 2022] DELETE /compute/v2.1/os-security-groups/8ad4b153-9a57-4205-b50a-505e2fcee75a => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:47.591927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:47.595576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:47.607615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:47.612562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.614732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.617365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:47.621771 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b80b1ba-d8b8-49f4-b154-0b8524e8331e tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1499 microversion: 2.1 time: 0.238303 Jun 16 18:38:47.622584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:47.622698 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1159/2236] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:47 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1499 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:47.779478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:47.789823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:47.791676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:47.792951 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f095d30-965f-45e0-ac34-bad39fd3814b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.215595 Jun 16 18:38:47.793971 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1078/2237] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:47 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:48.020263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:48.022843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:48.030375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.030856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.031695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.032300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.188645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:48.191085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:48.198495 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3272d683-a65b-40a0-bb95-232935c17033 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1470 microversion: 2.1 time: 0.182415 Jun 16 18:38:48.199440 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1160/2238] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:48 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:48.236911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:48.237529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:48.243856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.244307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.245082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.245520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.316610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ec705254474a2797ff413d97ce669e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce4ebda17f641c4a782a2893a7e9cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:48.325104 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c2629278-13b3-4b60-97a0-a046b4373950 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 200 len: 1614 microversion: 2.1 time: 0.092302 Jun 16 18:38:48.325680 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1079/2239] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:48 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:48.343850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:48.344471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:48.352410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.352871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.354041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.354331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.490066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:48.498387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3498ec8f-f0d6-4107-8370-9e8c5112c324 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.158545 Jun 16 18:38:48.498980 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1161/2240] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:48 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:48.646883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:48.647768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:48.660141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.660604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.661569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.662165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.819185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:48.819765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:48.839359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.839576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.840392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:48.840812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:48.992415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:49.000670 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a34a6f6e-e321-4be6-8d5a-e3f94f6bfd66 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1499 microversion: 2.1 time: 0.357622 Jun 16 18:38:49.002281 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1080/2241] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:48 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1499 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:49.072147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e32df76d-cf08-4b8a-89f5-2cac5047ce79 req-b9651c63-d69f-4911-b304-beeffa50d546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0861585c-f6be-40db-9c1a-d5b9bb022d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "49443c23-3d73-4790-8d09-420401ef5734"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:49.085520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e32df76d-cf08-4b8a-89f5-2cac5047ce79 req-b9651c63-d69f-4911-b304-beeffa50d546 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:49.086258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e32df76d-cf08-4b8a-89f5-2cac5047ce79 req-b9651c63-d69f-4911-b304-beeffa50d546 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:49.086409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:49.096286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:49.098406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:49.100680 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f8248c82-28da-4082-9fe4-e188c0787e8c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.291944 Jun 16 18:38:49.101762 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1162/2242] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:48 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:38:49.104547 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e32df76d-cf08-4b8a-89f5-2cac5047ce79 req-b9651c63-d69f-4911-b304-beeffa50d546 service nova] Creating event network-vif-unplugged:49443c23-3d73-4790-8d09-420401ef5734 for instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e on n-h1-846209-2 Jun 16 18:38:49.112314 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e32df76d-cf08-4b8a-89f5-2cac5047ce79 req-b9651c63-d69f-4911-b304-beeffa50d546 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048156 Jun 16 18:38:49.113337 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1081/2243] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:49.216865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:49.217760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:49.226574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:49.227274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:49.229123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:49.229779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:49.345984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:49.352135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:49.366112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:49.366112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:49.367382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:49.368392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:49.397717 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] HTTP exception thrown: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Request method failure captured: Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e HTTP/1.1 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3gCaEm8cltBFOs1Cb34GmaSv_XiRADhLN_HjfFCfkuAZgcokjUsRoNrCYKtO0ayp3W7Zz3BoAwCVl8pYJlguY9RcBx2SCQUH_Ieo6LrKgPnylWR83vRTAoJAMYYMT3s1pV2N1tDgnx9NtUi_yhGO5AdF8rGPOUHDFlQALX9NHQQE_4 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8ce4ebda17f641c4a782a2893a7e9cfa Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ce4ebda17f641c4a782a2893a7e9cfa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8ce4ebda17f641c4a782a2893a7e9cfa Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachSCSIVolumeTestJSON-498797654-project Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 88ec705254474a2797ff413d97ce669e Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-498797654-project Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a4f131bf-1702-4acf-b73a-2327d0c9315e'} Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:49.399433 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Returning 404 to user: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:49.403032 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-111940b0-052c-423e-984f-ea684ed9e9d7 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 404 len: 111 microversion: 2.1 time: 0.059906 Jun 16 18:38:49.405875 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1082/2244] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:49 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:49.410684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8402cd82-9b3c-4c55-a7af-3b912da1f254 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '.version_select at 0x7f866e961dc0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:49.438596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8402cd82-9b3c-4c55-a7af-3b912da1f254 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920096483" status: 202 len: 0 microversion: 2.1 time: 0.030403 Jun 16 18:38:49.439454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1083/2245] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:38:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920096483 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:49.516671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:49.518761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:49.528097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:49.529184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:49.530867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:49.531469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:49.576322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:49.590047 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0bb2bc66-ee1b-4899-9bf9-274de2f59baf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1470 microversion: 2.1 time: 0.377990 Jun 16 18:38:49.592148 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1163/2246] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:49 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1470 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:49.926497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:49.947676 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22366351-c597-4c24-80fb-b08e6d44ec70 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.434939 Jun 16 18:38:49.960790 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1084/2247] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:49 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:50.019501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:50.020127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:50.036946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:50.037405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:50.038247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:50.038836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:50.133401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:50.140671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:50.166529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:50.166964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:50.177214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:50.178861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:50.691605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6483600a33ef407d9071cd24d84f6ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84e38d180849e98a2222aede57177d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:50.711583 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cbd64541-f20a-4ea2-b782-3074ed841047 tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 200 len: 1499 microversion: 2.1 time: 0.696309 Jun 16 18:38:50.714132 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1164/2248] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:50 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 1499 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:50.726860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:50.730205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:50.746003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:50.746478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:50.747282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:50.747728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:50.822691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:50.834932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:50.849471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:50.858413 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-30a9fa29-237b-4d40-8393-969f460cb769 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.742175 Jun 16 18:38:50.859333 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1085/2249] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:50 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:50.870574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8c680460-e8ea-4c49-90aa-5fea926244ad req-0737785f-e347-4501-bb89-aca00da663dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f015f4-9f00-4880-9173-03b674d03c95", "name": "network-vif-deleted", "tag": "431965cc-38d3-4de3-a2d6-2aa176d81509"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:50.922113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8c680460-e8ea-4c49-90aa-5fea926244ad req-0737785f-e347-4501-bb89-aca00da663dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:50.922643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8c680460-e8ea-4c49-90aa-5fea926244ad req-0737785f-e347-4501-bb89-aca00da663dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:50.943985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:50.977140 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8c680460-e8ea-4c49-90aa-5fea926244ad req-0737785f-e347-4501-bb89-aca00da663dc service nova] Creating event network-vif-deleted:431965cc-38d3-4de3-a2d6-2aa176d81509 for instance f4f015f4-9f00-4880-9173-03b674d03c95 on n-h1-846209-2 Jun 16 18:38:50.999932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:51.014712 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1aed0a20-15e9-45ec-9e1c-458ebc700cbf tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 200 len: 1428 microversion: 2.1 time: 0.298703 Jun 16 18:38:51.015321 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1165/2250] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:50 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 1428 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:51.022734 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8c680460-e8ea-4c49-90aa-5fea926244ad req-0737785f-e347-4501-bb89-aca00da663dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160665 Jun 16 18:38:51.026060 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1086/2251] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:51.032092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:51.032822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:51.038069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fbca2620-9a08-4db0-a1e2-34572f9c680d req-69015669-5933-433b-a9ee-9d9d43314f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0861585c-f6be-40db-9c1a-d5b9bb022d4e", "name": "network-vif-deleted", "tag": "49443c23-3d73-4790-8d09-420401ef5734"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:51.069419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fbca2620-9a08-4db0-a1e2-34572f9c680d req-69015669-5933-433b-a9ee-9d9d43314f54 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:51.069876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fbca2620-9a08-4db0-a1e2-34572f9c680d req-69015669-5933-433b-a9ee-9d9d43314f54 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:51.081871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:51.082362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:51.083787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:51.084246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:51.134759 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fbca2620-9a08-4db0-a1e2-34572f9c680d req-69015669-5933-433b-a9ee-9d9d43314f54 service nova] Creating event network-vif-deleted:49443c23-3d73-4790-8d09-420401ef5734 for instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e on n-h1-846209-2 Jun 16 18:38:51.156332 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fbca2620-9a08-4db0-a1e2-34572f9c680d req-69015669-5933-433b-a9ee-9d9d43314f54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131606 Jun 16 18:38:51.156914 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1166/2252] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:51.429671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:51.444956 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ecaaf796-9e7c-4f3a-bf53-58f52d98109f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.417555 Jun 16 18:38:51.446314 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1087/2253] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:51 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:51.730959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:51.732359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] [instance: f4f015f4-9f00-4880-9173-03b674d03c95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:51.741417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:51.741879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:51.742809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:51.745668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:51.763897 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] HTTP exception thrown: Instance f4f015f4-9f00-4880-9173-03b674d03c95 could not be found. Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Request method failure captured: Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 HTTP/1.1 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3agc7QBejQqVM1bWcSioM8ETzgX24ysbqgFHRgdAKWsxtmo9g4rkXbxY2Fw-GRB_jV_qHvPQDT46PsD0iDWEQYv_WBu3BM4leNp4hw0FX4tea5hFW0dupQlCMl97OJRaZaexIhuOCnvg2RL1d9mKWmNAnN4iz9TQVS78C5huK1DUCc Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d84e38d180849e98a2222aede57177d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d84e38d180849e98a2222aede57177d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d84e38d180849e98a2222aede57177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveMigrationTest-623027432 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3d84e38d180849e98a2222aede57177d Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveMigrationTest-623027432 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6483600a33ef407d9071cd24d84f6ee6 Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveMigrationTest-623027432-project Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f4f015f4-9f00-4880-9173-03b674d03c95 could not be found. Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f4f015f4-9f00-4880-9173-03b674d03c95'} Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f015f4-9f00-4880-9173-03b674d03c95 could not be found. Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f015f4-9f00-4880-9173-03b674d03c95 could not be found. Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:51.766260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f015f4-9f00-4880-9173-03b674d03c95 could not be found. Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] Returning 404 to user: Instance f4f015f4-9f00-4880-9173-03b674d03c95 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:51.773438 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ba56684f-6de7-4024-bc43-d282960d366a tempest-LiveMigrationTest-623027432 tempest-LiveMigrationTest-623027432-project] 10.222.0.27 "GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95" status: 404 len: 111 microversion: 2.1 time: 0.046583 Jun 16 18:38:51.777086 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1167/2254] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:51 2022] GET /compute/v2.1/servers/f4f015f4-9f00-4880-9173-03b674d03c95 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:51.877396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:51.878042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:51.888160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:51.889268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:51.890698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:51.891383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.032547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:52.033237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0861585c-f6be-40db-9c1a-d5b9bb022d4e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:52.043087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.043567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.056688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.057291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.082327 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] HTTP exception thrown: Instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e could not be found. Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Request method failure captured: Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e HTTP/1.1 Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3glEJo0mBFgxCsDZSE5mcmW-mSVHXogoB6riDSnmSGHZ3xhXba7rU22BmyH2rLYsq7X1dubtmLH1Ayx3a2IuaUipa71uuGfTu2f7_LEA4WMuUQRuO_wzYv4EUvbs8EhRsR2KjHzYWV_4cvbYKRaC57k899Tlnd6UTnsaLgrBgAXthU Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 283e375f03104021bdf7a756af5bdcce Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_283e375f03104021bdf7a756af5bdcce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 283e375f03104021bdf7a756af5bdcce Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAdminTestJSON-486282003-project Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 8dd7fc37c6a04f5da2aca97532bcf84b Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAdminTestJSON-486282003-project Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e could not be found. Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '0861585c-f6be-40db-9c1a-d5b9bb022d4e'} Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e could not be found. Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e could not be found. Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:52.097570 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e could not be found. Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Returning 404 to user: Instance 0861585c-f6be-40db-9c1a-d5b9bb022d4e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b1e1f53-698d-4c92-8aad-78b2568ebc09 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e" status: 404 len: 111 microversion: 2.1 time: 0.071519 Jun 16 18:38:52.107477 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1168/2255] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:52 2022] GET /compute/v2.1/servers/0861585c-f6be-40db-9c1a-d5b9bb022d4e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:52.109358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:52.109878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:52.127691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.128522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.129596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.134689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.193177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:52.330484 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-157a394b-15e2-4ddf-9532-6f037060e2f5 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 204 len: 0 microversion: 2.1 time: 0.221854 Jun 16 18:38:52.331635 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1169/2256] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:52 2022] DELETE /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:38:52.344517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:52.350426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:52.364985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.366261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.367865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.368540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.819040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:52.822141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:52.830796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:52.831623 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d4a2a56a-3973-402d-9f53-3888fa6ea760 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1470 microversion: 2.1 time: 0.494851 Jun 16 18:38:52.834455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:52.835964 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ed0e796-0b36-4806-8234-8ab23f6106e8 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.963071 Jun 16 18:38:52.837049 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1088/2257] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:51 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:52.844287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:52.845416 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1170/2258] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:52 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1470 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:52.846425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:52.858395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.859200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:52.860355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:52.862150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:53.016568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-50023947-5e5c-4cdd-ab93-ca303e3f3d7c req-afe9240c-f957-4d06-9517-ec00c1b45125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be179f1-c859-45c9-a96c-f7f25f126546", "name": "network-vif-unplugged", "status": "completed", "tag": "f925959e-95a7-48a3-b183-5dd22c6a2665"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:53.059079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-50023947-5e5c-4cdd-ab93-ca303e3f3d7c req-afe9240c-f957-4d06-9517-ec00c1b45125 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:53.061526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-50023947-5e5c-4cdd-ab93-ca303e3f3d7c req-afe9240c-f957-4d06-9517-ec00c1b45125 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:53.091830 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-50023947-5e5c-4cdd-ab93-ca303e3f3d7c req-afe9240c-f957-4d06-9517-ec00c1b45125 service nova] Creating event network-vif-unplugged:f925959e-95a7-48a3-b183-5dd22c6a2665 for instance 4be179f1-c859-45c9-a96c-f7f25f126546 on n-h1-846209-2 Jun 16 18:38:53.104377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-50023947-5e5c-4cdd-ab93-ca303e3f3d7c req-afe9240c-f957-4d06-9517-ec00c1b45125 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094557 Jun 16 18:38:53.105795 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1171/2259] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:38:53.218068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:53.229241 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b5ddb808-4fc0-45fb-9871-654d9bc8221b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.390920 Jun 16 18:38:53.229837 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1089/2260] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:52 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:53.853207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:53.853840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:53.856274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:53.857010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:53.867269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:53.878285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:53.878759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:53.879561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:53.880662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:53.881448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:53.882594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:53.888868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:54.479417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:54.501068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:54.508166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:54.513407 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-38aeb592-06ec-4613-963a-36bb639cc9c5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.663536 Jun 16 18:38:54.515177 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1090/2261] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:53 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:38:54.524526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:54.525384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:54.533476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:54.534224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:54.535224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:54.536598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:54.574239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:54.586643 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e81d5255-43c7-4087-8d4b-21d4d3f9287b tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1470 microversion: 2.1 time: 0.741656 Jun 16 18:38:54.587442 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1172/2262] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:53 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1470 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:54.918947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:54.931990 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cb9e4c91-3773-48af-8244-a5fc5013781d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.415415 Jun 16 18:38:54.947590 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1091/2263] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:54 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:54.963861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:54.972139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:54.978144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Searching by: {'deleted': False, 'project_id': '863792ec29f746f3a811e43f63660e11'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:38:54.985720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:54.986439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:54.987475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:54.988110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.125418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:38:55.207723 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6870c00a-21cf-49bc-bb11-c35616353136 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.248447 Jun 16 18:38:55.208673 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1173/2264] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:38:54 2022] GET /compute/v2.1/servers => generated 339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:55.220750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:55.225335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:55.226549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Searching by: {'deleted': False, 'project_id': '863792ec29f746f3a811e43f63660e11'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:38:55.249643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.250845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.251849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.253610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.313742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:38:55.386321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:55.403670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.403954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.534211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:55.536662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:55.560998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.562173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.562292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.566601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.646707 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-86fb69e8-a94b-4dc1-b632-a1a0b8812e5a tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1708 microversion: 2.1 time: 0.430453 Jun 16 18:38:55.647904 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1092/2265] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:38:55 2022] GET /compute/v2.1/servers/detail => generated 1708 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:55.652792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:55.653639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:55.667148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.667673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.668658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.669253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.793555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:55.809245 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-89e01ab5-45e9-462b-a48b-e917a33eaeb3 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1428 microversion: 2.1 time: 0.160111 Jun 16 18:38:55.810310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1093/2266] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:55 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:55.832225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2c35df80-da52-413a-bfeb-513b99677d27 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:55.863166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2c35df80-da52-413a-bfeb-513b99677d27 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051492 Jun 16 18:38:55.866870 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1094/2267] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:38:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:55.939153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:55.955967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:55.956841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:55.970714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:55.977696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:55.979038 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66279e76-dfd7-4e92-919d-ce453f57bf3c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.450355 Jun 16 18:38:55.980067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:55.981013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:55.981825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.004904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.005398 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1174/2268] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:55 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:56.022769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-75dc437e-0673-42e3-a99f-38d8aa362a42 req-30b6ee8b-0deb-4608-85b3-15812587e528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec9541c-3218-401f-b314-dc00a192ec98", "name": "network-vif-deleted", "tag": "18afa003-668c-46ac-8cb1-4db3a3c6c075"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:56.046344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75dc437e-0673-42e3-a99f-38d8aa362a42 req-30b6ee8b-0deb-4608-85b3-15812587e528 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.049122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75dc437e-0673-42e3-a99f-38d8aa362a42 req-30b6ee8b-0deb-4608-85b3-15812587e528 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.088614 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-75dc437e-0673-42e3-a99f-38d8aa362a42 req-30b6ee8b-0deb-4608-85b3-15812587e528 service nova] Creating event network-vif-deleted:18afa003-668c-46ac-8cb1-4db3a3c6c075 for instance 0ec9541c-3218-401f-b314-dc00a192ec98 on n-h2-846209-2 Jun 16 18:38:56.096555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-75dc437e-0673-42e3-a99f-38d8aa362a42 req-30b6ee8b-0deb-4608-85b3-15812587e528 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084926 Jun 16 18:38:56.097497 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1175/2269] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:56.384779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:56.385428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:56.394902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.395922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.397054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.398091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.434829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:56.541473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:56.574969 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b12c7ce-cc5c-4bf0-8f8c-0c93e60122f1 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.623581 Jun 16 18:38:56.580045 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1095/2270] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:55 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:56.600584 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25141ff4-d326-4f82-a8a8-af471d8f0828 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 204 len: 0 microversion: 2.1 time: 0.221373 Jun 16 18:38:56.611179 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1176/2271] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:56 2022] DELETE /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:56.618691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:56.619318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:56.628728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.631296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.634441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.636626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.768147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:56.768970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:56.780669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.782258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.785452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.786153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.819692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:56.821236 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] HTTP exception thrown: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Request method failure captured: Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e HTTP/1.1 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3gCaEm8cltBFOs1Cb34GmaSv_XiRADhLN_HjfFCfkuAZgcokjUsRoNrCYKtO0ayp3W7Zz3BoAwCVl8pYJlguY9RcBx2SCQUH_Ieo6LrKgPnylWR83vRTAoJAMYYMT3s1pV2N1tDgnx9NtUi_yhGO5AdF8rGPOUHDFlQALX9NHQQE_4 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8ce4ebda17f641c4a782a2893a7e9cfa Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ce4ebda17f641c4a782a2893a7e9cfa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8ce4ebda17f641c4a782a2893a7e9cfa Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachSCSIVolumeTestJSON-498797654-project Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 88ec705254474a2797ff413d97ce669e Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-498797654-project Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a4f131bf-1702-4acf-b73a-2327d0c9315e'} Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:56.831488 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:56.835647 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:56.836948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Returning 404 to user: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:56.839036 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e779adf-ff37-412b-b3a1-25ae56da552d tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 404 len: 111 microversion: 2.1 time: 0.075543 Jun 16 18:38:56.846281 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1177/2272] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:56 2022] DELETE /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:56.852528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:56.853311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:56.861009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.861592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.862557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.863119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.907834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:56.908802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:56.909536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lazy-loading 'fault' on Instance uuid 0ec9541c-3218-401f-b314-dc00a192ec98 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:56.996687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd7fc37c6a04f5da2aca97532bcf84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283e375f03104021bdf7a756af5bdcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:57.007503 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b5c4656-7ab0-4b70-b848-410fef5938a0 tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 200 len: 1304 microversion: 2.1 time: 0.159955 Jun 16 18:38:57.019314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1178/2273] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:56 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:57.030681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:57.031671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] [instance: a4f131bf-1702-4acf-b73a-2327d0c9315e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:57.038693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:57.039490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:57.040444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:57.041026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:57.084846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] HTTP exception thrown: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Request method failure captured: Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e HTTP/1.1 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3gCaEm8cltBFOs1Cb34GmaSv_XiRADhLN_HjfFCfkuAZgcokjUsRoNrCYKtO0ayp3W7Zz3BoAwCVl8pYJlguY9RcBx2SCQUH_Ieo6LrKgPnylWR83vRTAoJAMYYMT3s1pV2N1tDgnx9NtUi_yhGO5AdF8rGPOUHDFlQALX9NHQQE_4 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8ce4ebda17f641c4a782a2893a7e9cfa Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ce4ebda17f641c4a782a2893a7e9cfa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ce4ebda17f641c4a782a2893a7e9cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8ce4ebda17f641c4a782a2893a7e9cfa Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-498797654 Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachSCSIVolumeTestJSON-498797654-project Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 88ec705254474a2797ff413d97ce669e Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-498797654-project Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a4f131bf-1702-4acf-b73a-2327d0c9315e'} Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:57.086782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:57.090722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:57.090722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:57.090722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:57.090722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:57.090722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:57.090722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. Jun 16 18:38:57.090722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:57.092773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] Returning 404 to user: Instance a4f131bf-1702-4acf-b73a-2327d0c9315e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:57.093930 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a07eb1ac-30e6-459b-8500-9896e1c97342 tempest-AttachSCSIVolumeTestJSON-498797654 tempest-AttachSCSIVolumeTestJSON-498797654-project] 10.222.0.27 "GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e" status: 404 len: 111 microversion: 2.1 time: 0.072676 Jun 16 18:38:57.098294 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1179/2274] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:57 2022] GET /compute/v2.1/servers/a4f131bf-1702-4acf-b73a-2327d0c9315e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:57.104544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:57.105340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:57.111908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:57.112565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:57.113646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:57.114801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:57.183267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:57.198788 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a721844-c434-4c03-ae00-a025200472d6 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1711 microversion: 2.1 time: 0.586873 Jun 16 18:38:57.199391 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1096/2275] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:56 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1711 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:57.366383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:57.386156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:57.387720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:57.388920 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7625cf0b-c7ac-4af4-b9dc-126c7cfe583e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1487 microversion: 2.25 time: 0.288520 Jun 16 18:38:57.389501 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1180/2276] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:57 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1487 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:57.597361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:57.598050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:57.619859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:57.620523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:57.621472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:57.622173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:57.911205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:57.925030 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-44058aaa-77b5-49ad-b424-0a2ef2db8fb9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1511 microversion: 2.1 time: 0.333112 Jun 16 18:38:57.926728 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1097/2277] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:57 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:58.028385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:58.029155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] [instance: 0ec9541c-3218-401f-b314-dc00a192ec98] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:58.038954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.039585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.040499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.041055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.092991 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] HTTP exception thrown: Instance 0ec9541c-3218-401f-b314-dc00a192ec98 could not be found. Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Request method failure captured: Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 HTTP/1.1 Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3glEJo0mBFgxCsDZSE5mcmW-mSVHXogoB6riDSnmSGHZ3xhXba7rU22BmyH2rLYsq7X1dubtmLH1Ayx3a2IuaUipa71uuGfTu2f7_LEA4WMuUQRuO_wzYv4EUvbs8EhRsR2KjHzYWV_4cvbYKRaC57k899Tlnd6UTnsaLgrBgAXthU Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 283e375f03104021bdf7a756af5bdcce Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_283e375f03104021bdf7a756af5bdcce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/283e375f03104021bdf7a756af5bdcce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 283e375f03104021bdf7a756af5bdcce Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAdminTestJSON-486282003 Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAdminTestJSON-486282003-project Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 8dd7fc37c6a04f5da2aca97532bcf84b Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAdminTestJSON-486282003-project Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 0ec9541c-3218-401f-b314-dc00a192ec98 could not be found. Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '0ec9541c-3218-401f-b314-dc00a192ec98'} Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec9541c-3218-401f-b314-dc00a192ec98 could not be found. Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec9541c-3218-401f-b314-dc00a192ec98 could not be found. Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:58.095664 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec9541c-3218-401f-b314-dc00a192ec98 could not be found. Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] Returning 404 to user: Instance 0ec9541c-3218-401f-b314-dc00a192ec98 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-11255bcc-9a38-4a72-8e7b-81d8ed00ed4f tempest-ServersAdminTestJSON-486282003 tempest-ServersAdminTestJSON-486282003-project] 10.222.0.27 "GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98" status: 404 len: 111 microversion: 2.1 time: 0.073019 Jun 16 18:38:58.112030 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1181/2278] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:58 2022] GET /compute/v2.1/servers/0ec9541c-3218-401f-b314-dc00a192ec98 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:58.217822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:58.220890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:58.242332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.246170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.247474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.251217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.409798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:58.411176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:58.448161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.448631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.450236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.453535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.007126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:59.022504 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b02e705a-b2ee-4a43-a69d-fbb2f267dc17 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1711 microversion: 2.1 time: 0.809241 Jun 16 18:38:59.024024 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1098/2279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:58 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1711 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:59.031494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:59.032617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:59.041114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:59.044822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.045644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.047725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.048357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.105058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:59.125314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:59.126980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:59.128235 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ac94280e-49b8-4b8b-9332-daae6702260f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1477 microversion: 2.25 time: 0.723899 Jun 16 18:38:59.129326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1182/2280] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:58 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1477 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:59.149478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d980d5bb-d91a-4610-97ec-e03bb8145c1f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '.version_select at 0x7f866f511700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:59.152426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d980d5bb-d91a-4610-97ec-e03bb8145c1f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.153256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d980d5bb-d91a-4610-97ec-e03bb8145c1f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.175023 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d980d5bb-d91a-4610-97ec-e03bb8145c1f tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.25 time: 0.029359 Jun 16 18:38:59.178561 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1183/2281] 10.222.0.27 () {60 vars in 1183 bytes} [Thu Jun 16 18:38:59 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:38:59.202039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:59.203835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:59.227710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.229675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.233485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.235057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.523363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:59.535725 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c848965-cbbf-4bf0-acbd-313e5350cf0c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1488 microversion: 2.1 time: 0.510105 Jun 16 18:38:59.550864 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1099/2282] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:59 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1488 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:59.561498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5c06aa62-1a89-4304-b523-154ba214bf7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-755305"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:59.563066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5c06aa62-1a89-4304-b523-154ba214bf7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:59.570723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c06aa62-1a89-4304-b523-154ba214bf7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.572244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c06aa62-1a89-4304-b523-154ba214bf7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.573183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c06aa62-1a89-4304-b523-154ba214bf7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.573701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c06aa62-1a89-4304-b523-154ba214bf7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.622045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] Lazy-loading 'services' on Instance uuid 4be179f1-c859-45c9-a96c-f7f25f126546 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:38:59.649447 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71caa20a-9467-444f-992e-112b088f65c0 tempest-LiveAutoBlockMigrationV225Test-2038325911 tempest-LiveAutoBlockMigrationV225Test-2038325911-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1970 microversion: 2.25 time: 0.451781 Jun 16 18:38:59.662025 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1184/2283] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:59 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1970 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:38:59.701656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:59.704136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:59.716182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.717144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.718738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.719597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.749392 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5c06aa62-1a89-4304-b523-154ba214bf7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "PUT /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1057 microversion: 2.1 time: 0.193583 Jun 16 18:38:59.756709 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1100/2284] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:38:59 2022] PUT /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1057 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:59.794246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:59.796514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:59.808973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.809469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:59.810657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.811676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.812276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.981879 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e5821047-48c0-4d46-ae6a-48e5d7b27504 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 204 len: 0 microversion: 2.25 time: 0.284230 Jun 16 18:38:59.986614 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1185/2285] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:38:59 2022] DELETE /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 18:39:00.011872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:00.014616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:00.033117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.034605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:00.037319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.039763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:00.579282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:00.593665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f96822c-63c5-4467-b2f4-3118566282a3 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1484 microversion: 2.1 time: 0.816913 Jun 16 18:39:00.598266 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1101/2286] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:59 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1484 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:00.606450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:00.612508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:00.627715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.628177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:00.628976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.629421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:00.729682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:00.762841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:00.768179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:00.771673 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f326813a-d39b-4577-acfe-98f924dfa65e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1483 microversion: 2.25 time: 0.779407 Jun 16 18:39:00.778608 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1186/2287] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:38:59 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1483 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:00.799344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:00.804160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:00.825514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.826134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:00.828670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.830159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:00.885851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:00.896597 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a828128f-7815-449d-a3c3-0f9bcc992470 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1644 microversion: 2.1 time: 0.295645 Jun 16 18:39:00.897204 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1102/2288] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:00 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1644 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:01.150820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:01.175850 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-398b4b0d-6fcf-40d6-975d-d58f082e9159 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1484 microversion: 2.1 time: 0.394708 Jun 16 18:39:01.176469 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1187/2289] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:00 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1484 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:01.204400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:01.205154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:01.223549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.224555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.225469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.226011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.238166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:01.299074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:39:01.509316 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c92f420a-598c-4dbb-8c46-6960cf232e87 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 204 len: 0 microversion: 2.1 time: 0.312980 Jun 16 18:39:01.510734 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1103/2290] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:01 2022] DELETE /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:39:01.518921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:01.519811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:01.532440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.533147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.534330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.534935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.796759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:01.798282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:01.804051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:01.817837 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5dff14b7-3c90-467b-9dab-3eb7189caac4 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1490 microversion: 2.1 time: 0.302850 Jun 16 18:39:01.818804 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1188/2291] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:01 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1490 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:01.822476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.824191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.825970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.826635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.920835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:01.921732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:01.937059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.938395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.941431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.943217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.085897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:02.097374 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e20c4fd2-80a9-4326-aa75-442c3a084a00 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1644 microversion: 2.1 time: 0.179817 Jun 16 18:39:02.099751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1189/2292] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:01 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1644 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:02.167197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:02.184384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:02.186533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:02.191179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca472843-3b14-415f-954d-33453508b67a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1483 microversion: 2.25 time: 0.400167 Jun 16 18:39:02.195602 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1104/2293] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:01 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1483 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:02.516422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3aa46597-b1bd-4947-93b6-361d75802026 req-a4d8e671-9b28-451b-8f6d-02166aa74cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd3683c-d609-4a28-ad33-3d6223b2ea3f", "name": "network-vif-deleted", "tag": "060bc235-92c1-46cd-b174-7dc186de42e1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:02.541864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3aa46597-b1bd-4947-93b6-361d75802026 req-a4d8e671-9b28-451b-8f6d-02166aa74cf4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.547897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3aa46597-b1bd-4947-93b6-361d75802026 req-a4d8e671-9b28-451b-8f6d-02166aa74cf4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.609549 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3aa46597-b1bd-4947-93b6-361d75802026 req-a4d8e671-9b28-451b-8f6d-02166aa74cf4 service nova] Creating event network-vif-deleted:060bc235-92c1-46cd-b174-7dc186de42e1 for instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f on n-h2-846209-2 Jun 16 18:39:02.659825 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3aa46597-b1bd-4947-93b6-361d75802026 req-a4d8e671-9b28-451b-8f6d-02166aa74cf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133282 Jun 16 18:39:02.661718 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1190/2294] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:02.837960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:02.839415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:02.848937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.850030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.851573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.852305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.118409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:03.119819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:03.175317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:03.188960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.193633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:03.194596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.226725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:03.235808 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-464ca813-58a1-4e09-bff1-89d7da7ce43c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1490 microversion: 2.1 time: 0.403872 Jun 16 18:39:03.246361 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1105/2295] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:02 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1490 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:03.256298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:03.282037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:03.302789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:03.304898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.310197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:03.311070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.359217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:03.360352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.361211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lazy-loading 'fault' on Instance uuid 8bd3683c-d609-4a28-ad33-3d6223b2ea3f {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:39:03.609687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:03.626058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bba0a64194440f8bb6f4839f751db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863792ec29f746f3a811e43f63660e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:03.631466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:03.633426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:03.635054 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1d9cbd87-e210-4c1a-9ea3-8a5d4b730dad tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1441 microversion: 2.25 time: 0.387278 Jun 16 18:39:03.637606 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-844fdec5-85bc-490b-b4a3-31e5518557e0 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 200 len: 1365 microversion: 2.1 time: 0.525934 Jun 16 18:39:03.642468 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1191/2296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:03 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 1365 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:03.664381 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1106/2297] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:03 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1441 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:04.254661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:04.256711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:04.279215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.297230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.298553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.299191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.422511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef529906-adeb-4b2f-897c-cc15f87cc5c2 tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:04.442514 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef529906-adeb-4b2f-897c-cc15f87cc5c2 tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.434669 Jun 16 18:39:04.445766 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1192/2298] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:39:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:04.662644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:04.664204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] [instance: 8bd3683c-d609-4a28-ad33-3d6223b2ea3f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:04.689662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:04.694411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.694911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.704649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:04.708768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.716319 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-582fdf39-46db-4412-aa50-caf8fe130e7c tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1490 microversion: 2.1 time: 0.466561 Jun 16 18:39:04.716890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.730530 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1107/2299] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:04 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1490 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:04.750208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:04.757060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:04.780628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.783309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.784688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.788164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.789942 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] HTTP exception thrown: Instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f could not be found. Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Request method failure captured: Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f HTTP/1.1 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3h9kJLjBCUKcC3kbZsV8w8y--st2wWO2bfytDtdd4ppSs4q3Y6MvfWTXNkdxxCN5f8cGqbkDICSUoEXuJem1LBu4y35jyA-RAqh-2oNjMVSQhjijPBoNsqLe5nZEeohbTChw-9ymWOUY5sX3p8J_a0mQtO0naVZY6e71sXQIOm7e10 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 863792ec29f746f3a811e43f63660e11 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestManualDisk-1975975898 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/863792ec29f746f3a811e43f63660e11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/863792ec29f746f3a811e43f63660e11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_863792ec29f746f3a811e43f63660e11", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/863792ec29f746f3a811e43f63660e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestManualDisk-1975975898 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 863792ec29f746f3a811e43f63660e11 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestManualDisk-1975975898 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestManualDisk-1975975898-project Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 87bba0a64194440f8bb6f4839f751db9 Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestManualDisk-1975975898-project Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f could not be found. Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '8bd3683c-d609-4a28-ad33-3d6223b2ea3f'} Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f could not be found. Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f could not be found. Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:04.800966 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:04.805431 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:04.805431 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:04.805431 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:04.805431 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:04.805431 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:04.805431 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f could not be found. Jun 16 18:39:04.805431 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:04.808159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Returning 404 to user: Instance 8bd3683c-d609-4a28-ad33-3d6223b2ea3f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:04.809383 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d86e0249-f891-458b-a9fa-12cf91d2c247 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f" status: 404 len: 111 microversion: 2.1 time: 0.153238 Jun 16 18:39:04.814062 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1193/2300] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:04 2022] GET /compute/v2.1/servers/8bd3683c-d609-4a28-ad33-3d6223b2ea3f => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:39:04.826109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7d4a584-1bc1-4985-834b-2936dca91da1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] Calling method '.version_select at 0x7f8674042af0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:04.880225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7d4a584-1bc1-4985-834b-2936dca91da1 tempest-ServersTestManualDisk-1975975898 tempest-ServersTestManualDisk-1975975898-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-69486199" status: 202 len: 0 microversion: 2.1 time: 0.059248 Jun 16 18:39:04.881873 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1194/2301] 10.222.0.27 () {58 vars in 1214 bytes} [Thu Jun 16 18:39:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-69486199 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:39:04.945717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:04.966549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:04.972578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:04.975054 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ad93a4a-375b-4eff-ae58-7a4cc62ebfcf tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1266 microversion: 2.25 time: 0.240856 Jun 16 18:39:04.978286 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1108/2302] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:04 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:05.029304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-330ca460-60a6-4347-acd4-64dadb67327e req-7ec9c76c-e50f-4569-8a4d-a6c94984e8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be179f1-c859-45c9-a96c-f7f25f126546", "name": "network-vif-deleted", "tag": "f925959e-95a7-48a3-b183-5dd22c6a2665"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:05.051925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:05.060447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-330ca460-60a6-4347-acd4-64dadb67327e req-7ec9c76c-e50f-4569-8a4d-a6c94984e8d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:05.061045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-330ca460-60a6-4347-acd4-64dadb67327e req-7ec9c76c-e50f-4569-8a4d-a6c94984e8d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:05.120769 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-330ca460-60a6-4347-acd4-64dadb67327e req-7ec9c76c-e50f-4569-8a4d-a6c94984e8d7 service nova] Creating event network-vif-deleted:f925959e-95a7-48a3-b183-5dd22c6a2665 for instance 4be179f1-c859-45c9-a96c-f7f25f126546 on n-h2-846209-2 Jun 16 18:39:05.140732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-330ca460-60a6-4347-acd4-64dadb67327e req-7ec9c76c-e50f-4569-8a4d-a6c94984e8d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115416 Jun 16 18:39:05.141725 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1195/2303] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:05.747155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:05.748843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:05.759077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:05.766837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:05.803503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:05.804077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:05.806647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:05.807852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:05.828230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-387c040a-d6ae-4254-9f49-9ca61595a42b tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-511883214", "imageRef": "b71abfcc-5452-4597-acde-dcf27ebbbb39", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:05.972312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-387c040a-d6ae-4254-9f49-9ca61595a42b tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:39:06.840047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:06.858779 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9ceb2e52-6cf7-491f-88c7-a1749fd6f654 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1448 microversion: 2.1 time: 1.112741 Jun 16 18:39:06.860295 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1109/2304] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:05 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1448 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:39:06.867896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:06.874375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:06.888973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:06.890889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:06.893383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:06.895661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:07.077851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:07.093311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:07.102095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:07.103567 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4e7fcb62-d0a1-4e19-9d94-892e95e6ca87 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1266 microversion: 2.25 time: 0.242171 Jun 16 18:39:07.109991 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1110/2305] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:06 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:07.397826 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-387c040a-d6ae-4254-9f49-9ca61595a42b tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-387c040a-d6ae-4254-9f49-9ca61595a42b tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] Request method failure captured: Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 142 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3jHV2gafnWnuCFkSLg0dZUpBZv0JrhVohBPydvgaRkiLbm51v9VEksNT1L3ETs9hNe9SCdzNrvCF97z-YGW0oL2kyW4DaPUfbT1im4V_2CNtHZmtVTiyjDCtloMrR1o5oZk5C-RUeWFV4J0CVLX_AUXgvzHkV5z_T3CoGIg-Go2kjE Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8bc212ad52074c9fa282d475f6a1a161 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FlavorsV2NegativeTest-1643643920 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bc212ad52074c9fa282d475f6a1a161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8bc212ad52074c9fa282d475f6a1a161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8bc212ad52074c9fa282d475f6a1a161", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bc212ad52074c9fa282d475f6a1a161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FlavorsV2NegativeTest-1643643920 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8bc212ad52074c9fa282d475f6a1a161 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1643643920 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FlavorsV2NegativeTest-1643643920-project Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 82ab5fef817c493a877bf460c5b31f45 Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FlavorsV2NegativeTest-1643643920-project Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-511883214", "imageRef": "b71abfcc-5452-4597-acde-dcf27ebbbb39", "flavorRef": "452"}} Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: exception: Flavor's memory is too small for requested image. Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-511883214', 'imageRef': 'b71abfcc-5452-4597-acde-dcf27ebbbb39', 'flavorRef': '452'}}} Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:39:07.401120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-387c040a-d6ae-4254-9f49-9ca61595a42b tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-387c040a-d6ae-4254-9f49-9ca61595a42b tempest-FlavorsV2NegativeTest-1643643920 tempest-FlavorsV2NegativeTest-1643643920-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.583173 Jun 16 18:39:07.410216 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1196/2306] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:39:05 2022] POST /compute/v2.1/servers => generated 93 bytes in 1587 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:39:07.461128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-252b4c78-6c0c-4cd1-92cd-5de1165ddf9d req-ad7488db-1d5c-43e8-bc5a-6942ded37afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9316215-b4d6-4a88-a489-58555121da3a", "name": "network-vif-deleted", "tag": "78eaf1ec-7d79-4a41-a03d-3b5afdab1839"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:07.497554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-252b4c78-6c0c-4cd1-92cd-5de1165ddf9d req-ad7488db-1d5c-43e8-bc5a-6942ded37afe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:07.502928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-252b4c78-6c0c-4cd1-92cd-5de1165ddf9d req-ad7488db-1d5c-43e8-bc5a-6942ded37afe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:07.538268 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-252b4c78-6c0c-4cd1-92cd-5de1165ddf9d req-ad7488db-1d5c-43e8-bc5a-6942ded37afe service nova] Creating event network-vif-deleted:78eaf1ec-7d79-4a41-a03d-3b5afdab1839 for instance c9316215-b4d6-4a88-a489-58555121da3a on n-h2-846209-2 Jun 16 18:39:07.553821 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-252b4c78-6c0c-4cd1-92cd-5de1165ddf9d req-ad7488db-1d5c-43e8-bc5a-6942ded37afe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096626 Jun 16 18:39:07.556394 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1111/2307] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:07.901052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:07.902864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:07.939604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:07.940227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:07.944080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:07.951210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:08.116076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:08.117083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:08.118242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lazy-loading 'fault' on Instance uuid c9316215-b4d6-4a88-a489-58555121da3a {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:39:08.131293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:08.132726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:08.152498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:08.156525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:08.165172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:08.166577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:08.408175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:08.409726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:08.424987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92c36e81-7091-44a0-bd57-6b7a764a4a07 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 200 len: 1306 microversion: 2.1 time: 0.536684 Jun 16 18:39:08.426256 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1197/2308] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:07 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 1306 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:08.436241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:08.446472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:08.456892 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-125c863a-4aa7-42fe-9477-a938509964e4 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1266 microversion: 2.25 time: 0.331939 Jun 16 18:39:08.462103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1112/2309] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:08 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:09.447281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:09.447848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:09.464663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.467167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.468280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.472211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.485942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:09.486988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:09.500969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.504082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.509476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.511774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.523472 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a HTTP/1.1 Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c9316215-b4d6-4a88-a489-58555121da3a'} Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.526558 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.530437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.530437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.530437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:09.530437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:09.530437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.530437 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.530437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:09.531703 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24a8b923-a7f7-4f4c-868d-0515b5470d10 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 404 len: 111 microversion: 2.1 time: 0.090217 Jun 16 18:39:09.539249 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1198/2310] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:09 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:09.552714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:09.558404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:09.578637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.579472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.582666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.583938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.598212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:09.645042 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a HTTP/1.1 Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c9316215-b4d6-4a88-a489-58555121da3a'} Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:09.647382 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b4a4b4c-3ee7-457d-b956-de31cdfcecaa tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 404 len: 111 microversion: 2.1 time: 0.101013 Jun 16 18:39:09.653548 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1199/2311] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:09 2022] DELETE /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:09.667961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:09.668597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: c9316215-b4d6-4a88-a489-58555121da3a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:09.689758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.690334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.691172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.691804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.721513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:09.738615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:09.742040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:09.743445 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.743877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af8f4030-acb6-495b-b36a-ad9aa42ed943 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1266 microversion: 2.25 time: 0.268306 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a HTTP/1.1 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c9316215-b4d6-4a88-a489-58555121da3a'} Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.746201 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.752158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.752158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.752158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:09.752158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:09.752158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. Jun 16 18:39:09.752158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.753980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance c9316215-b4d6-4a88-a489-58555121da3a could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:09.755952 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1113/2312] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:09 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:09.761068 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab78cf2e-0bc4-494e-b131-60e0c4696d8d tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a" status: 404 len: 111 microversion: 2.1 time: 0.105059 Jun 16 18:39:09.762015 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1200/2313] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:09 2022] GET /compute/v2.1/servers/c9316215-b4d6-4a88-a489-58555121da3a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:09.780522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:09.781049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:09.807739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.811279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.814901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.816684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.853967 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f HTTP/1.1 Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '12755d5c-a24e-48ce-a3d1-a2f062d2a29f'} Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:09.856074 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a4622b44-99e9-496b-b25d-961d728a254b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 404 len: 111 microversion: 2.1 time: 0.083674 Jun 16 18:39:09.861323 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1114/2314] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:09 2022] DELETE /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:09.873780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:09.874583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 12755d5c-a24e-48ce-a3d1-a2f062d2a29f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:09.885793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.894993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.896195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.897469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.935881 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f HTTP/1.1 Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '12755d5c-a24e-48ce-a3d1-a2f062d2a29f'} Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.937668 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 12755d5c-a24e-48ce-a3d1-a2f062d2a29f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0329c32e-5ed1-4c86-a920-3d543175a194 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f" status: 404 len: 111 microversion: 2.1 time: 0.075274 Jun 16 18:39:09.946417 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1201/2315] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:09 2022] GET /compute/v2.1/servers/12755d5c-a24e-48ce-a3d1-a2f062d2a29f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:39:09.951809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:09.952326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:09.966982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.967551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:09.968367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:09.968824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.012213 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e HTTP/1.1 Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'b5f1a338-34e1-46a7-9a44-a4e6b1c3618e'} Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.013834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.018105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.021633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94ecfa7c-4803-44f0-b05e-dc1d50a55d9f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 404 len: 111 microversion: 2.1 time: 0.072988 Jun 16 18:39:10.026238 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1115/2316] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:09 2022] DELETE /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.031827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.032616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: b5f1a338-34e1-46a7-9a44-a4e6b1c3618e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.043750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.044366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.047469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.054178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.099554 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e HTTP/1.1 Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b5f1a338-34e1-46a7-9a44-a4e6b1c3618e'} Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.101422 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.105947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.105947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.105947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.105947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.105947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. Jun 16 18:39:10.105947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.107040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance b5f1a338-34e1-46a7-9a44-a4e6b1c3618e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.108867 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2bf784f3-4857-43a5-9cd7-1af9fb981ca5 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e" status: 404 len: 111 microversion: 2.1 time: 0.081454 Jun 16 18:39:10.119029 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1202/2317] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:10 2022] GET /compute/v2.1/servers/b5f1a338-34e1-46a7-9a44-a4e6b1c3618e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:39:10.119812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.120343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.134188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.134649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.135461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.138325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.162324 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 HTTP/1.1 Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '65c6c7ab-0c3f-422f-b198-897c7700caa8'} Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.164117 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0eeb915d-4355-49b7-8348-799ad0cc3acc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 404 len: 111 microversion: 2.1 time: 0.051915 Jun 16 18:39:10.168141 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1116/2318] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:10 2022] DELETE /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.180697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.181883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 65c6c7ab-0c3f-422f-b198-897c7700caa8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.196637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.197582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.199021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.199853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.232687 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 HTTP/1.1 Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '65c6c7ab-0c3f-422f-b198-897c7700caa8'} Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.235157 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.246882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.246882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.246882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.246882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.246882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. Jun 16 18:39:10.246882 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.250674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 65c6c7ab-0c3f-422f-b198-897c7700caa8 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.251800 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e07f9fcd-fc36-426f-8d38-b6ad2591316b tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8" status: 404 len: 111 microversion: 2.1 time: 0.078629 Jun 16 18:39:10.252566 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1203/2319] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:10 2022] GET /compute/v2.1/servers/65c6c7ab-0c3f-422f-b198-897c7700caa8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.266418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.267220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.282535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.283060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.283926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.284376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.320890 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 HTTP/1.1 Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'dc46a4bd-aa35-4968-a855-9c7527528187'} Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.328059 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-be8d4296-fe41-47cc-a61a-eaab193d93c6 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 404 len: 111 microversion: 2.1 time: 0.071846 Jun 16 18:39:10.332038 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1117/2320] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:10 2022] DELETE /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.341122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.342078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: dc46a4bd-aa35-4968-a855-9c7527528187] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.352059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.352759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.354100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.355378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.394448 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 HTTP/1.1 Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'dc46a4bd-aa35-4968-a855-9c7527528187'} Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.400297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.404956 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.404956 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.404956 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.404956 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.404956 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. Jun 16 18:39:10.404956 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.406586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance dc46a4bd-aa35-4968-a855-9c7527528187 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.407685 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef2f7fa0-176c-454a-aa0b-30c28c234f90 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187" status: 404 len: 111 microversion: 2.1 time: 0.070510 Jun 16 18:39:10.409496 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1204/2321] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:10 2022] GET /compute/v2.1/servers/dc46a4bd-aa35-4968-a855-9c7527528187 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.417698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.418501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.429735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.432378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.434352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.435882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.460521 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 HTTP/1.1 Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '71636c96-2206-4a76-9f30-5f0db5ecc7b7'} Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.462535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.466873 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.468642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.469873 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-85b465dc-2d74-4e42-9fbb-9fb14bb24447 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 404 len: 111 microversion: 2.1 time: 0.056258 Jun 16 18:39:10.471033 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1118/2322] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:10 2022] DELETE /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.484823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.485568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 71636c96-2206-4a76-9f30-5f0db5ecc7b7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.514120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.515080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.517387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.518676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.569379 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 HTTP/1.1 Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '71636c96-2206-4a76-9f30-5f0db5ecc7b7'} Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.571423 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 71636c96-2206-4a76-9f30-5f0db5ecc7b7 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6dd9ea22-aa62-4ca0-8699-b9b0ff100153 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7" status: 404 len: 111 microversion: 2.1 time: 0.096071 Jun 16 18:39:10.579745 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1205/2323] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:10 2022] GET /compute/v2.1/servers/71636c96-2206-4a76-9f30-5f0db5ecc7b7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.583440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.584391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 6e29326b-fb6e-40ad-8e3b-ad2f7a711575] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.611420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.611903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.612723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.613758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.634409 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575 HTTP/1.1 Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '6e29326b-fb6e-40ad-8e3b-ad2f7a711575'} Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.636596 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.640623 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.642307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.643409 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b2e96c52-e038-4f20-9fb2-3c08bdf11186 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575" status: 404 len: 111 microversion: 2.1 time: 0.065390 Jun 16 18:39:10.644919 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1119/2324] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:10 2022] DELETE /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.662972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.664390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 6e29326b-fb6e-40ad-8e3b-ad2f7a711575] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.688788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.690694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.694751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.696169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.752748 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575 HTTP/1.1 Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '6e29326b-fb6e-40ad-8e3b-ad2f7a711575'} Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.758358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:10.769580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:10.769580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:10.769580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:10.769580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:10.769580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. Jun 16 18:39:10.769580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:10.772093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.772093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.774535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 6e29326b-fb6e-40ad-8e3b-ad2f7a711575 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:10.775937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.776412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.777239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.777733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.779144 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3d4c5e7-32fc-4896-b11d-be339c945b1f tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575" status: 404 len: 111 microversion: 2.1 time: 0.126182 Jun 16 18:39:10.781168 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1206/2325] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:10 2022] GET /compute/v2.1/servers/6e29326b-fb6e-40ad-8e3b-ad2f7a711575 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:10.791519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:10.792920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:10.814450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.815217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.816339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:10.817050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:10.885216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:39:11.061522 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54d06f14-997a-46c0-ab26-50ed4e2ab8d8 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 204 len: 0 microversion: 2.1 time: 0.273972 Jun 16 18:39:11.069859 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1207/2326] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:10 2022] DELETE /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:39:11.099773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:11.106195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:11.123722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:11.125095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:11.126489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:11.129252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:11.648766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:11.671813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:11.674531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:11.676398 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-767e4888-6c2f-49c5-86ef-47323bacbf6c tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1266 microversion: 2.25 time: 0.917760 Jun 16 18:39:11.681739 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1120/2327] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:10 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1266 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:12.300600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:12.332376 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4ea4b419-3418-4faf-9ce4-b2b5f6f3ee65 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1478 microversion: 2.1 time: 1.255451 Jun 16 18:39:12.333415 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1208/2328] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:11 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1478 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:12.700391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:12.701466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:12.716626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:12.717808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:12.720618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:12.721966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:13.158658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:13.177856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:13.182045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:13.189142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f818f459-6055-4e44-ae0e-3d81e397d83f tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 200 len: 1266 microversion: 2.25 time: 0.487746 Jun 16 18:39:13.190708 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1121/2329] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:12 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 1266 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:13.369155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:13.369862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:13.399646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:13.401785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:13.403266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:13.408128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:14.076822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:14.093301 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-229a4d25-46ab-4c8d-bec3-d6349bd256a9 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1478 microversion: 2.1 time: 0.728988 Jun 16 18:39:14.105550 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1209/2330] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:13 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1478 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:14.210221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:14.211296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4be179f1-c859-45c9-a96c-f7f25f126546] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:14.226866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:14.240060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:14.243136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:14.243990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:14.292091 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] HTTP exception thrown: Instance 4be179f1-c859-45c9-a96c-f7f25f126546 could not be found. Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Request method failure captured: Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 HTTP/1.1 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3aOkHwUAKNJYbsDOEEnUI8igYHfw8J-vGK08BrmyKkm5QPET9B7swgEgke0HR11dMM7L36_OkDnn6PYSS8NO_wPot8a3qshSo5cScrrs4QKXSgF_r6V_ojtRh-KnqRpcooeOTcTq-lseDi8SUq9kuruAqTt97dRZdOIQYXiIBPk55I Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1d8ae8c43284fde8e49276c9e1faa8c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 4060431577d14c5198872173d8375e26 Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 4be179f1-c859-45c9-a96c-f7f25f126546 could not be found. Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '4be179f1-c859-45c9-a96c-f7f25f126546'} Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be179f1-c859-45c9-a96c-f7f25f126546 could not be found. Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be179f1-c859-45c9-a96c-f7f25f126546 could not be found. Jun 16 18:39:14.294025 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be179f1-c859-45c9-a96c-f7f25f126546 could not be found. Jun 16 18:39:14.297724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:14.300348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Returning 404 to user: Instance 4be179f1-c859-45c9-a96c-f7f25f126546 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:14.301930 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c817b84-d478-4516-ab28-962cb0b7ce13 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546" status: 404 len: 111 microversion: 2.25 time: 0.097370 Jun 16 18:39:14.306113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1122/2331] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:14 2022] GET /compute/v2.1/servers/4be179f1-c859-45c9-a96c-f7f25f126546 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:39:15.117647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:15.118675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:15.133020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:15.138196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:15.141361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:15.148897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:15.225625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:15.328041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f56d70d-1951-43d1-a2a3-a7a98711e21f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Calling method '.version_select at 0x7f866eba0ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:15.479293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-3f56d70d-1951-43d1-a2a3-a7a98711e21f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:39:15.480033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-3f56d70d-1951-43d1-a2a3-a7a98711e21f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Neutron security group 2e58fd64-206e-457e-805e-df3bf12cb946 not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:39:15.480706 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3f56d70d-1951-43d1-a2a3-a7a98711e21f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] HTTP exception thrown: Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist Jun 16 18:39:15.480706 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-5e953ff8-4f56-4419-98e8-af277549e4c6'] Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f56d70d-1951-43d1-a2a3-a7a98711e21f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Request method failure captured: Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-security-groups/2e58fd64-206e-457e-805e-df3bf12cb946 HTTP/1.1 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3jSDxLX82KPDCJP3gX8pmz78LX2DKzdvwoV16tDir20Cz03bCtzhf4ToeWa3P6KW_g7tw_-QvkyWJ2hJ9YRofO5LT_fb-sYXv7ho5CSbyqXPUpCMqksK6fsN665Z1aDSza9R3ZSln_FstrAYl3RMBIPLSv-ZvU3w1uREkYtcl6xSdY Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/580a91be08014b8091c69ad838f1e331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_580a91be08014b8091c69ad838f1e331", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 71f2ee7dfc8d4dcd9dea0278fb40b331 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-5e953ff8-4f56-4419-98e8-af277549e4c6'] Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2e58fd64-206e-457e-805e-df3bf12cb946'} Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:39:15.482949 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e953ff8-4f56-4419-98e8-af277549e4c6'] Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e953ff8-4f56-4419-98e8-af277549e4c6'] Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e953ff8-4f56-4419-98e8-af277549e4c6'] Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e953ff8-4f56-4419-98e8-af277549e4c6'] Jun 16 18:39:15.487064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:15.490885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f56d70d-1951-43d1-a2a3-a7a98711e21f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Returning 404 to user: Security group 2e58fd64-206e-457e-805e-df3bf12cb946 does not exist Jun 16 18:39:15.490885 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-5e953ff8-4f56-4419-98e8-af277549e4c6'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:15.491634 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3f56d70d-1951-43d1-a2a3-a7a98711e21f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2e58fd64-206e-457e-805e-df3bf12cb946" status: 404 len: 194 microversion: 2.1 time: 0.425894 Jun 16 18:39:15.492672 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1210/2332] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:39:15 2022] DELETE /compute/v2.1/os-security-groups/2e58fd64-206e-457e-805e-df3bf12cb946 => generated 194 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:15.501842 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34227eb0-b208-4fc2-bda5-a02cbb2648ff tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004080 Jun 16 18:39:15.506906 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1211/2333] 10.222.0.27 () {58 vars in 1163 bytes} [Thu Jun 16 18:39:15 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:39:15.526401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e65c917c-7431-4901-ab4d-688a854f1640 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Calling method '.version_select at 0x7f866f4c7a60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:16.564589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:16.581956 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c022aaf4-e072-4a2e-a842-1731544931c0 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1478 microversion: 2.1 time: 1.473363 Jun 16 18:39:16.583078 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1123/2334] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:15 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1478 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:17.060092 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e65c917c-7431-4901-ab4d-688a854f1640 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.548181 Jun 16 18:39:17.068084 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1212/2335] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:39:15 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:17.073996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfde2090-7ea5-49a2-89f7-f2c864db4403 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Calling method '.version_select at 0x7f866e9798b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:17.470177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-bfde2090-7ea5-49a2-89f7-f2c864db4403 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:39:17.471450 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-bfde2090-7ea5-49a2-89f7-f2c864db4403 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 16 18:39:17.471450 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-10b35c9d-723a-42e3-b725-835a6fe04fa1'] Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfde2090-7ea5-49a2-89f7-f2c864db4403 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Request method failure captured: Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-security-groups/a19174d1-ca9d-4445-a910-3d3f22b5880c HTTP/1.1 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3jSDxLX82KPDCJP3gX8pmz78LX2DKzdvwoV16tDir20Cz03bCtzhf4ToeWa3P6KW_g7tw_-QvkyWJ2hJ9YRofO5LT_fb-sYXv7ho5CSbyqXPUpCMqksK6fsN665Z1aDSza9R3ZSln_FstrAYl3RMBIPLSv-ZvU3w1uREkYtcl6xSdY Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/580a91be08014b8091c69ad838f1e331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_580a91be08014b8091c69ad838f1e331", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 71f2ee7dfc8d4dcd9dea0278fb40b331 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: exception: Insufficient rights for removing default security group. Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-10b35c9d-723a-42e3-b725-835a6fe04fa1'] Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a19174d1-ca9d-4445-a910-3d3f22b5880c'} Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:39:17.475034 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10b35c9d-723a-42e3-b725-835a6fe04fa1'] Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10b35c9d-723a-42e3-b725-835a6fe04fa1'] Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10b35c9d-723a-42e3-b725-835a6fe04fa1'] Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10b35c9d-723a-42e3-b725-835a6fe04fa1'] Jun 16 18:39:17.478668 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.482000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfde2090-7ea5-49a2-89f7-f2c864db4403 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 16 18:39:17.482000 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-10b35c9d-723a-42e3-b725-835a6fe04fa1'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:17.483355 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bfde2090-7ea5-49a2-89f7-f2c864db4403 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a19174d1-ca9d-4445-a910-3d3f22b5880c" status: 400 len: 182 microversion: 2.1 time: 0.414047 Jun 16 18:39:17.484895 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1124/2336] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:39:17 2022] DELETE /compute/v2.1/os-security-groups/a19174d1-ca9d-4445-a910-3d3f22b5880c => generated 182 bytes in 416 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:39:17.515904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3e0d0ba-6557-4fe7-a295-24ccec95df2f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Calling method '.version_select at 0x7f866f6cb4c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:17.592325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-a3e0d0ba-6557-4fe7-a295-24ccec95df2f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:39:17.594909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-a3e0d0ba-6557-4fe7-a295-24ccec95df2f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Neutron security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:39:17.596585 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a3e0d0ba-6557-4fe7-a295-24ccec95df2f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] HTTP exception thrown: Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist Jun 16 18:39:17.596585 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-8430d091-7033-49c8-a3fa-2344d6efcbc9'] Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3e0d0ba-6557-4fe7-a295-24ccec95df2f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Request method failure captured: Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-security-groups/f10d7f65-eb83-44fd-87bc-f5e6d44117d3 HTTP/1.1 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3jSDxLX82KPDCJP3gX8pmz78LX2DKzdvwoV16tDir20Cz03bCtzhf4ToeWa3P6KW_g7tw_-QvkyWJ2hJ9YRofO5LT_fb-sYXv7ho5CSbyqXPUpCMqksK6fsN665Z1aDSza9R3ZSln_FstrAYl3RMBIPLSv-ZvU3w1uREkYtcl6xSdY Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/580a91be08014b8091c69ad838f1e331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_580a91be08014b8091c69ad838f1e331", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 71f2ee7dfc8d4dcd9dea0278fb40b331 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-8430d091-7033-49c8-a3fa-2344d6efcbc9'] Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f10d7f65-eb83-44fd-87bc-f5e6d44117d3'} Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:39:17.608815 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8430d091-7033-49c8-a3fa-2344d6efcbc9'] Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8430d091-7033-49c8-a3fa-2344d6efcbc9'] Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8430d091-7033-49c8-a3fa-2344d6efcbc9'] Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8430d091-7033-49c8-a3fa-2344d6efcbc9'] Jun 16 18:39:17.616397 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.630138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:17.630138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:17.630138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:17.632752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3e0d0ba-6557-4fe7-a295-24ccec95df2f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Returning 404 to user: Security group f10d7f65-eb83-44fd-87bc-f5e6d44117d3 does not exist Jun 16 18:39:17.632752 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-8430d091-7033-49c8-a3fa-2344d6efcbc9'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:17.634411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:17.640736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:17.641967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:17.654417 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3e0d0ba-6557-4fe7-a295-24ccec95df2f tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/f10d7f65-eb83-44fd-87bc-f5e6d44117d3" status: 404 len: 194 microversion: 2.1 time: 0.152344 Jun 16 18:39:17.672622 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1213/2337] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:39:17 2022] GET /compute/v2.1/os-security-groups/f10d7f65-eb83-44fd-87bc-f5e6d44117d3 => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:17.710420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba32e5f8-fc65-43cb-85d0-e0f674742974 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Action: 'update', calling method: .version_select at 0x7f866f6da1f0>, body: {"security_group": {"name": "tempest-sg-1245363177", "description": "tempest-description-942597878"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:17.961616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-ba32e5f8-fc65-43cb-85d0-e0f674742974 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:39:17.962259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-ba32e5f8-fc65-43cb-85d0-e0f674742974 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Neutron security group 976082a9-773a-456a-8d08-4e6c45505bd2 not found {{(pid=119206) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:39:17.962793 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ba32e5f8-fc65-43cb-85d0-e0f674742974 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] HTTP exception thrown: Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist Jun 16 18:39:17.962793 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-ed3f7196-1616-4169-ac89-be05fc0f4f0f'] Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba32e5f8-fc65-43cb-85d0-e0f674742974 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Request method failure captured: Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/os-security-groups/976082a9-773a-456a-8d08-4e6c45505bd2 HTTP/1.1 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 101 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3jSDxLX82KPDCJP3gX8pmz78LX2DKzdvwoV16tDir20Cz03bCtzhf4ToeWa3P6KW_g7tw_-QvkyWJ2hJ9YRofO5LT_fb-sYXv7ho5CSbyqXPUpCMqksK6fsN665Z1aDSza9R3ZSln_FstrAYl3RMBIPLSv-ZvU3w1uREkYtcl6xSdY Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/580a91be08014b8091c69ad838f1e331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_580a91be08014b8091c69ad838f1e331", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/580a91be08014b8091c69ad838f1e331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 580a91be08014b8091c69ad838f1e331 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 71f2ee7dfc8d4dcd9dea0278fb40b331 Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1320880241-project Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: {"security_group": {"name": "tempest-sg-1245363177", "description": "tempest-description-942597878"}} Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-ed3f7196-1616-4169-ac89-be05fc0f4f0f'] Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '976082a9-773a-456a-8d08-4e6c45505bd2', 'body': {'security_group': {'name': 'tempest-sg-1245363177', 'description': 'tempest-description-942597878'}}} Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:39:17.964796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3f7196-1616-4169-ac89-be05fc0f4f0f'] Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3f7196-1616-4169-ac89-be05fc0f4f0f'] Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3f7196-1616-4169-ac89-be05fc0f4f0f'] Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3f7196-1616-4169-ac89-be05fc0f4f0f'] Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba32e5f8-fc65-43cb-85d0-e0f674742974 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] Returning 404 to user: Security group 976082a9-773a-456a-8d08-4e6c45505bd2 does not exist Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-ed3f7196-1616-4169-ac89-be05fc0f4f0f'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ba32e5f8-fc65-43cb-85d0-e0f674742974 tempest-SecurityGroupsNegativeTestJSON-1320880241 tempest-SecurityGroupsNegativeTestJSON-1320880241-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/976082a9-773a-456a-8d08-4e6c45505bd2" status: 404 len: 194 microversion: 2.1 time: 0.291687 Jun 16 18:39:17.968851 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1214/2338] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Jun 16 18:39:17 2022] PUT /compute/v2.1/os-security-groups/976082a9-773a-456a-8d08-4e6c45505bd2 => generated 194 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:17.983191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '344b166b0b2f4af8b2c5db81eb5a658b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f23c5552fe4c869ccd2f1145571f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:18.026639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4ed5379-3889-4233-a641-0a07ffa30629 tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 200 len: 1436 microversion: 2.1 time: 0.421335 Jun 16 18:39:18.044162 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1125/2339] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:17 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 1436 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:18.052490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-13c3a77f-cb3b-4310-af49-ac7970edad97 req-b23cd723-f95c-4fa7-b669-be03b613a9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa", "name": "network-vif-deleted", "tag": "e9fb4dde-f4d4-44f7-9761-1b447219da30"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:18.086959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-13c3a77f-cb3b-4310-af49-ac7970edad97 req-b23cd723-f95c-4fa7-b669-be03b613a9d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:18.087977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-13c3a77f-cb3b-4310-af49-ac7970edad97 req-b23cd723-f95c-4fa7-b669-be03b613a9d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:18.160589 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-13c3a77f-cb3b-4310-af49-ac7970edad97 req-b23cd723-f95c-4fa7-b669-be03b613a9d7 service nova] Creating event network-vif-deleted:e9fb4dde-f4d4-44f7-9761-1b447219da30 for instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa on n-h1-846209-2 Jun 16 18:39:18.180511 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-13c3a77f-cb3b-4310-af49-ac7970edad97 req-b23cd723-f95c-4fa7-b669-be03b613a9d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133639 Jun 16 18:39:18.197484 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1215/2340] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:19.049887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:19.050532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] [instance: 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:19.058163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:19.065461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:19.073548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:19.077773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:19.159573 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] HTTP exception thrown: Instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa could not be found. Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Request method failure captured: Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa HTTP/1.1 Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3etch8_sM41JAB_xvcRTOF5btJJPgFgmjuLp8GbOW07ct-FXjOxS78qWoJYL9K5YouxVq45KRom8sB_ze8zGeUb5EezMVOg2ygtZI2rF15WNGmhDKnDm1YT2yURTtZ7dkXg5Ji4tttso0eflDG2FlTNkeThMg2J60XOrytNDtzsx4w Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64f23c5552fe4c869ccd2f1145571f0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64f23c5552fe4c869ccd2f1145571f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestJSON-740219656 Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 64f23c5552fe4c869ccd2f1145571f0b Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestJSON-740219656 Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestJSON-740219656-project Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 344b166b0b2f4af8b2c5db81eb5a658b Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestJSON-740219656-project Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa could not be found. Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa'} Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa could not be found. Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa could not be found. Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:19.161797 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:19.166838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:19.166838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:19.166838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:19.166838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:19.166838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa could not be found. Jun 16 18:39:19.166838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:19.166838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] Returning 404 to user: Instance 4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:19.172470 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-15a03a35-5040-4be1-903c-eab5436e29bc tempest-ServersTestJSON-740219656 tempest-ServersTestJSON-740219656-project] 10.222.0.27 "GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa" status: 404 len: 111 microversion: 2.1 time: 0.125005 Jun 16 18:39:19.174067 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1126/2341] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:19 2022] GET /compute/v2.1/servers/4d09d12b-d8a9-4ebf-9dc0-cfad8df0f6aa => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:22.532619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:22.533427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:22.569062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.569492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:22.591617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.597820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:22.684572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:39:22.911803 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0bcabc0f-4822-4366-b255-68264f7f904d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 204 len: 0 microversion: 2.25 time: 0.387596 Jun 16 18:39:22.913222 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1216/2342] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:39:22 2022] DELETE /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:39:22.921674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:22.922907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:22.934798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.935292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:22.936291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.936766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:24.590158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-805d0eeb-df56-491e-a266-63936ad3dde2 req-26621fbf-5566-4c72-a206-7a3a4afd8053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d14e76-7250-4441-98dc-a361072f16a9", "name": "network-vif-deleted", "tag": "f34965d0-9ef6-4965-808e-58e621c5c0b2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:24.609653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-805d0eeb-df56-491e-a266-63936ad3dde2 req-26621fbf-5566-4c72-a206-7a3a4afd8053 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:24.610727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-805d0eeb-df56-491e-a266-63936ad3dde2 req-26621fbf-5566-4c72-a206-7a3a4afd8053 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:24.649240 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-805d0eeb-df56-491e-a266-63936ad3dde2 req-26621fbf-5566-4c72-a206-7a3a4afd8053 service nova] Creating event network-vif-deleted:f34965d0-9ef6-4965-808e-58e621c5c0b2 for instance 39d14e76-7250-4441-98dc-a361072f16a9 on n-h2-846209-2 Jun 16 18:39:24.664694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-805d0eeb-df56-491e-a266-63936ad3dde2 req-26621fbf-5566-4c72-a206-7a3a4afd8053 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086907 Jun 16 18:39:24.667350 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1217/2343] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:25.087030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:25.134442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:25.138008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:25.156932 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa6b982d-796a-4384-9280-0d2c28ce96aa tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 200 len: 1614 microversion: 2.25 time: 2.223618 Jun 16 18:39:25.159029 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1127/2344] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:22 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 1614 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:26.180062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:26.180985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 39d14e76-7250-4441-98dc-a361072f16a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:26.211556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.212305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:26.213813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.216480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:26.278173 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] HTTP exception thrown: Instance 39d14e76-7250-4441-98dc-a361072f16a9 could not be found. Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Request method failure captured: Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 HTTP/1.1 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3aOkHwUAKNJYbsDOEEnUI8igYHfw8J-vGK08BrmyKkm5QPET9B7swgEgke0HR11dMM7L36_OkDnn6PYSS8NO_wPot8a3qshSo5cScrrs4QKXSgF_r6V_ojtRh-KnqRpcooeOTcTq-lseDi8SUq9kuruAqTt97dRZdOIQYXiIBPk55I Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1d8ae8c43284fde8e49276c9e1faa8c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 4060431577d14c5198872173d8375e26 Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 39d14e76-7250-4441-98dc-a361072f16a9 could not be found. Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '39d14e76-7250-4441-98dc-a361072f16a9'} Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d14e76-7250-4441-98dc-a361072f16a9 could not be found. Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d14e76-7250-4441-98dc-a361072f16a9 could not be found. Jun 16 18:39:26.284495 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d14e76-7250-4441-98dc-a361072f16a9 could not be found. Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Returning 404 to user: Instance 39d14e76-7250-4441-98dc-a361072f16a9 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:26.289282 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-143d4aa0-8be1-40f4-9a8b-496aaf9709f7 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9" status: 404 len: 111 microversion: 2.25 time: 0.114020 Jun 16 18:39:26.291061 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1218/2345] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:26 2022] GET /compute/v2.1/servers/39d14e76-7250-4441-98dc-a361072f16a9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:39:26.299866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:26.301188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:26.320481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.322464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:26.322464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.332477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:26.533784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:39:26.757024 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2c8ad6ef-4420-4dc7-b148-d5690d6eaba6 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 204 len: 0 microversion: 2.25 time: 0.457096 Jun 16 18:39:26.759989 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1128/2346] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:39:26 2022] DELETE /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:39:26.780945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:26.790054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:26.816475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.821108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:26.828397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.845883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:27.578874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:27.623204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:27.625067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:27.627081 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd8532cf-d54e-4ac6-9b06-42a7ed4905b3 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1549 microversion: 2.25 time: 0.859826 Jun 16 18:39:27.628082 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1219/2347] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:26 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1549 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:28.659936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:28.661935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:28.678432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:28.680043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:28.686700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:28.687731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:29.459777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:29.479480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:29.488053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:29.495011 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-580b5903-3e97-4ad0-ba4b-a3c0ce9ade5e tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1549 microversion: 2.25 time: 0.834805 Jun 16 18:39:29.495696 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1129/2348] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:28 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1549 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:29.909045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-88fab9cd-11e3-4943-abad-3e1d63b96dbb req-7322d350-c3b1-4d86-9767-843c95502b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dec74f5-68be-47e2-acc5-8a6eec839883", "name": "network-vif-deleted", "tag": "5bf53088-fbdc-47e4-86c7-3a95436ab49b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:29.954526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-88fab9cd-11e3-4943-abad-3e1d63b96dbb req-7322d350-c3b1-4d86-9767-843c95502b66 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:29.955292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-88fab9cd-11e3-4943-abad-3e1d63b96dbb req-7322d350-c3b1-4d86-9767-843c95502b66 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:30.008128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-88fab9cd-11e3-4943-abad-3e1d63b96dbb req-7322d350-c3b1-4d86-9767-843c95502b66 service nova] Creating event network-vif-deleted:5bf53088-fbdc-47e4-86c7-3a95436ab49b for instance 4dec74f5-68be-47e2-acc5-8a6eec839883 on n-h1-846209-2 Jun 16 18:39:30.029200 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-88fab9cd-11e3-4943-abad-3e1d63b96dbb req-7322d350-c3b1-4d86-9767-843c95502b66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149373 Jun 16 18:39:30.032360 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1220/2349] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:30.515253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:30.515878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:30.519856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:30.528027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:30.528739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:30.529700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:30.530356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:30.596785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:30.598336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:30.600988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lazy-loading 'fault' on Instance uuid 4dec74f5-68be-47e2-acc5-8a6eec839883 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:39:30.740282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:30.751587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:30.753845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:30.755944 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a48e5a28-792b-4428-8329-ebdde5df7c1d tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 200 len: 1352 microversion: 2.25 time: 0.245654 Jun 16 18:39:30.756981 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1130/2350] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:30 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 1352 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:31.797959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:31.799760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 4dec74f5-68be-47e2-acc5-8a6eec839883] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:31.860961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:31.869953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:31.876197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:31.877970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:31.951656 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] HTTP exception thrown: Instance 4dec74f5-68be-47e2-acc5-8a6eec839883 could not be found. Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Request method failure captured: Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 HTTP/1.1 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3aOkHwUAKNJYbsDOEEnUI8igYHfw8J-vGK08BrmyKkm5QPET9B7swgEgke0HR11dMM7L36_OkDnn6PYSS8NO_wPot8a3qshSo5cScrrs4QKXSgF_r6V_ojtRh-KnqRpcooeOTcTq-lseDi8SUq9kuruAqTt97dRZdOIQYXiIBPk55I Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1d8ae8c43284fde8e49276c9e1faa8c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 4060431577d14c5198872173d8375e26 Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 4dec74f5-68be-47e2-acc5-8a6eec839883 could not be found. Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '4dec74f5-68be-47e2-acc5-8a6eec839883'} Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dec74f5-68be-47e2-acc5-8a6eec839883 could not be found. Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dec74f5-68be-47e2-acc5-8a6eec839883 could not be found. Jun 16 18:39:31.956298 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dec74f5-68be-47e2-acc5-8a6eec839883 could not be found. Jun 16 18:39:31.960255 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:39:31.963984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Returning 404 to user: Instance 4dec74f5-68be-47e2-acc5-8a6eec839883 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:31.966994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36ea4071-2782-4753-bdf1-45f975a7e423 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883" status: 404 len: 111 microversion: 2.25 time: 0.193067 Jun 16 18:39:32.002758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:32.006680 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1221/2351] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:31 2022] GET /compute/v2.1/servers/4dec74f5-68be-47e2-acc5-8a6eec839883 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:39:32.008297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:32.026950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:32.028910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:32.030726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:32.031675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:32.100175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:39:32.349800 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d4769abe-85c0-462b-9c6f-6781ca198957 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 204 len: 0 microversion: 2.25 time: 0.369212 Jun 16 18:39:32.364878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:32.365883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:32.369257 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1131/2352] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:39:31 2022] DELETE /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:39:32.389074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:32.390121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:32.391510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:32.392378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:33.422600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:33.441509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:33.449316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:33.450834 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-421c66da-56a0-4977-87e3-4d31f754e8b5 tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1563 microversion: 2.25 time: 1.093230 Jun 16 18:39:33.455862 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1222/2353] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:32 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1563 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:34.479838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:34.480686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:34.506889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:34.507476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:34.508339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:34.514077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:34.910580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bb309bdd-904d-4114-b982-91b4e5fabb41 req-d2f2c817-b114-490d-be64-a794e05f989f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8542d7-28dd-4d92-9478-29f75115d971", "name": "network-vif-deleted", "tag": "48a523f8-07e1-4b76-94e5-113d1c400297"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:34.950488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:34.986809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bb309bdd-904d-4114-b982-91b4e5fabb41 req-d2f2c817-b114-490d-be64-a794e05f989f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:34.988791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bb309bdd-904d-4114-b982-91b4e5fabb41 req-d2f2c817-b114-490d-be64-a794e05f989f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:35.071523 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bb309bdd-904d-4114-b982-91b4e5fabb41 req-d2f2c817-b114-490d-be64-a794e05f989f service nova] Creating event network-vif-deleted:48a523f8-07e1-4b76-94e5-113d1c400297 for instance 8a8542d7-28dd-4d92-9478-29f75115d971 on n-h2-846209-2 Jun 16 18:39:35.087291 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bb309bdd-904d-4114-b982-91b4e5fabb41 req-d2f2c817-b114-490d-be64-a794e05f989f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185888 Jun 16 18:39:35.090816 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1223/2354] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:35.737647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:35.757148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:35.761538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4060431577d14c5198872173d8375e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d8ae8c43284fde8e49276c9e1faa8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:35.763989 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4b50a849-fde7-4c05-89f5-78e05c4cb68b tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 200 len: 1521 microversion: 2.25 time: 1.290691 Jun 16 18:39:35.765657 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1132/2355] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:34 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 1521 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:39:35.868584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-163518750", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:35.995436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:39:36.690628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:39:36.693070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:39:36.695996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:39:36.696689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:39:36.697763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:39:36.720749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.721031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.730595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.731357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.780195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Getting quotas for project 49f937ac41884c63883ac78b32d9c906. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:39:36.783946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:36.784580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] [instance: 8a8542d7-28dd-4d92-9478-29f75115d971] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:36.792499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Getting quotas for user 47c3a5005dfd4624bc5316e1fd79d09b and project 49f937ac41884c63883ac78b32d9c906. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:39:36.798177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.799018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.809152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.809861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.819007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:39:36.825201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:39:36.826525 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] HTTP exception thrown: Instance 8a8542d7-28dd-4d92-9478-29f75115d971 could not be found. Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Request method failure captured: Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 HTTP/1.1 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3aOkHwUAKNJYbsDOEEnUI8igYHfw8J-vGK08BrmyKkm5QPET9B7swgEgke0HR11dMM7L36_OkDnn6PYSS8NO_wPot8a3qshSo5cScrrs4QKXSgF_r6V_ojtRh-KnqRpcooeOTcTq-lseDi8SUq9kuruAqTt97dRZdOIQYXiIBPk55I Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1d8ae8c43284fde8e49276c9e1faa8c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1d8ae8c43284fde8e49276c9e1faa8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d1d8ae8c43284fde8e49276c9e1faa8c Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-385871389 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 4060431577d14c5198872173d8375e26 Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-385871389-project Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 8a8542d7-28dd-4d92-9478-29f75115d971 could not be found. Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '8a8542d7-28dd-4d92-9478-29f75115d971'} Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8542d7-28dd-4d92-9478-29f75115d971 could not be found. Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8542d7-28dd-4d92-9478-29f75115d971 could not be found. Jun 16 18:39:36.838535 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8542d7-28dd-4d92-9478-29f75115d971 could not be found. Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] Returning 404 to user: Instance 8a8542d7-28dd-4d92-9478-29f75115d971 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:36.845957 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a4de451-3375-4bf2-9d20-1fadccb04a6a tempest-LiveAutoBlockMigrationV225Test-385871389 tempest-LiveAutoBlockMigrationV225Test-385871389-project] 10.222.0.27 "GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971" status: 404 len: 111 microversion: 2.25 time: 0.060392 Jun 16 18:39:36.847702 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1133/2356] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:39:36 2022] GET /compute/v2.1/servers/8a8542d7-28dd-4d92-9478-29f75115d971 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:39:36.890909 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19a07ea1-2bbe-4a5a-9ccc-4630910612b4 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385941 Jun 16 18:39:36.898269 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1224/2357] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:39:36.902764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-93cbb3cc-34fc-4686-a0fc-b72664a0a90d tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:36.903396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-93cbb3cc-34fc-4686-a0fc-b72664a0a90d tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:37.195641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-93cbb3cc-34fc-4686-a0fc-b72664a0a90d tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:37.220055 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-93cbb3cc-34fc-4686-a0fc-b72664a0a90d tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1213 microversion: 2.1 time: 0.321098 Jun 16 18:39:37.220770 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1134/2358] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:36 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1213 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:39:38.291777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:38.298825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:38.321095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:38.323996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:38.327042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:38.331141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:38.652200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:38.715136 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7d2919f9-a829-415e-8368-a8e703fb77cc tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1265 microversion: 2.1 time: 0.463472 Jun 16 18:39:38.739039 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1225/2359] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:38 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1265 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:39.812412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:39.822329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:39.862317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:39.863632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:39.868743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:39.870822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:40.431345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:40.448073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-494cf02a-33c2-4077-b1b1-4a82921dd30c tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Action: 'create', calling method: .version_select at 0x7f866ec44940>, body: {"pool": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:40.463855 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-46a30bd9-187c-49df-979a-377d3e20f348 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1271 microversion: 2.1 time: 0.717901 Jun 16 18:39:40.482508 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1135/2360] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:39 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1271 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:41.489834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:41.497300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:41.544262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:41.544759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:41.545738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:41.555921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:43.647071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:43.656044 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-15a09ede-8c87-4c29-9f92-48ba5f66cff1 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1313 microversion: 2.1 time: 2.173428 Jun 16 18:39:43.675702 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1136/2361] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:41 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1313 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:43.710579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c2af0512-ec55-4577-9915-485e92c7e708 req-36c409ce-f16c-4e09-a488-30f917df3b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395", "tag": "422008fb-a82c-4988-94b9-1bfc50079ddd"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:43.756264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2af0512-ec55-4577-9915-485e92c7e708 req-36c409ce-f16c-4e09-a488-30f917df3b5b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:43.757041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2af0512-ec55-4577-9915-485e92c7e708 req-36c409ce-f16c-4e09-a488-30f917df3b5b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:43.791515 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c2af0512-ec55-4577-9915-485e92c7e708 req-36c409ce-f16c-4e09-a488-30f917df3b5b service nova] Creating event network-changed:422008fb-a82c-4988-94b9-1bfc50079ddd for instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 on n-h2-846209-2 Jun 16 18:39:43.810014 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c2af0512-ec55-4577-9915-485e92c7e708 req-36c409ce-f16c-4e09-a488-30f917df3b5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128250 Jun 16 18:39:43.819107 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1137/2362] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:44.675674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:44.676414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:44.691823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:44.719215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:44.721199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:44.722320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:46.070185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:46.072777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:46.084473 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-093ca83a-0d47-4695-a9f6-46cd76ed2326 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1313 microversion: 2.1 time: 1.414281 Jun 16 18:39:46.095361 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1138/2363] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:44 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1313 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:46.761725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:46.809423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:47.102788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:47.103417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:47.127422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:47.127900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:47.128721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:47.129162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:47.209037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:48.278975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:48.315873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:48.343509 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f884057-276c-4ca1-9a25-f2da9ef76b9b tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1313 microversion: 2.1 time: 1.244901 Jun 16 18:39:48.345777 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1139/2364] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:47 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1313 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:39:48.697196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:49.361814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:49.363156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:49.391671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:49.392135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:49.392959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:49.393636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:49.726347 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-494cf02a-33c2-4077-b1b1-4a82921dd30c tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.594223 Jun 16 18:39:49.730255 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1226/2365] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:39:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:49.745482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-53b7f880-8d7e-4261-81c0-e4fa2b9f0b14 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Action: 'create', calling method: .version_select at 0x7f86741b6310>, body: {"pool": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:51.578002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:51.588445 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62b08628-4366-4ce8-a88a-3c4a67ba7c73 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1313 microversion: 2.1 time: 2.230514 Jun 16 18:39:51.595258 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1140/2366] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:49 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1313 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:51.610325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c0e37bcb-555a-4fc3-ba95-94e03f3819b6 req-0437df44-782f-4d83-b9ad-daaf1db38d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395", "name": "network-vif-plugged", "status": "completed", "tag": "422008fb-a82c-4988-94b9-1bfc50079ddd"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:51.623964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c0e37bcb-555a-4fc3-ba95-94e03f3819b6 req-0437df44-782f-4d83-b9ad-daaf1db38d0c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:51.631092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c0e37bcb-555a-4fc3-ba95-94e03f3819b6 req-0437df44-782f-4d83-b9ad-daaf1db38d0c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:51.657263 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c0e37bcb-555a-4fc3-ba95-94e03f3819b6 req-0437df44-782f-4d83-b9ad-daaf1db38d0c service nova] Creating event network-vif-plugged:422008fb-a82c-4988-94b9-1bfc50079ddd for instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 on n-h2-846209-2 Jun 16 18:39:51.670810 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c0e37bcb-555a-4fc3-ba95-94e03f3819b6 req-0437df44-782f-4d83-b9ad-daaf1db38d0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073625 Jun 16 18:39:51.672698 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1141/2367] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:52.142115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1194405515", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "d558b9ab-8351-4459-8106-38a3dec83045"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:52.263308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] validate_networks() for [('d558b9ab-8351-4459-8106-38a3dec83045', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:39:55.596551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:39:55.598217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:39:55.601816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:39:55.603476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:39:55.604109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:39:55.639741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:55.650419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:55.651700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:55.653088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:55.681327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Getting quotas for project 70e471697d5b480990e27d9c52fc10f5. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:39:55.696234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Getting quotas for user d69a9d3a40254394b5ffcbb04aa64533 and project 70e471697d5b480990e27d9c52fc10f5. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:39:55.727168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:39:55.732478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:39:55.829609 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.129160 Jun 16 18:39:55.835214 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1142/2368] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:39:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:39:55.852540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:55.853853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:55.865484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:55.867918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:55.871959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:55.874327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:56.453099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:56.466735 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-beba21f4-e299-42c4-982c-9f71d6e84808 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1463 microversion: 2.1 time: 0.620485 Jun 16 18:39:56.471993 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1143/2369] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:55 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1463 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:56.587268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10a42c46-6440-489b-ab0a-cd55d6330848 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Action: 'create', calling method: .version_select at 0x7f8677fdcaf0>, body: {"keypair": {"name": "tempest-keypair-705993029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZu3qSzQzPFBOC7iUASbq+BZ9rGbYcYPMomr/eiADswTTSCTp8t59dBasD/fpbrq+KoXjuh3Azq0oJ7eymUJYBG4yWtqbC1OsjVw2ThRJf3pl+AzUKB9ayKubfxZ8QHrw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:56.645028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-10a42c46-6440-489b-ab0a-cd55d6330848 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Getting quotas for project 3b6359c0b3f04ea9b5dac20090c13793. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:39:56.671862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-10a42c46-6440-489b-ab0a-cd55d6330848 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Getting quotas for user 850790080e684b23837fd98a4f3de061 and project 3b6359c0b3f04ea9b5dac20090c13793. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:39:56.751954 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10a42c46-6440-489b-ab0a-cd55d6330848 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.277747 Jun 16 18:39:56.752631 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1144/2370] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:39:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:56.765890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:56.770205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:56.799761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:56.800623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:56.803798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:56.805114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.039558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:57.079427 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9935b2ed-c209-4f70-ae35-4c120f535052 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1221 microversion: 2.1 time: 0.325530 Jun 16 18:39:57.081272 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1145/2371] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:56 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1221 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:57.386442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2aa3f5d3-3c30-47cf-90bd-3356dec80de5 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Calling method '.version_select at 0x7f8677fdce50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:57.418211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aa3f5d3-3c30-47cf-90bd-3356dec80de5 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.418991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aa3f5d3-3c30-47cf-90bd-3356dec80de5 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.462723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aa3f5d3-3c30-47cf-90bd-3356dec80de5 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.463268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aa3f5d3-3c30-47cf-90bd-3356dec80de5 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.516919 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2aa3f5d3-3c30-47cf-90bd-3356dec80de5 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/49f937ac41884c63883ac78b32d9c906?start=2022-06-15T18%3A39%3A56.477594&end=2022-06-17T18%3A39%3A56.477594" status: 200 len: 694 microversion: 2.1 time: 0.433799 Jun 16 18:39:57.517586 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1146/2372] 10.222.0.27 () {58 vars in 1411 bytes} [Thu Jun 16 18:39:57 2022] GET /compute/v2.1/os-simple-tenant-usage/49f937ac41884c63883ac78b32d9c906?start=2022-06-15T18%3A39%3A56.477594&end=2022-06-17T18%3A39%3A56.477594 => generated 694 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:57.538326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e95609a8-86c7-4da6-bb54-eb0918c1ad55 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '.version_select at 0x7f866e8d9e50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:57.564384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e95609a8-86c7-4da6-bb54-eb0918c1ad55 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.568282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e95609a8-86c7-4da6-bb54-eb0918c1ad55 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.601358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e95609a8-86c7-4da6-bb54-eb0918c1ad55 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.603097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e95609a8-86c7-4da6-bb54-eb0918c1ad55 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.637422 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e95609a8-86c7-4da6-bb54-eb0918c1ad55 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/49f937ac41884c63883ac78b32d9c906?start=2022-06-15T18%3A39%3A56.477594&end=2022-06-17T18%3A39%3A56.477594" status: 200 len: 693 microversion: 2.1 time: 0.107060 Jun 16 18:39:57.647752 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1147/2373] 10.222.0.27 () {58 vars in 1411 bytes} [Thu Jun 16 18:39:57 2022] GET /compute/v2.1/os-simple-tenant-usage/49f937ac41884c63883ac78b32d9c906?start=2022-06-15T18%3A39%3A56.477594&end=2022-06-17T18%3A39%3A56.477594 => generated 693 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:57.656429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be0f4184-ef79-41c9-a329-6775259db802 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Calling method '.version_select at 0x7f866e906af0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:57.672986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be0f4184-ef79-41c9-a329-6775259db802 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.678335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be0f4184-ef79-41c9-a329-6775259db802 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.739841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be0f4184-ef79-41c9-a329-6775259db802 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.740499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be0f4184-ef79-41c9-a329-6775259db802 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:58.039146 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-be0f4184-ef79-41c9-a329-6775259db802 tempest-TenantUsagesTestJSON-182271180 tempest-TenantUsagesTestJSON-182271180-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T18%3A39%3A56.477594&end=2022-06-17T18%3A39%3A56.477594&detailed=1" status: 200 len: 29400 microversion: 2.1 time: 0.387142 Jun 16 18:39:58.045019 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1148/2374] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jun 16 18:39:57 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T18%3A39%3A56.477594&end=2022-06-17T18%3A39%3A56.477594&detailed=1 => generated 29400 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:58.085802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:58.087936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:58.124869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:58.130530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:58.135258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:58.136004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:58.276591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:39:58.517633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0deabf8b-adf2-4dbf-82b6-eaaee7eafa58 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 204 len: 0 microversion: 2.1 time: 0.435525 Jun 16 18:39:58.523242 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1149/2375] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:58 2022] DELETE /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:39:58.558024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:58.574723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:58.593619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:58.594188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:58.595033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:58.595476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:59.014076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:59.024823 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-481299a0-0597-494a-9826-de92005ff9c3 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1275 microversion: 2.1 time: 0.491160 Jun 16 18:39:59.040276 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1150/2376] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:58 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1275 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:59.045689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:59.050983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:59.069752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:59.070510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:59.071867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:59.072473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:00.393035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-53b7f880-8d7e-4261-81c0-e4fa2b9f0b14 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.653997 Jun 16 18:40:00.393647 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1227/2377] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:39:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:40:00.399580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:00.400043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:00.422773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:00.423416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:00.424378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:00.426543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:00.664361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:00.680672 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ecadc32c-60bd-464c-a576-74efce8b9dc6 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1275 microversion: 2.1 time: 0.279516 Jun 16 18:40:00.681951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1228/2378] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:00 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:00.687220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3fc0c027-37c1-4b78-abab-441d3e24e751 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Action: 'create', calling method: .version_select at 0x7f866f1a4160>, body: {"pool": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:00.699578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c3a5005dfd4624bc5316e1fd79d09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f937ac41884c63883ac78b32d9c906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:00.725224 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-85bad41f-3220-45d4-8e0a-d0ed7d9f975e tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 200 len: 1469 microversion: 2.1 time: 1.683039 Jun 16 18:40:00.730637 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1151/2379] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:59 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 1469 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:01.701855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:01.704967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:01.717384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:01.790702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:01.799134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:01.800426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:01.801158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:03.470468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:03.495481 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1bfce2e-05a1-41a9-9863-204c573a691b tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1317 microversion: 2.1 time: 1.795463 Jun 16 18:40:03.496677 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1152/2380] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:01 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1317 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:03.526888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:03.528109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] [instance: 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:03.541817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:03.543087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:03.544425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:03.545256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:03.564025 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] HTTP exception thrown: Instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 could not be found. Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Request method failure captured: Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 HTTP/1.1 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3jlLYOCd-TABy_JuvWKmtcyeCdPRA283AOZjVuR2VXiJKkvd9fvEeCn0cCuPq22xZNgttOCeTRM35mM_zuA_ep76jHW3u7UjVeVXo2ZSu0HbKrBUo5w0qy6IeHVl5r-vzqbag5khXkQ5nBBMZDDAl5Ko-b6d3eFa0oCG63tpcEklXI Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 49f937ac41884c63883ac78b32d9c906 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TenantUsagesTestJSON-44928553 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49f937ac41884c63883ac78b32d9c906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49f937ac41884c63883ac78b32d9c906"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49f937ac41884c63883ac78b32d9c906", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49f937ac41884c63883ac78b32d9c906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TenantUsagesTestJSON-44928553 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 49f937ac41884c63883ac78b32d9c906 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TenantUsagesTestJSON-44928553 Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TenantUsagesTestJSON-44928553-project Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 47c3a5005dfd4624bc5316e1fd79d09b Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TenantUsagesTestJSON-44928553-project Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 could not be found. Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395'} Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 could not be found. Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 could not be found. Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:03.566357 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:03.571239 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:03.571239 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:03.571239 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:03.571239 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:03.571239 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:03.571239 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 could not be found. Jun 16 18:40:03.571239 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:03.572990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] Returning 404 to user: Instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:03.574169 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f28cfeb-8dd7-48b7-ac13-5be97a2a9ad9 tempest-TenantUsagesTestJSON-44928553 tempest-TenantUsagesTestJSON-44928553-project] 10.222.0.27 "GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395" status: 404 len: 111 microversion: 2.1 time: 0.062027 Jun 16 18:40:03.575736 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1153/2381] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:03 2022] GET /compute/v2.1/servers/030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:40:03.587624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-295f2b2a-fbe6-49e0-b4eb-9e0383e0f273 req-e63cdca9-51f9-4573-b67b-8a9dbd2516b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395", "name": "network-vif-deleted", "tag": "422008fb-a82c-4988-94b9-1bfc50079ddd"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:03.609993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-295f2b2a-fbe6-49e0-b4eb-9e0383e0f273 req-e63cdca9-51f9-4573-b67b-8a9dbd2516b0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:03.610449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-295f2b2a-fbe6-49e0-b4eb-9e0383e0f273 req-e63cdca9-51f9-4573-b67b-8a9dbd2516b0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:03.637380 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-295f2b2a-fbe6-49e0-b4eb-9e0383e0f273 req-e63cdca9-51f9-4573-b67b-8a9dbd2516b0 service nova] Creating event network-vif-deleted:422008fb-a82c-4988-94b9-1bfc50079ddd for instance 030d6fcc-e1d8-46a0-9a9c-b9e1c9a07395 on n-h2-846209-2 Jun 16 18:40:03.650389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-295f2b2a-fbe6-49e0-b4eb-9e0383e0f273 req-e63cdca9-51f9-4573-b67b-8a9dbd2516b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070988 Jun 16 18:40:03.651797 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1154/2382] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:04.211037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0133f651-c615-4caf-b7b9-6c48d884a545 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Action: 'create', calling method: .version_select at 0x7f866e8c1ca0>, body: {"pool": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:06.707230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:07.736509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:08.621639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0133f651-c615-4caf-b7b9-6c48d884a545 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.660798 Jun 16 18:40:08.625795 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1155/2383] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:40:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:08.688953 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3fc0c027-37c1-4b78-abab-441d3e24e751 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.005155 Jun 16 18:40:08.698565 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1229/2384] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:40:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:08.706154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:08.720969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:08.734425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:08.735621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:08.737579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:08.739645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:09.095717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:09.133855 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b535364-a450-44dd-ad61-7d362ae1f83a tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1317 microversion: 2.1 time: 0.430013 Jun 16 18:40:09.134600 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1230/2385] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:08 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:09.148001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b7ff55a1-046c-439e-9220-fb7308750a0c req-abc504f3-814d-4024-91eb-d56f98227230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09cc04e-39ad-405a-9854-34f896076160", "tag": "a6991ad5-c697-49ef-b6df-d8d0a1cca1df"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:09.162920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b7ff55a1-046c-439e-9220-fb7308750a0c req-abc504f3-814d-4024-91eb-d56f98227230 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:09.166364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b7ff55a1-046c-439e-9220-fb7308750a0c req-abc504f3-814d-4024-91eb-d56f98227230 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:09.166599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2082746725", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:09.195328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b7ff55a1-046c-439e-9220-fb7308750a0c req-abc504f3-814d-4024-91eb-d56f98227230 service nova] Creating event network-changed:a6991ad5-c697-49ef-b6df-d8d0a1cca1df for instance c09cc04e-39ad-405a-9854-34f896076160 on n-h1-846209-2 Jun 16 18:40:09.204980 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b7ff55a1-046c-439e-9220-fb7308750a0c req-abc504f3-814d-4024-91eb-d56f98227230 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066321 Jun 16 18:40:09.206392 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1231/2386] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:09.215774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1134946049", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3b672d69-91cb-4a81-9aca-0608ee4c35f3"}], "security_groups": [{"name": "tempest-securitygroup--966054195"}], "key_name": "tempest-keypair-705993029", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:09.307284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] validate_networks() for [('99bd8b9b-a897-4204-886b-50b9270a6c81', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:40:09.623600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] validate_networks() for [('3b672d69-91cb-4a81-9aca-0608ee4c35f3', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:40:10.347873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:40:10.350888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:40:10.351400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:40:10.351827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:40:10.352254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:40:10.378322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:10.378852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:10.380009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:10.380532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:10.413685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Getting quotas for project 4435bd19f8854d8ba3bbedb71ecfbe56. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:10.428218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Getting quotas for user b297ccf84406465c9a45f467baf469a6 and project 4435bd19f8854d8ba3bbedb71ecfbe56. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:10.451220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:40:10.453818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:40:10.586968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Getting quotas for project 3b6359c0b3f04ea9b5dac20090c13793. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:10.597133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Getting quotas for user 850790080e684b23837fd98a4f3de061 and project 3b6359c0b3f04ea9b5dac20090c13793. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:10.617143 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d5399f1b-c049-42af-89ac-e67272e0dcf3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.988444 Jun 16 18:40:10.618126 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1156/2387] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:40:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:40:10.648912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:40:10.650653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:40:10.652510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:40:10.654747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:40:10.655409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:40:10.675255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:10.677667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:10.679034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:10.679721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:10.707043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Getting quotas for project 3b6359c0b3f04ea9b5dac20090c13793. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:10.715584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Getting quotas for user 850790080e684b23837fd98a4f3de061 and project 3b6359c0b3f04ea9b5dac20090c13793. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:10.740637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:40:10.750217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:40:10.876871 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fed49bea-3d50-42e2-8ed6-057b2fe988f0 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.667449 Jun 16 18:40:10.878650 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1232/2388] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:40:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:40:10.888200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89315164-31a0-45ed-8e49-a58071b230d9 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Calling method '.version_select at 0x7f866eddb700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:11.082299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:11.088286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:11.115095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:11.115958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:11.120936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:11.124100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:11.192913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:40:11.430486 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89315164-31a0-45ed-8e49-a58071b230d9 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/8f827117-7fd9-4a51-a72d-5b70a3c4bbcf" status: 200 len: 142 microversion: 2.1 time: 0.549520 Jun 16 18:40:11.431069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1233/2389] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:40:10 2022] GET /compute/v2.1/os-floating-ips/8f827117-7fd9-4a51-a72d-5b70a3c4bbcf => generated 142 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:11.437051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-09ca8a54-c6b1-43da-aebd-5351024f87dd tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Action: 'create', calling method: .version_select at 0x7f866ee35280>, body: {"pool": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:11.465726 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7d40e93-c0db-47d5-b44b-e0fc09bb46cf tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 204 len: 0 microversion: 2.32 time: 0.844446 Jun 16 18:40:11.466643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1157/2390] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:40:10 2022] DELETE /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:40:11.490572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:11.492902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:11.516742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:11.518970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:11.522633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:11.523082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:12.168280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:12.195351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-233e5dad-750c-423d-a345-4c7da02f3943 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1317 microversion: 2.1 time: 0.724163 Jun 16 18:40:12.197654 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1158/2391] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:11 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:12.208363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:12.210499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:12.227294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:12.228981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:12.230421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:12.232546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:12.276479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:12.384419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:12.398645 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3e6e1c2-66d9-4706-925d-6a309293d82d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1213 microversion: 2.1 time: 0.199410 Jun 16 18:40:12.399885 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1159/2392] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:12 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:12.419139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:12.421684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:12.446870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:12.447345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:12.448666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:12.452287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:12.643472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:12.656837 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f49258d5-c657-490c-b8f9-ecdec7bfe45d tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1265 microversion: 2.1 time: 0.254253 Jun 16 18:40:12.657442 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1160/2393] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:12 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:12.668200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d77c875-6166-44a7-924a-a93674a9e300 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Calling method '.version_select at 0x7f866e8d2280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:13.252588 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d77c875-6166-44a7-924a-a93674a9e300 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.593798 Jun 16 18:40:13.253173 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1161/2394] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:40:12 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:13.264685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:13.265353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:13.280603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:13.281328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:13.282357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:13.282988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:14.625559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:14.638197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:14.643191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:14.644523 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b0d84203-f7cb-4793-920e-18cb784b421e tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 2955 microversion: 2.32 time: 1.385643 Jun 16 18:40:14.646023 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1162/2395] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:13 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 2955 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:15.207798 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ec090c50-89f0-4d60-9769-4be541cdbb56 tempest-TenantUsagesNegativeTestJSON-571361715 tempest-TenantUsagesNegativeTestJSON-571361715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-15T18%3A40%3A12.950199&end=2022-06-17T18%3A40%3A12.950199" status: 404 len: 112 microversion: - time: 0.560073 Jun 16 18:40:15.208336 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1163/2396] 10.222.0.27 () {58 vars in 1315 bytes} [Thu Jun 16 18:40:14 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-15T18%3A40%3A12.950199&end=2022-06-17T18%3A40%3A12.950199 => generated 112 bytes in 562 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:40:15.231665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:15.232329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:15.251227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:15.251886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:15.254159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:15.257314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:15.746569 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-09ca8a54-c6b1-43da-aebd-5351024f87dd tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.314202 Jun 16 18:40:15.747718 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1234/2397] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:40:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:15.753501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9fb1043c-2a0f-4e37-9fec-16c877d8bfd1 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Calling method '.version_select at 0x7f866f1a4ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:15.860921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:15.873128 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1c7adec4-70b5-4205-be75-4bddf94afdde tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1317 microversion: 2.1 time: 0.656732 Jun 16 18:40:15.880778 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1164/2398] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:15 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:15.886326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:15.887099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:15.896839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:15.902545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:15.903767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:15.904567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:16.038769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:16.048923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-136e681f-1f9a-4012-8887-6ecb1bca5b7d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1275 microversion: 2.1 time: 0.166765 Jun 16 18:40:16.049945 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1165/2399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:15 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:16.054732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:16.055349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:16.074270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:16.075111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:16.076151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:16.077023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:16.192088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:16.203333 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fbd8d69c-b48a-4933-8a49-017392d1d0f4 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1327 microversion: 2.1 time: 0.152442 Jun 16 18:40:16.204106 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1166/2400] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:16 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1327 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:16.219417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f46c7ff8-08e8-4dc5-8e21-88e276c12a04 tempest-TenantUsagesNegativeTestJSON-571361715 tempest-TenantUsagesNegativeTestJSON-571361715-project-admin] Calling method '.version_select at 0x7f8677fdcee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:16.222590 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f46c7ff8-08e8-4dc5-8e21-88e276c12a04 tempest-TenantUsagesNegativeTestJSON-571361715 tempest-TenantUsagesNegativeTestJSON-571361715-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f46c7ff8-08e8-4dc5-8e21-88e276c12a04 tempest-TenantUsagesNegativeTestJSON-571361715 tempest-TenantUsagesNegativeTestJSON-571361715-project-admin] Request method failure captured: Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-simple-tenant-usage/ec7eaef0018242a4a61ec1f8f16591d6?start=2022-06-17T18%3A40%3A12.950199&end=2022-06-15T18%3A40%3A12.950199 HTTP/1.1 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kMwb7zkdPMmDPAxKWR9Hyl44HWCBfuumtZVsvaHeIzAuiIJvcFW4o94-MiBmGxXxPO1eHhdXP_EwfvybR8-XJFvadJLro1iww0ut4L1QfFMa24hJB7_UJGU-b85pSvGK8spZahpNjUYVQXZEtcrYdbxtiCHpBAitF6cdJ9v3JwHdw Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4c6d4d6163274ce88093e61a85825a06 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-571361715 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c6d4d6163274ce88093e61a85825a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4c6d4d6163274ce88093e61a85825a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4c6d4d6163274ce88093e61a85825a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c6d4d6163274ce88093e61a85825a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-571361715 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4c6d4d6163274ce88093e61a85825a06 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-571361715 Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TenantUsagesNegativeTestJSON-571361715-project-admin Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6a53868005d745ab8781d9ef99cfb20e Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-571361715-project-admin Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid start time. The start time cannot occur after the end time. Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ec7eaef0018242a4a61ec1f8f16591d6'} Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 16 18:40:16.236550 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:16.245705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f46c7ff8-08e8-4dc5-8e21-88e276c12a04 tempest-TenantUsagesNegativeTestJSON-571361715 tempest-TenantUsagesNegativeTestJSON-571361715-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:16.245705 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f46c7ff8-08e8-4dc5-8e21-88e276c12a04 tempest-TenantUsagesNegativeTestJSON-571361715 tempest-TenantUsagesNegativeTestJSON-571361715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/ec7eaef0018242a4a61ec1f8f16591d6?start=2022-06-17T18%3A40%3A12.950199&end=2022-06-15T18%3A40%3A12.950199" status: 400 len: 111 microversion: 2.1 time: 0.024919 Jun 16 18:40:16.247446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1167/2401] 10.222.0.27 () {58 vars in 1411 bytes} [Thu Jun 16 18:40:16 2022] GET /compute/v2.1/os-simple-tenant-usage/ec7eaef0018242a4a61ec1f8f16591d6?start=2022-06-17T18%3A40%3A12.950199&end=2022-06-15T18%3A40%3A12.950199 => generated 111 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:40:16.251997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7668b06a-a48a-4bfd-8f2c-b71edddcd504 req-a55619a6-9305-4931-9778-2a14a026f8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09cc04e-39ad-405a-9854-34f896076160", "name": "network-vif-plugged", "status": "completed", "tag": "a6991ad5-c697-49ef-b6df-d8d0a1cca1df"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:16.269899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7668b06a-a48a-4bfd-8f2c-b71edddcd504 req-a55619a6-9305-4931-9778-2a14a026f8b1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:16.271251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7668b06a-a48a-4bfd-8f2c-b71edddcd504 req-a55619a6-9305-4931-9778-2a14a026f8b1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:16.296323 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7668b06a-a48a-4bfd-8f2c-b71edddcd504 req-a55619a6-9305-4931-9778-2a14a026f8b1 service nova] Creating event network-vif-plugged:a6991ad5-c697-49ef-b6df-d8d0a1cca1df for instance c09cc04e-39ad-405a-9854-34f896076160 on n-h1-846209-2 Jun 16 18:40:16.303629 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7668b06a-a48a-4bfd-8f2c-b71edddcd504 req-a55619a6-9305-4931-9778-2a14a026f8b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055178 Jun 16 18:40:16.309662 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1168/2402] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:16.327134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:16.327855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:16.339663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:16.340131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:16.341105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:16.341555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:16.812966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:16.846724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:16.851894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:16.862223 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50625bb7-1e43-4409-bec3-0692d3c15d1f tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 2955 microversion: 2.32 time: 0.549722 Jun 16 18:40:16.866683 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1169/2403] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:16 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 2955 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:16.873180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-538f2df6-9852-42fb-9af5-0237c2bef67d tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Calling method '.version_select at 0x7f866e8d2700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:17.253342 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-538f2df6-9852-42fb-9af5-0237c2bef67d tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/aca8c36c-460e-4936-878d-bbc74b96d448" status: 200 len: 142 microversion: 2.1 time: 0.383661 Jun 16 18:40:17.263345 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1170/2404] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:40:16 2022] GET /compute/v2.1/os-floating-ips/aca8c36c-460e-4936-878d-bbc74b96d448 => generated 142 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:17.503774 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9fb1043c-2a0f-4e37-9fec-16c877d8bfd1 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/8f827117-7fd9-4a51-a72d-5b70a3c4bbcf" status: 202 len: 0 microversion: 2.1 time: 1.754287 Jun 16 18:40:17.506340 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1235/2405] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:40:15 2022] DELETE /compute/v2.1/os-floating-ips/8f827117-7fd9-4a51-a72d-5b70a3c4bbcf => generated 0 bytes in 1758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:17.524101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:17.528100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:17.544404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:17.546088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:17.547439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:17.548121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:17.913140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:17.928862 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-29d8a5d9-bf47-4ee8-8d7e-cdf6a054ffaa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1317 microversion: 2.1 time: 0.420553 Jun 16 18:40:17.932717 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1236/2406] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:17 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:17.946992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:17.948849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:17.971197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:17.971700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:17.972521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:17.973594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:18.171830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-434dc7fe-9e63-4f42-b453-d7ee57ef18bf tempest-TenantUsagesNegativeTestJSON-89605773 tempest-TenantUsagesNegativeTestJSON-89605773-project] Calling method '.version_select at 0x7f866e9738b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:18.177852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-434dc7fe-9e63-4f42-b453-d7ee57ef18bf tempest-TenantUsagesNegativeTestJSON-89605773 tempest-TenantUsagesNegativeTestJSON-89605773-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'f7a24c460c7c4d71a5b0d46dadba65c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7eaef0018242a4a61ec1f8f16591d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-434dc7fe-9e63-4f42-b453-d7ee57ef18bf tempest-TenantUsagesNegativeTestJSON-89605773 tempest-TenantUsagesNegativeTestJSON-89605773-project] Request method failure captured: Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T18%3A40%3A12.950199&end=2022-06-17T18%3A40%3A12.950199&detailed=1 HTTP/1.1 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kK0o0Sxpu6RWx8b3VGRS_aUbjDqJZ2-1t65UKmn1RQkeYCPD-CGU8LNHWstmBcFG1CHcQYLPX4XDQJILFkp32D_rOkERNNl5h37wqlzZhNs0eDoqddSYpNxmbC6rjwIG89ZYBXctZwnbHJaWKQv58SUvGDX41G-PWSyxIv1s_qwCI Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ec7eaef0018242a4a61ec1f8f16591d6 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-89605773 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec7eaef0018242a4a61ec1f8f16591d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec7eaef0018242a4a61ec1f8f16591d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec7eaef0018242a4a61ec1f8f16591d6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec7eaef0018242a4a61ec1f8f16591d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-89605773 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ec7eaef0018242a4a61ec1f8f16591d6 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-89605773 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TenantUsagesNegativeTestJSON-89605773-project Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: f7a24c460c7c4d71a5b0d46dadba65c6 Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-89605773-project Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: action_args: {} Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:40:18.182608 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 16 18:40:18.191788 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:18.195137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-434dc7fe-9e63-4f42-b453-d7ee57ef18bf tempest-TenantUsagesNegativeTestJSON-89605773 tempest-TenantUsagesNegativeTestJSON-89605773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:18.196221 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-434dc7fe-9e63-4f42-b453-d7ee57ef18bf tempest-TenantUsagesNegativeTestJSON-89605773 tempest-TenantUsagesNegativeTestJSON-89605773-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T18%3A40%3A12.950199&end=2022-06-17T18%3A40%3A12.950199&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.930531 Jun 16 18:40:18.196955 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1171/2407] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jun 16 18:40:17 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T18%3A40%3A12.950199&end=2022-06-17T18%3A40%3A12.950199&detailed=1 => generated 123 bytes in 933 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:40:18.223360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:18.228412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:18.259031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:18.260951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:18.264238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:18.266753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:18.306565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:18.349682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59dd66e2-db0f-4db8-a140-8f745244f422 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1317 microversion: 2.1 time: 0.413994 Jun 16 18:40:18.362330 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1237/2408] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:17 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:18.368761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bd1f759b-ae8f-4e15-9d7c-65ed5b46de69 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Calling method '.version_select at 0x7f866ed783a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:18.713606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:18.740278 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9e6b064-d482-493c-bd4e-e69029b163fb tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1394 microversion: 2.1 time: 0.540815 Jun 16 18:40:18.745670 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1172/2409] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:18 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1394 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:18.755774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9a0b0993-f2cd-4ae7-bc50-b597bcf1814a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Action: 'create', calling method: .version_select at 0x7f866e908dc0>, body: {"pool": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:20.354093 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bd1f759b-ae8f-4e15-9d7c-65ed5b46de69 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/aca8c36c-460e-4936-878d-bbc74b96d448" status: 202 len: 0 microversion: 2.1 time: 1.990245 Jun 16 18:40:20.359597 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1238/2410] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:40:18 2022] DELETE /compute/v2.1/os-floating-ips/aca8c36c-460e-4936-878d-bbc74b96d448 => generated 0 bytes in 1997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:20.377403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:20.378363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:20.398964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.403478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:20.406452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:20.415705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:20.416677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:20.437839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.693162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.724305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.794499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:20.814286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:20.821072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:20.822452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6c48607f-eaa6-4d6e-88d6-caa1169376ee tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 2913 microversion: 2.32 time: 0.461428 Jun 16 18:40:20.823122 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1239/2411] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:20 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 2913 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:20.832582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:20.839183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:20.856156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:20.864313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:20.865968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:20.868921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:21.230997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:21.244726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-18c4469c-31db-4fd9-91c0-e61937876b52 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1506 microversion: 2.1 time: 0.414624 Jun 16 18:40:21.246281 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1240/2412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:20 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:21.258273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:21.260636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:21.280059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:21.288590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:21.289662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:21.290374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:21.986571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:22.014022 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f51aa20-d4db-4c80-8c1f-8dbaf601eb63 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1317 microversion: 2.1 time: 0.765886 Jun 16 18:40:22.015280 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1241/2413] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:21 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:22.025448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3c9cffc7-6ab1-4e4c-ab8a-72701f557202 req-482628d8-b4a5-4a62-bb47-5490cd35b0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-unplugged", "status": "completed", "tag": "aa145fe7-4192-4143-91ea-a0ab1f38677e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:22.040747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3c9cffc7-6ab1-4e4c-ab8a-72701f557202 req-482628d8-b4a5-4a62-bb47-5490cd35b0cd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.041989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3c9cffc7-6ab1-4e4c-ab8a-72701f557202 req-482628d8-b4a5-4a62-bb47-5490cd35b0cd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.063156 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3c9cffc7-6ab1-4e4c-ab8a-72701f557202 req-482628d8-b4a5-4a62-bb47-5490cd35b0cd service nova] Creating event network-vif-unplugged:aa145fe7-4192-4143-91ea-a0ab1f38677e for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:22.073032 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3c9cffc7-6ab1-4e4c-ab8a-72701f557202 req-482628d8-b4a5-4a62-bb47-5490cd35b0cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055858 Jun 16 18:40:22.074473 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1242/2414] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:22.084536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:22.085683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:22.093504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.094628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.095629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.096287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.128313 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9a0b0993-f2cd-4ae7-bc50-b597bcf1814a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.378517 Jun 16 18:40:22.129055 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1173/2415] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:40:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:22.146468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-bbd298af-d495-40cf-b68d-f0ec5dbc72c0 req-6bd9ecdb-535c-4441-b4fc-2e0a14854415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e57881-9458-4864-a6d8-79555341a48e", "tag": "f395f5ff-79af-48cc-8d9f-7b45e4bba8d9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:22.165561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bbd298af-d495-40cf-b68d-f0ec5dbc72c0 req-6bd9ecdb-535c-4441-b4fc-2e0a14854415 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.167382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bbd298af-d495-40cf-b68d-f0ec5dbc72c0 req-6bd9ecdb-535c-4441-b4fc-2e0a14854415 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.182772 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-bbd298af-d495-40cf-b68d-f0ec5dbc72c0 req-6bd9ecdb-535c-4441-b4fc-2e0a14854415 service nova] Creating event network-changed:f395f5ff-79af-48cc-8d9f-7b45e4bba8d9 for instance e5e57881-9458-4864-a6d8-79555341a48e on n-h2-846209-2 Jun 16 18:40:22.192975 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-bbd298af-d495-40cf-b68d-f0ec5dbc72c0 req-6bd9ecdb-535c-4441-b4fc-2e0a14854415 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052151 Jun 16 18:40:22.194378 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1174/2416] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:22.200205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad5c7f4c-c572-4b0c-ae16-e72661b0c99c tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Calling method '.version_select at 0x7f866e8d2670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:22.561831 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad5c7f4c-c572-4b0c-ae16-e72661b0c99c tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.365530 Jun 16 18:40:22.562993 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1175/2417] 10.222.0.27 () {58 vars in 1163 bytes} [Thu Jun 16 18:40:22 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:40:22.569482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:22.584613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:22.588413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:22.590842 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4680daf0-09f9-4e7f-a6f6-0a284bf86315 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1394 microversion: 2.1 time: 0.512102 Jun 16 18:40:22.593344 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1243/2418] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:22 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1394 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:22.601827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.606052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.607301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.607756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.651985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:22.653189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-810ff22b-8629-4b43-8759-e59b54b1cbd1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160/os-instance-actions/req-b4ab00c1-6f62-4a82-ac32-569881ff37a5" status: 200 len: 313 microversion: 2.1 time: 0.078401 Jun 16 18:40:22.653823 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1176/2419] 10.222.0.27 () {58 vars in 1418 bytes} [Thu Jun 16 18:40:22 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160/os-instance-actions/req-b4ab00c1-6f62-4a82-ac32-569881ff37a5 => generated 313 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:22.659133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:22.659764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:22.667056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.667572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.668806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:22.670220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:23.090684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1455538736", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:23.156441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:40:23.192553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:23.203524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:23.205071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:23.206479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa240cf4-68af-4ea2-8ab5-9db9c3ab85b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 2819 microversion: 2.32 time: 0.551652 Jun 16 18:40:23.207293 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1177/2420] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:22 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 2819 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:23.213785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4674d6de-ddea-4541-bc3b-3c1af81e3fb2 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Calling method '.version_select at 0x7f866e898a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:24.090601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:40:24.091353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:40:24.092287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:40:24.093121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:40:24.093878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:40:24.124628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:24.125522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:24.126373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:24.128850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:24.156369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:24.164548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:24.182946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:40:24.185930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:40:24.393441 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6959505d-1f5a-423f-b848-502b2e6581cd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.798409 Jun 16 18:40:24.397405 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1244/2421] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:40:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:40:24.407106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15f9d531-48d7-4eec-9d30-d4c9c9e4961c tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Calling method '.version_select at 0x7f866ec44af0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:24.857165 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15f9d531-48d7-4eec-9d30-d4c9c9e4961c tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.458035 Jun 16 18:40:24.866528 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1245/2422] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:40:24 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:24.872737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f93ba811-f9f1-41b0-9c64-9da3f21fe190 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:24.873842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f93ba811-f9f1-41b0-9c64-9da3f21fe190 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:24.887100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f93ba811-f9f1-41b0-9c64-9da3f21fe190 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:24.887672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f93ba811-f9f1-41b0-9c64-9da3f21fe190 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:24.890226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f93ba811-f9f1-41b0-9c64-9da3f21fe190 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:24.890749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f93ba811-f9f1-41b0-9c64-9da3f21fe190 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.008794 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f93ba811-f9f1-41b0-9c64-9da3f21fe190 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "POST /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160/action" status: 202 len: 0 microversion: 2.1 time: 0.140646 Jun 16 18:40:25.027257 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1246/2423] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:40:24 2022] POST /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:25.044013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:25.048874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:25.081374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.081673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.087242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.087718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.438816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4674d6de-ddea-4541-bc3b-3c1af81e3fb2 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab" status: 202 len: 0 microversion: 2.1 time: 2.229364 Jun 16 18:40:25.439813 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1178/2424] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:40:23 2022] DELETE /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab => generated 0 bytes in 2232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:25.449312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:25.451537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:25.462442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.463705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.464760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.465750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.627937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:25.638812 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c801a11f-e8ac-44d6-9e12-08c683076578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1317 microversion: 2.1 time: 0.606784 Jun 16 18:40:25.639665 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1247/2425] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:25 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:25.659185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-unplugged", "status": "completed", "tag": "e50658e2-b980-4977-bf2a-fc925e9bb8ac"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-unplugged", "status": "completed", "tag": "060fd62e-c274-4002-82ff-d6c21be38ac5"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-unplugged", "status": "completed", "tag": "dcba32f5-5668-4977-9a51-5d6e60fa9c4f"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-unplugged", "status": "completed", "tag": "81274976-813c-4c06-b3c6-a7e8aea88f15"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:25.671343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.672228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.688731 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] Creating event network-vif-unplugged:e50658e2-b980-4977-bf2a-fc925e9bb8ac for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:25.689483 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] Creating event network-vif-unplugged:060fd62e-c274-4002-82ff-d6c21be38ac5 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:25.690217 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] Creating event network-vif-unplugged:dcba32f5-5668-4977-9a51-5d6e60fa9c4f for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:25.690914 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] Creating event network-vif-unplugged:81274976-813c-4c06-b3c6-a7e8aea88f15 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:25.698218 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e10e5455-fe8c-40b3-912c-5332f7ef16f4 req-2a590147-10a1-48aa-a6cc-303923a65758 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.045165 Jun 16 18:40:25.699536 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1248/2426] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:25.706579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:25.709071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:25.717884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.718876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.719747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.720496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.864909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:25.873567 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bb1b04e8-8593-43fb-b4fb-0605eac8ec94 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1394 microversion: 2.1 time: 0.432448 Jun 16 18:40:25.898052 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1179/2427] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:25 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1394 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:25.904023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e98225-1fd5-4da5-a370-ce284f3448a6", "tag": "b19385ee-458d-4bd4-81c9-2f37998db071"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-deleted", "tag": "dcba32f5-5668-4977-9a51-5d6e60fa9c4f"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-deleted", "tag": "060fd62e-c274-4002-82ff-d6c21be38ac5"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-deleted", "tag": "aa145fe7-4192-4143-91ea-a0ab1f38677e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:25.924040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.925873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.944597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:25.951191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] Creating event network-changed:b19385ee-458d-4bd4-81c9-2f37998db071 for instance f7e98225-1fd5-4da5-a370-ce284f3448a6 on n-h2-846209-2 Jun 16 18:40:25.951938 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] Creating event network-vif-deleted:dcba32f5-5668-4977-9a51-5d6e60fa9c4f for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:25.954118 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] Creating event network-vif-deleted:060fd62e-c274-4002-82ff-d6c21be38ac5 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:25.954804 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] Creating event network-vif-deleted:aa145fe7-4192-4143-91ea-a0ab1f38677e for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:25.975614 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4bf2b434-1146-4800-ad61-5a68c5165955 req-bdbb611f-2b03-4749-b801-b4ad13b74e2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.075763 Jun 16 18:40:25.976835 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1180/2428] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:25.981803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:25.983944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:25.990379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:25.991362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:25.992050 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-86f36f3f-8e93-4733-a4d4-bfaa9f88b861 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 2725 microversion: 2.32 time: 0.288344 Jun 16 18:40:25.994038 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1249/2429] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:25 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 2725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:26.022827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:26.023469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:26.024512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:26.025379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:26.241203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6be9a7af-d8af-4ced-b8b3-9da25c47f2f9 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Action: 'create', calling method: .version_select at 0x7f866f1a4e50>, body: {"keypair": {"name": "tempest-keypair-904260995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKP3GyEI0yaDFqKad/B125FSIUdpOQnzzbfjgTKSj7rv18WaR74QS9ajppNtewN718oE3sGcSjT2DmcyGp5a9Hmb7T/UV5cYyVaMoesDJk42k/NzBwB4ibraE48lkH6Fw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:26.276208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6be9a7af-d8af-4ced-b8b3-9da25c47f2f9 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:26.307895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6be9a7af-d8af-4ced-b8b3-9da25c47f2f9 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for user 2be9f74c33024bb1aaae95b0681fd935 and project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:26.377140 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6be9a7af-d8af-4ced-b8b3-9da25c47f2f9 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.381361 Jun 16 18:40:26.383443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1250/2430] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:40:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:26.387665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad7481e8-e06b-4d63-84a5-5df7c273ff1a tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Calling method '.version_select at 0x7f866f1a4700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:26.391106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:26.402489 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6639fa88-a821-4f57-9e23-b1c66f01ace7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1269 microversion: 2.1 time: 0.422832 Jun 16 18:40:26.406646 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1181/2431] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:25 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1269 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:26.420902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:26.423034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:26.433646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:26.434207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:26.435114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:26.435650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:26.923032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:26.935320 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1eb38fbe-3e6f-4cfe-9984-e9fc0d8bc7e2 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1508 microversion: 2.1 time: 0.526337 Jun 16 18:40:26.937035 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1182/2432] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:26 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1508 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:26.943894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fe680aa-255e-470f-9805-8f325e36ae39 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Calling method '.version_select at 0x7f866e908d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:27.341075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-5fe680aa-255e-470f-9805-8f325e36ae39 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab could not be found", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:40:27.342040 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-5fe680aa-255e-470f-9805-8f325e36ae39 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] HTTP exception thrown: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fe680aa-255e-470f-9805-8f325e36ae39 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Request method failure captured: Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab HTTP/1.1 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kD2TxVvCLzpf4s_TEYPzRehrxPMUzZSnbvZw1gJKQkp8V5kgv_KbcZh5seHNSNy54nJd2rt6Y2BPCq1Cc9VWSNpdTLX5JVUEBC59oCCgrUMFt_pB8lOLAdeAGTXPaLaW0g5do4jWSVcvxIo8sU0Y-tB1_bLM-EZuLhkogJnrC9eE0 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8a0248ff3c4c4e2d99659d91515f26df Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FloatingIPsTestJSON-1373005696 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a0248ff3c4c4e2d99659d91515f26df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a0248ff3c4c4e2d99659d91515f26df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a0248ff3c4c4e2d99659d91515f26df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a0248ff3c4c4e2d99659d91515f26df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FloatingIPsTestJSON-1373005696 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8a0248ff3c4c4e2d99659d91515f26df Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1373005696 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FloatingIPsTestJSON-1373005696-project Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1349610f958a4ccf9ed6bed22561aecc Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FloatingIPsTestJSON-1373005696-project Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: exception: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'd18b66c4-6ea7-439e-9a74-2e4a9b1be6ab'} Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab could not be found Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75788419-2f96-4857-842e-d8b861e90541'] Jun 16 18:40:27.344166 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab. Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:27.348197 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:27.351334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fe680aa-255e-470f-9805-8f325e36ae39 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Returning 404 to user: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:27.352390 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5fe680aa-255e-470f-9805-8f325e36ae39 tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab" status: 404 len: 111 microversion: 2.1 time: 0.414372 Jun 16 18:40:27.356843 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1183/2433] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:40:26 2022] GET /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab => generated 111 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:40:27.362819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bc90f0e9-5833-4496-8ab0-57138b879a52 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f866e898940>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:27.375192 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bc90f0e9-5833-4496-8ab0-57138b879a52 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-904260995" status: 200 len: 497 microversion: 2.1 time: 0.016857 Jun 16 18:40:27.382603 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1184/2434] 10.222.0.27 () {58 vars in 1214 bytes} [Thu Jun 16 18:40:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-904260995 => generated 497 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:27.388444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:27.389333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:27.397111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:27.398520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:27.399345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:27.399851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:27.765996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:27.777339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ad3cb5a-1655-411c-8e29-8fceac59fbcc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1317 microversion: 2.1 time: 0.392874 Jun 16 18:40:27.778405 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1185/2435] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:27 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:27.783827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:27.785047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:27.801451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:27.802412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:27.804178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:27.804805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.170855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:28.179996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67fb74f5-0936-4054-b415-a3a56a6ab2f6 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1394 microversion: 2.1 time: 0.400144 Jun 16 18:40:28.180702 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1186/2436] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:27 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1394 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:28.195614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:28.196523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:28.204926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.205801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.207375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.209484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.303443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:28.315729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:28.318349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:28.319710 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-534d909a-5479-423f-8b06-5fd30fe757ae tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.137845 Jun 16 18:40:28.320394 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1187/2437] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:28 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:28.325200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ba3dd144-0968-4308-adb8-a14d3fb8788a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Calling method '.version_select at 0x7f866e979160>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:28.424870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-ba3dd144-0968-4308-adb8-a14d3fb8788a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab could not be found", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:40:28.425867 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ba3dd144-0968-4308-adb8-a14d3fb8788a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] HTTP exception thrown: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ba3dd144-0968-4308-adb8-a14d3fb8788a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Request method failure captured: Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab HTTP/1.1 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kD2TxVvCLzpf4s_TEYPzRehrxPMUzZSnbvZw1gJKQkp8V5kgv_KbcZh5seHNSNy54nJd2rt6Y2BPCq1Cc9VWSNpdTLX5JVUEBC59oCCgrUMFt_pB8lOLAdeAGTXPaLaW0g5do4jWSVcvxIo8sU0Y-tB1_bLM-EZuLhkogJnrC9eE0 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8a0248ff3c4c4e2d99659d91515f26df Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-FloatingIPsTestJSON-1373005696 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a0248ff3c4c4e2d99659d91515f26df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a0248ff3c4c4e2d99659d91515f26df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a0248ff3c4c4e2d99659d91515f26df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a0248ff3c4c4e2d99659d91515f26df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-FloatingIPsTestJSON-1373005696 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8a0248ff3c4c4e2d99659d91515f26df Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1373005696 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-FloatingIPsTestJSON-1373005696-project Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1349610f958a4ccf9ed6bed22561aecc Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-FloatingIPsTestJSON-1373005696-project Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: exception: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'd18b66c4-6ea7-439e-9a74-2e4a9b1be6ab'} Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab could not be found Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-942d56ef-f909-44d4-a8bc-a5825ed46628'] Jun 16 18:40:28.428314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab. Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ba3dd144-0968-4308-adb8-a14d3fb8788a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] Returning 404 to user: Floating IP not found for ID d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:28.431819 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ba3dd144-0968-4308-adb8-a14d3fb8788a tempest-FloatingIPsTestJSON-1373005696 tempest-FloatingIPsTestJSON-1373005696-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab" status: 404 len: 111 microversion: 2.1 time: 0.108837 Jun 16 18:40:28.437075 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1188/2438] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:40:28 2022] DELETE /compute/v2.1/os-floating-ips/d18b66c4-6ea7-439e-9a74-2e4a9b1be6ab => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:40:28.443530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-08760c18-7a3c-4c66-8880-62c66a6d9c80 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f866e908d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:28.468043 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-08760c18-7a3c-4c66-8880-62c66a6d9c80 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904260995" status: 202 len: 0 microversion: 2.1 time: 0.029754 Jun 16 18:40:28.469110 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1189/2439] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904260995 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:28.475508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:28.476490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:28.486109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.486844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.488058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.488669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.493422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:28.669948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:28.682306 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b32c7b08-bf25-40de-85f1-5742a3f95c80 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1275 microversion: 2.1 time: 0.210638 Jun 16 18:40:28.693346 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1190/2440] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:28 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:28.698732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-66f6873e-e32a-4caf-8618-aa571a535f50 req-60a8719b-1014-4dd3-9655-903d06826af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e57881-9458-4864-a6d8-79555341a48e", "name": "network-vif-plugged", "status": "completed", "tag": "f395f5ff-79af-48cc-8d9f-7b45e4bba8d9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:28.713851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-66f6873e-e32a-4caf-8618-aa571a535f50 req-60a8719b-1014-4dd3-9655-903d06826af5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.714500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-66f6873e-e32a-4caf-8618-aa571a535f50 req-60a8719b-1014-4dd3-9655-903d06826af5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.715524 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ad7481e8-e06b-4d63-84a5-5df7c273ff1a tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/333cb1f5-ce25-49f4-96d1-4f5b05148c07" status: 202 len: 0 microversion: 2.1 time: 2.335226 Jun 16 18:40:28.716157 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1251/2441] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:40:26 2022] DELETE /compute/v2.1/os-floating-ips/333cb1f5-ce25-49f4-96d1-4f5b05148c07 => generated 0 bytes in 2337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:28.721870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:28.722798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:28.728833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:28.730933 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-66f6873e-e32a-4caf-8618-aa571a535f50 req-60a8719b-1014-4dd3-9655-903d06826af5 service nova] Creating event network-vif-plugged:f395f5ff-79af-48cc-8d9f-7b45e4bba8d9 for instance e5e57881-9458-4864-a6d8-79555341a48e on n-h2-846209-2 Jun 16 18:40:28.736745 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-66f6873e-e32a-4caf-8618-aa571a535f50 req-60a8719b-1014-4dd3-9655-903d06826af5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041640 Jun 16 18:40:28.740951 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1191/2442] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:28.744596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.745066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.748667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.749173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.759782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e204b5e5-8c67-4a6b-8576-7a2bb91951af req-2a36cfcb-d221-4859-a19e-29c57bca5ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-deleted", "tag": "e50658e2-b980-4977-bf2a-fc925e9bb8ac"}, {"server_uuid": "5d404bf4-c6e7-49e2-9dbd-d3584ced0295", "name": "network-vif-deleted", "tag": "81274976-813c-4c06-b3c6-a7e8aea88f15"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:28.771339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e204b5e5-8c67-4a6b-8576-7a2bb91951af req-2a36cfcb-d221-4859-a19e-29c57bca5ea9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.772081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e204b5e5-8c67-4a6b-8576-7a2bb91951af req-2a36cfcb-d221-4859-a19e-29c57bca5ea9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.793371 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e204b5e5-8c67-4a6b-8576-7a2bb91951af req-2a36cfcb-d221-4859-a19e-29c57bca5ea9 service nova] Creating event network-vif-deleted:e50658e2-b980-4977-bf2a-fc925e9bb8ac for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:28.795735 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e204b5e5-8c67-4a6b-8576-7a2bb91951af req-2a36cfcb-d221-4859-a19e-29c57bca5ea9 service nova] Creating event network-vif-deleted:81274976-813c-4c06-b3c6-a7e8aea88f15 for instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 on n-h1-846209-2 Jun 16 18:40:28.810562 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e204b5e5-8c67-4a6b-8576-7a2bb91951af req-2a36cfcb-d221-4859-a19e-29c57bca5ea9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067678 Jun 16 18:40:28.814338 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1192/2443] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:28.816030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:28.823585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03c4a61b-e038-4ec3-abef-463a095d38b2 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Action: 'create', calling method: .version_select at 0x7f866e9798b0>, body: {"keypair": {"name": "tempest-keypair-335801466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMp2oRCwCBIyDxwmn/MT+CXciwPVazTpCQ4sE09Fywdn5PFJilJLGwYfLqCwfvfZTAPqVeoUMN6x71Pn5cB7HvsXxmacibggqJdCVv5KxNY9Fez+c33edbAlT+qK2Yn7w=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:28.846872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-03c4a61b-e038-4ec3-abef-463a095d38b2 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:28.854717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-03c4a61b-e038-4ec3-abef-463a095d38b2 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for user 2be9f74c33024bb1aaae95b0681fd935 and project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:28.888521 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03c4a61b-e038-4ec3-abef-463a095d38b2 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072911 Jun 16 18:40:28.893961 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1193/2444] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:40:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:28.896818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c8ba4532-76c6-423d-817e-8f3373861d4f tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Calling method '.version_select at 0x7f866f78bca0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:29.041295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:29.049124 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b069bb07-ad3d-4fc7-8c2b-09fe55a985ce tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1506 microversion: 2.1 time: 0.331913 Jun 16 18:40:29.050282 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1252/2445] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:28 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:29.055044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:29.063405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:29.071812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.081833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.083292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.084082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.508999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:29.521071 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f62766e7-d4dd-4806-9d2a-dc4f17efa128 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1317 microversion: 2.1 time: 0.468771 Jun 16 18:40:29.522051 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1253/2446] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:29 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:29.527324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7753238b-1e77-468b-b5aa-3140bce31a33 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f866eba0ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:29.551329 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7753238b-1e77-468b-b5aa-3140bce31a33 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-335801466" status: 202 len: 0 microversion: 2.1 time: 0.027632 Jun 16 18:40:29.557676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1254/2447] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-335801466 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:29.563544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6cd441bf-ba20-4042-811c-e4e3d1ea3efa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '.version_select at 0x7f866f1a4310>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:29.564398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6cd441bf-ba20-4042-811c-e4e3d1ea3efa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:29.573272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cd441bf-ba20-4042-811c-e4e3d1ea3efa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.573992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cd441bf-ba20-4042-811c-e4e3d1ea3efa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.575382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cd441bf-ba20-4042-811c-e4e3d1ea3efa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.576024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cd441bf-ba20-4042-811c-e4e3d1ea3efa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.615116 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6cd441bf-ba20-4042-811c-e4e3d1ea3efa tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.055921 Jun 16 18:40:29.621878 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1255/2448] 10.222.0.27 () {58 vars in 1295 bytes} [Thu Jun 16 18:40:29 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160/os-instance-actions => generated 611 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:29.628128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:29.628977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:29.635960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.636701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.637646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.638265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.142830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:30.160013 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9f21844-8360-416e-8295-ce0983e03048 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1394 microversion: 2.1 time: 0.534203 Jun 16 18:40:30.163517 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1256/2449] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:29 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1394 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:30.173434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:30.174874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:30.194857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.195367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.196336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.196985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.451720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:30.471857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:30.474842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:30.476225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e2a89d0-e168-4d73-bff5-36933dec35bc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.309885 Jun 16 18:40:30.476936 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1257/2450] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:30 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:30.483507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ee8a33d-e407-4517-9a14-327f55c671ee tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Action: 'create', calling method: .version_select at 0x7f8677f87160>, body: {"keypair": {"name": "tempest-keypair-1856063168", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:30.522972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7ee8a33d-e407-4517-9a14-327f55c671ee tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:30.543569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7ee8a33d-e407-4517-9a14-327f55c671ee tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for user 2be9f74c33024bb1aaae95b0681fd935 and project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:30.581387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ee8a33d-e407-4517-9a14-327f55c671ee tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.103021 Jun 16 18:40:30.587290 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1258/2451] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:40:30 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:30.602389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:30.603316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:30.611272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.612043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.613083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.614422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.654877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:40:30.784429 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6927e51-f5cb-443b-8d02-592ff85212dc tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 204 len: 0 microversion: 2.1 time: 0.198944 Jun 16 18:40:30.787287 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1259/2452] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:40:30 2022] DELETE /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:30.795964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:30.796685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:30.804177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.804642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.805452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.806013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.881270 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c8ba4532-76c6-423d-817e-8f3373861d4f tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e63e24d3-81d0-4d96-91f9-c943efd2490f" status: 202 len: 0 microversion: 2.1 time: 1.990111 Jun 16 18:40:30.881991 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1194/2453] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:40:28 2022] DELETE /compute/v2.1/os-floating-ips/e63e24d3-81d0-4d96-91f9-c943efd2490f => generated 0 bytes in 1992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:30.887405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:30.888312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:30.905942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.907026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.909469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.911762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:31.179543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:31.190892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-275174de-6188-4f00-b489-87a3b8f9395b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1317 microversion: 2.1 time: 0.399220 Jun 16 18:40:31.194099 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1260/2454] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:30 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:31.202872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78188eab-96bb-4546-9d20-e9a135a831c2 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f866ea4c820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:31.238912 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-78188eab-96bb-4546-9d20-e9a135a831c2 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856063168" status: 202 len: 0 microversion: 2.1 time: 0.043056 Jun 16 18:40:31.241298 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1261/2455] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856063168 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:31.258051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4e533382-becc-4b9f-8051-36521bde3ede req-239bb8ab-2628-49d1-99ac-26f8edf37fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e98225-1fd5-4da5-a370-ce284f3448a6", "name": "network-vif-plugged", "status": "completed", "tag": "b19385ee-458d-4bd4-81c9-2f37998db071"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:31.269067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4e533382-becc-4b9f-8051-36521bde3ede req-239bb8ab-2628-49d1-99ac-26f8edf37fd4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:31.273389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4e533382-becc-4b9f-8051-36521bde3ede req-239bb8ab-2628-49d1-99ac-26f8edf37fd4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:31.293729 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4e533382-becc-4b9f-8051-36521bde3ede req-239bb8ab-2628-49d1-99ac-26f8edf37fd4 service nova] Creating event network-vif-plugged:b19385ee-458d-4bd4-81c9-2f37998db071 for instance f7e98225-1fd5-4da5-a370-ce284f3448a6 on n-h2-846209-2 Jun 16 18:40:31.300278 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4e533382-becc-4b9f-8051-36521bde3ede req-239bb8ab-2628-49d1-99ac-26f8edf37fd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057169 Jun 16 18:40:31.305831 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1262/2456] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:31.324386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:31.328749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:31.342321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:31.343164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:31.348029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:31.348029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:31.702002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:31.720981 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f6fec4d-98c5-413a-b015-90e369f54f04 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.835037 Jun 16 18:40:31.741165 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1195/2457] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:30 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:31.747940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28035341-4e4c-4a6d-9922-88ae75fcc028 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] Calling method '.version_select at 0x7f866e836700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:31.934217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:31.944103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ad65314-90e4-4195-924e-2f2b456141f1 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1512 microversion: 2.1 time: 0.636188 Jun 16 18:40:31.955388 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1263/2458] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:31 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1512 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:31.961604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:31.962264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:31.969973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:31.970416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:31.971201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:31.971639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:32.337595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:32.349837 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-490a39ce-053e-407f-b401-37c89537c6ad tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1394 microversion: 2.1 time: 0.391380 Jun 16 18:40:32.362585 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1264/2459] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:31 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1394 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:32.362585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fde0c797-c222-4260-83b5-52f8c49b01ae tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Action: 'create', calling method: .version_select at 0x7f866f6cb550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1778713670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBuSjCO0H6MYqmul1FrFJWi/dzxnB8sdZkXOwZk2eiupaIs0ZLdOTw4nnQ0fWsaJ9Ru5rSelQrM7toCD/Y2PjjuAuh0AYH/PF0JMHblD9WiwmjqMxFvvspWd8hvb7VnhA=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:32.386150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-fde0c797-c222-4260-83b5-52f8c49b01ae tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:32.392795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-fde0c797-c222-4260-83b5-52f8c49b01ae tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for user 2be9f74c33024bb1aaae95b0681fd935 and project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:32.426009 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fde0c797-c222-4260-83b5-52f8c49b01ae tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.067900 Jun 16 18:40:32.426009 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1265/2460] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:40:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:32.430664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:32.431280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:32.444565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:32.445114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:32.446245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:32.446763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:32.669230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:32.689214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:32.693691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:32.696356 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c593f58-5048-498f-81e7-693127ed7b32 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.270374 Jun 16 18:40:32.697493 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1266/2461] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:32 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:32.702465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9bd75586-0245-4664-9a8d-d8cb8ad18644 req-1babecdd-c9d3-4847-bc66-c355f9367ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ff1dd7-0d48-479e-95f1-af7f8d2b2530", "tag": "a136882d-37aa-4b9f-8921-5f8b4b2da24f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:32.712039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9bd75586-0245-4664-9a8d-d8cb8ad18644 req-1babecdd-c9d3-4847-bc66-c355f9367ae1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:32.712484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9bd75586-0245-4664-9a8d-d8cb8ad18644 req-1babecdd-c9d3-4847-bc66-c355f9367ae1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:32.727175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9bd75586-0245-4664-9a8d-d8cb8ad18644 req-1babecdd-c9d3-4847-bc66-c355f9367ae1 service nova] Creating event network-changed:a136882d-37aa-4b9f-8921-5f8b4b2da24f for instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 on n-h1-846209-2 Jun 16 18:40:32.732892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9bd75586-0245-4664-9a8d-d8cb8ad18644 req-1babecdd-c9d3-4847-bc66-c355f9367ae1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033927 Jun 16 18:40:32.734438 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1267/2462] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:32.740481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-781649331", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:32.821105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] validate_networks() for [('99bd8b9b-a897-4204-886b-50b9270a6c81', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:40:34.142131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:34.675389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28035341-4e4c-4a6d-9922-88ae75fcc028 tempest-FloatingIPDetailsTestJSON-84940757 tempest-FloatingIPDetailsTestJSON-84940757-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/90040913-4a8b-4b28-9ce8-9a0d4eddaba8" status: 202 len: 0 microversion: 2.1 time: 2.932745 Jun 16 18:40:34.678115 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1196/2463] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:40:31 2022] DELETE /compute/v2.1/os-floating-ips/90040913-4a8b-4b28-9ce8-9a0d4eddaba8 => generated 0 bytes in 2936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:34.685242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:34.686192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:34.691731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:34.703652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:40:34.704513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:40:34.705406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:40:34.706204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:40:34.706784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:40:34.720640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:34.722073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:34.724260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:34.725055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:34.733633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:34.738315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:34.740676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:34.741283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:34.798812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Getting quotas for project 4435bd19f8854d8ba3bbedb71ecfbe56. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:34.821935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Getting quotas for user b297ccf84406465c9a45f467baf469a6 and project 4435bd19f8854d8ba3bbedb71ecfbe56. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:34.883650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:40:34.890278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:40:34.976971 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1861451-b9d2-425d-9476-0d55198c0fec tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.241265 Jun 16 18:40:34.977646 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1268/2464] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:40:34.994524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-801ec2c4-c2dc-48aa-90a2-011a77a9d5e5 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Action: 'create', calling method: .version_select at 0x7f866ea6d1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-581568079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiTPa36nCCgnSVmVUAogOQunPQ/DqzvrLCXRK0vDmrrmMTrdFObhIGcM0kgMVH1Bq61E9EtfS0v/pPUEp91huniRL+MWtIzFc3vEQHUM4U6CfQNmjHUT/RL3m3kT4sm2w=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:35.046162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-801ec2c4-c2dc-48aa-90a2-011a77a9d5e5 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:35.070926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-801ec2c4-c2dc-48aa-90a2-011a77a9d5e5 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for user 2be9f74c33024bb1aaae95b0681fd935 and project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:35.128599 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-801ec2c4-c2dc-48aa-90a2-011a77a9d5e5 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.148601 Jun 16 18:40:35.130990 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1269/2465] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:40:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:35.151913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:35.152632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:35.187577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.188349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.189491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.190231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.208705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:35.225077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-edc937c5-1f76-4fa0-a903-be2f02af04b4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1317 microversion: 2.1 time: 0.545386 Jun 16 18:40:35.227374 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1197/2466] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:34 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:35.247238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:35.252114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:35.271861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.272475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.282820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.284682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.483044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd69a9d3a40254394b5ffcbb04aa64533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e471697d5b480990e27d9c52fc10f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:35.505675 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dcc2051d-5546-4a28-9caa-48d9819a4344 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 200 len: 1302 microversion: 2.1 time: 0.371243 Jun 16 18:40:35.506363 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1270/2467] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:35 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 1302 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:35.519819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:35.520562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:35.540082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.540689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.541593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.542585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.815520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:35.832263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:35.851150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:35.858397 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-314d0bb1-9950-4f7f-a06d-ff759a15d8b6 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.344773 Jun 16 18:40:35.859402 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1271/2468] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:35 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:35.877817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a9b21e8d-634b-48d9-a652-52f2a58172c5 req-38524b5b-95b5-490b-b3db-dbaa2162f5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09cc04e-39ad-405a-9854-34f896076160", "name": "network-vif-deleted", "tag": "a6991ad5-c697-49ef-b6df-d8d0a1cca1df"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:35.906793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a9b21e8d-634b-48d9-a652-52f2a58172c5 req-38524b5b-95b5-490b-b3db-dbaa2162f5e5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.907380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a9b21e8d-634b-48d9-a652-52f2a58172c5 req-38524b5b-95b5-490b-b3db-dbaa2162f5e5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.920408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:35.934600 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d2dc925-823d-4049-9f75-13857459f5d5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1575 microversion: 2.1 time: 0.705831 Jun 16 18:40:35.935513 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1198/2469] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:35 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1575 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:35.944982 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a9b21e8d-634b-48d9-a652-52f2a58172c5 req-38524b5b-95b5-490b-b3db-dbaa2162f5e5 service nova] Creating event network-vif-deleted:a6991ad5-c697-49ef-b6df-d8d0a1cca1df for instance c09cc04e-39ad-405a-9854-34f896076160 on n-h1-846209-2 Jun 16 18:40:35.949582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:35.951096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:35.953434 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a9b21e8d-634b-48d9-a652-52f2a58172c5 req-38524b5b-95b5-490b-b3db-dbaa2162f5e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092602 Jun 16 18:40:35.958943 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1272/2470] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:35.964410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.965139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.966182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:35.966833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:35.974333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d3653b35-1f5f-461d-98e4-405570ce5d58 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Action: 'create', calling method: .version_select at 0x7f866f1a4310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1285699425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbaXOdxwacdOAmodOFs4YR7MNnSwEN6pUbSWmsTLQMCT5JreiGiEdPpZ2tfKZhWZ6MMg4aFIGLc1AetpgINTwf8nq9K+Q+9w0ZfPp7uMl/st7hIqSW0FnsDxKvw1ncOOg=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:36.019089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d3653b35-1f5f-461d-98e4-405570ce5d58 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:36.024742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:36.033071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d3653b35-1f5f-461d-98e4-405570ce5d58 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Getting quotas for user 2be9f74c33024bb1aaae95b0681fd935 and project 1b29beb41afc48d7a782dd1dc4ab9547. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:36.068871 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d3653b35-1f5f-461d-98e4-405570ce5d58 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.107985 Jun 16 18:40:36.072213 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1273/2471] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:40:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:36.082210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb00906f-6916-4ee6-90fa-82642b94b246 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.083601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cb00906f-6916-4ee6-90fa-82642b94b246 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:36.093741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb00906f-6916-4ee6-90fa-82642b94b246 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.094319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb00906f-6916-4ee6-90fa-82642b94b246 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:36.095176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb00906f-6916-4ee6-90fa-82642b94b246 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.095812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb00906f-6916-4ee6-90fa-82642b94b246 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:36.108239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:36.127476 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-31c69363-d148-43f5-8ea3-76554cd3ec01 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1220 microversion: 2.1 time: 0.190857 Jun 16 18:40:36.128277 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1199/2472] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:35 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1220 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:36.139192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52c17982-0749-4a02-8df7-85fb3d75ff95 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f8678031a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.142437 n-d-846209-2 devstack@n-api.service[119207]: WARNING oslo_db.sqlalchemy.utils [None req-52c17982-0749-4a02-8df7-85fb3d75ff95 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 18:40:36.159186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52c17982-0749-4a02-8df7-85fb3d75ff95 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.029368 Jun 16 18:40:36.160722 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1200/2473] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:40:36 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:36.172508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dfd9c199-5353-4b03-9c07-a92848775ad3 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f866e9340d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.219545 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dfd9c199-5353-4b03-9c07-a92848775ad3 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1285699425" status: 202 len: 0 microversion: 2.1 time: 0.052417 Jun 16 18:40:36.220151 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1201/2474] 10.222.0.27 () {58 vars in 1277 bytes} [Thu Jun 16 18:40:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1285699425 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:40:36.231711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-353e90d7-879d-4733-b62b-02ca0527d38d tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f867418c790>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.262989 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-353e90d7-879d-4733-b62b-02ca0527d38d tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-581568079" status: 202 len: 0 microversion: 2.1 time: 0.036680 Jun 16 18:40:36.265006 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1202/2475] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:40:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-581568079 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:36.282022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.283801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:36.296739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.297656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:36.298766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.299497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:36.345136 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cb00906f-6916-4ee6-90fa-82642b94b246 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.267314 Jun 16 18:40:36.345999 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1274/2476] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:40:36 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:36.358601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81b74f8a-0a73-48ac-8009-091615e26d29 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] Calling method '.version_select at 0x7f866f3611f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.421479 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81b74f8a-0a73-48ac-8009-091615e26d29 tempest-KeyPairsV2TestJSON-1771864425 tempest-KeyPairsV2TestJSON-1771864425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1778713670" status: 202 len: 0 microversion: 2.1 time: 0.074415 Jun 16 18:40:36.426955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1275/2477] 10.222.0.27 () {58 vars in 1277 bytes} [Thu Jun 16 18:40:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1778713670 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:40:36.534104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.534992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] [instance: c09cc04e-39ad-405a-9854-34f896076160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:36.545931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.558460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:36.559521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.560076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:36.594408 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] HTTP exception thrown: Instance c09cc04e-39ad-405a-9854-34f896076160 could not be found. Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Request method failure captured: Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 HTTP/1.1 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3j3OA_MS2VtwzIMQqiv1gtlKJUdjTirsDJ-wqlPDCzmLeoGoG1JLPowYoEGDMn3hC1hnRAKSaPiGRqtpwnytUOOScgxJtjz0E1Ghk6LSHsDWDIh3WxfrPlY92cVPCeVh9zOebsxMwIQwIy3I6-H6lmdaSICTMTTi1U_ptAtE1VQIsA Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 70e471697d5b480990e27d9c52fc10f5 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-InstanceActionsTestJSON-1735302910 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70e471697d5b480990e27d9c52fc10f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/70e471697d5b480990e27d9c52fc10f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_70e471697d5b480990e27d9c52fc10f5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70e471697d5b480990e27d9c52fc10f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-InstanceActionsTestJSON-1735302910 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 70e471697d5b480990e27d9c52fc10f5 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1735302910 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-InstanceActionsTestJSON-1735302910-project Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: d69a9d3a40254394b5ffcbb04aa64533 Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-InstanceActionsTestJSON-1735302910-project Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c09cc04e-39ad-405a-9854-34f896076160 could not be found. Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c09cc04e-39ad-405a-9854-34f896076160'} Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09cc04e-39ad-405a-9854-34f896076160 could not be found. Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09cc04e-39ad-405a-9854-34f896076160 could not be found. Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:36.599467 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:36.603196 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:36.603196 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:36.603196 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:36.603196 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:36.603196 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:36.603196 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09cc04e-39ad-405a-9854-34f896076160 could not be found. Jun 16 18:40:36.603196 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:36.605527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] Returning 404 to user: Instance c09cc04e-39ad-405a-9854-34f896076160 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:36.612832 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-108d38dc-fcf6-4e6a-b28b-c19b6ef92839 tempest-InstanceActionsTestJSON-1735302910 tempest-InstanceActionsTestJSON-1735302910-project] 10.222.0.27 "GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160" status: 404 len: 111 microversion: 2.1 time: 0.093978 Jun 16 18:40:36.619534 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1276/2478] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:36 2022] GET /compute/v2.1/servers/c09cc04e-39ad-405a-9854-34f896076160 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:40:36.877446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:36.879881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:36.892062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.892839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:36.897145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:36.898716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:37.094916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:37.097382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:37.117398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:37.119205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:37.127848 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9829c0a5-7446-422f-9357-ad212423f89b tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.254210 Jun 16 18:40:37.128920 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1277/2479] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:36 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:40:37.148179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:37.149519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:37.158762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:37.159481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:37.160281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:37.161238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:37.180483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:37.193769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5154e885-c02c-42f8-a7fd-4b88c00e9a81 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1317 microversion: 2.1 time: 0.921630 Jun 16 18:40:37.205056 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1203/2480] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:36 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1317 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:37.565656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:37.584474 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7d6f9f42-f408-4bf7-9057-cbf9ecd46578 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1274 microversion: 2.1 time: 0.439022 Jun 16 18:40:37.594618 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1278/2481] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:37 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1274 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:38.110244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2199270-49a0-40f4-9b65-79ecd133c687 tempest-AZV2TestJSON-1937654859 tempest-AZV2TestJSON-1937654859-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:38.115411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2199270-49a0-40f4-9b65-79ecd133c687 tempest-AZV2TestJSON-1937654859 tempest-AZV2TestJSON-1937654859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.116243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2199270-49a0-40f4-9b65-79ecd133c687 tempest-AZV2TestJSON-1937654859 tempest-AZV2TestJSON-1937654859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.117476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2199270-49a0-40f4-9b65-79ecd133c687 tempest-AZV2TestJSON-1937654859 tempest-AZV2TestJSON-1937654859-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.121413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2199270-49a0-40f4-9b65-79ecd133c687 tempest-AZV2TestJSON-1937654859 tempest-AZV2TestJSON-1937654859-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.149578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:38.150888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:38.173599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.174855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.175704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.179528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.219646 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b2199270-49a0-40f4-9b65-79ecd133c687 tempest-AZV2TestJSON-1937654859 tempest-AZV2TestJSON-1937654859-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.347160 Jun 16 18:40:38.226115 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1204/2482] 10.222.0.27 () {58 vars in 1163 bytes} [Thu Jun 16 18:40:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:40:38.237358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:38.240800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:38.256836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.258673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.264905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.266957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.466030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:38.481110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:38.488791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:38.493088 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2855a7b2-cae1-4c50-8ad2-3fe08ccc9c96 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.348959 Jun 16 18:40:38.508165 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1279/2483] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:38 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:38.599486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:38.600251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:38.615029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.615962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.616921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:38.618393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:38.868638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:39.434330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:39.448386 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d3bdbd21-4ba0-43cd-a9db-5fc963592e35 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1317 microversion: 2.1 time: 1.220871 Jun 16 18:40:39.449373 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1205/2484] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:38 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1317 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:39.463177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:39.463991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:39.482267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:39.482825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:39.483720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:39.484219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:39.572873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:39.582068 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b446b97a-8074-402b-bef1-636be6534767 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1575 microversion: 2.1 time: 0.990605 Jun 16 18:40:39.588469 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1280/2485] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:38 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1575 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:39.604923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e70651e7-c373-4f02-81a2-ec08807b032d req-14802dc9-2bdd-4914-92af-596f990af29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e98225-1fd5-4da5-a370-ce284f3448a6", "tag": "b19385ee-458d-4bd4-81c9-2f37998db071"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:39.620919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e70651e7-c373-4f02-81a2-ec08807b032d req-14802dc9-2bdd-4914-92af-596f990af29c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:39.621561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e70651e7-c373-4f02-81a2-ec08807b032d req-14802dc9-2bdd-4914-92af-596f990af29c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:39.665140 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e70651e7-c373-4f02-81a2-ec08807b032d req-14802dc9-2bdd-4914-92af-596f990af29c service nova] Creating event network-changed:b19385ee-458d-4bd4-81c9-2f37998db071 for instance f7e98225-1fd5-4da5-a370-ce284f3448a6 on n-h2-846209-2 Jun 16 18:40:39.680917 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e70651e7-c373-4f02-81a2-ec08807b032d req-14802dc9-2bdd-4914-92af-596f990af29c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090802 Jun 16 18:40:39.699358 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1281/2486] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:39.716363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:39.717700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:39.733049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:39.733892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:39.734955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:39.737308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:40.088368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:40.119230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:40.123106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:40.131266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31846a47-aac2-4011-9e5b-f384a02a6705 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.430270 Jun 16 18:40:40.144730 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1282/2487] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:39 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:40.150023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4fc58a09-552d-4832-9ac8-a95c104e0830 req-4098a4bf-84eb-430a-bff7-5d5d0c91e283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ff1dd7-0d48-479e-95f1-af7f8d2b2530", "name": "network-vif-plugged", "status": "completed", "tag": "a136882d-37aa-4b9f-8921-5f8b4b2da24f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:40.195291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4fc58a09-552d-4832-9ac8-a95c104e0830 req-4098a4bf-84eb-430a-bff7-5d5d0c91e283 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:40.195913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4fc58a09-552d-4832-9ac8-a95c104e0830 req-4098a4bf-84eb-430a-bff7-5d5d0c91e283 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:40.236397 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4fc58a09-552d-4832-9ac8-a95c104e0830 req-4098a4bf-84eb-430a-bff7-5d5d0c91e283 service nova] Creating event network-vif-plugged:a136882d-37aa-4b9f-8921-5f8b4b2da24f for instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 on n-h1-846209-2 Jun 16 18:40:40.251860 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4fc58a09-552d-4832-9ac8-a95c104e0830 req-4098a4bf-84eb-430a-bff7-5d5d0c91e283 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105255 Jun 16 18:40:40.252918 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1283/2488] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:40.331688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:40.342257 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1259180b-ff7e-4b17-90e8-aa2fac967d74 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1316 microversion: 2.1 time: 0.888313 Jun 16 18:40:40.375544 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1206/2489] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:39 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1316 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:40.466926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:40.468020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:40.482453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:40.483289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:40.484311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:40.484959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:41.153371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:41.154816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:41.183926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:41.187224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:41.188319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:41.189379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:41.696727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:41.714147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:41.716271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:41.718600 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-79e2f181-db86-4b21-862f-20469cfb59c8 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.569462 Jun 16 18:40:41.722207 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1207/2490] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:41 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:40:41.733572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:41.734684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:41.746106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:41.746880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:41.748721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:41.749440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:41.962325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:41.970936 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f22991b1-c847-4514-8449-fd704507c7a1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1317 microversion: 2.1 time: 1.508487 Jun 16 18:40:41.983791 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1284/2491] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:40 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1317 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:42.006841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-98d53dd9-a05d-4857-9a36-8a6abcdfda97 req-229f11e7-8b81-4803-9842-0589503b7053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe57ae7-55c2-4e56-a339-23aa640c8204", "tag": "e11cd6f4-2817-4695-bc46-84b68dd12e61"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:42.027571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-98d53dd9-a05d-4857-9a36-8a6abcdfda97 req-229f11e7-8b81-4803-9842-0589503b7053 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:42.028276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-98d53dd9-a05d-4857-9a36-8a6abcdfda97 req-229f11e7-8b81-4803-9842-0589503b7053 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:42.045297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-98d53dd9-a05d-4857-9a36-8a6abcdfda97 req-229f11e7-8b81-4803-9842-0589503b7053 service nova] Creating event network-changed:e11cd6f4-2817-4695-bc46-84b68dd12e61 for instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 on n-h2-846209-2 Jun 16 18:40:42.052299 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-98d53dd9-a05d-4857-9a36-8a6abcdfda97 req-229f11e7-8b81-4803-9842-0589503b7053 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054996 Jun 16 18:40:42.053663 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1285/2492] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:42.542838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:42.553013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98140f52-2c26-4972-810f-7eee7346b2be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1316 microversion: 2.1 time: 0.827306 Jun 16 18:40:42.558557 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1208/2493] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:41 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:42.672732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23552321-0a12-4bcd-8a80-db7d6cb2d6ae tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f8677f873a0>, body: {"keypair": {"name": "tempest-keypair-783834372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdSM52Ik/Sgfv7WMtyGiRwR2GmMh3AkiiCN1VF13aM1dYCvcviqFoIOiKTDtCMY/IGuFBvYzHQg4ku3cwuduuUklcd6dKUNCz/pZ3VeuGPSd4HyoFFZ2pd0Xh9vV4S1Aw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:42.691830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-23552321-0a12-4bcd-8a80-db7d6cb2d6ae tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:42.705053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-23552321-0a12-4bcd-8a80-db7d6cb2d6ae tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:42.744156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:42.745141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:42.756665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:42.760102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:42.761001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:42.761512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:42.792903 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-23552321-0a12-4bcd-8a80-db7d6cb2d6ae tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.421903 Jun 16 18:40:42.799341 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1286/2494] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Jun 16 18:40:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 424 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 16 18:40:42.810642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d743d8e-f0ba-4f04-9b60-cc9fcc840776 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866f14c820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:42.825081 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d743d8e-f0ba-4f04-9b60-cc9fcc840776 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-783834372" status: 200 len: 512 microversion: 2.2 time: 0.024200 Jun 16 18:40:42.832160 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1287/2495] 10.222.0.27 () {60 vars in 1254 bytes} [Thu Jun 16 18:40:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-783834372 => generated 512 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:42.844364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ea0968a-f51c-4143-8fd0-76abf52f0ea3 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866eac1b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:42.868609 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1ea0968a-f51c-4143-8fd0-76abf52f0ea3 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783834372" status: 204 len: 0 microversion: 2.2 time: 0.030750 Jun 16 18:40:42.870023 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1288/2496] 10.222.0.27 () {60 vars in 1257 bytes} [Thu Jun 16 18:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783834372 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:42.886328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-39030526-1c7c-4faa-bd09-3419ef840824 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f866e5053a0>, body: {"keypair": {"name": "tempest-keypair-1794835137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGUzC72W1vasDnxRinipuDJCTP9osdUAOw8A91k7fOHguH2oUVGw8LlqEKYJ/GBvomCDayMfS0bi+qTGeJu8nqUNnPDhcYv8co5giidRnhKBvmA33GU+ZtvC0NWjqayHw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:42.907228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-39030526-1c7c-4faa-bd09-3419ef840824 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:42.914898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-39030526-1c7c-4faa-bd09-3419ef840824 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:42.949709 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-39030526-1c7c-4faa-bd09-3419ef840824 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.070097 Jun 16 18:40:42.950740 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1289/2497] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Jun 16 18:40:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:40:42.962274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-42e433d7-621e-4d0b-8ade-6be611a549c4 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866e505430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:42.966070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:42.989509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:42.997135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:42.999820 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3415a9a-57f5-4007-8b51-dde8ca94d121 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.261321 Jun 16 18:40:43.012504 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1209/2498] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:42 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:43.017831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:43.018810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:43.026884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:43.027687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:43.028552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:43.029135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:43.039285 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-42e433d7-621e-4d0b-8ade-6be611a549c4 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794835137" status: 204 len: 0 microversion: 2.2 time: 0.082272 Jun 16 18:40:43.040550 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1290/2499] 10.222.0.27 () {60 vars in 1260 bytes} [Thu Jun 16 18:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794835137 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:43.055918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7903aecc-3404-4035-839d-3880a73a4de6 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f866eac1ca0>, body: {"keypair": {"name": "tempest-keypair-615274854", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:43.086676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7903aecc-3404-4035-839d-3880a73a4de6 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:43.099901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7903aecc-3404-4035-839d-3880a73a4de6 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:43.153040 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7903aecc-3404-4035-839d-3880a73a4de6 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.107153 Jun 16 18:40:43.158603 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1291/2500] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Jun 16 18:40:43 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:40:43.165680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c83a5334-8c97-4090-8e9c-4a064dcce128 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f867813b790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:43.195147 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c83a5334-8c97-4090-8e9c-4a064dcce128 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615274854" status: 204 len: 0 microversion: 2.2 time: 0.035027 Jun 16 18:40:43.203266 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1292/2501] 10.222.0.27 () {60 vars in 1257 bytes} [Thu Jun 16 18:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615274854 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:43.213468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28ac22de-ae42-4c12-b8fb-24dc339c4bdf tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f867813b9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1715886678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjtqFPAIZu1NggX7qhiMr3aAfOcRFwNPNhNxZMPJY+G+ZFDKkqPr0lheQz8HZJe+jabbOlQcyXwPY3xoePY6Hlchdl+CVk7TTSvCFm+5tj7nsIt9+ZxvKCAh3xw6PF6dA=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:43.299218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-28ac22de-ae42-4c12-b8fb-24dc339c4bdf tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:43.309733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-28ac22de-ae42-4c12-b8fb-24dc339c4bdf tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:43.383545 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28ac22de-ae42-4c12-b8fb-24dc339c4bdf tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.178169 Jun 16 18:40:43.399324 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1293/2502] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Jun 16 18:40:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:40:43.405666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-34cd2c29-e427-4f64-871a-7591efc25dd1 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f866eac1c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1079694431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYFqX9KBWcp0yGhtZTCAzDnou1GlVvQ5ySoaRoWQeWuojKbamLd8NVZKAjm03tg3uEC8V2spjy5m6A939tAq6kEjuo16bsH0PtHEBi/dtWRXg3qGcb6VOWjRboqXoQY7w=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:43.424200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-34cd2c29-e427-4f64-871a-7591efc25dd1 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:43.427339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:43.431561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-34cd2c29-e427-4f64-871a-7591efc25dd1 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:43.490464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34cd2c29-e427-4f64-871a-7591efc25dd1 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.089759 Jun 16 18:40:43.498082 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1294/2503] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Jun 16 18:40:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:40:43.503466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12a9825c-fe16-4d78-914d-40dbc5a10e31 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f866e5058b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1195588525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+CClyrgHdnoK54vNAdsyTHfhEG8ROe1JP2ZH/3TRXY9kozapyL4fxzSAQ0FO7Ez3lVdhFC0Fxqn23OGrC3h1nbgVq2zPK/7gqKoEODeAXM/0rAJ7b1bln+s+p/WcGMFg=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:43.532195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-12a9825c-fe16-4d78-914d-40dbc5a10e31 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:43.541325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-12a9825c-fe16-4d78-914d-40dbc5a10e31 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:43.605281 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12a9825c-fe16-4d78-914d-40dbc5a10e31 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.105652 Jun 16 18:40:43.609985 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1295/2504] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Jun 16 18:40:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:40:43.625191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:43.626267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:43.647353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:43.650743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:43.653939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:43.656104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:43.761233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:43.778817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5d3f6f08-9731-45f2-9bf7-7fda5ce3f371 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1466 microversion: 2.1 time: 0.764832 Jun 16 18:40:43.791132 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1210/2505] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:43 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1466 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:43.796071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a2593177-e23b-4118-b617-d327acf25643 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866e8e4c10>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:43.798901 n-d-846209-2 devstack@n-api.service[119207]: WARNING oslo_db.sqlalchemy.utils [None req-a2593177-e23b-4118-b617-d327acf25643 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 18:40:43.811649 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a2593177-e23b-4118-b617-d327acf25643 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.019232 Jun 16 18:40:43.819017 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1211/2506] 10.222.0.27 () {60 vars in 1176 bytes} [Thu Jun 16 18:40:43 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:44.024940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c4aa339-c442-42e2-b19a-e71acb519bb8 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:44.026111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0c4aa339-c442-42e2-b19a-e71acb519bb8 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:44.034423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c4aa339-c442-42e2-b19a-e71acb519bb8 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:44.035104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c4aa339-c442-42e2-b19a-e71acb519bb8 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:44.036649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c4aa339-c442-42e2-b19a-e71acb519bb8 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:44.037262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c4aa339-c442-42e2-b19a-e71acb519bb8 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:44.762403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:44.778476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:44.791982 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d7a0769a-14c0-464b-b766-cf9ffac5b015 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1316 microversion: 2.1 time: 1.180372 Jun 16 18:40:44.795437 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1296/2507] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:43 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1316 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:44.802666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-492c27ba-1429-41d0-83f8-c71d25af5e9f tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f867813b550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:44.848285 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-492c27ba-1429-41d0-83f8-c71d25af5e9f tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1195588525" status: 204 len: 0 microversion: 2.2 time: 0.051366 Jun 16 18:40:44.848900 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1297/2508] 10.222.0.27 () {60 vars in 1320 bytes} [Thu Jun 16 18:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1195588525 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:44.862967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:44.870088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:44.878599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:44.879433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:44.880960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:44.882641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:45.023149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:45.039497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:45.041550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1560b6858b144a0397ad4ee7da636d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8153ca9ca7ea4d0381215928fc7c0900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:45.043259 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6227e06-6234-4754-b0d1-45ede34b11cc tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 200 len: 1605 microversion: 2.32 time: 0.191225 Jun 16 18:40:45.044100 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1298/2509] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:44 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 1605 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:40:45.049949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d226ade5-23c3-4a83-834a-d01b92b29984 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866e5058b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:45.074537 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d226ade5-23c3-4a83-834a-d01b92b29984 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1079694431" status: 204 len: 0 microversion: 2.2 time: 0.029054 Jun 16 18:40:45.076545 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1299/2510] 10.222.0.27 () {60 vars in 1320 bytes} [Thu Jun 16 18:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1079694431 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:45.091192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0c489bf-7d73-4644-8dd8-968760e82c84 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f867813b0d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:45.135711 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c0c489bf-7d73-4644-8dd8-968760e82c84 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1715886678" status: 204 len: 0 microversion: 2.2 time: 0.051973 Jun 16 18:40:45.138752 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1300/2511] 10.222.0.27 () {60 vars in 1320 bytes} [Thu Jun 16 18:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1715886678 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:40:45.153331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-64f6f034-045a-46c5-b3f4-62487bd91caa tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f866ea6dd30>, body: {"keypair": {"name": "tempest-keypair-975091434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKuFPAlru59TNd2EXHiGCMybqpPMU3RuPAXoPKwyRJpqFTPOPX7DB/5D8g9CakGbnNtulWWxqTkNAx5Rub6ABsLtklcMT3FR7NBTbHeebukCdmppmNYtW8G0aDlVoW4pw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:45.193271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-64f6f034-045a-46c5-b3f4-62487bd91caa tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:45.211215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-64f6f034-045a-46c5-b3f4-62487bd91caa tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:45.261332 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-64f6f034-045a-46c5-b3f4-62487bd91caa tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.110761 Jun 16 18:40:45.265589 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1301/2512] 10.222.0.27 () {62 vars in 1198 bytes} [Thu Jun 16 18:40:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:40:45.286399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e1da019-be73-4d12-ae6a-064602e11335 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866ea7b1f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:45.319314 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e1da019-be73-4d12-ae6a-064602e11335 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-975091434" status: 200 len: 512 microversion: 2.2 time: 0.047713 Jun 16 18:40:45.319933 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1302/2513] 10.222.0.27 () {60 vars in 1254 bytes} [Thu Jun 16 18:40:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-975091434 => generated 512 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:45.342461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-58b9d089-4cd9-4978-bb79-50a0181cceba tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866f1a4430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:45.345454 n-d-846209-2 devstack@n-api.service[119206]: WARNING oslo_db.sqlalchemy.utils [None req-58b9d089-4cd9-4978-bb79-50a0181cceba tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 18:40:45.360246 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-58b9d089-4cd9-4978-bb79-50a0181cceba tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.024977 Jun 16 18:40:45.361106 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1303/2514] 10.222.0.27 () {60 vars in 1176 bytes} [Thu Jun 16 18:40:45 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:45.371366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-952543ed-1835-4cad-b5e0-d070321c9ac1 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f867813b550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:45.436472 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-952543ed-1835-4cad-b5e0-d070321c9ac1 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975091434" status: 204 len: 0 microversion: 2.2 time: 0.067598 Jun 16 18:40:45.438208 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1304/2515] 10.222.0.27 () {60 vars in 1257 bytes} [Thu Jun 16 18:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975091434 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:45.458303 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c4aa339-c442-42e2-b19a-e71acb519bb8 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1617 microversion: 2.1 time: 1.635609 Jun 16 18:40:45.460620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Action: 'create', calling method: .version_select at 0x7f866eba2d30>, body: {"keypair": {"name": "tempest-keypair-2094022773", "type": "x509"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:45.471770 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1212/2516] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:43 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1617 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:45.482693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3be38bcf-6c27-40d0-bece-2458fe81f708 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: .version_select at 0x7f866e898ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1354326550", "policies": ["affinity"]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:45.498465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:45.507603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:45.530060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.processutils [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp_trjjez1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_trjjez1/temp.key -subj /CN=dc3267a93a8f476cb1419e47f2cfa0f3 -extensions v3_req_client {{(pid=119206) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 16 18:40:45.568211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3be38bcf-6c27-40d0-bece-2458fe81f708 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:45.591897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3be38bcf-6c27-40d0-bece-2458fe81f708 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:45.689358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3be38bcf-6c27-40d0-bece-2458fe81f708 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:45.709758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3be38bcf-6c27-40d0-bece-2458fe81f708 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:45.733949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3be38bcf-6c27-40d0-bece-2458fe81f708 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.260531 Jun 16 18:40:45.734847 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1213/2517] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Jun 16 18:40:45 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:45.821103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:45.821740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:45.840974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:45.842869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:45.844999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:45.848719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:46.584964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.processutils [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp_trjjez1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_trjjez1/temp.key -subj /CN=dc3267a93a8f476cb1419e47f2cfa0f3 -extensions v3_req_client" returned: 0 in 1.054s {{(pid=119206) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 16 18:40:46.591260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.processutils [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp_trjjez1/temp.key -password pass: {{(pid=119206) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 16 18:40:46.676605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.processutils [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp_trjjez1/temp.key -password pass:" returned: 0 in 0.085s {{(pid=119206) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 16 18:40:46.764920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:46.778362 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b514155-e01a-4c85-957c-3b26b35eab7b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1316 microversion: 2.1 time: 0.961971 Jun 16 18:40:46.779716 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1214/2518] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:45 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1316 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:46.783001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:46.785015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-43663399", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8bab66f8-5fa8-408a-bcdc-a0a8d2d6293e"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:46.799717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Getting quotas for user dc3267a93a8f476cb1419e47f2cfa0f3 and project 08b5fb6d91314f1d80d18921b251ecdd. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:46.843930 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b5b9cc70-6bfb-4eff-b87b-d4ebbf32043e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.397053 Jun 16 18:40:46.847193 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1305/2519] 10.222.0.27 () {62 vars in 1197 bytes} [Thu Jun 16 18:40:45 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1403 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:46.863314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:46.865453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:46.882880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:46.885243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:46.887266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:46.887926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:46.900158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:40:46.927267 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] HTTP exception thrown: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Request method failure captured: Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 HTTP/1.1 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3d8Oe9SkmgPqJOgdwljORnX52nasBov9DgNjw7fp__e7_dsWuBv-2DzXPX-s2NI75j1LmJkjiambGcp3teR8epwDTGojuRFcihMsMsTZ_3LLv0k9RbFC8unuO41NaH7OEQoTG5cA889mwEeT7qDJVA44poeal9zjQdPkm3RnGG8-NA Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.32 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8153ca9ca7ea4d0381215928fc7c0900 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8153ca9ca7ea4d0381215928fc7c0900", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8153ca9ca7ea4d0381215928fc7c0900 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TaggedBootDevicesTest-1434693886-project Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 1560b6858b144a0397ad4ee7da636d8b Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TaggedBootDevicesTest-1434693886-project Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5d404bf4-c6e7-49e2-9dbd-d3584ced0295'} Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:46.930765 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:46.935821 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:46.935821 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:46.935821 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:46.935821 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:46.935821 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:46.935821 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:46.935821 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:46.940910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Returning 404 to user: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:46.944623 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1bc9b71a-c87e-40fb-928d-09d01c2b12ba tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 404 len: 111 microversion: 2.32 time: 0.094881 Jun 16 18:40:46.947372 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1306/2520] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:46 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:40:46.953037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-618dce7f-f20a-4209-95e7-300b61b73b8e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866eddb310>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:46.962958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-618dce7f-f20a-4209-95e7-300b61b73b8e tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-2094022773" status: 200 len: 1534 microversion: 2.2 time: 0.014259 Jun 16 18:40:46.963862 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1307/2521] 10.222.0.27 () {60 vars in 1257 bytes} [Thu Jun 16 18:40:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2094022773 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:46.969460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e858fd48-c377-4ab7-be4e-66e01e9e6262 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '.version_select at 0x7f866eac1d30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:47.000209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e858fd48-c377-4ab7-be4e-66e01e9e6262 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633317157" status: 204 len: 0 microversion: 2.32 time: 0.034825 Jun 16 18:40:47.001319 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1308/2522] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633317157 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:40:47.007760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ed439a9-c7f3-4ae3-8555-bc200d3c8556 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866f6cbf70>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:47.012881 n-d-846209-2 devstack@n-api.service[119206]: WARNING oslo_db.sqlalchemy.utils [None req-2ed439a9-c7f3-4ae3-8555-bc200d3c8556 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 18:40:47.021337 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2ed439a9-c7f3-4ae3-8555-bc200d3c8556 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.017524 Jun 16 18:40:47.022610 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1309/2523] 10.222.0.27 () {60 vars in 1176 bytes} [Thu Jun 16 18:40:47 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:47.035181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f2d05bd-a6c4-4a27-896b-39063f839d95 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] Calling method '.version_select at 0x7f866eddbe50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:47.081670 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f2d05bd-a6c4-4a27-896b-39063f839d95 tempest-KeyPairsV22TestJSON-172298937 tempest-KeyPairsV22TestJSON-172298937-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094022773" status: 204 len: 0 microversion: 2.2 time: 0.051777 Jun 16 18:40:47.084611 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1310/2524] 10.222.0.27 () {60 vars in 1260 bytes} [Thu Jun 16 18:40:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094022773 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:40:47.797168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:47.798117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:47.811828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:47.812987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:47.814333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:47.818659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:48.159058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:48.272059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:40:48.272713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:40:48.272974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:40:48.273423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:40:48.273814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:40:48.350475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:48.353365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:48.354417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:48.355214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:48.407082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:48.413746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:48.434935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:48.444905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Going to run 2 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:40:48.446717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae5aae53-5382-4c34-bb31-0cd02008b8b7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1316 microversion: 2.1 time: 0.654318 Jun 16 18:40:48.448060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:40:48.451707 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1311/2525] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:47 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:48.472517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-12c7c4a5-0918-4418-952d-388530052a2b req-9c06c6a7-6b57-415a-8892-61e3b050694b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe57ae7-55c2-4e56-a339-23aa640c8204", "name": "network-vif-plugged", "status": "completed", "tag": "e11cd6f4-2817-4695-bc46-84b68dd12e61"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:48.496667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119207) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 16 18:40:48.497884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-12c7c4a5-0918-4418-952d-388530052a2b req-9c06c6a7-6b57-415a-8892-61e3b050694b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:48.504154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-12c7c4a5-0918-4418-952d-388530052a2b req-9c06c6a7-6b57-415a-8892-61e3b050694b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:48.528377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-12c7c4a5-0918-4418-952d-388530052a2b req-9c06c6a7-6b57-415a-8892-61e3b050694b service nova] Creating event network-vif-plugged:e11cd6f4-2817-4695-bc46-84b68dd12e61 for instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 on n-h2-846209-2 Jun 16 18:40:48.544951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-12c7c4a5-0918-4418-952d-388530052a2b req-9c06c6a7-6b57-415a-8892-61e3b050694b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081573 Jun 16 18:40:48.549169 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1312/2526] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:48.576208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:48.586234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:48.649898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:48.709018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:48.720801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:48.751533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=3b48f1e6-0ad5-4be0-829f-d237ed920db5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:40:48.886913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:48.912382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:48.969798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:48.979584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:49.091107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4bbc4df6-01de-404a-adeb-0fb4e936015d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.309733 Jun 16 18:40:49.102781 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1215/2527] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:40:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 2322 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:40:49.107191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:49.120595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:49.121503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Searching by: {'deleted': False, 'project_id': '6a21d936370c4a5bbdd254cacc618708'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:40:49.181306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:49.185054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:49.190063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:49.190974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:49.249248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:40:49.292132 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-20b1362d-4457-4ef9-85ad-f31d42579a96 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.189808 Jun 16 18:40:49.293548 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1313/2528] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:40:49 2022] GET /compute/v2.1/servers => generated 1000 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:49.333007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3b13087-c592-4647-b9b5-f1fbb84e9672 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:49.342742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b3b13087-c592-4647-b9b5-f1fbb84e9672 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:49.472194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:49.474808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:49.488163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:49.489466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:49.495745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:49.496389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:50.198687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3b13087-c592-4647-b9b5-f1fbb84e9672 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:50.220262 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3b13087-c592-4647-b9b5-f1fbb84e9672 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1217 microversion: 2.1 time: 0.915668 Jun 16 18:40:50.239787 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1216/2529] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:49 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1217 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:50.836654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:50.846709 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c84a2ca-e2c0-4107-8e5c-c48a11f1b577 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1316 microversion: 2.1 time: 1.382623 Jun 16 18:40:50.852952 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1314/2530] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:49 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1316 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:51.240114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:51.240738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:51.250364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:51.250823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:51.251607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:51.252048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:51.394559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:51.414921 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-64b059ec-a9dd-4b55-9bc6-3313d309de07 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1269 microversion: 2.1 time: 0.178490 Jun 16 18:40:51.415325 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1217/2531] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:51 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:51.867882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:51.868509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:51.870800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:51.885250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:51.885704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:51.886536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:51.886997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:52.431815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:52.447826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:52.462043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:52.462566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:52.463464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:52.464273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:52.489547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:52.516994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:52.534149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e31dec07-96b0-4b43-9653-66948e207824 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1506 microversion: 2.1 time: 0.670974 Jun 16 18:40:52.546343 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1315/2532] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:51 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:52.553532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:52.554373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:52.573768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:52.574324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:52.575124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:52.575746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:52.607108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:52.623254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a81757d-65d5-4ecc-802c-571edd3f1364 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1275 microversion: 2.1 time: 0.195332 Jun 16 18:40:52.624484 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1218/2533] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:52 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:52.646952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:40:52.824741 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b69c64f7-a345-40a2-ab59-fce3b306be4b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 204 len: 0 microversion: 2.1 time: 0.275158 Jun 16 18:40:52.825378 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1316/2534] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:40:52 2022] DELETE /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:40:52.833644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:52.834670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:52.846520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:52.847353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:52.850145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:52.850902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:53.231807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:53.242454 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7e0adc1f-33eb-465e-b458-2622b0e13b92 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1512 microversion: 2.1 time: 0.412620 Jun 16 18:40:53.248258 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1219/2535] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:52 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:53.641628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:53.642387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:53.658889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:53.662624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:53.664591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:53.665053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:54.268076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:54.268443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:54.290424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:54.292876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:54.298993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:54.300010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:54.614413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:54.615908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:54.627605 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5dedf502-b851-4941-baf5-77bdebc37709 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 0.990250 Jun 16 18:40:54.634461 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1317/2536] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:53 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:54.828593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1bc91699-4cb8-475e-9c1d-3dd5169c62bc tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.193031 Jun 16 18:40:54.829947 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1318/2537] 10.222.0.27 () {58 vars in 1127 bytes} [Thu Jun 16 18:40:54 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:40:54.840569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6db45e4d-69e1-45c3-a9f9-cb30152ac31b tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Calling method '.version_select at 0x7f866f11f9d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:54.874919 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-6db45e4d-69e1-45c3-a9f9-cb30152ac31b tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] HTTP exception thrown: Image not found. Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6db45e4d-69e1-45c3-a9f9-cb30152ac31b tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Request method failure captured: Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k2go39XIzw1noL0l7tprwm_ENNY-Np3Sstm42Bs128EMT-FrlcwGg39bLgw2P4uRN5F-qza_Q29pBjz5KECIafaemqvBCyk4zUqEO7EsagKzHpwFq8HSNuTRJKmpIIvkGzHOwszGHs6BSXS-EUMgG5NAzw6CBhRNmYwMBQKdHSLpQ Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45325655047747a0b2593b4a1223315e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45325655047747a0b2593b4a1223315e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0328933fd603408d81e5e577b009e372 Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '-1'} Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.877114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:40:54.880975 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.884728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6db45e4d-69e1-45c3-a9f9-cb30152ac31b tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:54.886003 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6db45e4d-69e1-45c3-a9f9-cb30152ac31b tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.050141 Jun 16 18:40:54.887521 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1319/2538] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jun 16 18:40:54 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:40:54.897610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-564d8124-9d3c-4236-82b9-658de59ef50a tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Calling method '.version_select at 0x7f866eba2820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:54.927821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-564d8124-9d3c-4236-82b9-658de59ef50a tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] HTTP exception thrown: Image not found. Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-564d8124-9d3c-4236-82b9-658de59ef50a tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Request method failure captured: Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/14362538-bddb-4b73-8eb8-e780abbc363j HTTP/1.1 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k2go39XIzw1noL0l7tprwm_ENNY-Np3Sstm42Bs128EMT-FrlcwGg39bLgw2P4uRN5F-qza_Q29pBjz5KECIafaemqvBCyk4zUqEO7EsagKzHpwFq8HSNuTRJKmpIIvkGzHOwszGHs6BSXS-EUMgG5NAzw6CBhRNmYwMBQKdHSLpQ Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45325655047747a0b2593b4a1223315e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45325655047747a0b2593b4a1223315e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0328933fd603408d81e5e577b009e372 Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '14362538-bddb-4b73-8eb8-e780abbc363j'} Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 14362538-bddb-4b73-8eb8-e780abbc363j to delete Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14362538-bddb-4b73-8eb8-e780abbc363j could not be found. Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.930872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:40:54.934913 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.940661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-564d8124-9d3c-4236-82b9-658de59ef50a tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:54.941836 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-564d8124-9d3c-4236-82b9-658de59ef50a tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] 10.222.0.27 "DELETE /compute/v2.1/images/14362538-bddb-4b73-8eb8-e780abbc363j" status: 404 len: 62 microversion: 2.1 time: 0.049247 Jun 16 18:40:54.943069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1320/2539] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:54 2022] DELETE /compute/v2.1/images/14362538-bddb-4b73-8eb8-e780abbc363j => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:40:54.958243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-861c1aa6-0575-4139-900e-83928b5ed934 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Calling method '.version_select at 0x7f866ec47d30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:54.982661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-861c1aa6-0575-4139-900e-83928b5ed934 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] HTTP exception thrown: Image not found. Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-861c1aa6-0575-4139-900e-83928b5ed934 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Request method failure captured: Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/62cf7b09-a435-4a62-bfe7-01ba797036691 HTTP/1.1 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k2go39XIzw1noL0l7tprwm_ENNY-Np3Sstm42Bs128EMT-FrlcwGg39bLgw2P4uRN5F-qza_Q29pBjz5KECIafaemqvBCyk4zUqEO7EsagKzHpwFq8HSNuTRJKmpIIvkGzHOwszGHs6BSXS-EUMgG5NAzw6CBhRNmYwMBQKdHSLpQ Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45325655047747a0b2593b4a1223315e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45325655047747a0b2593b4a1223315e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0328933fd603408d81e5e577b009e372 Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '62cf7b09-a435-4a62-bfe7-01ba797036691'} Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 62cf7b09-a435-4a62-bfe7-01ba797036691 to delete Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62cf7b09-a435-4a62-bfe7-01ba797036691 could not be found. Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.986493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:40:54.990869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:54.995142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-861c1aa6-0575-4139-900e-83928b5ed934 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:54.996745 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-861c1aa6-0575-4139-900e-83928b5ed934 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] 10.222.0.27 "DELETE /compute/v2.1/images/62cf7b09-a435-4a62-bfe7-01ba797036691" status: 404 len: 62 microversion: 2.1 time: 0.044544 Jun 16 18:40:55.006897 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1321/2540] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:40:54 2022] DELETE /compute/v2.1/images/62cf7b09-a435-4a62-bfe7-01ba797036691 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:40:55.015417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-489fb608-4bf6-4a7a-b7a4-7ce9e590c224 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Calling method '.version_select at 0x7f866eba2d30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:55.044952 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-489fb608-4bf6-4a7a-b7a4-7ce9e590c224 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] HTTP exception thrown: Image not found. Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-489fb608-4bf6-4a7a-b7a4-7ce9e590c224 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Request method failure captured: Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/tempest-invalid-272893321 HTTP/1.1 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k2go39XIzw1noL0l7tprwm_ENNY-Np3Sstm42Bs128EMT-FrlcwGg39bLgw2P4uRN5F-qza_Q29pBjz5KECIafaemqvBCyk4zUqEO7EsagKzHpwFq8HSNuTRJKmpIIvkGzHOwszGHs6BSXS-EUMgG5NAzw6CBhRNmYwMBQKdHSLpQ Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45325655047747a0b2593b4a1223315e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45325655047747a0b2593b4a1223315e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0328933fd603408d81e5e577b009e372 Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'tempest-invalid-272893321'} Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-272893321 to delete Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-272893321 could not be found. Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.046851 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-489fb608-4bf6-4a7a-b7a4-7ce9e590c224 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-489fb608-4bf6-4a7a-b7a4-7ce9e590c224 tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-272893321" status: 404 len: 62 microversion: 2.1 time: 0.040415 Jun 16 18:40:55.055573 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1322/2541] 10.222.0.27 () {58 vars in 1202 bytes} [Thu Jun 16 18:40:55 2022] DELETE /compute/v2.1/images/tempest-invalid-272893321 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:40:55.058394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4cb3374-e609-4496-9ea6-a9e392bea2de tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Calling method '.version_select at 0x7f866f11fa60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:55.095807 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f4cb3374-e609-4496-9ea6-a9e392bea2de tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] HTTP exception thrown: Image not found. Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4cb3374-e609-4496-9ea6-a9e392bea2de tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Request method failure captured: Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/images/82c8f97b-2f25-4784-bad6-6b979a3183bc HTTP/1.1 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k2go39XIzw1noL0l7tprwm_ENNY-Np3Sstm42Bs128EMT-FrlcwGg39bLgw2P4uRN5F-qza_Q29pBjz5KECIafaemqvBCyk4zUqEO7EsagKzHpwFq8HSNuTRJKmpIIvkGzHOwszGHs6BSXS-EUMgG5NAzw6CBhRNmYwMBQKdHSLpQ Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/45325655047747a0b2593b4a1223315e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_45325655047747a0b2593b4a1223315e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/45325655047747a0b2593b4a1223315e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 45325655047747a0b2593b4a1223315e Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-913442353 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0328933fd603408d81e5e577b009e372 Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-913442353-project Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: exception: Image not found. Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '82c8f97b-2f25-4784-bad6-6b979a3183bc'} Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 82c8f97b-2f25-4784-bad6-6b979a3183bc to delete Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 82c8f97b-2f25-4784-bad6-6b979a3183bc could not be found. Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:55.097831 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4cb3374-e609-4496-9ea6-a9e392bea2de tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] Returning 404 to user: Image not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:55.103515 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4cb3374-e609-4496-9ea6-a9e392bea2de tempest-ImagesDeleteNegativeTestJSON-913442353 tempest-ImagesDeleteNegativeTestJSON-913442353-project] 10.222.0.27 "DELETE /compute/v2.1/images/82c8f97b-2f25-4784-bad6-6b979a3183bc" status: 404 len: 62 microversion: 2.1 time: 0.045632 Jun 16 18:40:55.111871 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1323/2542] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:55 2022] DELETE /compute/v2.1/images/82c8f97b-2f25-4784-bad6-6b979a3183bc => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:40:55.243378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:55.261805 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b4d607a4-bb1c-4b7a-938c-26441a2a98a1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1512 microversion: 2.1 time: 0.998507 Jun 16 18:40:55.262340 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1220/2543] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:54 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1512 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:55.659993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:55.661630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:55.684546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:55.686370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:55.691400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:55.695566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:56.284075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:56.284698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:56.299106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:56.299613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:56.300360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:56.300803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:56.816391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=68 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:57.326589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:57.350554 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7ab2428d-fc75-4737-ac91-e94a95cc98c6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 200 len: 1512 microversion: 2.1 time: 1.067884 Jun 16 18:40:57.368396 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1221/2544] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:56 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 1512 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:57.546728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-58301e4a-a96a-43ef-be5d-0bda61c41774 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Action: 'create', calling method: .version_select at 0x7f866f378430>, body: {"keypair": {"name": "tempest-keypair-207491509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgJIBXuKPGkfxuTDW2wDoJONk/WFpshTqPRywoaIARX5C0pnXmlBCrWOzuwpaU7hTFAls+eAK0PKhPavMqnV5vjfIjwYBXi4gfQRVGeoJHfGIuCnSgI89Hjb4WtL0N/jQ=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:57.592243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-58301e4a-a96a-43ef-be5d-0bda61c41774 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Getting quotas for project 139abd9c58324711ac867b920ee2ef7d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:57.600396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-58301e4a-a96a-43ef-be5d-0bda61c41774 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Getting quotas for user a5868f931c6342faa9e0c0b276ae5c7d and project 139abd9c58324711ac867b920ee2ef7d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:57.675257 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-58301e4a-a96a-43ef-be5d-0bda61c41774 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.305374 Jun 16 18:40:57.676260 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1222/2545] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:40:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:57.683683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8540d634-571b-496c-a0b4-84287a4fad2c req-b1965b8c-f63b-4bfe-b3c9-a97f9aa1791b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe57ae7-55c2-4e56-a339-23aa640c8204", "name": "network-vif-deleted", "tag": "e11cd6f4-2817-4695-bc46-84b68dd12e61"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:57.709479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8540d634-571b-496c-a0b4-84287a4fad2c req-b1965b8c-f63b-4bfe-b3c9-a97f9aa1791b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:57.709962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8540d634-571b-496c-a0b4-84287a4fad2c req-b1965b8c-f63b-4bfe-b3c9-a97f9aa1791b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:57.715911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:57.731095 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8540d634-571b-496c-a0b4-84287a4fad2c req-b1965b8c-f63b-4bfe-b3c9-a97f9aa1791b service nova] Creating event network-vif-deleted:e11cd6f4-2817-4695-bc46-84b68dd12e61 for instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 on n-h2-846209-2 Jun 16 18:40:57.742778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c952e693-54cf-4d2e-8ab7-9786a1a37799 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 2.092643 Jun 16 18:40:57.753531 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1324/2546] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:55 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:57.776504 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8540d634-571b-496c-a0b4-84287a4fad2c req-b1965b8c-f63b-4bfe-b3c9-a97f9aa1791b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098630 Jun 16 18:40:57.778012 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1223/2547] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:58.164424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:58.165149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:58.186985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.187910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.189107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.189895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.227401 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] HTTP exception thrown: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Request method failure captured: Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 HTTP/1.1 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3d8Oe9SkmgPqJOgdwljORnX52nasBov9DgNjw7fp__e7_dsWuBv-2DzXPX-s2NI75j1LmJkjiambGcp3teR8epwDTGojuRFcihMsMsTZ_3LLv0k9RbFC8unuO41NaH7OEQoTG5cA889mwEeT7qDJVA44poeal9zjQdPkm3RnGG8-NA Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.32 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8153ca9ca7ea4d0381215928fc7c0900 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8153ca9ca7ea4d0381215928fc7c0900", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8153ca9ca7ea4d0381215928fc7c0900 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TaggedBootDevicesTest-1434693886-project Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 1560b6858b144a0397ad4ee7da636d8b Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TaggedBootDevicesTest-1434693886-project Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5d404bf4-c6e7-49e2-9dbd-d3584ced0295'} Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:40:58.229419 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.234009 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.240304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Returning 404 to user: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:58.241452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e26ab114-c28a-4e37-b552-eee56d6c6066 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 404 len: 111 microversion: 2.32 time: 0.082135 Jun 16 18:40:58.247870 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1325/2548] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:40:58 2022] DELETE /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:40:58.257930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:58.258994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] [instance: 5d404bf4-c6e7-49e2-9dbd-d3584ced0295] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:58.273257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.274118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.275508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.276340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.359450 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] HTTP exception thrown: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Request method failure captured: Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 HTTP/1.1 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3d8Oe9SkmgPqJOgdwljORnX52nasBov9DgNjw7fp__e7_dsWuBv-2DzXPX-s2NI75j1LmJkjiambGcp3teR8epwDTGojuRFcihMsMsTZ_3LLv0k9RbFC8unuO41NaH7OEQoTG5cA889mwEeT7qDJVA44poeal9zjQdPkm3RnGG8-NA Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.32 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8153ca9ca7ea4d0381215928fc7c0900 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8153ca9ca7ea4d0381215928fc7c0900", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8153ca9ca7ea4d0381215928fc7c0900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8153ca9ca7ea4d0381215928fc7c0900 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1434693886 Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TaggedBootDevicesTest-1434693886-project Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1560b6858b144a0397ad4ee7da636d8b Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TaggedBootDevicesTest-1434693886-project Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5d404bf4-c6e7-49e2-9dbd-d3584ced0295'} Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:58.366430 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.372062 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.372062 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:58.372062 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:58.372062 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:58.372062 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:58.372062 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. Jun 16 18:40:58.372062 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.373359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:58.373359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:58.376077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] Returning 404 to user: Instance 5d404bf4-c6e7-49e2-9dbd-d3584ced0295 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:58.376077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7cd4c5c9-cd2e-4afe-aaa7-8d3ff73f7a95 tempest-TaggedBootDevicesTest-1434693886 tempest-TaggedBootDevicesTest-1434693886-project] 10.222.0.27 "GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295" status: 404 len: 111 microversion: 2.32 time: 0.126270 Jun 16 18:40:58.377182 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1224/2549] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:40:58 2022] GET /compute/v2.1/servers/5d404bf4-c6e7-49e2-9dbd-d3584ced0295 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:40:58.377303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.403307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.406978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.407667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.474961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 HTTP/1.1 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '7fe57ae7-55c2-4e56-a339-23aa640c8204'} Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:40:58.477563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.483197 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:40:58.483197 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:40:58.483197 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:40:58.483197 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:40:58.483197 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:40:58.483197 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:40:58.483197 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:40:58.492099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:40:58.493222 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fd7b6532-ace8-4551-a64d-fd8c032a1b50 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 404 len: 111 microversion: 2.1 time: 0.127963 Jun 16 18:40:58.507330 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1326/2550] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:58 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:40:58.515307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:58.516157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:58.523250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:58.539256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.540643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.546668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.547161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.763665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:58.764214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:58.787814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.791130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:58.793971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:58.801168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:59.219656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:59.696847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:59.712900 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b93a2ca-398f-4588-8466-755337a3ca12 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 0.954516 Jun 16 18:40:59.713661 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1327/2551] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:58 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:59.880745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1699159416", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "11e5186c-2927-4632-a396-fad715b85769"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:59.983647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] validate_networks() for [('11e5186c-2927-4632-a396-fad715b85769', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:00.252180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:00.260911 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-194a10bf-d8c1-462f-80c2-630001768e53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.754319 Jun 16 18:41:00.261531 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1225/2552] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:58 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:00.401191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9f54ac24-61be-41b2-b9a1-b8fad8e70221 req-a9719ab9-409e-436c-9ec3-00b59c006c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2cf7c4-c45f-48b5-9dab-0c6fb001607b", "tag": "82a723c9-0fce-4bcc-9671-f6b6a82d07e2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:00.420066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9f54ac24-61be-41b2-b9a1-b8fad8e70221 req-a9719ab9-409e-436c-9ec3-00b59c006c22 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:00.420551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9f54ac24-61be-41b2-b9a1-b8fad8e70221 req-a9719ab9-409e-436c-9ec3-00b59c006c22 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:00.461692 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9f54ac24-61be-41b2-b9a1-b8fad8e70221 req-a9719ab9-409e-436c-9ec3-00b59c006c22 service nova] Creating event network-changed:82a723c9-0fce-4bcc-9671-f6b6a82d07e2 for instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b on n-h1-846209-2 Jun 16 18:41:00.483192 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9f54ac24-61be-41b2-b9a1-b8fad8e70221 req-a9719ab9-409e-436c-9ec3-00b59c006c22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080736 Jun 16 18:41:00.494438 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1226/2553] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:41:00.708958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4e420c03-e103-4dca-b568-dee5e2a57181 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4e420c03-e103-4dca-b568-dee5e2a57181 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 163 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": 12345, "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 12345 Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:41:00.711544 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4e420c03-e103-4dca-b568-dee5e2a57181 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4e420c03-e103-4dca-b568-dee5e2a57181 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009513 Jun 16 18:41:00.719218 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1227/2554] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:00 2022] POST /compute/v2.1/servers => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:41:00.742355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:00.743264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:00.778602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:00.779150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:00.780004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:00.791604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:02.111497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:02.127283 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2731733e-9e78-43e9-bdcb-265176a89856 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.409179 Jun 16 18:41:02.131290 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1228/2555] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:00 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:02.136422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:02.146832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:02.160099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:02.167840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:02.168833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:02.169415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:03.107585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:03.132413 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bea44745-efb5-46f5-83f9-f90fee26e745 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 0.999624 Jun 16 18:41:03.134190 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1229/2556] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:02 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:03.365181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-999e30b2-0ec9-4c99-8460-a3282fec46ab tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866f2e4c10>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwD7wN9SyTkDarVwjmxKG3bX7kMfT4YnPeLBFhs1xT761TUr/XnHBg8QUIWBzxZN/WQT1JoKNIu0LmpKaC4agE3LvSjdFpC9HMRIogracedtVXrkpzu8C/l0HFBxzDnVg=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:03.391779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:03.393750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:03.394473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:03.395267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:03.395893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:03.397628 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-999e30b2-0ec9-4c99-8460-a3282fec46ab tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-999e30b2-0ec9-4c99-8460-a3282fec46ab tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 257 Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwD7wN9SyTkDarVwjmxKG3bX7kMfT4YnPeLBFhs1xT761TUr/XnHBg8QUIWBzxZN/WQT1JoKNIu0LmpKaC4agE3LvSjdFpC9HMRIogracedtVXrkpzu8C/l0HFBxzDnVg=="}} Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwD7wN9SyTkDarVwjmxKG3bX7kMfT4YnPeLBFhs1xT761TUr/XnHBg8QUIWBzxZN/WQT1JoKNIu0LmpKaC4agE3LvSjdFpC9HMRIogracedtVXrkpzu8C/l0HFBxzDnVg=='}}} Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:03.409106 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 18:41:03.413370 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.416549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-999e30b2-0ec9-4c99-8460-a3282fec46ab tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:03.422702 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-999e30b2-0ec9-4c99-8460-a3282fec46ab tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.287116 Jun 16 18:41:03.424008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:03.424647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:03.426687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:03.429241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:03.429569 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1230/2557] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:41:03 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:03.464318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:03.468572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:03.476925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Getting quotas for project a366b490a0ec4a6ca8fc55bd8dbce3b1. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:03.484099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:03.487108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:03.491384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:03.492884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:03.495704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Getting quotas for user e80291e8e5bb461383eeadddfb70162c and project a366b490a0ec4a6ca8fc55bd8dbce3b1. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:03.541560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:41:03.562068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:03.684211 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2649e80-dad7-4712-a2e9-7a717f1124da tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.937158 Jun 16 18:41:03.687459 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1328/2558] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:40:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:41:03.700480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-121af961-6126-48d0-8f46-ff3cc6190782 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866e3f7940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1949741358", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:03.735093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-121af961-6126-48d0-8f46-ff3cc6190782 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:03.751152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-121af961-6126-48d0-8f46-ff3cc6190782 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for user 319cd33ac6be4da7b31875c988897a8f and project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:03.806480 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-121af961-6126-48d0-8f46-ff3cc6190782 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-121af961-6126-48d0-8f46-ff3cc6190782 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 2167 Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1949741358", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:41:03.824439 n-d-846209-2 devstack@n-api.service[119206]: exception: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1949741358', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:03.826873 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:03.829924 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:03.831551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-121af961-6126-48d0-8f46-ff3cc6190782 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:03.833186 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-121af961-6126-48d0-8f46-ff3cc6190782 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144631 Jun 16 18:41:03.834451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1329/2559] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Jun 16 18:41:03 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:03.843524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d88001bb-476a-4d40-b9c6-720f97f6fd17 req-215a916e-7175-472c-9090-5e86733de61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b48f1e6-0ad5-4be0-829f-d237ed920db5", "tag": "db25f6b3-1d13-48f5-959e-6b3818cab47e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:03.873999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d88001bb-476a-4d40-b9c6-720f97f6fd17 req-215a916e-7175-472c-9090-5e86733de61b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:03.880026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d88001bb-476a-4d40-b9c6-720f97f6fd17 req-215a916e-7175-472c-9090-5e86733de61b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:03.908878 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d88001bb-476a-4d40-b9c6-720f97f6fd17 req-215a916e-7175-472c-9090-5e86733de61b service nova] Creating event network-changed:db25f6b3-1d13-48f5-959e-6b3818cab47e for instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 on n-h1-846209-2 Jun 16 18:41:03.920482 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d88001bb-476a-4d40-b9c6-720f97f6fd17 req-215a916e-7175-472c-9090-5e86733de61b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082381 Jun 16 18:41:03.924031 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1330/2560] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:03.936848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad1b7c74-e570-4af4-91ad-3bb6139a7392 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866e388c10>, body: {"keypair": {"name": "tempest-keypair-333082673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyHfIDgQqwaMH2xnlOxvvMDTqfYuOAE3W06O8cqu73ExGPp8R4iVkWproRkZ8qKd8ub1f8H8mxr93KN92Qhy9ps6saEf5jM2zhbei1EpMdFEN+UwpwvlUJVaeK71mrEAg=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:03.985680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ad1b7c74-e570-4af4-91ad-3bb6139a7392 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:04.002575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ad1b7c74-e570-4af4-91ad-3bb6139a7392 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for user 319cd33ac6be4da7b31875c988897a8f and project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:04.072682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ad1b7c74-e570-4af4-91ad-3bb6139a7392 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147248 Jun 16 18:41:04.074098 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1331/2561] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:41:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:04.087228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-535904215", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "11e5186c-2927-4632-a396-fad715b85769"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:04.217004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] validate_networks() for [('11e5186c-2927-4632-a396-fad715b85769', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:04.760356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:04.771840 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e08d4c64-ec28-4557-9ae9-4804aace9a86 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.329597 Jun 16 18:41:04.774940 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1231/2562] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:03 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:04.784151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1d98acf-7f25-48e2-a45c-6224e3fe76b8 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866f2e4ca0>, body: {"keypair": {"name": "tempest-keypair-333082673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoVA/yFlR3hhnb37NXyJBxIn3JIbJ4jR2R6DcTKEyDWhE1Cu+GFmqEZYVP6gFnBs/Lpy0Loepx4BclIsUWEHDfBSczk0xuuMXfar5UXyDZ8iJyB7qMZRLrN3wdFn9SIzw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:04.861814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f1d98acf-7f25-48e2-a45c-6224e3fe76b8 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:04.877023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f1d98acf-7f25-48e2-a45c-6224e3fe76b8 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for user 319cd33ac6be4da7b31875c988897a8f and project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:04.932991 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f1d98acf-7f25-48e2-a45c-6224e3fe76b8 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] HTTP exception thrown: Key pair 'tempest-keypair-333082673' already exists. Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1d98acf-7f25-48e2-a45c-6224e3fe76b8 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 272 Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: {"keypair": {"name": "tempest-keypair-333082673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoVA/yFlR3hhnb37NXyJBxIn3JIbJ4jR2R6DcTKEyDWhE1Cu+GFmqEZYVP6gFnBs/Lpy0Loepx4BclIsUWEHDfBSczk0xuuMXfar5UXyDZ8iJyB7qMZRLrN3wdFn9SIzw=="}} Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: exception: Key pair 'tempest-keypair-333082673' already exists. Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-333082673', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoVA/yFlR3hhnb37NXyJBxIn3JIbJ4jR2R6DcTKEyDWhE1Cu+GFmqEZYVP6gFnBs/Lpy0Loepx4BclIsUWEHDfBSczk0xuuMXfar5UXyDZ8iJyB7qMZRLrN3wdFn9SIzw=='}}} Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result.read() Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '319cd33ac6be4da7b31875c988897a8f-tempest-keypair-333082673' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 16 18:41:04.991423 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi session.flush() Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result.read() Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 18:41:04.995390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '319cd33ac6be4da7b31875c988897a8f-tempest-keypair-333082673' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 16, 18, 41, 4, 919714), 'updated_at': None, 'name': 'tempest-keypair-333082673', 'user_id': '319cd33ac6be4da7b31875c988897a8f', 'fingerprint': 'f8:8c:25:5a:9f:b0:bb:84:05:1c:71:59:66:a7:59:5a', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoVA/yFlR3hhnb37NXyJBxIn3JIbJ4jR2R6DcTKEyDWhE1Cu+GFmqEZYVP6gFnBs/Lpy0Loepx4BclIsUWEHDfBSczk0xuuMXfar5UXyDZ8iJyB7qMZRLrN3wdFn9SIzw==', 'type': 'ssh'}] Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi keypair.create() Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._create() Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-333082673' already exists. Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 16 18:41:05.000981 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-333082673' already exists. Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-333082673' already exists. Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.011104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1d98acf-7f25-48e2-a45c-6224e3fe76b8 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 409 to user: Key pair 'tempest-keypair-333082673' already exists. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:05.013183 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f1d98acf-7f25-48e2-a45c-6224e3fe76b8 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.235123 Jun 16 18:41:05.015672 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1232/2563] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:41:04 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 240 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:41:05.024437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:05.027968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:05.046764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:05.047650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:05.048767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:05.049602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:05.683341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:05.698977 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-394cfa40-b6dc-4c12-bb3f-71af022b85be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 0.681946 Jun 16 18:41:05.699758 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1233/2564] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:05 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:05.714532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8123f668-6dfd-48fb-acef-1ea3633eb706 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Calling method '.version_select at 0x7f866f26a430>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:05.785144 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8123f668-6dfd-48fb-acef-1ea3633eb706 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333082673" status: 202 len: 0 microversion: 2.1 time: 0.083849 Jun 16 18:41:05.787979 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1234/2565] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333082673 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:41:05.804945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80cf8960-86c8-4625-8a04-ff57e8ec225a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866f2b7c10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlz1Qa9kezWnK1trh6lG0K//sVEiRMOrQ3Jzo/nkJUKo8olvhNnhhy4JIVBrTNR6jp8zy8XpbwrwHt5GsoMt03RBSudrqe2JaUpPorYs6DfzaEeastrEWlhp1avL9D6jg=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80cf8960-86c8-4625-8a04-ff57e8ec225a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 247 Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlz1Qa9kezWnK1trh6lG0K//sVEiRMOrQ3Jzo/nkJUKo8olvhNnhhy4JIVBrTNR6jp8zy8XpbwrwHt5GsoMt03RBSudrqe2JaUpPorYs6DfzaEeastrEWlhp1avL9D6jg=="}} Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlz1Qa9kezWnK1trh6lG0K//sVEiRMOrQ3Jzo/nkJUKo8olvhNnhhy4JIVBrTNR6jp8zy8XpbwrwHt5GsoMt03RBSudrqe2JaUpPorYs6DfzaEeastrEWlhp1avL9D6jg=='}}} Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi '' Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:41:05.810579 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80cf8960-86c8-4625-8a04-ff57e8ec225a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-80cf8960-86c8-4625-8a04-ff57e8ec225a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018259 Jun 16 18:41:05.814467 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1235/2566] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:41:05 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:05.824801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee5b5f20-6758-4713-ad46-87875a1e7f46 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866f296dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-732950814", "public_key": " "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:05.873858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:05.893411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ee5b5f20-6758-4713-ad46-87875a1e7f46 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:05.919423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ee5b5f20-6758-4713-ad46-87875a1e7f46 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for user 319cd33ac6be4da7b31875c988897a8f and project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:06.019226 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ee5b5f20-6758-4713-ad46-87875a1e7f46 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee5b5f20-6758-4713-ad46-87875a1e7f46 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 94 Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-732950814", "public_key": " "}} Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: exception: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-732950814', 'public_key': ' '}}} Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.024191 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.029347 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.038868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ee5b5f20-6758-4713-ad46-87875a1e7f46 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:06.044520 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ee5b5f20-6758-4713-ad46-87875a1e7f46 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.225255 Jun 16 18:41:06.045653 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1236/2567] 10.222.0.27 () {60 vars in 1157 bytes} [Thu Jun 16 18:41:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:06.062577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4eed28eb-e854-4648-84d9-e46967630ba7 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866f26ae50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuI4O3q3Q1t3isA4DDKyszI/dBXeH7ahrK3O0eTvMANZ1MAKT1HL9TNTBZjGdJRoA3Nm8l1s4vq/fzpEYzqvJgOtN05D8LOedHI3cPiGPHgbfd4UXwc+RrBDY16Hgc00w=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4eed28eb-e854-4648-84d9-e46967630ba7 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 507 Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuI4O3q3Q1t3isA4DDKyszI/dBXeH7ahrK3O0eTvMANZ1MAKT1HL9TNTBZjGdJRoA3Nm8l1s4vq/fzpEYzqvJgOtN05D8LOedHI3cPiGPHgbfd4UXwc+RrBDY16Hgc00w=="}} Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuI4O3q3Q1t3isA4DDKyszI/dBXeH7ahrK3O0eTvMANZ1MAKT1HL9TNTBZjGdJRoA3Nm8l1s4vq/fzpEYzqvJgOtN05D8LOedHI3cPiGPHgbfd4UXwc+RrBDY16Hgc00w=='}}} Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 16 18:41:06.067625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 18:41:06.071290 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.076831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4eed28eb-e854-4648-84d9-e46967630ba7 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:06.085461 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4eed28eb-e854-4648-84d9-e46967630ba7 tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.030566 Jun 16 18:41:06.086828 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1237/2568] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:41:06 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:41:06.104879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2f20512-f2a4-419d-b41a-ca168f856d3a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Action: 'create', calling method: .version_select at 0x7f866f1d7940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-89019710", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:06.146278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b2f20512-f2a4-419d-b41a-ca168f856d3a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:06.162102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b2f20512-f2a4-419d-b41a-ca168f856d3a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Getting quotas for user 319cd33ac6be4da7b31875c988897a8f and project 87866d7bb9d046cbba5746c9e53a4c1f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:06.213021 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b2f20512-f2a4-419d-b41a-ca168f856d3a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2f20512-f2a4-419d-b41a-ca168f856d3a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 116 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-89019710", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: exception: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-89019710', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 16 18:41:06.226457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 16 18:41:06.231111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.241736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2f20512-f2a4-419d-b41a-ca168f856d3a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:06.242901 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b2f20512-f2a4-419d-b41a-ca168f856d3a tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.145922 Jun 16 18:41:06.247701 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1238/2569] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:41:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:06.257320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1b77bd2b-c4e0-4c87-ba5b-918524cd72dd tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Calling method '.version_select at 0x7f866f2ace50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:06.286840 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1b77bd2b-c4e0-4c87-ba5b-918524cd72dd tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1682541562 not found for user 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1b77bd2b-c4e0-4c87-ba5b-918524cd72dd tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Request method failure captured: Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1682541562 HTTP/1.1 Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k9kY51AfW1G9-KM0ZCptA460WkLIpxzZ9PWEoy5u_Nt_bjpkWOhiEmamIq05L5shOpCLNcMcsU77fs5UxsaU_S0FXR21cHpwjjBN1gpTCpq7BX3HZYhoQdlJ_6BDwMBz1qD_uqJIqM536-fi-kneDTiv8rlko6JZQYWe7yCUvHTvY Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87866d7bb9d046cbba5746c9e53a4c1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87866d7bb9d046cbba5746c9e53a4c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 87866d7bb9d046cbba5746c9e53a4c1f Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2048502816 Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2048502816-project Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: exception: Keypair tempest-keypair-non-existent-1682541562 not found for user 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'tempest-keypair-non-existent-1682541562'} Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1682541562 not found for user 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.291308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1682541562 not found for user 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1682541562 not found for user 319cd33ac6be4da7b31875c988897a8f Jun 16 18:41:06.296861 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:06.306184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1b77bd2b-c4e0-4c87-ba5b-918524cd72dd tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1682541562 not found for user 319cd33ac6be4da7b31875c988897a8f {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:06.307332 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1b77bd2b-c4e0-4c87-ba5b-918524cd72dd tempest-KeyPairsNegativeTestJSON-2048502816 tempest-KeyPairsNegativeTestJSON-2048502816-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1682541562" status: 404 len: 145 microversion: 2.1 time: 0.056854 Jun 16 18:41:06.307923 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1239/2570] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 18:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1682541562 => generated 145 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:41:06.720615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:06.721729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:06.734659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:06.736450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:06.737554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:06.739744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:06.968610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:06.969176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:06.970138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:06.970920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:06.971714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:07.006366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:07.011721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:07.012629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:07.024347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:07.113257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Getting quotas for project a366b490a0ec4a6ca8fc55bd8dbce3b1. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:07.127466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Getting quotas for user e80291e8e5bb461383eeadddfb70162c and project a366b490a0ec4a6ca8fc55bd8dbce3b1. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:07.170577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:41:07.173789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:07.200875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:07.221192 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ffc7c01e-ac2d-494e-9282-4e78b8a5e507 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 0.508329 Jun 16 18:41:07.226808 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1240/2571] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:06 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:41:07.384002 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d796fd7b-1787-42e5-8ad0-fa72f71b11f4 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.308392 Jun 16 18:41:07.393798 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1332/2572] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:41:07.713736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1953615417", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "451", "networks": [{"uuid": "11e5186c-2927-4632-a396-fad715b85769"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:08.013959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] validate_networks() for [('11e5186c-2927-4632-a396-fad715b85769', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:08.244456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:08.245162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:08.262708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:08.263167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:08.263958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:08.264402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:09.879305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:09.880020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:09.880762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:09.881492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:09.882131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:09.897170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=49 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:09.908649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:09.909441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:09.911500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:09.913287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:09.978845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Getting quotas for project a366b490a0ec4a6ca8fc55bd8dbce3b1. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:09.998765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Getting quotas for user e80291e8e5bb461383eeadddfb70162c and project a366b490a0ec4a6ca8fc55bd8dbce3b1. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:10.040595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:41:10.049245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:10.235596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8fe8b07-a3fd-4b9a-9599-23920ee8f8fb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.526613 Jun 16 18:41:10.244253 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1241/2573] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:41:10.253077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f3b920f-bb14-41ee-a4f6-d0537a878a2a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-745690865", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "aace5e29-05c7-4767-858e-7220fb8c2f83", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:10.491819 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1f3b920f-bb14-41ee-a4f6-d0537a878a2a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Block Device aace5e29-05c7-4767-858e-7220fb8c2f83 is not bootable. Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f3b920f-bb14-41ee-a4f6-d0537a878a2a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 357 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-745690865", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "aace5e29-05c7-4767-858e-7220fb8c2f83", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: exception: Block Device aace5e29-05c7-4767-858e-7220fb8c2f83 is not bootable. Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-745690865', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'aace5e29-05c7-4767-858e-7220fb8c2f83'}], 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device aace5e29-05c7-4767-858e-7220fb8c2f83 is not bootable. Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:10.498996 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device aace5e29-05c7-4767-858e-7220fb8c2f83 is not bootable. Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device aace5e29-05c7-4767-858e-7220fb8c2f83 is not bootable. Jun 16 18:41:10.504950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:10.508573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f3b920f-bb14-41ee-a4f6-d0537a878a2a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Block Device aace5e29-05c7-4767-858e-7220fb8c2f83 is not bootable. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:10.509625 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f3b920f-bb14-41ee-a4f6-d0537a878a2a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.264307 Jun 16 18:41:10.513074 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1242/2574] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:10.541984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:10.557385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:10.558275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Searching by: {'deleted': False, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:10.571707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:10.586844 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fa52af2a-bd7e-4b36-95e3-918792a9c803 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 2.346243 Jun 16 18:41:10.589042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:10.589457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:10.590413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:10.590864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:10.592481 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1333/2575] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:08 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:41:10.604768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8cec49ba-fd2c-497f-a05a-f6dbf4610b52 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:10.607581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8cec49ba-fd2c-497f-a05a-f6dbf4610b52 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:11.018363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8cec49ba-fd2c-497f-a05a-f6dbf4610b52 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:11.046451 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8cec49ba-fd2c-497f-a05a-f6dbf4610b52 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1221 microversion: 2.1 time: 0.451499 Jun 16 18:41:11.057595 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1334/2576] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:10 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1221 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:11.105086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a9b4302d-92ac-4bf4-a1e6-2c3b77d5cbf4 req-004278b4-44f0-4b74-aa4f-94bab20d38b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2cf7c4-c45f-48b5-9dab-0c6fb001607b", "name": "network-vif-plugged", "status": "completed", "tag": "82a723c9-0fce-4bcc-9671-f6b6a82d07e2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:11.137002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:11.143326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a9b4302d-92ac-4bf4-a1e6-2c3b77d5cbf4 req-004278b4-44f0-4b74-aa4f-94bab20d38b5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.143779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a9b4302d-92ac-4bf4-a1e6-2c3b77d5cbf4 req-004278b4-44f0-4b74-aa4f-94bab20d38b5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.180847 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a9b4302d-92ac-4bf4-a1e6-2c3b77d5cbf4 req-004278b4-44f0-4b74-aa4f-94bab20d38b5 service nova] Creating event network-vif-plugged:82a723c9-0fce-4bcc-9671-f6b6a82d07e2 for instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b on n-h1-846209-2 Jun 16 18:41:11.199068 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a9b4302d-92ac-4bf4-a1e6-2c3b77d5cbf4 req-004278b4-44f0-4b74-aa4f-94bab20d38b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138808 Jun 16 18:41:11.202525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1335/2577] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:11.223559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:11.233611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:11.282406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.287352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.295236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.295753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.504782 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c21c19fe-54ea-480a-96bf-91b8dad8b9a1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.980859 Jun 16 18:41:11.506813 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1243/2578] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:41:10 2022] GET /compute/v2.1/servers => generated 334 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:11.527999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3a87119d-4c3e-473f-8422-8a40e8e53c50 req-a1928e94-5dd7-4106-9426-0c0443c2d2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40991995-c40c-4086-86d5-49b27ba49a3e", "tag": "d96e6e9e-da6e-4888-8c9d-cc965d4dd092"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:11.605282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3a87119d-4c3e-473f-8422-8a40e8e53c50 req-a1928e94-5dd7-4106-9426-0c0443c2d2ea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.607770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3a87119d-4c3e-473f-8422-8a40e8e53c50 req-a1928e94-5dd7-4106-9426-0c0443c2d2ea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.675368 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3a87119d-4c3e-473f-8422-8a40e8e53c50 req-a1928e94-5dd7-4106-9426-0c0443c2d2ea service nova] Creating event network-changed:d96e6e9e-da6e-4888-8c9d-cc965d4dd092 for instance 40991995-c40c-4086-86d5-49b27ba49a3e on n-h2-846209-2 Jun 16 18:41:11.699812 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3a87119d-4c3e-473f-8422-8a40e8e53c50 req-a1928e94-5dd7-4106-9426-0c0443c2d2ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183282 Jun 16 18:41:11.703336 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1244/2579] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:11.734337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:11.759475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:11.763491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Searching by: {'deleted': False, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:11.805353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.809728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.813744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.819211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:12.043485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:12.213758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:12.234909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:12.235776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:13.612037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:13.631295 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c4163ef-5822-4935-82e4-6feb5a321a9e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 2.421259 Jun 16 18:41:13.632009 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1336/2580] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:11 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:13.641713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:13.645389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:13.673040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:13.673592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:13.676531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:13.678763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:14.869899 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7cf4ada-d5a7-4fc8-8919-4908fd1afb5e tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 3.163661 Jun 16 18:41:14.870559 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1245/2581] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:41:11 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 3166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:14.944350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:14.963885 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-70673a9f-c713-4896-8c3e-b276a07d9285 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1317 microversion: 2.1 time: 1.330685 Jun 16 18:41:14.969630 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1337/2582] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:13 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1317 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:14.984032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:14.989026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:15.003805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:15.008032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:15.012074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:15.014268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:15.218956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3afc5671-f00f-474c-ae55-99305f68a135 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Calling method '.version_select at 0x7f866f153310>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:15.248377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3afc5671-f00f-474c-ae55-99305f68a135 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:15.249128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3afc5671-f00f-474c-ae55-99305f68a135 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:15.250140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3afc5671-f00f-474c-ae55-99305f68a135 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:15.250762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3afc5671-f00f-474c-ae55-99305f68a135 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:15.309901 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3afc5671-f00f-474c-ae55-99305f68a135 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.437879 Jun 16 18:41:15.310474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1246/2583] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 18:41:14 2022] GET /compute/v2.1/limits => generated 511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:15.320622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:15.327601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:15.353889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:15.354406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:15.366151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:15.366929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:15.713825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:15.723626 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1cdfe404-96f1-4d1a-9bb0-fe3346de730e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1321 microversion: 2.1 time: 0.750988 Jun 16 18:41:15.724245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1338/2584] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:14 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:15.750377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a2826d1f-6fe0-4073-b970-9d1ded41fb15 req-731daabe-55fb-4325-a443-a2cb48eb4bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b48f1e6-0ad5-4be0-829f-d237ed920db5", "name": "network-vif-plugged", "status": "completed", "tag": "db25f6b3-1d13-48f5-959e-6b3818cab47e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:15.766574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a2826d1f-6fe0-4073-b970-9d1ded41fb15 req-731daabe-55fb-4325-a443-a2cb48eb4bdb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:15.773265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a2826d1f-6fe0-4073-b970-9d1ded41fb15 req-731daabe-55fb-4325-a443-a2cb48eb4bdb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:15.815835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a2826d1f-6fe0-4073-b970-9d1ded41fb15 req-731daabe-55fb-4325-a443-a2cb48eb4bdb service nova] Creating event network-vif-plugged:db25f6b3-1d13-48f5-959e-6b3818cab47e for instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 on n-h1-846209-2 Jun 16 18:41:15.822343 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a2826d1f-6fe0-4073-b970-9d1ded41fb15 req-731daabe-55fb-4325-a443-a2cb48eb4bdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096803 Jun 16 18:41:15.830526 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1339/2585] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:15.840334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-07ac483d-a52c-4041-8e5a-7fe5bf0d4229 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:15.868228 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-07ac483d-a52c-4041-8e5a-7fe5bf0d4229 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036037 Jun 16 18:41:15.869702 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1340/2586] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:41:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:15.882975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-900537288", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:15.942482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:15.950886 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0687e755-3e38-473a-a4ae-1044b8440a36 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.639136 Jun 16 18:41:15.958144 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1247/2587] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:15 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:15.989205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:15.990439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:16.004734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:16.013886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:16.014914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:16.019660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:16.021029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:17.078685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:17.393227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Getting quotas for project 0748361dc5eb43d6a25344437ef39b9c. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:17.397297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:17.411884 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae26e0c6-a0a9-4a43-ad6b-c8aa5f388b18 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1466 microversion: 2.1 time: 1.430233 Jun 16 18:41:17.412601 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1248/2588] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:15 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1466 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:17.419535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Getting quotas for user 52597ca5c3a341ff94900899e0d310dd and project 0748361dc5eb43d6a25344437ef39b9c. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:17.421295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:17.448156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:17.448667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:17.466895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:17.469035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:17.470388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:17.476246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:17.486109 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Request method failure captured: Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 1751 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3lH10ILdS-TV69RWUeXNMDnczqwL_lsCFWF19KX0WjJkT7et2Rh6NK6W7yfN4ZQpV_21qBP7Fr22MUfbdG1YgwJmwquuEdy1xLsdy8Gksk4IHJL-z7Q7alQIN43f-3vvtUr5gqmWmq2DZCa7af_jUEwX_R-If_sgbsmUzELmegLEV0 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 0748361dc5eb43d6a25344437ef39b9c Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1871793402 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0748361dc5eb43d6a25344437ef39b9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0748361dc5eb43d6a25344437ef39b9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0748361dc5eb43d6a25344437ef39b9c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0748361dc5eb43d6a25344437ef39b9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1871793402 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 0748361dc5eb43d6a25344437ef39b9c Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1871793402 Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 52597ca5c3a341ff94900899e0d310dd Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-900537288", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:41:17.488713 n-d-846209-2 devstack@n-api.service[119206]: exception: Maximum number of metadata items exceeds 128 Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-900537288', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:17.491402 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 16 18:41:17.495536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:17.497542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:17.501416 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-11567567-0b7f-42b4-ae9f-b288043b7af6 tempest-AbsoluteLimitsNegativeTestJSON-1871793402 tempest-AbsoluteLimitsNegativeTestJSON-1871793402-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.627787 Jun 16 18:41:17.502882 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1341/2589] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Jun 16 18:41:15 2022] POST /compute/v2.1/servers => generated 87 bytes in 1632 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:41:17.509074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:17.511181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:17.519218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:17.520770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:17.521779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:17.522465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:17.542576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:17.597416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:41:17.864725 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-918f502f-1e71-4f9b-8c96-a4539a4a04f1 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 204 len: 0 microversion: 2.1 time: 0.432142 Jun 16 18:41:17.867508 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1249/2590] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:41:17 2022] DELETE /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:41:17.875182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-00ce1b2a-b67f-4318-a2fb-5142692ccb80 req-c95a2c4f-1895-40a9-8921-fc9608a90bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8444f566-46ac-448b-9633-cf3b6d16e2ba", "tag": "7f0fd46b-ab80-4b84-af82-ce0d78416e93"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:17.884924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-00ce1b2a-b67f-4318-a2fb-5142692ccb80 req-c95a2c4f-1895-40a9-8921-fc9608a90bab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:17.885687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-00ce1b2a-b67f-4318-a2fb-5142692ccb80 req-c95a2c4f-1895-40a9-8921-fc9608a90bab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:17.906469 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-00ce1b2a-b67f-4318-a2fb-5142692ccb80 req-c95a2c4f-1895-40a9-8921-fc9608a90bab service nova] Creating event network-changed:7f0fd46b-ab80-4b84-af82-ce0d78416e93 for instance 8444f566-46ac-448b-9633-cf3b6d16e2ba on n-h2-846209-2 Jun 16 18:41:17.916833 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-00ce1b2a-b67f-4318-a2fb-5142692ccb80 req-c95a2c4f-1895-40a9-8921-fc9608a90bab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047678 Jun 16 18:41:17.920707 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1250/2591] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:17.938416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:17.939338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:17.952509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:17.952979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:17.953778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:17.954251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:18.110848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:18.125014 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0828eefa-4bed-4475-a17f-6c060367ba3c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1321 microversion: 2.1 time: 0.619587 Jun 16 18:41:18.130326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1342/2592] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:17 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:18.160285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:18.165828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:18.185164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:18.185640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:18.197481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:18.198532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:19.231812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:19.262177 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-da999a3b-3c6b-4e64-b5fb-c331bff99ad2 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 200 len: 1317 microversion: 2.1 time: 1.338013 Jun 16 18:41:19.262713 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1251/2593] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:17 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 1317 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:19.282753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a580d9a0-008b-474d-aa2a-ca6631db5f6e req-6eddd9f3-0665-4499-973b-9386acb61df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40991995-c40c-4086-86d5-49b27ba49a3e", "name": "network-vif-plugged", "status": "completed", "tag": "d96e6e9e-da6e-4888-8c9d-cc965d4dd092"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:19.290833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:19.301286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be1bc6bf-a030-4c2c-bd36-3b87330969da tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1700 microversion: 2.1 time: 1.169121 Jun 16 18:41:19.310251 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1343/2594] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:18 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1700 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:19.310743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a580d9a0-008b-474d-aa2a-ca6631db5f6e req-6eddd9f3-0665-4499-973b-9386acb61df7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:19.310743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a580d9a0-008b-474d-aa2a-ca6631db5f6e req-6eddd9f3-0665-4499-973b-9386acb61df7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:19.320897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:19.327815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:19.350218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:19.352753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:19.357174 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a580d9a0-008b-474d-aa2a-ca6631db5f6e req-6eddd9f3-0665-4499-973b-9386acb61df7 service nova] Creating event network-vif-plugged:d96e6e9e-da6e-4888-8c9d-cc965d4dd092 for instance 40991995-c40c-4086-86d5-49b27ba49a3e on n-h2-846209-2 Jun 16 18:41:19.357697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:19.359250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:19.371755 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a580d9a0-008b-474d-aa2a-ca6631db5f6e req-6eddd9f3-0665-4499-973b-9386acb61df7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103481 Jun 16 18:41:19.380070 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1252/2595] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:19.819248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-60f85a55-738a-471c-9ee4-2605d3c2855a req-fb6778d9-e5c5-4f25-85af-b56d459e25c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecaece79-6b31-482a-afaf-6a709098c3b5", "tag": "db2e03bc-423e-4a49-aff9-599b23364af0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:19.843128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-60f85a55-738a-471c-9ee4-2605d3c2855a req-fb6778d9-e5c5-4f25-85af-b56d459e25c5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:19.843885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-60f85a55-738a-471c-9ee4-2605d3c2855a req-fb6778d9-e5c5-4f25-85af-b56d459e25c5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:19.867528 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-60f85a55-738a-471c-9ee4-2605d3c2855a req-fb6778d9-e5c5-4f25-85af-b56d459e25c5 service nova] Creating event network-changed:db2e03bc-423e-4a49-aff9-599b23364af0 for instance ecaece79-6b31-482a-afaf-6a709098c3b5 on n-h2-846209-2 Jun 16 18:41:19.883369 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-60f85a55-738a-471c-9ee4-2605d3c2855a req-fb6778d9-e5c5-4f25-85af-b56d459e25c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073301 Jun 16 18:41:19.884269 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1253/2596] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:20.282875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:20.283616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:20.291300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:20.304328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:20.304758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:20.305562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:20.306040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:20.310961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aabea741-61a9-431b-ad5b-5e9bbf06715e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1321 microversion: 2.1 time: 1.001737 Jun 16 18:41:20.311682 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1344/2597] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:19 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1321 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:20.325048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:20.325944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:20.346078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:20.346560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:20.347395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:20.349224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:20.949519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850790080e684b23837fd98a4f3de061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6359c0b3f04ea9b5dac20090c13793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:20.964044 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9770743a-013d-4b41-8fdd-e40262de63e5 tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 200 len: 1700 microversion: 2.1 time: 0.647671 Jun 16 18:41:20.965469 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1345/2598] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:20 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 1700 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:20.981832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df86d652-b7c0-4121-809a-02bf37b10001 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1769865414", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "destination_type": "local"}, {"source_type": "volume", "uuid": "b6abed20-2abf-4ff4-97db-8e6bf053ce28", "destination_type": "invalid"}], "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df86d652-b7c0-4121-809a-02bf37b10001 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 495 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1769865414", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "destination_type": "local"}, {"source_type": "volume", "uuid": "b6abed20-2abf-4ff4-97db-8e6bf053ce28", "destination_type": "invalid"}], "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1769865414', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b6abed20-2abf-4ff4-97db-8e6bf053ce28', 'destination_type': 'invalid'}], 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'invalid' Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:20.990493 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df86d652-b7c0-4121-809a-02bf37b10001 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-df86d652-b7c0-4121-809a-02bf37b10001 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.025134 Jun 16 18:41:20.994606 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1346/2599] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:20 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:21.012325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:21.012962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:21.029729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.030228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.031039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.031496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.039193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:21.077065 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3abf58c-8594-447f-8a5c-8768f85c628b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 200 len: 1466 microversion: 2.1 time: 0.799204 Jun 16 18:41:21.079161 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1254/2600] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:20 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 1466 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:21.097319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:21.105614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:21.107193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Searching by: {'reservation_id': 'r-e50qjdhu', 'deleted': False, 'project_id': '6a21d936370c4a5bbdd254cacc618708'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:21.120197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.120197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.120886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.127188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.469170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:21.678869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:21.699317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.703352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.834226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:21.845797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-095391cf-0138-40bd-9f83-be9c38a15983 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.847860 Jun 16 18:41:21.850638 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1347/2601] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:20 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:21.864261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:21.867706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:21.883171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.884058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.886374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.889794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:23.484642 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc7f3638-28c3-4b23-96bb-ad64721fd6da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-e50qjdhu" status: 200 len: 2925 microversion: 2.1 time: 2.391665 Jun 16 18:41:23.486026 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1255/2602] 10.222.0.27 () {58 vars in 1196 bytes} [Thu Jun 16 18:41:21 2022] GET /compute/v2.1/servers/detail?reservation_id=r-e50qjdhu => generated 2925 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:41:23.492952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:23.494441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:23.506385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.507510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:23.511683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.512952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:23.595421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:23.607543 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-948d0d1e-2548-4410-9104-4aeeb270bccc tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1321 microversion: 2.1 time: 1.753587 Jun 16 18:41:23.616184 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1348/2603] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:21 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1321 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:23.627799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:23.629043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] [instance: f7e98225-1fd5-4da5-a370-ce284f3448a6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:23.636578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.637712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:23.639181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.639796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:23.663252 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] HTTP exception thrown: Instance f7e98225-1fd5-4da5-a370-ce284f3448a6 could not be found. Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Request method failure captured: Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 HTTP/1.1 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3j7M7Wc2oLRce3Eccod6alNpY1wTe2_z0LUz_hOW_FVQ4L4f2pL8Bl3DhOC6uBcdQtsggiBHzRYwQjjUJ0S6PSUpByw5FCl9xex6YOA06gkbhs6cKkhQ7z-wbgwjo4qDlDhjkzXzB2TzJaBIkdkYjEWP7gu-9sh4mg6nd_-QBYKAGc Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3b6359c0b3f04ea9b5dac20090c13793 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestJSON-1434680265 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b6359c0b3f04ea9b5dac20090c13793"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b6359c0b3f04ea9b5dac20090c13793"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b6359c0b3f04ea9b5dac20090c13793", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b6359c0b3f04ea9b5dac20090c13793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestJSON-1434680265 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3b6359c0b3f04ea9b5dac20090c13793 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestJSON-1434680265 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestJSON-1434680265-project Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 850790080e684b23837fd98a4f3de061 Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestJSON-1434680265-project Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f7e98225-1fd5-4da5-a370-ce284f3448a6 could not be found. Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f7e98225-1fd5-4da5-a370-ce284f3448a6'} Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e98225-1fd5-4da5-a370-ce284f3448a6 could not be found. Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e98225-1fd5-4da5-a370-ce284f3448a6 could not be found. Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:23.665418 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:23.670848 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:23.670848 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:23.670848 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:23.670848 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:23.670848 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e98225-1fd5-4da5-a370-ce284f3448a6 could not be found. Jun 16 18:41:23.670848 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:23.672910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Returning 404 to user: Instance f7e98225-1fd5-4da5-a370-ce284f3448a6 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:23.674035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1cbc2e5f-40ef-4135-a3c5-8780f9c0283c tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6" status: 404 len: 111 microversion: 2.1 time: 0.056183 Jun 16 18:41:23.674794 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1349/2604] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:23 2022] GET /compute/v2.1/servers/f7e98225-1fd5-4da5-a370-ce284f3448a6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:41:23.682952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-46178ee8-72e6-49e3-a7da-9a02e0fc23c4 req-f5f91b88-3467-48ab-bee9-ecc7753b81bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e98225-1fd5-4da5-a370-ce284f3448a6", "name": "network-vif-deleted", "tag": "b19385ee-458d-4bd4-81c9-2f37998db071"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:23.715146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-46178ee8-72e6-49e3-a7da-9a02e0fc23c4 req-f5f91b88-3467-48ab-bee9-ecc7753b81bb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.719136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-46178ee8-72e6-49e3-a7da-9a02e0fc23c4 req-f5f91b88-3467-48ab-bee9-ecc7753b81bb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:23.761425 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-46178ee8-72e6-49e3-a7da-9a02e0fc23c4 req-f5f91b88-3467-48ab-bee9-ecc7753b81bb service nova] Creating event network-vif-deleted:b19385ee-458d-4bd4-81c9-2f37998db071 for instance f7e98225-1fd5-4da5-a370-ce284f3448a6 on n-h2-846209-2 Jun 16 18:41:23.777162 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-46178ee8-72e6-49e3-a7da-9a02e0fc23c4 req-f5f91b88-3467-48ab-bee9-ecc7753b81bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100156 Jun 16 18:41:23.788751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1350/2605] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:23.809212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f7575d38-48b1-4f9c-9cb4-98e654fba41b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:23.889384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_groups [None req-f7575d38-48b1-4f9c-9cb4-98e654fba41b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Querying cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) for 2 instances {{(pid=119206) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 16 18:41:23.890563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7575d38-48b1-4f9c-9cb4-98e654fba41b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.891291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7575d38-48b1-4f9c-9cb4-98e654fba41b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:24.007152 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f7575d38-48b1-4f9c-9cb4-98e654fba41b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/8bab66f8-5fa8-408a-bcdc-a0a8d2d6293e" status: 200 len: 266 microversion: 2.1 time: 0.208405 Jun 16 18:41:24.008245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1351/2606] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:41:23 2022] GET /compute/v2.1/os-server-groups/8bab66f8-5fa8-408a-bcdc-a0a8d2d6293e => generated 266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:24.021257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-84605a79-e421-4f2e-b8d2-35be362a93ed tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] Calling method '.version_select at 0x7f866ea6d280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:24.080326 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-84605a79-e421-4f2e-b8d2-35be362a93ed tempest-ServersTestJSON-1434680265 tempest-ServersTestJSON-1434680265-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705993029" status: 202 len: 0 microversion: 2.1 time: 0.068883 Jun 16 18:41:24.084743 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1352/2607] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:41:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705993029 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:41:24.115953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b6e5639-db83-4111-ab48-a4e8cdc2900c tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:24.116858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b6e5639-db83-4111-ab48-a4e8cdc2900c tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:24.128453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b6e5639-db83-4111-ab48-a4e8cdc2900c tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:24.137517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:24.146673 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-df4d3e8d-af01-4187-bf5b-fca91dfe04cb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.659068 Jun 16 18:41:24.147954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b6e5639-db83-4111-ab48-a4e8cdc2900c tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:24.148810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b6e5639-db83-4111-ab48-a4e8cdc2900c tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:24.149255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b6e5639-db83-4111-ab48-a4e8cdc2900c tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:24.152813 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1256/2608] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:23 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:24.476304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-215985376", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "7c1caade-5c76-4a19-b9c2-824bd691941b"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:24.614871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] validate_networks() for [('7c1caade-5c76-4a19-b9c2-824bd691941b', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:24.919725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:24.931948 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b6e5639-db83-4111-ab48-a4e8cdc2900c tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 200 len: 1617 microversion: 2.1 time: 0.845520 Jun 16 18:41:24.933163 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1353/2609] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:24 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 1617 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:24.938778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46d2b8a2-aa56-4539-bfed-596070a1070e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1275544200", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46d2b8a2-aa56-4539-bfed-596070a1070e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 492 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1275544200", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1275544200', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jun 16 18:41:24.942787 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 16 18:41:24.946165 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:24.954076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46d2b8a2-aa56-4539-bfed-596070a1070e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:24.956061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46d2b8a2-aa56-4539-bfed-596070a1070e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.021072 Jun 16 18:41:24.963010 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1354/2610] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:24 2022] POST /compute/v2.1/servers => generated 624 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:24.982701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:24.986547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:25.009713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:25.015503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:25.016384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:25.019471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:25.477579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:25.486879 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9fd91c60-8290-402f-a413-509b4caaa04b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1321 microversion: 2.1 time: 0.522483 Jun 16 18:41:25.499088 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1355/2611] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:24 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:25.504971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6f3845f-c091-491e-9671-8324d5414d49 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:25.505982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6f3845f-c091-491e-9671-8324d5414d49 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:25.516438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f3845f-c091-491e-9671-8324d5414d49 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:25.522900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f3845f-c091-491e-9671-8324d5414d49 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:25.524200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f3845f-c091-491e-9671-8324d5414d49 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:25.524806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f3845f-c091-491e-9671-8324d5414d49 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:25.968827 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6f3845f-c091-491e-9671-8324d5414d49 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 200 len: 1617 microversion: 2.1 time: 0.468316 Jun 16 18:41:25.969881 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1356/2612] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:25 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 1617 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:25.991696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:25.992731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:26.007808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.014015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.015315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.016015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.232690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:26.232690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:26.232690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:26.232690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:26.232690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:26.281532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.282018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.282837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.283281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.313711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Getting quotas for project 0aff614b1a6b4ad2ba352038b276799a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:26.325186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Getting quotas for user 530daa1c9c814248b477c53f871e29d1 and project 0aff614b1a6b4ad2ba352038b276799a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:26.373417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:41:26.376219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:26.384562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:26.396364 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-038c8d3e-9555-4e87-880e-6618e58468e9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.409502 Jun 16 18:41:26.400414 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1357/2613] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:25 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:26.419412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2aff0139-2a6a-4f5a-8b12-87847af4873e req-b1d3a2ab-a504-413a-9431-505492385201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8444f566-46ac-448b-9633-cf3b6d16e2ba", "name": "network-vif-plugged", "status": "completed", "tag": "7f0fd46b-ab80-4b84-af82-ce0d78416e93"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:26.455297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2aff0139-2a6a-4f5a-8b12-87847af4873e req-b1d3a2ab-a504-413a-9431-505492385201 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.456591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2aff0139-2a6a-4f5a-8b12-87847af4873e req-b1d3a2ab-a504-413a-9431-505492385201 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.481185 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9351242-08f6-4d0d-8e4f-785a60b6ed35 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.325093 Jun 16 18:41:26.484149 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1257/2614] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:41:26.501503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c824e3f3-12ff-43a3-89ad-203bd49b637d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: .version_select at 0x7f866f128280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2066078755", "policies": ["anti-affinity"]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:26.521881 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2aff0139-2a6a-4f5a-8b12-87847af4873e req-b1d3a2ab-a504-413a-9431-505492385201 service nova] Creating event network-vif-plugged:7f0fd46b-ab80-4b84-af82-ce0d78416e93 for instance 8444f566-46ac-448b-9633-cf3b6d16e2ba on n-h2-846209-2 Jun 16 18:41:26.555923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2aff0139-2a6a-4f5a-8b12-87847af4873e req-b1d3a2ab-a504-413a-9431-505492385201 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153561 Jun 16 18:41:26.556338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:26.561705 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1358/2615] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:26.575189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:26.578937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:26.593216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.595610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.599215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.606780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.612738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c824e3f3-12ff-43a3-89ad-203bd49b637d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:26.642365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c824e3f3-12ff-43a3-89ad-203bd49b637d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:26.793000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c824e3f3-12ff-43a3-89ad-203bd49b637d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:26.806545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c824e3f3-12ff-43a3-89ad-203bd49b637d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:26.843238 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c824e3f3-12ff-43a3-89ad-203bd49b637d tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.357121 Jun 16 18:41:26.847305 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1258/2616] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Jun 16 18:41:26 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:26.856341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa0d0052-229f-45da-bc83-9e00c81d2cae tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:26.856646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa0d0052-229f-45da-bc83-9e00c81d2cae tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:27.196432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa0d0052-229f-45da-bc83-9e00c81d2cae tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:27.227610 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa0d0052-229f-45da-bc83-9e00c81d2cae tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1217 microversion: 2.1 time: 0.377419 Jun 16 18:41:27.229221 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1259/2617] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:26 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1217 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:27.240281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:27.242833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:27.251031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:27.251493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:27.252479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:27.252929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:27.465787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=26 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:27.792966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:27.814220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fe177974-e505-4a9f-a107-3120a94b1c8c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.242333 Jun 16 18:41:27.815479 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1359/2618] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:26 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:27.829285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-70956987", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "730465d5-116f-4450-aab7-b91f80d00816"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:28.011069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:28.171746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:28.209597 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f9fd6a99-3f1f-4ca4-94ad-51d7a1ae046d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1321 microversion: 2.1 time: 0.971633 Jun 16 18:41:28.229060 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1260/2619] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:27 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1321 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:28.243603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fffe04f1-ea7f-4faf-8dc8-77087cf19b19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fffe04f1-ea7f-4faf-8dc8-77087cf19b19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 416 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:28.256755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:41:28.260768 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:28.263809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fffe04f1-ea7f-4faf-8dc8-77087cf19b19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:28.264435 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fffe04f1-ea7f-4faf-8dc8-77087cf19b19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.033967 Jun 16 18:41:28.265020 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1261/2620] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:28 2022] POST /compute/v2.1/servers => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:28.272524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:28.274093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:28.287371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:28.288128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:28.289404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:28.290094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:29.140420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:29.158625 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5190d5dd-70eb-4fd3-8150-5019fad8ff3d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1213 microversion: 2.1 time: 0.886261 Jun 16 18:41:29.159552 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1262/2621] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:28 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1213 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:29.175112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:29.183821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:29.198607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:29.202984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:29.209272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:29.209736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.134345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:30.156851 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17b7e34f-be43-40ce-bd9d-305d3b301808 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.985517 Jun 16 18:41:30.169610 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1263/2622] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:29 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:30.173607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:30.173607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:30.174224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:30.174539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:30.174951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:30.177123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:30.177733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:30.198739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.199021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.199814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.200349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.227626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.228380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.229524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.232160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.294650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:30.309344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:30.357285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Going to run 2 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:41:30.365555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:30.462602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119206) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 16 18:41:30.541191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:30.559122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:30.718334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:30.731588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:30.761479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=64f7f779-3f3a-41b7-b2d8-cf4777355ee2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:30.978310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:31.000983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:31.075483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:31.088321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:31.104498 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7b86e0d3-4ddb-43bd-82c6-01f02cf1772f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1512 microversion: 2.1 time: 0.945354 Jun 16 18:41:31.109273 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1264/2623] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:30 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1512 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:31.119678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:31.123468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:31.142327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:31.144555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:31.145943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:31.158483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:31.231191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:31.242867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:31.331234 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f60048fc-1b21-4fc9-8270-b8ebf156607e tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.513457 Jun 16 18:41:31.335266 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1360/2624] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 3519 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:41:31.349876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:31.351248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:31.375841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:31.381282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:31.382439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:31.383812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:31.789416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:31.804717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87e14b0a-78f9-4b4c-9d93-33130a01aaf1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1275 microversion: 2.1 time: 0.460598 Jun 16 18:41:31.818992 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1361/2625] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:31 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1275 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:31.829710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:31.835164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:31.864254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:31.866177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:31.870307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:31.870860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:32.016285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:32.032296 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-43af682c-13a1-4e87-a95c-8fa71b797c54 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.921602 Jun 16 18:41:32.033941 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1265/2626] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:31 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:32.073732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:32.090830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:32.091904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Searching by: {'deleted': False, 'project_id': '6a21d936370c4a5bbdd254cacc618708'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:32.173185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:32.174919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:32.178011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:32.178923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:32.243749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:32.299062 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fe20525f-b5ae-4490-8920-b0dade3483eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1658 microversion: 2.1 time: 0.263696 Jun 16 18:41:32.306291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1266/2627] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:41:32 2022] GET /compute/v2.1/servers => generated 1658 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:32.313654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-201327d5-5412-423f-9dd1-3c00a7752689 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1383671094", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": -1, "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:32.326485 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-201327d5-5412-423f-9dd1-3c00a7752689 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Flavor -1 could not be found. Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-201327d5-5412-423f-9dd1-3c00a7752689 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 206 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1383671094", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": -1, "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: exception: Flavor -1 could not be found. Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1383671094', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': -1, 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:32.333169 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jun 16 18:41:32.337803 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:32.348847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-201327d5-5412-423f-9dd1-3c00a7752689 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:32.350746 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-201327d5-5412-423f-9dd1-3c00a7752689 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.042368 Jun 16 18:41:32.352582 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1267/2628] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:32 2022] POST /compute/v2.1/servers => generated 73 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:32.358989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c67bf88e-b1b6-4e5f-86c4-d8f1d4831b58 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:32.359991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c67bf88e-b1b6-4e5f-86c4-d8f1d4831b58 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:32.556103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c67bf88e-b1b6-4e5f-86c4-d8f1d4831b58 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:32.567175 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c67bf88e-b1b6-4e5f-86c4-d8f1d4831b58 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1217 microversion: 2.1 time: 0.210419 Jun 16 18:41:32.572615 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1268/2629] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:32 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:32.599334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:32.600235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:32.615878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:32.616750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:32.617762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:32.621206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:32.967367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:32.977244 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d11c3c59-de96-4e8c-8b5f-846c7df4450e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1512 microversion: 2.1 time: 1.156477 Jun 16 18:41:32.985419 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1362/2630] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:31 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1512 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:32.991405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:32.997263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:33.008325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.008783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:33.010269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.010724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:33.142518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:33.160290 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7b08695-570a-4c44-9226-aed0ad42f2c1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.573848 Jun 16 18:41:33.163045 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1269/2631] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:32 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:33.174422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:33.175107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:33.187100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.187836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:33.188786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.189422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:33.240610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:33.256840 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a5fefeb9-b53b-41e3-8d79-b9340d4aaf41 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1275 microversion: 2.1 time: 0.269868 Jun 16 18:41:33.260123 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1363/2632] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:32 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:33.272369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:33.287802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:33.302882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.303659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:33.304662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.305307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:33.819769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:33.869432 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-119ff317-84dc-4f77-96aa-5d10ce477dde tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.605522 Jun 16 18:41:33.882499 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1364/2633] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:33 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:33.882499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:33.882499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:33.890719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.892544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:33.893712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:33.893984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:34.091988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:34.107842 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2c6bbbe8-c7cc-4d3e-9178-7aebb97462ba tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1269 microversion: 2.1 time: 0.234419 Jun 16 18:41:34.108696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1365/2634] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:33 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:34.139550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f662c820-3e57-4101-83b3-53c1d7fa98fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-269849472", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f662c820-3e57-4101-83b3-53c1d7fa98fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 172 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-269849472", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-269849472', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi -1 Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:41:34.152111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 16 18:41:34.157967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:41:34.164351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f662c820-3e57-4101-83b3-53c1d7fa98fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:34.168643 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f662c820-3e57-4101-83b3-53c1d7fa98fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.054159 Jun 16 18:41:34.173203 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1366/2635] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:34.189934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:34.192546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:34.210995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:34.211456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:34.215971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:34.216597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:34.256506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:34.274358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:34.280738 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf6a9552-b50c-4e65-8088-c2a51cac4892 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1320 microversion: 2.1 time: 1.114082 Jun 16 18:41:34.282668 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1270/2636] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:33 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1320 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:34.292836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:34.294016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:34.303764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:34.304881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:34.306943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:34.307652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:35.584279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:35.594367 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7f4d5c98-d8be-4375-8629-cceea2c849e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.415571 Jun 16 18:41:35.594964 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1367/2637] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:34 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:41:35.612964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:35.652442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22b30521-cc47-4b0c-938e-3f7d35ab0639 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1317 microversion: 2.1 time: 1.365960 Jun 16 18:41:35.667418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1271/2638] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:34 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1317 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:35.675312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:35.677295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:35.706952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:35.707574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:35.708605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:35.709043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:35.736923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3abec443-3eb3-4f0c-92ab-b8d5d14342b4 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e3521f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-938510078", "description": "tempest-description-1029722109"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:35.985957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:36.010288 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9c710a9-1f6e-4037-aa6f-ca1c48263b2b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1275 microversion: 2.1 time: 0.341317 Jun 16 18:41:36.020113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1272/2639] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:35 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1275 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:36.032168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:36.033286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:36.045682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:36.046439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:36.047408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:36.048019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:36.715009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:36.726443 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7373e43-7681-47bd-9a0b-b194d5ccb4b5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1320 microversion: 2.1 time: 0.704252 Jun 16 18:41:36.727653 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1273/2640] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:36 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1320 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:36.737009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a0360867-c88f-4f43-a6d0-a23fabb1c6b7 req-070a1e17-c9ca-46c7-9f65-35d26ce9632b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecaece79-6b31-482a-afaf-6a709098c3b5", "name": "network-vif-plugged", "status": "completed", "tag": "db2e03bc-423e-4a49-aff9-599b23364af0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:36.750644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a0360867-c88f-4f43-a6d0-a23fabb1c6b7 req-070a1e17-c9ca-46c7-9f65-35d26ce9632b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:36.751243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a0360867-c88f-4f43-a6d0-a23fabb1c6b7 req-070a1e17-c9ca-46c7-9f65-35d26ce9632b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:36.766893 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a0360867-c88f-4f43-a6d0-a23fabb1c6b7 req-070a1e17-c9ca-46c7-9f65-35d26ce9632b service nova] Creating event network-vif-plugged:db2e03bc-423e-4a49-aff9-599b23364af0 for instance ecaece79-6b31-482a-afaf-6a709098c3b5 on n-h2-846209-2 Jun 16 18:41:36.776226 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a0360867-c88f-4f43-a6d0-a23fabb1c6b7 req-070a1e17-c9ca-46c7-9f65-35d26ce9632b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045952 Jun 16 18:41:36.777881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1274/2641] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:36.787303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:36.788327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:36.800044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:36.801033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:36.802352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:36.805701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:37.942711 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3abec443-3eb3-4f0c-92ab-b8d5d14342b4 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.331909 Jun 16 18:41:37.945830 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1368/2642] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:41:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:37.954672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:37.955335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:37.971878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:37.973368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:37.974707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:37.975373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:38.024795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:38.059030 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-80deb3fe-a0c2-48f4-9537-7ad3b8bda1a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.279108 Jun 16 18:41:38.060908 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1275/2643] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:36 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:38.134195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:38.134839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:38.195629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:38.196744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:38.199999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:38.210679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:38.442474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:38.459262 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a28942ea-72e7-4949-a8bc-814c6f3003df tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1275 microversion: 2.1 time: 0.396526 Jun 16 18:41:38.469147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1276/2644] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:38 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1275 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:38.480322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:38.494218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:38.508015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:38.516363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:38.521400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:38.522204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:38.798380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:38.820987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54ada816-5dee-441d-8480-c75ac0c2035e tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1317 microversion: 2.1 time: 0.872182 Jun 16 18:41:38.824359 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1369/2645] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:37 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:38.840350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-57f97241-75ca-44f4-b178-1b8a086bea6d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e3425e0>, body: {"security_group_rule": {"parent_group_id": "176b5b28-da2c-4c12-a5fc-df419d5f4a3d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:39.371756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:39.390919 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35159955-2646-4728-85b4-a1edde7e8603 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1511 microversion: 2.1 time: 0.914764 Jun 16 18:41:39.404780 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1277/2646] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:38 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1511 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:39.437493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18319362-7603-4485-a83d-381814ab6576 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1138510238", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:39.451144 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-18319362-7603-4485-a83d-381814ab6576 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18319362-7603-4485-a83d-381814ab6576 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 216 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1138510238", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1138510238', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:39.462790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:39.467048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18319362-7603-4485-a83d-381814ab6576 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:39.468371 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-18319362-7603-4485-a83d-381814ab6576 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.062165 Jun 16 18:41:39.469883 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1278/2647] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:39 2022] POST /compute/v2.1/servers => generated 123 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:39.484513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:39.490400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:39.492269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:39.509928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:39.510680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:39.511924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:39.513234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:39.620845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=15 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:39.740640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:39.960600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=30 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:39.967111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:39.977842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:39.978426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:40.260637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:40.337998 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-57f97241-75ca-44f4-b178-1b8a086bea6d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.512064 Jun 16 18:41:40.339567 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1370/2648] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:41:38 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:40.349978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:40.352387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:40.372419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:40.376494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:40.377625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:40.381484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:40.840246 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f317ed45-a38c-4aca-bfa2-66f135ae200c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.367813 Jun 16 18:41:40.841675 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1279/2649] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jun 16 18:41:39 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:40.846709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:40.848260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:40.886500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:40.888823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:40.890218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:40.892847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:41.275807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=22 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:41.340156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:41.353444 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87eeffae-af58-42bc-af67-34e9761e5a34 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.012211 Jun 16 18:41:41.370888 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1371/2650] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:40 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:41.377098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:41.382668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:41.398865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:41.401844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:41.402998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:41.403691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:42.560380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:42.572947 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ccf19354-f9ab-46f0-80b9-a734da208da7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1317 microversion: 2.1 time: 1.199793 Jun 16 18:41:42.575734 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1372/2651] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:41 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1317 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:42.588930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1704233695", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dac01a4d-62a5-46b4-a591-4866a5ada802"}], "security_groups": [{"name": "tempest-securitygroup--1037656971"}], "key_name": "tempest-keypair-207491509", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ecb4292a-72f3-4990-9f48-125d0e2691aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:42.631063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:42.676260 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-31aee068-7e3c-47c6-a543-ca2bebb98fbc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1317 microversion: 2.1 time: 1.821061 Jun 16 18:41:42.678167 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1280/2652] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:40 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1317 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:42.690642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3840a50-b974-457a-b46e-a6fb4e127e4d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866f150ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-341357125", "description": "tempest-description-1265695324"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:43.011838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] validate_networks() for [('dac01a4d-62a5-46b4-a591-4866a5ada802', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:44.336128 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3840a50-b974-457a-b46e-a6fb4e127e4d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.655721 Jun 16 18:41:44.356391 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1281/2653] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:41:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:44.361990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:44.380139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:44.382836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1699159416', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:44.400450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:44.402779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:44.404445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:44.407089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:44.604405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:44.714267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:44.721300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:44.721761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.017654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Getting quotas for project 139abd9c58324711ac867b920ee2ef7d. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:45.044593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Getting quotas for user a5868f931c6342faa9e0c0b276ae5c7d and project 139abd9c58324711ac867b920ee2ef7d. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:45.054542 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af79d0a4-5bf6-481c-bcd3-e234eba8066f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1699159416" status: 200 len: 1515 microversion: 2.1 time: 0.696924 Jun 16 18:41:45.070572 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1282/2654] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:41:44 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1699159416 => generated 1515 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:45.083145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-048395fd-24e6-4489-9e5f-4c913d3af9af req-120644c4-2f33-41bb-8d1f-7734f6193779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53623e30-af71-4962-8e71-267c0568a758", "tag": "3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:45.099021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-048395fd-24e6-4489-9e5f-4c913d3af9af req-120644c4-2f33-41bb-8d1f-7734f6193779 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.100068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-048395fd-24e6-4489-9e5f-4c913d3af9af req-120644c4-2f33-41bb-8d1f-7734f6193779 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.102633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:45.103895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:45.104511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:45.105394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:45.106926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:45.122710 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-048395fd-24e6-4489-9e5f-4c913d3af9af req-120644c4-2f33-41bb-8d1f-7734f6193779 service nova] Creating event network-changed:3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67 for instance 53623e30-af71-4962-8e71-267c0568a758 on n-h1-846209-2 Jun 16 18:41:45.131161 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-048395fd-24e6-4489-9e5f-4c913d3af9af req-120644c4-2f33-41bb-8d1f-7734f6193779 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058131 Jun 16 18:41:45.132715 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1283/2655] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:45.133604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.134328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.136690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.137148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.140318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:45.141326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:45.149671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.150415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.151447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.152384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.174961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Getting quotas for project 139abd9c58324711ac867b920ee2ef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:45.182215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Getting quotas for user a5868f931c6342faa9e0c0b276ae5c7d and project 139abd9c58324711ac867b920ee2ef7d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:45.293689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:41:45.296124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ecb4292a-72f3-4990-9f48-125d0e2691aa',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:45.584294 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b713592a-f874-412c-9d5f-425ae6246929 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.005397 Jun 16 18:41:45.590798 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1373/2656] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:42 2022] POST /compute/v2.1/servers => generated 407 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:41:45.603000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:45.605296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:45.612385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.612845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.614592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.615371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.897053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:45.915827 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17e8a0b6-5889-45bc-ad1c-5167eb5f0baf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.780976 Jun 16 18:41:45.916428 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1284/2657] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:45 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:45.923086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:45.924007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:45.949948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.952578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:45.955078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:45.956485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:46.377594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:46.387689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e10f277d-4d67-4ddc-9057-44f392e89092 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1317 microversion: 2.1 time: 0.795416 Jun 16 18:41:46.396331 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1374/2658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:45 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1317 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:46.402025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ecb28a80-dba5-4287-b718-a44706648d4e tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866ec47d30>, body: {"security_group_rule": {"parent_group_id": "41ba0b49-f26d-4e8c-8e04-5fdde7053a77", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:46.824503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:46.834203 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eebb9321-5230-4edc-b3bb-9616c1f46980 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1317 microversion: 2.1 time: 0.916154 Jun 16 18:41:46.835193 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1285/2659] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:45 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1317 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:46.841005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:46.845297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:46.846570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:46.853163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:46.853976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:46.855130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:46.855895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:47.000673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:47.100336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:47.110232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:47.111203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:48.101213 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ecb28a80-dba5-4287-b718-a44706648d4e tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.702607 Jun 16 18:41:48.103710 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1375/2660] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:41:46 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:48.110960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:48.112253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:48.114558 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ac97135-06b4-4187-9cc7-6eec5106aec2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.278120 Jun 16 18:41:48.124345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:48.125629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:48.126759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:48.127547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:48.128735 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1286/2661] 10.222.0.27 () {58 vars in 1172 bytes} [Thu Jun 16 18:41:46 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:48.138143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bdca579-17de-49a4-ace8-2aafe631734a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-709041312", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-key-1883474802", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:48.241055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-9bdca579-17de-49a4-ace8-2aafe631734a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] validate_networks() for [('99bd8b9b-a897-4204-886b-50b9270a6c81', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:48.996449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:49.010631 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54e64a04-c2cd-4768-82dd-da90aaad8c57 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1305 microversion: 2.1 time: 0.904502 Jun 16 18:41:49.011968 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1376/2662] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:48 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1305 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:49.022154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-caab65c6-35ea-4626-9128-9c1975ea68a6 req-55254007-4454-4513-9a5c-e28af0eee662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302e189f-94eb-433b-aa76-79508173e361", "tag": "e5588220-578a-4b30-96d4-eee64d0ab7b2"}, {"name": "network-changed", "server_uuid": "64f7f779-3f3a-41b7-b2d8-cf4777355ee2", "tag": "5f0e6c8b-f702-4cae-b887-89e04d9efdf4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:49.042639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-caab65c6-35ea-4626-9128-9c1975ea68a6 req-55254007-4454-4513-9a5c-e28af0eee662 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.043209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-caab65c6-35ea-4626-9128-9c1975ea68a6 req-55254007-4454-4513-9a5c-e28af0eee662 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.073104 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-caab65c6-35ea-4626-9128-9c1975ea68a6 req-55254007-4454-4513-9a5c-e28af0eee662 service nova] Creating event network-changed:e5588220-578a-4b30-96d4-eee64d0ab7b2 for instance 302e189f-94eb-433b-aa76-79508173e361 on n-h1-846209-2 Jun 16 18:41:49.074046 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-caab65c6-35ea-4626-9128-9c1975ea68a6 req-55254007-4454-4513-9a5c-e28af0eee662 service nova] Creating event network-changed:5f0e6c8b-f702-4cae-b887-89e04d9efdf4 for instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 on n-h2-846209-2 Jun 16 18:41:49.090878 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-caab65c6-35ea-4626-9128-9c1975ea68a6 req-55254007-4454-4513-9a5c-e28af0eee662 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077311 Jun 16 18:41:49.092286 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1377/2663] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:49.106289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:49.107984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:49.125852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.126744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.127793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.128469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.134358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:49.155271 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-9bdca579-17de-49a4-ace8-2aafe631734a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Invalid key_name provided. Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bdca579-17de-49a4-ace8-2aafe631734a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 246 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-709041312", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-key-1883474802", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid key_name provided. Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-709041312', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'key_name': 'tempest-key-1883474802', 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1883474802 not found for user b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:49.158091 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bdca579-17de-49a4-ace8-2aafe631734a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid key_name provided. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:49.162636 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bdca579-17de-49a4-ace8-2aafe631734a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.029245 Jun 16 18:41:49.170210 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1287/2664] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 1041 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:49.190330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:49.190964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:49.224695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.225159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.225995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.226450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.835941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:49.845900 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c49b3099-ca6c-4a2c-b0cc-6d9835db7c00 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1317 microversion: 2.1 time: 0.752119 Jun 16 18:41:49.847863 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1378/2665] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:49 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:49.862732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c92189ea-2316-475a-814f-cb7d98ab4264 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866eba2820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-778347817", "description": "tempest-description-1466326877"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:49.869044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:49.881760 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98e5e6ba-d1b0-4c8d-b6a9-046f48a3b32f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1317 microversion: 2.1 time: 0.707041 Jun 16 18:41:49.883692 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1288/2666] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:49 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:49.892290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:49.896629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:49.897434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.servers [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Removing options 'limit' from query {{(pid=119207) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 16 18:41:49.898515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:49.906321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.907039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.908116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.908828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.953671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:49.963990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.964864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.969525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:50.547859 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c626e81e-a2ac-417b-bc86-8ebe55c69dbd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.662836 Jun 16 18:41:50.548935 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1289/2667] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:41:49 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:50.553711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:50.554568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:50.572068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:50.578323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:50.582585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:50.589438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.019922 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c92189ea-2316-475a-814f-cb7d98ab4264 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.168316 Jun 16 18:41:51.021352 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1379/2668] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:41:49 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:51.026604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:51.028026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:51.037651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.038523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.039677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.040559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.251615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:51.282908 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8a95dba-5575-422b-8de5-5c0effc16b89 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.733353 Jun 16 18:41:51.283862 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1290/2669] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:50 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:51.302199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7466761f-3957-444e-8b68-def2bfdddb4f req-bc0bdc27-ef97-476d-bbab-131688cfe88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45f8f8b-681a-4973-bcf1-4d2891f69bbb", "tag": "4794262c-b785-47f9-9f46-3dd28dcd4497"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:51.321793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7466761f-3957-444e-8b68-def2bfdddb4f req-bc0bdc27-ef97-476d-bbab-131688cfe88a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.323685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7466761f-3957-444e-8b68-def2bfdddb4f req-bc0bdc27-ef97-476d-bbab-131688cfe88a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.344096 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7466761f-3957-444e-8b68-def2bfdddb4f req-bc0bdc27-ef97-476d-bbab-131688cfe88a service nova] Creating event network-changed:4794262c-b785-47f9-9f46-3dd28dcd4497 for instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb on n-h2-846209-2 Jun 16 18:41:51.359058 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7466761f-3957-444e-8b68-def2bfdddb4f req-bc0bdc27-ef97-476d-bbab-131688cfe88a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071255 Jun 16 18:41:51.361312 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1291/2670] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:51.380833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-be8abebe-a5e9-4a0a-b538-fa8aa7728c81 req-2f9b22b7-aa6c-49d8-a971-231fa9374802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53623e30-af71-4962-8e71-267c0568a758", "name": "network-vif-plugged", "status": "completed", "tag": "3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:51.397298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:51.400554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-be8abebe-a5e9-4a0a-b538-fa8aa7728c81 req-2f9b22b7-aa6c-49d8-a971-231fa9374802 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.401500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-be8abebe-a5e9-4a0a-b538-fa8aa7728c81 req-2f9b22b7-aa6c-49d8-a971-231fa9374802 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.416426 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-be8abebe-a5e9-4a0a-b538-fa8aa7728c81 req-2f9b22b7-aa6c-49d8-a971-231fa9374802 service nova] Creating event network-vif-plugged:3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67 for instance 53623e30-af71-4962-8e71-267c0568a758 on n-h1-846209-2 Jun 16 18:41:51.422391 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-be8abebe-a5e9-4a0a-b538-fa8aa7728c81 req-2f9b22b7-aa6c-49d8-a971-231fa9374802 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057650 Jun 16 18:41:51.423818 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1292/2671] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:51.432258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:51.438655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:51.439860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:51.448442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.449230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.450347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.451033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.607103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:51.766645 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98d95c62-dad3-4426-bf5a-b65d3abcfcb9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.341042 Jun 16 18:41:51.767597 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1293/2672] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:41:51 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:51.773604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:51.774515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:51.782037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.783182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.784311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.785747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.832603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:51.841610 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41d67261-44ef-4c88-ac40-e2ff60d821fb tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1305 microversion: 2.1 time: 0.818792 Jun 16 18:41:51.842559 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1380/2673] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:51 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1305 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:51.849136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:51.850148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:51.857767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.858583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.859504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.859927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.132248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:52.140555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71574e70-b458-4e79-a7a4-8b7cd32bcb79 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1317 microversion: 2.1 time: 0.296891 Jun 16 18:41:52.152996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:52.153193 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1381/2674] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:51 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:52.158336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dddf06ec-845d-4f97-a6af-60330db528fc tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e338a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1156178998", "description": "tempest-description-1891462881"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:52.176458 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92107f75-245b-4e5a-bce6-c50c970ea5b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1317 microversion: 2.1 time: 0.407342 Jun 16 18:41:52.191048 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1294/2675] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:51 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:52.191048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:52.192627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:52.202960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.203926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.204752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.205485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.618871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:52.628103 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5c6be550-93b7-4c79-8bff-4b4871e4424d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.444526 Jun 16 18:41:52.633605 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1295/2676] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:52 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:52.638856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:52.653510 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dddf06ec-845d-4f97-a6af-60330db528fc tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.493995 Jun 16 18:41:52.654716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:52.655142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.servers [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Removing options 'limit' from query {{(pid=119207) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 16 18:41:52.656041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:52.656916 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1382/2677] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:41:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:52.671475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c281898d-2370-486b-b115-03c3b66f9d4c tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e2d1dc0>, body: {"security_group_rule": {"parent_group_id": "38d879ba-fcda-42f2-b4d4-288bd7163b1f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "01f334b9-f66e-4065-b363-41c44a3089a8"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:52.676955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.677416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.678278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.678718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.724759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:52.784722 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-abf329c6-64ad-47fe-9c9b-b6ab0e6042d5 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.148941 Jun 16 18:41:52.792691 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1296/2678] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Jun 16 18:41:52 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:52.809427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:52.819826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:52.821525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:52.839570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.841200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.844083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.844545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.889973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:52.926835 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-475cddb2-52ea-486a-8d61-3d6a133870bf tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.129915 Jun 16 18:41:52.928211 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1297/2679] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:41:52 2022] GET /compute/v2.1/servers => generated 1011 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:52.944338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:52.945384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:52.978464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.979277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.983660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.986465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:53.954899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:53.969491 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-51ace4b3-d2da-4426-aac9-d542e195d81c tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1305 microversion: 2.1 time: 1.039818 Jun 16 18:41:53.970165 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1298/2680] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:52 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1305 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:53.986828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8cf3203-4c75-489e-9da1-021abaaeeb25 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-595798752", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:54.406800 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c281898d-2370-486b-b115-03c3b66f9d4c tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.740849 Jun 16 18:41:54.408581 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1383/2681] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:41:52 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:54.413727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-e8cf3203-4c75-489e-9da1-021abaaeeb25 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Neutron security group does_not_exist not found {{(pid=119207) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jun 16 18:41:54.414598 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e8cf3203-4c75-489e-9da1-021abaaeeb25 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jun 16 18:41:54.416143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:54.428009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8cf3203-4c75-489e-9da1-021abaaeeb25 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 257 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-595798752", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: exception: Unable to find security_group with name or id 'does_not_exist' Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-595798752', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jun 16 18:41:54.429148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:54.434634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8cf3203-4c75-489e-9da1-021abaaeeb25 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:54.444952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8cf3203-4c75-489e-9da1-021abaaeeb25 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.459646 Jun 16 18:41:54.444952 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1299/2682] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:53 2022] POST /compute/v2.1/servers => generated 106 bytes in 461 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:41:54.444952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:54.444952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:54.445663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:54.449848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:54.450333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:54.451229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:54.451530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:54.463149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:54.464003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:54.465123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:54.466111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:54.563802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:54.646455 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-feb667c1-5639-4358-afc3-149e2d4da10a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.236394 Jun 16 18:41:54.647422 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1384/2683] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:41:54 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:54.652756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:54.653816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:54.663085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:54.663876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:54.664940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:54.665661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.059370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:55.070013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e76ce182-4456-4258-962c-7558cb5e7437 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1317 microversion: 2.1 time: 0.637464 Jun 16 18:41:55.072379 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1300/2684] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:54 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:55.077607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fb53ba0-7be5-410d-bc98-079f2cea4bec tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e39d700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-712924376", "description": "tempest-description-1022747530"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:55.191764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:55.196359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:55.204919 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fe1f655f-f436-49dc-975f-9b5e439fc8bb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1507 microversion: 2.1 time: 0.556190 Jun 16 18:41:55.206011 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1385/2685] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:54 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:55.214087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:55.215047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:55.228812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.229522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.230845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.231291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.611731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:55.624923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5825f789-242e-427d-b82d-e5b25382e201 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.417131 Jun 16 18:41:55.640041 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1386/2686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:55 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:55.646095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:55.652272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:55.669348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.servers [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Removing options 'limit' from query {{(pid=119206) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 16 18:41:55.670625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:55.683567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.686238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.689519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.690085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.710077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5fb53ba0-7be5-410d-bc98-079f2cea4bec tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.636154 Jun 16 18:41:55.711634 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1301/2687] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:41:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:55.722026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a0f833b7-6ead-490c-b045-a40dfb14b4e6 req-94fbc09f-741f-4a52-a66b-909c9c3476e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302e189f-94eb-433b-aa76-79508173e361", "name": "network-vif-plugged", "status": "completed", "tag": "e5588220-578a-4b30-96d4-eee64d0ab7b2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:55.751813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a0f833b7-6ead-490c-b045-a40dfb14b4e6 req-94fbc09f-741f-4a52-a66b-909c9c3476e9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.752744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a0f833b7-6ead-490c-b045-a40dfb14b4e6 req-94fbc09f-741f-4a52-a66b-909c9c3476e9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.770103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8702ae4c-858e-4335-bd47-77ada087a694 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.125016 Jun 16 18:41:55.772180 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a0f833b7-6ead-490c-b045-a40dfb14b4e6 req-94fbc09f-741f-4a52-a66b-909c9c3476e9 service nova] Creating event network-vif-plugged:e5588220-578a-4b30-96d4-eee64d0ab7b2 for instance 302e189f-94eb-433b-aa76-79508173e361 on n-h1-846209-2 Jun 16 18:41:55.792333 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1387/2688] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jun 16 18:41:55 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:55.807906 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a0f833b7-6ead-490c-b045-a40dfb14b4e6 req-94fbc09f-741f-4a52-a66b-909c9c3476e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091044 Jun 16 18:41:55.810723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:55.811058 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1302/2689] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:55.814511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:55.822201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:55.823174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:55.845031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.851421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.852616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.853229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.854809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.857072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:55.859359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:55.859940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:56.424317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:56.434029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:56.449675 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4bcbe888-c532-431f-9a76-85ada118b9e3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1507 microversion: 2.1 time: 0.635952 Jun 16 18:41:56.458953 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1303/2690] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:55 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1507 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:56.465577 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7161e555-c320-47c4-b8bc-52a4ac491c48 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.663610 Jun 16 18:41:56.466982 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1388/2691] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:55 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:56.489320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:56.490174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:56.498620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a533ab21-e19f-461e-9e43-ec2d3f9d33c2 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e34cf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1037801266", "description": "tempest-description-569966604"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:56.507797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:56.508428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:56.509381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:56.510124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.012924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:57.022773 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6bfd8194-3d7b-4128-a082-b2c3ef6e5ee2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.558397 Jun 16 18:41:57.035880 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1304/2692] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:56 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:57.041037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:57.045946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:57.047014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1699159416', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:41:57.052981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.053453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.054540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.054982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.155865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:41:57.197818 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a533ab21-e19f-461e-9e43-ec2d3f9d33c2 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.728788 Jun 16 18:41:57.200016 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1389/2693] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:41:56 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:57.220643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:57.221289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:57.232077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.232531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.233307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.233947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.238876 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-efb25982-61b0-431c-bfa0-c28ce90d9dd2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1699159416" status: 200 len: 346 microversion: 2.1 time: 0.201611 Jun 16 18:41:57.240182 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1305/2694] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:41:57 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1699159416 => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:57.246189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:57.248399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:57.257460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.257948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.258882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.259192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.349489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:57.350107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:57.350879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:57.351394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:57.351913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:57.421106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:57.428048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.428709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.429308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:57.429769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:57.463899 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-048cfd47-377a-42be-b969-273d76354205 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "POST /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758/action" status: 202 len: 1109 microversion: 2.1 time: 0.222339 Jun 16 18:41:57.464966 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1306/2695] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:41:57 2022] POST /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758/action => generated 1109 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 16 18:41:57.469708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca72b974-d425-4851-9f2f-d3c8774a1880 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:57.470241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca72b974-d425-4851-9f2f-d3c8774a1880 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e31c2561-a0d0-460b-bb47-fd21b1f973a2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:57.476478 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ca72b974-d425-4851-9f2f-d3c8774a1880 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance e31c2561-a0d0-460b-bb47-fd21b1f973a2 could not be found. Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca72b974-d425-4851-9f2f-d3c8774a1880 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/e31c2561-a0d0-460b-bb47-fd21b1f973a2 HTTP/1.1 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance e31c2561-a0d0-460b-bb47-fd21b1f973a2 could not be found. Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e31c2561-a0d0-460b-bb47-fd21b1f973a2'} Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31c2561-a0d0-460b-bb47-fd21b1f973a2 could not be found. Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31c2561-a0d0-460b-bb47-fd21b1f973a2 could not be found. Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:57.478546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31c2561-a0d0-460b-bb47-fd21b1f973a2 could not be found. Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca72b974-d425-4851-9f2f-d3c8774a1880 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance e31c2561-a0d0-460b-bb47-fd21b1f973a2 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca72b974-d425-4851-9f2f-d3c8774a1880 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e31c2561-a0d0-460b-bb47-fd21b1f973a2" status: 404 len: 111 microversion: 2.1 time: 0.013944 Jun 16 18:41:57.486118 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1307/2696] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:41:57 2022] DELETE /compute/v2.1/servers/e31c2561-a0d0-460b-bb47-fd21b1f973a2 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:41:57.491461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfeee9e6-ca60-4239-9441-60538b895a4e tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e38c280>, body: {"security_group_rule": {"parent_group_id": "da57ea60-12fd-4d91-80c5-1d23d68f1357", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "87a14eeb-b0f5-4c1f-bdc3-f57958237e04"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:57.990306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:58.002199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97481816-b671-4cff-b49b-3ad58aa493db tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1317 microversion: 2.1 time: 0.800506 Jun 16 18:41:58.013609 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1390/2697] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:57 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:58.020371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-195f6687-bdcb-43fc-bf2a-568960bc7176 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:58.031023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-195f6687-bdcb-43fc-bf2a-568960bc7176 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:58.033011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-195f6687-bdcb-43fc-bf2a-568960bc7176 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:58.059224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-195f6687-bdcb-43fc-bf2a-568960bc7176 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Going to try to stop instance {{(pid=119206) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:41:58.107593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-195f6687-bdcb-43fc-bf2a-568960bc7176 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "POST /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.092246 Jun 16 18:41:58.108283 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1391/2698] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:41:58 2022] POST /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:41:58.114996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:58.115697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:58.122261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:58.122962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:58.124078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:58.124430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:58.509762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:58.520089 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-424b98d4-3811-44ac-ae4e-5b308d22a9fb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.409440 Jun 16 18:41:58.521058 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1392/2699] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:58 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:58.526642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:58.527875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:58.534578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:58.535101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:58.536216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:58.536923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:58.537042 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfeee9e6-ca60-4239-9441-60538b895a4e tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.049740 Jun 16 18:41:58.544309 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1308/2700] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:41:57 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:58.553467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:58.554457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:58.561299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:58.561840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:58.562876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:58.563454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:58.584340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:58.983282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:58.992894 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-799d5154-c089-4f4e-b63d-93677e4318d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.469865 Jun 16 18:41:58.992894 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1393/2701] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:58 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:59.004826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5d81f196-4f00-4b4e-b621-4352bbb30d9a req-c6f1e58e-5af2-4ada-bfc8-5eb4fb381a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f7f779-3f3a-41b7-b2d8-cf4777355ee2", "name": "network-vif-plugged", "status": "completed", "tag": "5f0e6c8b-f702-4cae-b887-89e04d9efdf4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:59.007290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5d81f196-4f00-4b4e-b621-4352bbb30d9a req-c6f1e58e-5af2-4ada-bfc8-5eb4fb381a61 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.008046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5d81f196-4f00-4b4e-b621-4352bbb30d9a req-c6f1e58e-5af2-4ada-bfc8-5eb4fb381a61 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.020801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:59.031132 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5d81f196-4f00-4b4e-b621-4352bbb30d9a req-c6f1e58e-5af2-4ada-bfc8-5eb4fb381a61 service nova] Creating event network-vif-plugged:5f0e6c8b-f702-4cae-b887-89e04d9efdf4 for instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 on n-h2-846209-2 Jun 16 18:41:59.037132 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61e9caa7-4d21-4ee0-887e-2204729be04e tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.488155 Jun 16 18:41:59.041101 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5d81f196-4f00-4b4e-b621-4352bbb30d9a req-c6f1e58e-5af2-4ada-bfc8-5eb4fb381a61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047012 Jun 16 18:41:59.042319 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1394/2702] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:59.047925 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1309/2703] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:58 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:59.056169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a84b2a6-1873-49f3-af96-3c2c38e90992 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e23f280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:59.062148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:59.063236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:59.071472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.072347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.073369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.074354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.389355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:59.401616 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2aa2e09b-7cef-48f0-99e9-435b4fd0f9ea tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1522 microversion: 2.1 time: 0.357658 Jun 16 18:41:59.414267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1395/2704] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:59 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:59.419886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:59.420879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:59.429001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.429677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.431035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.431308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.709108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:59.713546 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a84b2a6-1873-49f3-af96-3c2c38e90992 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/87a14eeb-b0f5-4c1f-bdc3-f57958237e04" status: 202 len: 0 microversion: 2.1 time: 0.664062 Jun 16 18:41:59.714860 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1310/2705] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:41:59 2022] DELETE /compute/v2.1/os-security-groups/87a14eeb-b0f5-4c1f-bdc3-f57958237e04 => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:41:59.720669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:59.722167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:59.734313 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87b72100-37b1-4b62-ae9f-c6248fec3ed0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.318071 Jun 16 18:41:59.735696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1396/2706] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:59 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:59.736039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.741521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.742137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:59.742399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.742870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.743953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:59.766997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.770661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.774742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:59.775546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:59.951562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=7 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:00.036581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:00.049350 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3636844b-c973-4594-b5b6-d40182950119 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1467 microversion: 2.1 time: 0.333018 Jun 16 18:42:00.066028 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1311/2707] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:59 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1467 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:00.073156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cab037be-a44d-4183-aa61-d202d4d0070e tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e950550>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:00.074142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:00.090417 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-93657fa7-d5fc-4989-a269-66065a0bfe9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.353076 Jun 16 18:42:00.091391 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1397/2708] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:59 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:00.096419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c6a26a8c-2d06-4a5c-8305-f104c6cfbb52 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:00.097953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c6a26a8c-2d06-4a5c-8305-f104c6cfbb52 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 18:42:00.098492 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-c6a26a8c-2d06-4a5c-8305-f104c6cfbb52 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c6a26a8c-2d06-4a5c-8305-f104c6cfbb52 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 9223372036854775808 could not be found. Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '9223372036854775808'} Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:00.100280 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c6a26a8c-2d06-4a5c-8305-f104c6cfbb52 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c6a26a8c-2d06-4a5c-8305-f104c6cfbb52 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009380 Jun 16 18:42:00.107541 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1398/2709] 10.222.0.27 () {58 vars in 1187 bytes} [Thu Jun 16 18:42:00 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:42:00.118637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:00.125561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:00.139722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:00.140189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:00.140991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:00.141442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:00.189325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:00.194455 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cab037be-a44d-4183-aa61-d202d4d0070e tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/da57ea60-12fd-4d91-80c5-1d23d68f1357" status: 200 len: 247 microversion: 2.1 time: 0.125969 Jun 16 18:42:00.196469 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1312/2710] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:42:00 2022] GET /compute/v2.1/os-security-groups/da57ea60-12fd-4d91-80c5-1d23d68f1357 => generated 247 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:00.429290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:00.441822 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-49270f4e-674c-4783-9cac-bf0e43523938 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.335254 Jun 16 18:42:00.442973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1399/2711] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:00 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:00.444745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1160571029", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:00.448699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:00.449656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:00.457527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:00.458359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:00.459336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:00.459925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:00.562789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] validate_networks() for [('eb4ce95a-6a88-43dd-b945-b8df90fc19d9', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:42:00.981180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:01.003420 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f986d92-b33e-42df-b69f-850c6304c3b9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2" status: 200 len: 1317 microversion: 2.1 time: 0.558949 Jun 16 18:42:01.005597 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1400/2712] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:00 2022] GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:01.012106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:01.013281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:01.017180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:01.028448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:01.029030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:01.029970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:01.030424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:01.827019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:01.838768 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a3a104e-02de-4728-95da-3959ca118293 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.831467 Jun 16 18:42:01.839928 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1401/2713] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:01 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:01.849487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca9ced87-58d1-4224-80b5-22cb4e686fa2 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e3385e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2098426414", "description": "tempest-description-1798428068"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:01.855154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:42:01.856187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:42:01.856832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:42:01.857411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:42:01.858027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:42:01.873420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:01.873874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:01.879744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:01.880206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:01.928029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Getting quotas for project ccdaad865e9746d582f1fbdb07cce5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:01.937536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Getting quotas for user a65eae1745f34a5599af74ac260ed634 and project ccdaad865e9746d582f1fbdb07cce5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:01.989178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:42:01.993780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:42:02.132021 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e5c9bf50-a756-4c6a-b971-cf674455a6ff tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.933904 Jun 16 18:42:02.136732 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1313/2714] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:42:02.138181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca9ced87-58d1-4224-80b5-22cb4e686fa2 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.295116 Jun 16 18:42:02.145963 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1402/2715] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:42:01 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:02.154459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:02.155154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:02.155776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:02.156510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:02.173078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.173814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.174638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.178138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.180235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.184827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.187263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.188517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.579772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:02.586335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:02.593502 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a1b0967-4618-4bf9-a53d-050b13a523d7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1522 microversion: 2.1 time: 0.454908 Jun 16 18:42:02.594416 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1314/2716] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:02 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:02.608629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2145508-fb37-49ec-bb21-5e5667e084a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.467315 Jun 16 18:42:02.609226 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1403/2717] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:02 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:02.620957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:02.621429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:02.621970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:02.624254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:02.632556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.633341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.640357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.641176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.642725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.643178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.648522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.650345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.902499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:02.918117 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0fdabd1-fc0b-4ab0-9302-013c0844131d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.307181 Jun 16 18:42:02.919432 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1404/2718] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:02 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:02.925467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:02.927763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:02.954172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.954677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.955476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.955894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.968687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:02.979227 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-278a3c0a-0036-4e79-bd51-0227b8426804 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.383538 Jun 16 18:42:02.980638 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1315/2719] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:02 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:02.986788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:02.988785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:02.997046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.997514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:02.998342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:02.999279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:03.099099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:03.112298 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9e9ccce2-8cd2-4b98-b355-fa8c445ec10e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1227 microversion: 2.1 time: 0.130217 Jun 16 18:42:03.115536 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1316/2720] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:02 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1227 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:03.125710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd054ca5-00d5-40be-8292-cf51e179a5ac tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e1ed700>, body: {"security_group_rule": {"parent_group_id": "f6ea8af7-83ff-419e-a3b8-95a683432d3e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:03.326760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:03.354153 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6e36fe30-3808-437a-aab1-ca37eb25b924 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2" status: 200 len: 1466 microversion: 2.1 time: 0.432112 Jun 16 18:42:03.375916 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1405/2721] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:02 2022] GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 => generated 1466 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:03.385228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86da9aeb-42ab-449b-a98f-5fb26e8a5b44 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:03.386237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86da9aeb-42ab-449b-a98f-5fb26e8a5b44 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Failed to fetch instance by id -1 {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 18:42:03.387347 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-86da9aeb-42ab-449b-a98f-5fb26e8a5b44 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance -1 could not be found. Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86da9aeb-42ab-449b-a98f-5fb26e8a5b44 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance -1 could not be found. Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '-1'} Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:03.389532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:03.397841 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:03.397841 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:03.397841 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jun 16 18:42:03.397841 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:03.400464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86da9aeb-42ab-449b-a98f-5fb26e8a5b44 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:03.402494 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-86da9aeb-42ab-449b-a98f-5fb26e8a5b44 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.024405 Jun 16 18:42:03.403940 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1406/2722] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:42:03 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:42:03.428723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:03.446209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:03.447874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Searching by: {'reservation_id': 'r-e46dxa9r', 'deleted': False, 'project_id': '6a21d936370c4a5bbdd254cacc618708'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:03.456462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:03.457846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:03.458777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:03.459228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:03.631672 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd054ca5-00d5-40be-8292-cf51e179a5ac tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.514758 Jun 16 18:42:03.633244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1317/2723] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:42:03 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:03.638266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:03.639338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:03.640203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:03.660526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:03.661202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:03.662278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:03.662884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:03.788759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:03.815407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:03.817110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:04.214422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:04.239120 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a97a7547-e856-404d-9054-e42206231642 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-e46dxa9r" status: 200 len: 2926 microversion: 2.1 time: 0.833611 Jun 16 18:42:04.240393 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1407/2724] 10.222.0.27 () {58 vars in 1196 bytes} [Thu Jun 16 18:42:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-e46dxa9r => generated 2926 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:04.243163 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91aa0f4c-2db6-4ff6-b948-9122a358f980 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.608510 Jun 16 18:42:04.244533 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1318/2725] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:03 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:04.249429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:04.250753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:04.279084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:04.281123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:04.281585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:04.282594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:04.283254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:04.287021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:04.308168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:04.308883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:04.309845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:04.310660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:04.617098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:04.632427 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8f93893-41bd-4e66-afa5-956baaa8b635 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.357609 Jun 16 18:42:04.644444 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1319/2726] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:04 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:04.645954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:04.650933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91bfbf64-3463-459b-aefe-846d63513b88 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Action: 'create', calling method: .version_select at 0x7f866e19b940>, body: {"security_group_rule": {"parent_group_id": "f6ea8af7-83ff-419e-a3b8-95a683432d3e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:04.663334 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0971dadf-2adc-40e6-b56b-0ac6fd95d9d1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1522 microversion: 2.1 time: 0.419628 Jun 16 18:42:04.676757 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1408/2727] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:04 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:04.688152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:04.688828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:04.697630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:04.698458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:04.699565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:04.700800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.010015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:05.031348 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91bfbf64-3463-459b-aefe-846d63513b88 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.384818 Jun 16 18:42:05.032310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1320/2728] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:42:04 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:05.035950 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aee02983-8429-4499-9cf4-43e57835249a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.357810 Jun 16 18:42:05.037991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:05.038805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:05.050198 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1409/2729] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:04 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:05.051258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.051879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.053826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.054511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.059738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:05.060808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:05.073294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.075222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.076948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.078455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.145549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:05.156047 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ebc51e8-08f6-4835-b4e0-29422c80e82a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1281 microversion: 2.1 time: 0.121038 Jun 16 18:42:05.166138 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1321/2730] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:05 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:05.174232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e0649a97-91ea-4fde-8e7a-8b128e01190a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:05.200237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.server_groups [None req-e0649a97-91ea-4fde-8e7a-8b128e01190a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Querying cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) for 2 instances {{(pid=119207) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 16 18:42:05.201669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0649a97-91ea-4fde-8e7a-8b128e01190a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.202301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0649a97-91ea-4fde-8e7a-8b128e01190a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.249568 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e0649a97-91ea-4fde-8e7a-8b128e01190a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/730465d5-116f-4450-aab7-b91f80d00816" status: 200 len: 271 microversion: 2.1 time: 0.082128 Jun 16 18:42:05.250284 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1322/2731] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:42:05 2022] GET /compute/v2.1/os-server-groups/730465d5-116f-4450-aab7-b91f80d00816 => generated 271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:05.259886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b7f8fae3-6d4e-4839-824e-2f23663010e0 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e1ed040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:05.348463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:05.352633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b7f8fae3-6d4e-4839-824e-2f23663010e0 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/f6ea8af7-83ff-419e-a3b8-95a683432d3e" status: 200 len: 665 microversion: 2.1 time: 0.088928 Jun 16 18:42:05.355412 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1323/2732] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:42:05 2022] GET /compute/v2.1/os-security-groups/f6ea8af7-83ff-419e-a3b8-95a683432d3e => generated 665 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:05.384459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c5d232c-7fb0-49c1-8439-9c273c56c066 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:05.388814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c5d232c-7fb0-49c1-8439-9c273c56c066 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:05.390901 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c054107-713c-4337-bb69-6038951390ab tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.337559 Jun 16 18:42:05.393522 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1410/2733] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:05 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:05.400238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97d03bd8-d980-4a49-9036-5f0a57f02736 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e2d1af0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:05.401214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5d232c-7fb0-49c1-8439-9c273c56c066 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.404068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5d232c-7fb0-49c1-8439-9c273c56c066 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.405997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5d232c-7fb0-49c1-8439-9c273c56c066 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.407461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5d232c-7fb0-49c1-8439-9c273c56c066 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.605527 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c5d232c-7fb0-49c1-8439-9c273c56c066 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1618 microversion: 2.1 time: 0.248594 Jun 16 18:42:05.606527 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1324/2734] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:05 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1618 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:05.630520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca3bc4ea-8e74-4ea1-bb5a-20e6eca4e811 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:05.631511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca3bc4ea-8e74-4ea1-bb5a-20e6eca4e811 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 238ed9bd-2aae-436c-854f-6b561bb5a265] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:05.643214 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ca3bc4ea-8e74-4ea1-bb5a-20e6eca4e811 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 238ed9bd-2aae-436c-854f-6b561bb5a265 could not be found. Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca3bc4ea-8e74-4ea1-bb5a-20e6eca4e811 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/238ed9bd-2aae-436c-854f-6b561bb5a265/action HTTP/1.1 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 19 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: {"forceDelete": {}} Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 238ed9bd-2aae-436c-854f-6b561bb5a265 could not be found. Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '238ed9bd-2aae-436c-854f-6b561bb5a265', 'body': {'forceDelete': {}}} Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238ed9bd-2aae-436c-854f-6b561bb5a265 could not be found. Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238ed9bd-2aae-436c-854f-6b561bb5a265 could not be found. Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:05.656003 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:05.663756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:05.663756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:05.663756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238ed9bd-2aae-436c-854f-6b561bb5a265 could not be found. Jun 16 18:42:05.663756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:05.663756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca3bc4ea-8e74-4ea1-bb5a-20e6eca4e811 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 238ed9bd-2aae-436c-854f-6b561bb5a265 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:05.663756 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca3bc4ea-8e74-4ea1-bb5a-20e6eca4e811 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/238ed9bd-2aae-436c-854f-6b561bb5a265/action" status: 404 len: 111 microversion: 2.1 time: 0.052069 Jun 16 18:42:05.663756 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1325/2735] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:05 2022] POST /compute/v2.1/servers/238ed9bd-2aae-436c-854f-6b561bb5a265/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:05.667739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e5dd11f9-ca0b-4538-a3bf-9b71033b0d7a tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:05.668557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e5dd11f9-ca0b-4538-a3bf-9b71033b0d7a tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:05.680842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5dd11f9-ca0b-4538-a3bf-9b71033b0d7a tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.681451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5dd11f9-ca0b-4538-a3bf-9b71033b0d7a tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.682499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5dd11f9-ca0b-4538-a3bf-9b71033b0d7a tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:05.683213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5dd11f9-ca0b-4538-a3bf-9b71033b0d7a tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:05.993315 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e5dd11f9-ca0b-4538-a3bf-9b71033b0d7a tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2" status: 200 len: 1617 microversion: 2.1 time: 0.329484 Jun 16 18:42:06.005951 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1326/2736] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:05 2022] GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 => generated 1617 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:06.017494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:06.017816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:06.028090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.029032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.030250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.031798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.217501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97d03bd8-d980-4a49-9036-5f0a57f02736 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/92e90497-185e-482e-85b2-f0a68ecc9c67" status: 202 len: 0 microversion: 2.1 time: 0.821965 Jun 16 18:42:06.219822 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1411/2737] 10.222.0.27 () {58 vars in 1286 bytes} [Thu Jun 16 18:42:05 2022] DELETE /compute/v2.1/os-security-group-rules/92e90497-185e-482e-85b2-f0a68ecc9c67 => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:06.227964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:06.229850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:06.251204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.251840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.252769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.253896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.340040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:06.354161 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-595a0e7a-bf45-4bb0-b7e0-5ac49e85e50c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.356034 Jun 16 18:42:06.355060 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1327/2738] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:05 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:06.377640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:06.379174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:06.386705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.387474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.388678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.389276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.576754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:06.588638 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9c8831f-7e02-4dc3-bff8-bd03f492c8da tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.364397 Jun 16 18:42:06.601631 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1412/2739] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:06 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:06.607620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:06.608549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:06.616042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.616867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.617832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.618470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.763556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:06.788129 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c6aef19c-bba2-481e-ba49-776bb8863f4e tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1522 microversion: 2.1 time: 0.431934 Jun 16 18:42:06.789205 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1328/2740] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:06 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:06.795253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:06.802818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:06.819999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.820720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.821616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:06.822359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:06.923720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:06.934436 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6702c276-caf4-4073-bc7b-4fd41a459fc5 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.331094 Jun 16 18:42:06.935274 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1413/2741] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:06 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:06.949359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b3cd1fb-b7a7-4dc7-87d2-3108ed95d28c tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e352ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:07.140593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:07.153379 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9947edfe-bec4-4665-8de0-a00d3ec76545 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1323 microversion: 2.1 time: 0.362896 Jun 16 18:42:07.163881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1329/2742] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:06 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:07.169090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-923078870", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "42ff1dd7-0d48-479e-95f1-af7f8d2b2530"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:07.250823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:42:07.735322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:42:07.735976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:42:07.736442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:42:07.737242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:42:07.738069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:42:07.763920 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b3cd1fb-b7a7-4dc7-87d2-3108ed95d28c tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f6ea8af7-83ff-419e-a3b8-95a683432d3e" status: 202 len: 0 microversion: 2.1 time: 0.827417 Jun 16 18:42:07.765196 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1414/2743] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:42:06 2022] DELETE /compute/v2.1/os-security-groups/f6ea8af7-83ff-419e-a3b8-95a683432d3e => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:07.771311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:07.772263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:07.773604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:07.774167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:07.775316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:07.779680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:07.799097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:07.811268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:07.812364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:07.813035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:07.896399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:07.927842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:08.005807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:42:08.008624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:42:08.157006 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d291a0fd-b721-452f-96e0-035b08af17a6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991894 Jun 16 18:42:08.165664 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1330/2744] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:42:08.179708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:08.181339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:08.211447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.212910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:08.215781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.218944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:08.596658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:08.610312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e931719c-d813-42ce-9df3-8d1b03ae5641 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.444719 Jun 16 18:42:08.620543 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1331/2745] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:08 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:08.630537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:08.642547 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-47551788-48e9-4494-9463-e00a0f09f2e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.875885 Jun 16 18:42:08.644409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cd6575b-3e6a-47e4-a63c-1e5af767864d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e1edaf0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:08.649458 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1415/2746] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:07 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:08.668025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:08.670007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:08.687847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.692817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:08.694014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.694622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:08.783650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-5cd6575b-3e6a-47e4-a63c-1e5af767864d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:42:08.784328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-5cd6575b-3e6a-47e4-a63c-1e5af767864d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Neutron security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:42:08.787123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-5cd6575b-3e6a-47e4-a63c-1e5af767864d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] HTTP exception thrown: Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist Jun 16 18:42:08.787123 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-be43457a-6335-415d-a918-652e331506e7'] Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cd6575b-3e6a-47e4-a63c-1e5af767864d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Request method failure captured: Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-security-groups/87a14eeb-b0f5-4c1f-bdc3-f57958237e04 HTTP/1.1 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3leOwz1cZVbT_R9Qg08WZ0mRq9obu6hYADQRphgmsx1rqLxfPGvAnIKOeGiQAPBF2z1hjU7eXKBh0dYqYPtejWnSvYBwNv3ZVzT2TYz_F6x1xuHqFuZgQ5PUix42cJDRCs2qbxUqGaUwYMW8J2WXT2Wzp24MwpnCdkI4JebuqBIW6c Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 0ec7e268a55b4a2f8be90eb5ef145925 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-504869153 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec7e268a55b4a2f8be90eb5ef145925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec7e268a55b4a2f8be90eb5ef145925"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec7e268a55b4a2f8be90eb5ef145925", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec7e268a55b4a2f8be90eb5ef145925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupRulesTestJSON-504869153 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 0ec7e268a55b4a2f8be90eb5ef145925 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-504869153 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupRulesTestJSON-504869153-project Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 45029f8c9fe7428bae7c8f8884c1118c Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupRulesTestJSON-504869153-project Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: exception: Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-be43457a-6335-415d-a918-652e331506e7'] Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '87a14eeb-b0f5-4c1f-bdc3-f57958237e04'} Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:42:08.789667 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be43457a-6335-415d-a918-652e331506e7'] Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be43457a-6335-415d-a918-652e331506e7'] Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be43457a-6335-415d-a918-652e331506e7'] Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be43457a-6335-415d-a918-652e331506e7'] Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cd6575b-3e6a-47e4-a63c-1e5af767864d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Returning 404 to user: Security group 87a14eeb-b0f5-4c1f-bdc3-f57958237e04 does not exist Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-be43457a-6335-415d-a918-652e331506e7'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5cd6575b-3e6a-47e4-a63c-1e5af767864d tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/87a14eeb-b0f5-4c1f-bdc3-f57958237e04" status: 404 len: 194 microversion: 2.1 time: 0.171981 Jun 16 18:42:08.794189 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1332/2747] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:42:08 2022] DELETE /compute/v2.1/os-security-groups/87a14eeb-b0f5-4c1f-bdc3-f57958237e04 => generated 194 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:08.807620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:08.808267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:08.852144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:08.854110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.854513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:08.855514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.856092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.478103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:09.494521 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-957fb5ea-7698-4d64-977c-5a554fde87c1 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1499 microversion: 2.1 time: 0.843771 Jun 16 18:42:09.505579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:09.522117 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a9cec409-e8b1-4130-a842-720609df78dd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.728947 Jun 16 18:42:09.526706 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1416/2748] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:08 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1499 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:09.527286 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1333/2749] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:08 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:09.536186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-cc137ed5-c397-4216-b711-fbb5e6f68624 req-4f6f08f4-603d-4a32-8f48-0b26370f85ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45f8f8b-681a-4973-bcf1-4d2891f69bbb", "name": "network-vif-plugged", "status": "completed", "tag": "4794262c-b785-47f9-9f46-3dd28dcd4497"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:09.543684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c40bfc45-a810-4bdd-af64-c0b428d43068 req-d7d8e802-e011-4ba2-a089-648f66319365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c200947-b0a2-4c31-94c7-35186b881d08", "tag": "6407cf64-ee37-44f6-b1c4-145da9892974"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:09.549703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-cc137ed5-c397-4216-b711-fbb5e6f68624 req-4f6f08f4-603d-4a32-8f48-0b26370f85ff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.550492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-cc137ed5-c397-4216-b711-fbb5e6f68624 req-4f6f08f4-603d-4a32-8f48-0b26370f85ff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.563569 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-cc137ed5-c397-4216-b711-fbb5e6f68624 req-4f6f08f4-603d-4a32-8f48-0b26370f85ff service nova] Creating event network-vif-plugged:4794262c-b785-47f9-9f46-3dd28dcd4497 for instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb on n-h2-846209-2 Jun 16 18:42:09.565097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c40bfc45-a810-4bdd-af64-c0b428d43068 req-d7d8e802-e011-4ba2-a089-648f66319365 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.565669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c40bfc45-a810-4bdd-af64-c0b428d43068 req-d7d8e802-e011-4ba2-a089-648f66319365 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.573638 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-cc137ed5-c397-4216-b711-fbb5e6f68624 req-4f6f08f4-603d-4a32-8f48-0b26370f85ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045255 Jun 16 18:42:09.577564 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1417/2750] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:09.598558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:09.599973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:09.606932 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c40bfc45-a810-4bdd-af64-c0b428d43068 req-d7d8e802-e011-4ba2-a089-648f66319365 service nova] Creating event network-changed:6407cf64-ee37-44f6-b1c4-145da9892974 for instance 5c200947-b0a2-4c31-94c7-35186b881d08 on n-h2-846209-2 Jun 16 18:42:09.607791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.608694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.609786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.610460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.617127 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c40bfc45-a810-4bdd-af64-c0b428d43068 req-d7d8e802-e011-4ba2-a089-648f66319365 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088462 Jun 16 18:42:09.619130 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1334/2751] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:09.625498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:09.626654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:09.640645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.643597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.646479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.647865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.662770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:09.803579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:09.815029 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a244cd9e-eb34-4e76-adb8-e0d12ff120fd tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1212 microversion: 2.1 time: 0.235758 Jun 16 18:42:09.818998 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1418/2752] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:09 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1212 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:09.834276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3d14e7a-e31e-47aa-b7fa-47d5b67d3c8f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:09.836824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3d14e7a-e31e-47aa-b7fa-47d5b67d3c8f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 8f463560-164a-4e90-b3b5-bb160bd808ab] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:09.853414 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a3d14e7a-e31e-47aa-b7fa-47d5b67d3c8f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 8f463560-164a-4e90-b3b5-bb160bd808ab could not be found. Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3d14e7a-e31e-47aa-b7fa-47d5b67d3c8f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/8f463560-164a-4e90-b3b5-bb160bd808ab/action HTTP/1.1 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 39 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: {"os-getConsoleOutput": {"length": 10}} Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 8f463560-164a-4e90-b3b5-bb160bd808ab could not be found. Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '8f463560-164a-4e90-b3b5-bb160bd808ab', 'body': {'os-getConsoleOutput': {'length': 10}}} Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f463560-164a-4e90-b3b5-bb160bd808ab could not be found. Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f463560-164a-4e90-b3b5-bb160bd808ab could not be found. Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:09.861266 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f463560-164a-4e90-b3b5-bb160bd808ab could not be found. Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3d14e7a-e31e-47aa-b7fa-47d5b67d3c8f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 8f463560-164a-4e90-b3b5-bb160bd808ab could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3d14e7a-e31e-47aa-b7fa-47d5b67d3c8f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/8f463560-164a-4e90-b3b5-bb160bd808ab/action" status: 404 len: 111 microversion: 2.1 time: 0.042659 Jun 16 18:42:09.868120 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1419/2753] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:09 2022] POST /compute/v2.1/servers/8f463560-164a-4e90-b3b5-bb160bd808ab/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:09.890685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0cadeccd-10e0-4751-a7ac-d2501b3a61f7 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e144700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:10.344602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:10.356384 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1b0af4fd-74ce-4c1c-a81c-956a9fbc9ca2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1323 microversion: 2.1 time: 0.734999 Jun 16 18:42:10.361315 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1335/2754] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:09 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1323 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:10.370878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:10.388439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:10.390154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:10.402249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.404609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.405723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.406267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.421652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=20 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:10.474262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:10.554062 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a26944e7-8f95-41da-8c0a-b40c2b767e9b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.184820 Jun 16 18:42:10.554062 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1336/2755] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Jun 16 18:42:10 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:10.563273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:10.563900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:10.573665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.574578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.575769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.576405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.601377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0cadeccd-10e0-4751-a7ac-d2501b3a61f7 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/da57ea60-12fd-4d91-80c5-1d23d68f1357" status: 202 len: 0 microversion: 2.1 time: 0.732466 Jun 16 18:42:10.605781 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1420/2756] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:42:09 2022] DELETE /compute/v2.1/os-security-groups/da57ea60-12fd-4d91-80c5-1d23d68f1357 => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:10.611017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:10.611913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:10.627873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.629341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.633421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.634171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.015596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:11.030842 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7cf4052e-b227-4d40-af1a-dfb4cf1b08c7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.477241 Jun 16 18:42:11.033652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:11.042929 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-40da0309-9b5d-4699-b5f1-a1f28ca6ec19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.435436 Jun 16 18:42:11.045705 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1337/2757] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:10 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:11.052423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:11.054071 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1421/2758] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:10 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:11.058102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:11.063265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8bee4daa-6a66-45db-bdae-8e3846f8c079 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:11.069128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.069619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.070604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.071191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.074847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bee4daa-6a66-45db-bdae-8e3846f8c079 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.075850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bee4daa-6a66-45db-bdae-8e3846f8c079 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.080831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:11.123217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8bee4daa-6a66-45db-bdae-8e3846f8c079 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Going to try to start instance {{(pid=119206) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:42:11.220999 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8bee4daa-6a66-45db-bdae-8e3846f8c079 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "POST /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.165354 Jun 16 18:42:11.226833 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1422/2759] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:11 2022] POST /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:11.233365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4b157cd3-268a-4a6a-8f34-018d637fa134 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e2d7310>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:11.387755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:11.402748 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5c4e18b7-4165-4d78-81b7-b478d91d5282 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1293 microversion: 2.1 time: 0.355110 Jun 16 18:42:11.406195 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1338/2760] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:11 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1293 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:11.412335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:11.418252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:11.446791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.447459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.448406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.448970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.566548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:11.589237 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7f3da7cc-73c3-42e1-9b16-dc82fb0632d0 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1268 microversion: 2.1 time: 0.181397 Jun 16 18:42:11.590366 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1339/2761] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:11 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:11.596219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:11.600092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:11.607484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.607952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.608851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.609232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.894739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:11.915596 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4b157cd3-268a-4a6a-8f34-018d637fa134 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/01f334b9-f66e-4065-b363-41c44a3089a8" status: 202 len: 0 microversion: 2.1 time: 0.687068 Jun 16 18:42:11.916419 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1423/2762] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:42:11 2022] DELETE /compute/v2.1/os-security-groups/01f334b9-f66e-4065-b363-41c44a3089a8 => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:11.921550 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-84498f19-87bd-4a11-819b-896c08762cdd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.329925 Jun 16 18:42:11.922621 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1340/2763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:11 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:11.923955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:11.924723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:11.939765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.940221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.941577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.945808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:11.947565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:11.948173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.961755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.962611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.963567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.964197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:12.388461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:12.408660 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-154d90f5-9a3c-463c-aaa5-4a558554317f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1323 microversion: 2.1 time: 0.473326 Jun 16 18:42:12.410065 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1341/2764] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:11 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:12.415303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-25abe42e-86bf-4b56-9819-baf86913ee26 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e950040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:12.478983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:12.489244 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-93053a22-202e-43f4-98d9-fc0dab2a3062 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1508 microversion: 2.1 time: 0.570611 Jun 16 18:42:12.494312 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1424/2765] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:11 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:12.499835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0ea5dce-6929-48f1-857c-122f7fd49c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:12.500821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0ea5dce-6929-48f1-857c-122f7fd49c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 1d7dc476-136f-42be-abb3-2f778f5ba364] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:12.508904 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f0ea5dce-6929-48f1-857c-122f7fd49c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 1d7dc476-136f-42be-abb3-2f778f5ba364 could not be found. Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0ea5dce-6929-48f1-857c-122f7fd49c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/1d7dc476-136f-42be-abb3-2f778f5ba364 HTTP/1.1 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 1d7dc476-136f-42be-abb3-2f778f5ba364 could not be found. Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '1d7dc476-136f-42be-abb3-2f778f5ba364'} Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7dc476-136f-42be-abb3-2f778f5ba364 could not be found. Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7dc476-136f-42be-abb3-2f778f5ba364 could not be found. Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:12.510967 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:12.514889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:12.514889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:12.514889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:12.514889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7dc476-136f-42be-abb3-2f778f5ba364 could not be found. Jun 16 18:42:12.514889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:12.519103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0ea5dce-6929-48f1-857c-122f7fd49c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 1d7dc476-136f-42be-abb3-2f778f5ba364 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:12.520973 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0ea5dce-6929-48f1-857c-122f7fd49c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/1d7dc476-136f-42be-abb3-2f778f5ba364" status: 404 len: 111 microversion: 2.1 time: 0.024950 Jun 16 18:42:12.522229 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1425/2766] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:12 2022] GET /compute/v2.1/servers/1d7dc476-136f-42be-abb3-2f778f5ba364 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:12.528163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:12.529056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:12.538138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:12.538956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:12.540047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:12.540736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:12.904984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:12.919528 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a72f263f-23ca-47dc-b985-28773641cda1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.395868 Jun 16 18:42:12.935445 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1426/2767] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:12 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:12.947142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:12.948206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:12.956097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:12.957929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:12.959083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:12.960000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.133375 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-25abe42e-86bf-4b56-9819-baf86913ee26 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/38d879ba-fcda-42f2-b4d4-288bd7163b1f" status: 202 len: 0 microversion: 2.1 time: 0.719846 Jun 16 18:42:13.134873 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1342/2768] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:42:12 2022] DELETE /compute/v2.1/os-security-groups/38d879ba-fcda-42f2-b4d4-288bd7163b1f => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:13.145940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:13.146851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:13.160741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.162036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.163264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.163909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.311144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:13.329014 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ebca5b69-3e83-448a-ad22-5fc3e5f6f230 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1483 microversion: 2.1 time: 0.391470 Jun 16 18:42:13.330423 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1427/2769] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:12 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1483 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:13.340882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:13.341605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:13.349891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.350701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.351715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.352330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.472999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:13.489800 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d586713-9eb8-4cc8-8a51-965e02319a84 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1274 microversion: 2.1 time: 0.156606 Jun 16 18:42:13.490620 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1428/2770] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:13 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:13.498199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:13.508100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9120288a-664e-4e81-828e-123c2e298eff tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e1514c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:13.511711 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ef0bdc25-9c28-415b-b5d3-5b8909eee8fc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.374962 Jun 16 18:42:13.524378 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1343/2771] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:13 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:13.529455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:13.538650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-68d45f6b-da91-41e1-8912-7a8bdba44865 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:13.539424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-68d45f6b-da91-41e1-8912-7a8bdba44865 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:13.547080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68d45f6b-da91-41e1-8912-7a8bdba44865 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.547561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68d45f6b-da91-41e1-8912-7a8bdba44865 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.548542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68d45f6b-da91-41e1-8912-7a8bdba44865 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.548990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68d45f6b-da91-41e1-8912-7a8bdba44865 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.711726 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-68d45f6b-da91-41e1-8912-7a8bdba44865 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184160 Jun 16 18:42:13.715555 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1344/2772] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:42:13 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:13.729565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:13.730554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:13.740141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.740806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.741848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:13.742515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:13.787523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:14.458735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:14.500062 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1d2ca870-f7d5-4736-9c8a-b28cbc2264a2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1323 microversion: 2.1 time: 0.774017 Jun 16 18:42:14.506482 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1345/2773] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:13 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1323 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:14.528965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:14.531415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:14.566842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:14.567508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:14.591971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:14.592789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:14.643518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9120288a-664e-4e81-828e-123c2e298eff tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/41ba0b49-f26d-4e8c-8e04-5fdde7053a77" status: 202 len: 0 microversion: 2.1 time: 1.150347 Jun 16 18:42:14.645604 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1429/2774] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:42:13 2022] DELETE /compute/v2.1/os-security-groups/41ba0b49-f26d-4e8c-8e04-5fdde7053a77 => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:14.651413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:14.652945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:14.669793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:14.670517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:14.671642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:14.672141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.029662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:16.040320 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-622fdde7-ef44-473d-9b44-223bb3214129 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1512 microversion: 2.1 time: 1.532130 Jun 16 18:42:16.058281 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1346/2775] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:14 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1512 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:16.058281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:16.060745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:16.066340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:16.079780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c05480d8-aa8e-414b-95cc-84924e758704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.432754 Jun 16 18:42:16.080967 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1430/2776] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:14 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:16.081862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.082362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.086572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:16.092288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.092857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.093654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:16.105856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.107128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.108121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.109016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.593474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:16.603355 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9ba491a4-7b36-438f-9c48-60c693c6f4b5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1316 microversion: 2.1 time: 0.520916 Jun 16 18:42:16.604677 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1431/2777] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:16 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:16.613420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb95fd3c-3bcf-4880-8729-65500b20c7e9 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] Calling method '.version_select at 0x7f866e178c10>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:16.709987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:16.744774 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d2d2a56d-33af-41f7-9727-eb6071668d4c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.690469 Jun 16 18:42:16.749853 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1347/2778] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:16 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:16.763131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:16.764021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:16.773154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.773154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.773154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.775124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.099060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:17.115291 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-adae6a62-cd2e-4acb-b410-3596fae5851b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1323 microversion: 2.1 time: 0.361540 Jun 16 18:42:17.126576 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1348/2779] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:16 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1323 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:17.133177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1d63e7a8-9543-4c13-8725-3c179f43a069 req-36e24c2e-0414-47e8-a5e0-8505863b0095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc", "tag": "7ebb7f51-5959-443e-b794-15f9278558ca"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:17.144362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1d63e7a8-9543-4c13-8725-3c179f43a069 req-36e24c2e-0414-47e8-a5e0-8505863b0095 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.145112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1d63e7a8-9543-4c13-8725-3c179f43a069 req-36e24c2e-0414-47e8-a5e0-8505863b0095 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.161206 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1d63e7a8-9543-4c13-8725-3c179f43a069 req-36e24c2e-0414-47e8-a5e0-8505863b0095 service nova] Creating event network-changed:7ebb7f51-5959-443e-b794-15f9278558ca for instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc on n-h2-846209-2 Jun 16 18:42:17.168149 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1d63e7a8-9543-4c13-8725-3c179f43a069 req-36e24c2e-0414-47e8-a5e0-8505863b0095 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039859 Jun 16 18:42:17.169392 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1349/2780] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:17.179581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:17.186843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:17.187843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.servers [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Removing options 'limit' from query {{(pid=119207) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 16 18:42:17.188814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:17.190295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.191960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.193028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.193628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.195355 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28db045a-0023-4b70-ad45-40752b359d8f tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.024402 Jun 16 18:42:17.196725 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1350/2781] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jun 16 18:42:17 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:42:17.202360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-93a762ba-ee4a-49f9-8db5-87415c446d2d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1537263243", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-93a762ba-ee4a-49f9-8db5-87415c446d2d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 238 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1537263243", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1537263243', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:42:17.205799 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 16 18:42:17.211150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:17.213534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-93a762ba-ee4a-49f9-8db5-87415c446d2d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:17.214657 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-93a762ba-ee4a-49f9-8db5-87415c446d2d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016510 Jun 16 18:42:17.215645 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1351/2782] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:42:17.225055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:17.226171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:17.236124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.237772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.239461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.240162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.310176 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cb95fd3c-3bcf-4880-8729-65500b20c7e9 tempest-SecurityGroupRulesTestJSON-504869153 tempest-SecurityGroupRulesTestJSON-504869153-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/176b5b28-da2c-4c12-a5fc-df419d5f4a3d" status: 202 len: 0 microversion: 2.1 time: 0.703953 Jun 16 18:42:17.311136 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1432/2783] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:42:16 2022] DELETE /compute/v2.1/os-security-groups/176b5b28-da2c-4c12-a5fc-df419d5f4a3d => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:17.317003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:17.317881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:17.337051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.337518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.340396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.342517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.669680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:17.678306 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd42060f-974d-4ab4-8fbe-5bb71cc283fd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1512 microversion: 2.1 time: 0.461268 Jun 16 18:42:17.678898 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1352/2784] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:17 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:17.698977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:17.699616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:17.710993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:17.728106 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-80f6ed04-8ad7-4ee9-b0e7-9ff56a1cc058 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.410125 Jun 16 18:42:17.741968 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1433/2785] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:17 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:17.743247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.744087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.747782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.748241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8fcefb8e-a3eb-4e31-8231-362317371b78 req-297006b5-1412-4898-a6d0-44973753c6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45f8f8b-681a-4973-bcf1-4d2891f69bbb", "tag": "4794262c-b785-47f9-9f46-3dd28dcd4497"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:17.749404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.779008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8fcefb8e-a3eb-4e31-8231-362317371b78 req-297006b5-1412-4898-a6d0-44973753c6f2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.779667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8fcefb8e-a3eb-4e31-8231-362317371b78 req-297006b5-1412-4898-a6d0-44973753c6f2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.795353 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8fcefb8e-a3eb-4e31-8231-362317371b78 req-297006b5-1412-4898-a6d0-44973753c6f2 service nova] Creating event network-changed:4794262c-b785-47f9-9f46-3dd28dcd4497 for instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb on n-h2-846209-2 Jun 16 18:42:17.801687 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8fcefb8e-a3eb-4e31-8231-362317371b78 req-297006b5-1412-4898-a6d0-44973753c6f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057837 Jun 16 18:42:17.806923 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1434/2786] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:17.814386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:17.815494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:17.824272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.824917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.826049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.826640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.996599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:18.119931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:18.134606 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8c8089eb-e3db-409a-bb58-aa0015e37a39 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1483 microversion: 2.1 time: 0.454560 Jun 16 18:42:18.137365 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1353/2787] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:17 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1483 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:18.146140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:18.147222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:18.163724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.166716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.169604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.172963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.224231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:18.251209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c729c25-5c93-41a6-aec4-f70cee1ac722 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1316 microversion: 2.1 time: 0.441399 Jun 16 18:42:18.255422 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1435/2788] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:17 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:18.282540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:18.287100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:18.301740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.302223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.307196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.307643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.572278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:18.588758 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94941764-d3be-4447-857e-77c23e3414e3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1511 microversion: 2.1 time: 0.449602 Jun 16 18:42:18.596090 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1354/2789] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:18 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1511 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:18.604536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:18.605478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:18.634119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.636230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.637482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.638203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.664982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:18.671108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:18.673451 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb20b96e-5477-4abe-8325-6a31633a6514 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.416673 Jun 16 18:42:18.674871 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1436/2790] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:18 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:18.679607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:18.680228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:18.698535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.699032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.699800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.700250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.854686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:18.864545 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ffde7b1a-ed52-48e3-b235-3a4746eec4da tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.266275 Jun 16 18:42:18.865410 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1355/2791] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:18 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:18.880275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:18.881205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:18.888081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.889051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.890040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:18.890642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.094719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:19.110499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf5b68c0-04f8-43fb-bc0d-fae826f1bab3 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1323 microversion: 2.1 time: 0.434397 Jun 16 18:42:19.112069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1437/2792] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:18 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:19.119073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-63ff1dfb-b53c-4365-b669-6b00e1f5a4d1 req-29048c59-ff9b-4a2b-96a2-0d06c3fe2000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c200947-b0a2-4c31-94c7-35186b881d08", "name": "network-vif-plugged", "status": "completed", "tag": "6407cf64-ee37-44f6-b1c4-145da9892974"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:19.133009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-63ff1dfb-b53c-4365-b669-6b00e1f5a4d1 req-29048c59-ff9b-4a2b-96a2-0d06c3fe2000 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.133717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-63ff1dfb-b53c-4365-b669-6b00e1f5a4d1 req-29048c59-ff9b-4a2b-96a2-0d06c3fe2000 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.150727 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-63ff1dfb-b53c-4365-b669-6b00e1f5a4d1 req-29048c59-ff9b-4a2b-96a2-0d06c3fe2000 service nova] Creating event network-vif-plugged:6407cf64-ee37-44f6-b1c4-145da9892974 for instance 5c200947-b0a2-4c31-94c7-35186b881d08 on n-h2-846209-2 Jun 16 18:42:19.162020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-63ff1dfb-b53c-4365-b669-6b00e1f5a4d1 req-29048c59-ff9b-4a2b-96a2-0d06c3fe2000 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047827 Jun 16 18:42:19.169999 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1438/2793] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:19.182369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72d432d1-0c07-43dd-8805-4c45265e768a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627520189", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:19.184625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72d432d1-0c07-43dd-8805-4c45265e768a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 234 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627520189", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-627520189', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = func(instance) Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'notvalid' Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:19.195563 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72d432d1-0c07-43dd-8805-4c45265e768a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:19.201630 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72d432d1-0c07-43dd-8805-4c45265e768a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026625 Jun 16 18:42:19.204990 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1439/2794] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:19 2022] POST /compute/v2.1/servers => generated 133 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:42:19.212395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:19.213141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:19.219309 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-128dc8cd-2bfc-4bee-92df-ec6827f30818 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1512 microversion: 2.1 time: 0.338077 Jun 16 18:42:19.220505 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1356/2795] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:18 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:19.228250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.229670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.230957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.231572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.237553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:19.244107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:19.244824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:19.725060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.726538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.727247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.727696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.840631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:19.855945 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6238bc8d-331a-43ed-9de5-8756fd7d5446 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.647604 Jun 16 18:42:19.858912 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1440/2796] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:19 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:42:19.897355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:19.898404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:19.921213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.922058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.925170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.929981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.962362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:20.090195 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7937dcbc-bf42-411d-b40e-b17ca89a01eb tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 345 microversion: 2.1 time: 0.856276 Jun 16 18:42:20.099576 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1357/2797] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:42:19 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 345 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:20.106095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:20.106931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:20.123834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.124577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.125546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.126504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.306937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:20.317296 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a89059b7-d977-46d2-9e73-9b28b66245e5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1316 microversion: 2.1 time: 0.456886 Jun 16 18:42:20.327433 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1441/2798] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:19 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:20.336479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:20.339949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:20.359227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.360141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.361080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.361672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.470750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:20.488482 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-193d9ecf-8455-4ded-8a9c-15a83dc832e4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.387231 Jun 16 18:42:20.493285 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1358/2799] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:20 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:20.498909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:20.505786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:20.522461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.523177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.524540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.524990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.778513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:20.788970 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d90e969-151e-44da-9895-1ac7f0170e08 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.460067 Jun 16 18:42:20.790059 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1442/2800] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:20 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:20.794953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:20.801795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:20.814280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.818838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.819813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.820367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.939978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:20.953317 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2b45425a-55a1-4fef-8f4a-0e4c07b538b7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1512 microversion: 2.1 time: 0.458259 Jun 16 18:42:20.963709 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1359/2801] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:20 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:20.973521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0be6891b-6045-471c-b9e8-2a7813e5b13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:20.977966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0be6891b-6045-471c-b9e8-2a7813e5b13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 2ac08ad9-4780-40da-b247-40ec05f2503a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:20.985721 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-0be6891b-6045-471c-b9e8-2a7813e5b13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 2ac08ad9-4780-40da-b247-40ec05f2503a could not be found. Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0be6891b-6045-471c-b9e8-2a7813e5b13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/2ac08ad9-4780-40da-b247-40ec05f2503a/action HTTP/1.1 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 13 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: {"pause": {}} Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 2ac08ad9-4780-40da-b247-40ec05f2503a could not be found. Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2ac08ad9-4780-40da-b247-40ec05f2503a', 'body': {'pause': {}}} Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac08ad9-4780-40da-b247-40ec05f2503a could not be found. Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac08ad9-4780-40da-b247-40ec05f2503a could not be found. Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:20.993383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:21.001150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:21.001150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:21.001150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac08ad9-4780-40da-b247-40ec05f2503a could not be found. Jun 16 18:42:21.001150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:21.004082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0be6891b-6045-471c-b9e8-2a7813e5b13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 2ac08ad9-4780-40da-b247-40ec05f2503a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:21.005653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0be6891b-6045-471c-b9e8-2a7813e5b13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/2ac08ad9-4780-40da-b247-40ec05f2503a/action" status: 404 len: 111 microversion: 2.1 time: 0.040421 Jun 16 18:42:21.006874 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1360/2802] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:20 2022] POST /compute/v2.1/servers/2ac08ad9-4780-40da-b247-40ec05f2503a/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:21.015876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:21.017969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:21.028307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.029241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.030420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.031096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.069014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:21.080667 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4b976c08-172b-46f0-a4be-810c6d5e1651 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1323 microversion: 2.1 time: 0.289299 Jun 16 18:42:21.081267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1443/2803] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:20 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:21.106425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:21.124683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:21.137456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.138500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.139558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.141021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.182114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:21.387021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:21.409425 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87368b75-67e8-404c-9919-6a5af4c083bd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1511 microversion: 2.1 time: 0.400453 Jun 16 18:42:21.410440 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1361/2804] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:21 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:21.425976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:21.429426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:21.431442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:21.443501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.444183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.445322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.445571 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46ec1d63-e5e5-48df-b20d-60aac1dbdcbc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.350023 Jun 16 18:42:21.448049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.448194 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1444/2805] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:21 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:21.454676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:21.455337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:21.464929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.465455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.466473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.467284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.745577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:21.750931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:21.758251 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-baef44af-67a1-42e2-9e39-3833e38b0a73 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1512 microversion: 2.1 time: 0.308924 Jun 16 18:42:21.759333 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1445/2806] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:21 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:21.768710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:21.773581 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b7392331-3eb6-4936-b791-5da8e55a0bfe tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1316 microversion: 2.1 time: 0.358839 Jun 16 18:42:21.774090 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1362/2807] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:21 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:21.774896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:21.789384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.789930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.790773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.791246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.799971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-82362d62-f851-4391-816e-912b676ac2e0 req-e2410774-1797-46d4-b885-4f35b24cc981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc", "name": "network-vif-plugged", "status": "completed", "tag": "7ebb7f51-5959-443e-b794-15f9278558ca"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:21.809194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-82362d62-f851-4391-816e-912b676ac2e0 req-e2410774-1797-46d4-b885-4f35b24cc981 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.810224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-82362d62-f851-4391-816e-912b676ac2e0 req-e2410774-1797-46d4-b885-4f35b24cc981 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.828300 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-82362d62-f851-4391-816e-912b676ac2e0 req-e2410774-1797-46d4-b885-4f35b24cc981 service nova] Creating event network-vif-plugged:7ebb7f51-5959-443e-b794-15f9278558ca for instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc on n-h2-846209-2 Jun 16 18:42:21.835155 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-82362d62-f851-4391-816e-912b676ac2e0 req-e2410774-1797-46d4-b885-4f35b24cc981 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051211 Jun 16 18:42:21.836562 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1363/2808] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:21.844390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:21.877439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:21.878962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:21.887450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.890433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.893666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.895291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.945476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:22.005435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:22.011141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:22.014341 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6993caba-b9bd-427e-b7b4-f9ba8cdf0de5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.253706 Jun 16 18:42:22.018684 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1446/2809] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:21 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:22.027022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.028182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.030738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:22.031369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:22.038960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.039418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.040188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.040619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.339855 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-795710aa-92b3-4585-bab4-9a14aa4f7421 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.501624 Jun 16 18:42:22.340691 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1364/2810] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:42:21 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:22.364103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8de5f6d6-176b-433c-809f-d80d47ffdc06 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:22.370012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:22.373413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8de5f6d6-176b-433c-809f-d80d47ffdc06 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:22.377209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ddf3317-808a-49e3-a6da-15fbe6fc9118 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.357138 Jun 16 18:42:22.385346 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1447/2811] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:22 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:22.385346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:22.385346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:22.390400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.390857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.391628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.392064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.393467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8de5f6d6-176b-433c-809f-d80d47ffdc06 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.395359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8de5f6d6-176b-433c-809f-d80d47ffdc06 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.399173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8de5f6d6-176b-433c-809f-d80d47ffdc06 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.399855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8de5f6d6-176b-433c-809f-d80d47ffdc06 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.527835 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8de5f6d6-176b-433c-809f-d80d47ffdc06 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.182367 Jun 16 18:42:22.530015 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1365/2812] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:22 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:22.537817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:22.542329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:22.543661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:22.641107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.641559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.642691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.642836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.687837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:22.692285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:22.701861 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab8bcb9a-4b2c-420f-8dcd-a4f0c80de95b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1518 microversion: 2.1 time: 0.320518 Jun 16 18:42:22.703685 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1448/2813] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:22 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1518 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:22.711338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:22.712380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:22.738564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.740335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.743275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.744459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.764785 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03becc19-6227-4c21-82d7-6e246c136a3b tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.233194 Jun 16 18:42:22.774485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1366/2814] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Jun 16 18:42:22 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:22.783179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:22.787982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:22.796685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.797292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.799575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.800184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.831761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lazy-loading 'flavor' on Instance uuid 5c200947-b0a2-4c31-94c7-35186b881d08 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:42:22.945968 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1eea1b91-7f6b-4e32-aa84-cae078e30418 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action" status: 200 len: 32 microversion: 2.1 time: 0.169842 Jun 16 18:42:22.946881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1367/2815] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:22 2022] POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:42:22.960523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:22.968331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:22.969631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:22.977932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.979529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.981402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.982513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.054775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:23.069294 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e3b093cf-fb2d-4445-aab8-84fd7aa56893 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1512 microversion: 2.1 time: 0.364256 Jun 16 18:42:23.070996 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1449/2816] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:22 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:23.091067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:23.092066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:23.101858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.102607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.103626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.104323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.139808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:23.234789 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8b7b24cd-fe94-46fb-9678-2eb04c328db6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.281794 Jun 16 18:42:23.235455 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1368/2817] 10.222.0.27 () {58 vars in 1211 bytes} [Thu Jun 16 18:42:22 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:23.250236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:23.251009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:23.263696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.269406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.269406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.269406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.278415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:23.749749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:23.755648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:23.772614 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-070cdc84-55dd-4ef8-ac78-d18633e1babc tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1316 microversion: 2.1 time: 0.700282 Jun 16 18:42:23.774310 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1450/2818] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:23 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1316 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:23.781279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:23.785599 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e85688e9-069b-4e20-b8b0-aaddb02743d1 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.549002 Jun 16 18:42:23.786929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:23.787959 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1369/2819] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:23 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:23.788548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:23.797309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.798542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.800203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.801320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.803155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:23.806843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:23.827284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.827735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.828520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:23.828958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.953328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:24.020008 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1f679cb-6f72-4379-94db-e4671b4fbc8d tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.243490 Jun 16 18:42:24.023307 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1451/2820] 10.222.0.27 () {58 vars in 1195 bytes} [Thu Jun 16 18:42:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:24.033397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:24.038253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:24.039311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'name': '1699159416', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:24.045184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.046078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.047108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.047739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.162793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:24.246580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:24.260792 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28938a06-e942-4ae5-bff7-70aa28deb7cb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1514 microversion: 2.1 time: 0.471674 Jun 16 18:42:24.272082 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1370/2821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:23 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1514 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:24.275936 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-954a75be-5d21-428e-a183-4e9250617b13 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?name=1699159416" status: 200 len: 346 microversion: 2.1 time: 0.246553 Jun 16 18:42:24.277013 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1452/2822] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Jun 16 18:42:24 2022] GET /compute/v2.1/servers?name=1699159416 => generated 346 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:24.278950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:24.279792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:24.289387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.290125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.291096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.291741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.299567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:24.304661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:24.305636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:24.313468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.314210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.316650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.317589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.582284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:24.592959 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aba95374-4c9d-4143-b617-e2266421682c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1492 microversion: 2.1 time: 0.319370 Jun 16 18:42:24.608602 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1371/2823] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:24 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1492 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:24.638014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:24.641865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:24.653930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.655577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.656733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.657628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.692444 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Cannot 'pause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state paused Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action HTTP/1.1 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 13 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: {"pause": {}} Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: exception: Cannot 'pause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state paused Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'pause': {}}} Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e57881-9458-4864-a6d8-79555341a48e in vm_state paused. Cannot pause while the instance is in this state. Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state paused Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:24.694195 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:24.700838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:24.700838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:24.700838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:24.700838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state paused Jun 16 18:42:24.700838 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:24.700838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 409 to user: Cannot 'pause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state paused {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:24.700838 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-275c99de-8d2f-48e3-b4c3-6425c80a0753 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 409 len: 143 microversion: 2.1 time: 0.082984 Jun 16 18:42:24.703973 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1372/2824] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:24 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 143 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:42:24.712602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a5788ac7-2f51-40c8-99d9-746b6cd7dfb1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:24.713155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a5788ac7-2f51-40c8-99d9-746b6cd7dfb1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:24.739509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5788ac7-2f51-40c8-99d9-746b6cd7dfb1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.742049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5788ac7-2f51-40c8-99d9-746b6cd7dfb1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.744102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5788ac7-2f51-40c8-99d9-746b6cd7dfb1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.746681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5788ac7-2f51-40c8-99d9-746b6cd7dfb1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.756110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:24.852715 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aad6b42f-6341-4c75-97ca-abbae23c273c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.567804 Jun 16 18:42:24.853653 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1453/2825] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Jun 16 18:42:24 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:42:24.864834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:24.868247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:24.884012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.885016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.885939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.886380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.958877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a5788ac7-2f51-40c8-99d9-746b6cd7dfb1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.252066 Jun 16 18:42:24.963581 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1373/2826] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:24 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:24.984888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:24.986059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:24.999425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.000072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.000863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.001304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.341405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:25.350665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e9ea070f-60d8-4e57-b9d3-29ee98a5de48 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.385733 Jun 16 18:42:25.355294 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1374/2827] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:24 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:25.366875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:25.373638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:25.383502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:25.384325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-169915941', 'deleted': False, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:42:25.387142 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a76f91d-7613-4458-8174-699624dad0de tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1464 microversion: 2.1 time: 0.531554 Jun 16 18:42:25.388587 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1454/2828] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:24 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1464 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:25.407809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.408694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:25.408827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.410288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:25.410627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.410949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.418631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.419449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.420447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.421130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.694140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:25.707422 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-794face3-8e1a-4314-940f-bbde0e1bc259 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.303199 Jun 16 18:42:25.708373 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1455/2829] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:25 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:25.714556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:25.715939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:25.728491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.730042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.731915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.732594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.811383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:42:25.888550 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a31e7d55-a97c-4374-b0bf-b70cb7314e6a tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-169915941" status: 200 len: 346 microversion: 2.1 time: 0.531814 Jun 16 18:42:25.889193 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1375/2830] 10.222.0.27 () {58 vars in 1227 bytes} [Thu Jun 16 18:42:25 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-169915941 => generated 346 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:25.904823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c5cc695-8130-422f-8948-803adc70dd90 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:25.905708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c5cc695-8130-422f-8948-803adc70dd90 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:25.918876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5cc695-8130-422f-8948-803adc70dd90 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.919409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5cc695-8130-422f-8948-803adc70dd90 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.920578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5cc695-8130-422f-8948-803adc70dd90 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.921118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5cc695-8130-422f-8948-803adc70dd90 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.122433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:26.148715 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69ac3c45-226b-440d-8714-f4cd07daa8ca tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1520 microversion: 2.1 time: 0.437856 Jun 16 18:42:26.155955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1456/2831] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:25 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:26.162327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:26.162989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:26.169422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.170357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.171342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.172001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.184483 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c5cc695-8130-422f-8948-803adc70dd90 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1615 microversion: 2.1 time: 0.293910 Jun 16 18:42:26.186173 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1376/2832] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:25 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1615 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:26.192390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:26.192921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:26.199983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.200818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.202132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.202941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.255034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:42:26.426948 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e1411bcb-71a6-41a5-b117-7e4f3757dde9 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 204 len: 0 microversion: 2.1 time: 0.238461 Jun 16 18:42:26.432107 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1377/2833] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:42:26 2022] DELETE /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:42:26.435432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:26.436905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-265075378", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["42ff1dd7-0d48-479e-95f1-af7f8d2b2530"]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:26.453707 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6179260e-3d0b-4b40-921a-a499eb0ba994 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.296406 Jun 16 18:42:26.454235 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1457/2834] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:26 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:26.472387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:26.473034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:26.496517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.497104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.498021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.498443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.512168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:42:26.865628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:26.876030 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc7869e4-0655-4414-8634-15a5d85d9eb8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.408973 Jun 16 18:42:26.877187 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1458/2835] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:26 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:26.884554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:26.886282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:26.890411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:26.896119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.897568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.899684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.900762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.971037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:42:26.971961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:42:26.972583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:42:26.973048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:42:26.973600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:42:26.991148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.994403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.995298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.996006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.047421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:27.060363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:27.080892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:42:27.085270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:42:27.102743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:27.151532 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5473e3f-c3e9-41ce-a836-c184e137bb8a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720078 Jun 16 18:42:27.152817 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1378/2836] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:42:27.162652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:27.163995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.179287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.179936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.180753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.181203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.185409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:27.192101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:27.199734 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12da2b5a-980b-42eb-a708-9358861c8985 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1518 microversion: 2.1 time: 0.320997 Jun 16 18:42:27.200941 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1459/2837] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:26 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1518 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:27.206209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-884758ef-44f5-4e61-9c75-b4582a86c7eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:27.207428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-884758ef-44f5-4e61-9c75-b4582a86c7eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.215451 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204/action HTTP/1.1 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 28 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: {"reboot": {"type": "SOFT"}} Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '7fe57ae7-55c2-4e56-a339-23aa640c8204', 'body': {'reboot': {'type': 'SOFT'}}} Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:27.218145 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:27.224024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.226268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:27.227968 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3aaee6b-aadd-4b64-b17c-638faf3ee4ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204/action" status: 404 len: 111 microversion: 2.1 time: 0.073379 Jun 16 18:42:27.232205 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1379/2838] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:27 2022] POST /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:27.242664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:27.243376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.257899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.261423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.265607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.266298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.278843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-884758ef-44f5-4e61-9c75-b4582a86c7eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:27.294522 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-884758ef-44f5-4e61-9c75-b4582a86c7eb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1216 microversion: 2.1 time: 0.091968 Jun 16 18:42:27.296672 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1460/2839] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:27 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:27.304929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:27.307715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.317278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.330221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.333121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.338194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.575273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:27.579047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:27.588585 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c74a6e2-ac32-4321-a74a-e2a0e335608c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.290425 Jun 16 18:42:27.589403 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1461/2840] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:27 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:27.591086 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-427b2fc6-0946-44fb-be30-1e55cd25d0cc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1520 microversion: 2.1 time: 0.356932 Jun 16 18:42:27.592563 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1380/2841] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:27 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:27.612033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:27.612033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.617782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.618274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.619119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.619515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.829078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:27.839269 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34568ed0-f32b-4cfa-84a7-b3cb787fecb3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.232885 Jun 16 18:42:27.839916 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1462/2842] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:27 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:27.861087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4e68a21-8d92-48c2-ac44-bdd9d3d4d6f9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:27.861087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e4e68a21-8d92-48c2-ac44-bdd9d3d4d6f9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.866509 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e4e68a21-8d92-48c2-ac44-bdd9d3d4d6f9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf could not be found. Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4e68a21-8d92-48c2-ac44-bdd9d3d4d6f9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf/action HTTP/1.1 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 28 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: {"reboot": {"type": "SOFT"}} Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf could not be found. Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf', 'body': {'reboot': {'type': 'SOFT'}}} Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf could not be found. Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf could not be found. Jun 16 18:42:27.868138 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf could not be found. Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4e68a21-8d92-48c2-ac44-bdd9d3d4d6f9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:27.872589 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4e68a21-8d92-48c2-ac44-bdd9d3d4d6f9 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf/action" status: 404 len: 111 microversion: 2.1 time: 0.015905 Jun 16 18:42:27.879241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:27.879878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.883050 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1381/2843] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:27 2022] POST /compute/v2.1/servers/a9fb3b1e-9fb1-4d5e-b3f8-04e41fce3ebf/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:27.887557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.888256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.889266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.890489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.893329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:27.894810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.902620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.903195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.904059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.904951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.144130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:28.169561 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4fdbb83d-e8e6-4316-a936-6a4b0604058a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.279329 Jun 16 18:42:28.171758 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1382/2844] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:27 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:28.195894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:28.207209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7f7c4f7-f0b1-47d4-b415-1a46404ecad6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.331897 Jun 16 18:42:28.209752 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1463/2845] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:27 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:28.225298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:28.226662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:28.227856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:28.228647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:28.236300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.237464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.238752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.239362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.247137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.247603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.250712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.251175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.659304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:28.676300 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a63afedb-0414-4cbb-ace7-83fd740500e3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.453617 Jun 16 18:42:28.677123 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1464/2846] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:28 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:42:28.689033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:28.689873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:28.711826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.712352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.713243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.713715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.772155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:28.785725 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b286a059-5008-466a-8979-4f0aae3339cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1518 microversion: 2.1 time: 0.570889 Jun 16 18:42:28.798031 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1383/2847] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:28 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1518 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:28.809383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7d4dbfe6-9f75-43cc-9e4d-a08a3556a6a3 req-d43269a5-023c-4dd0-9be4-15e9cece13b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53623e30-af71-4962-8e71-267c0568a758", "name": "network-vif-plugged", "status": "completed", "tag": "3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:28.838700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7d4dbfe6-9f75-43cc-9e4d-a08a3556a6a3 req-d43269a5-023c-4dd0-9be4-15e9cece13b8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.845102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7d4dbfe6-9f75-43cc-9e4d-a08a3556a6a3 req-d43269a5-023c-4dd0-9be4-15e9cece13b8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.848835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:28.860481 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-29b68cd9-ebf8-4d24-86f5-151fa3d87334 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1286 microversion: 2.1 time: 0.182228 Jun 16 18:42:28.863297 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1465/2848] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:28 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1286 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:28.870588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:28.872150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:28.881317 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7d4dbfe6-9f75-43cc-9e4d-a08a3556a6a3 req-d43269a5-023c-4dd0-9be4-15e9cece13b8 service nova] Creating event network-vif-plugged:3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67 for instance 53623e30-af71-4962-8e71-267c0568a758 on n-h1-846209-2 Jun 16 18:42:28.882391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.883056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.884136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.885029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.899053 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7d4dbfe6-9f75-43cc-9e4d-a08a3556a6a3 req-d43269a5-023c-4dd0-9be4-15e9cece13b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098992 Jun 16 18:42:28.902587 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1384/2849] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:28.923782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:28.929117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:28.951727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.953590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.955079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.958439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:29.004649 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204/action HTTP/1.1 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 65 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '7fe57ae7-55c2-4e56-a339-23aa640c8204', 'body': {'rebuild': {'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72'}}} Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 16 18:42:29.011111 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:29.015390 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5cb3b097-2aa1-4182-abde-3205c8a7f870 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204/action" status: 404 len: 111 microversion: 2.1 time: 0.108248 Jun 16 18:42:29.016556 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1385/2850] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:28 2022] POST /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204/action => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:29.027778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:29.028427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:29.038995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:29.039466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:29.040283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:29.040968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:29.390643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:29.435151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3de00cc8-4c83-4e3d-a9ce-6c9caec36cdd tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1520 microversion: 2.1 time: 0.569430 Jun 16 18:42:29.439771 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1466/2851] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:28 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1520 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:29.473315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:29.478675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:29.479565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:29.481472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:29.507948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:29.508819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:29.509827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:29.510618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2466738e-38aa-479e-bc54-5d4ce019e33c tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.491596 Jun 16 18:42:29.512103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1386/2852] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:29 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:29.519900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:29.531002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:29.531657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:29.541158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:29.541684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:29.542947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:29.543771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:29.919972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:29.937131 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c0468d7-1000-4a76-9506-c267f7ba6fe0 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.495144 Jun 16 18:42:29.954703 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1467/2853] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:29 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:30.031344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:30.042419 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-54bfeba7-3de6-4de5-911b-8d86e9e6c464 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.516706 Jun 16 18:42:30.043373 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1387/2854] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:29 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:30.074710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:30.079625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:30.104371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.104891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.105753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.110009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.166195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.166586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.167114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lazy-loading 'fault' on Instance uuid 8444f566-46ac-448b-9633-cf3b6d16e2ba {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:42:30.255371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:30.265530 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c8827396-e735-4acd-818f-d5e736a57925 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 200 len: 1311 microversion: 2.1 time: 0.220662 Jun 16 18:42:30.273847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fad0cdcf-db31-4fb4-987d-471eb5ffdf77 req-2d86f2dd-3fb2-404c-8b6b-4e13de4014a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8444f566-46ac-448b-9633-cf3b6d16e2ba", "name": "network-vif-deleted", "tag": "7f0fd46b-ab80-4b84-af82-ce0d78416e93"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:30.279928 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1388/2855] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:30 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:30.293198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fad0cdcf-db31-4fb4-987d-471eb5ffdf77 req-2d86f2dd-3fb2-404c-8b6b-4e13de4014a9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.294205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:30.294908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fad0cdcf-db31-4fb4-987d-471eb5ffdf77 req-2d86f2dd-3fb2-404c-8b6b-4e13de4014a9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.295954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:30.309599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.310011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.318666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.319139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.325674 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fad0cdcf-db31-4fb4-987d-471eb5ffdf77 req-2d86f2dd-3fb2-404c-8b6b-4e13de4014a9 service nova] Creating event network-vif-deleted:7f0fd46b-ab80-4b84-af82-ce0d78416e93 for instance 8444f566-46ac-448b-9633-cf3b6d16e2ba on n-h2-846209-2 Jun 16 18:42:30.339474 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fad0cdcf-db31-4fb4-987d-471eb5ffdf77 req-2d86f2dd-3fb2-404c-8b6b-4e13de4014a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382138 Jun 16 18:42:30.341385 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1468/2856] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:30.355358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8da09ee-841c-4682-bf9f-7dbd9d664e4d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:30.358218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f8da09ee-841c-4682-bf9f-7dbd9d664e4d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 5257ca9d-fd13-4141-88c9-5069cc3efd49] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:30.365828 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f8da09ee-841c-4682-bf9f-7dbd9d664e4d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 5257ca9d-fd13-4141-88c9-5069cc3efd49 could not be found. Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8da09ee-841c-4682-bf9f-7dbd9d664e4d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/5257ca9d-fd13-4141-88c9-5069cc3efd49/action HTTP/1.1 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 65 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5257ca9d-fd13-4141-88c9-5069cc3efd49 could not be found. Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5257ca9d-fd13-4141-88c9-5069cc3efd49', 'body': {'rebuild': {'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72'}}} Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5257ca9d-fd13-4141-88c9-5069cc3efd49 could not be found. Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 18:42:30.368182 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5257ca9d-fd13-4141-88c9-5069cc3efd49 could not be found. Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5257ca9d-fd13-4141-88c9-5069cc3efd49 could not be found. Jun 16 18:42:30.373646 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:30.376534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8da09ee-841c-4682-bf9f-7dbd9d664e4d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 5257ca9d-fd13-4141-88c9-5069cc3efd49 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:30.377526 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f8da09ee-841c-4682-bf9f-7dbd9d664e4d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/5257ca9d-fd13-4141-88c9-5069cc3efd49/action" status: 404 len: 111 microversion: 2.1 time: 0.033311 Jun 16 18:42:30.379788 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1469/2857] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:30 2022] POST /compute/v2.1/servers/5257ca9d-fd13-4141-88c9-5069cc3efd49/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:30.389390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:30.390507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:30.411765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.412617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.413844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.414540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.433007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:30.444202 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c2165a21-6c38-4a7d-af1e-77edd7059ad7 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1274 microversion: 2.1 time: 0.162154 Jun 16 18:42:30.445747 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1389/2858] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:30 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:30.471349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:30.474448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:30.486098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.486969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.488666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.489990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.969790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:31.001461 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0168ee19-3f88-4fe3-8ed3-2da4711097df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.615850 Jun 16 18:42:31.006292 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1470/2859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:30 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:31.052419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:31.058009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:31.080380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.093765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:31.095055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.095825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:31.513567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:31.538979 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e74d1727-22ae-4e78-9fc6-6af998668e9d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1520 microversion: 2.1 time: 1.082954 Jun 16 18:42:31.541124 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1390/2860] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:30 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1520 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:31.551310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:31.552204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:31.562460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.569657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:31.571489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.572118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:31.645417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:31.656935 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3b25fe1a-629d-4fd8-b36f-1eed778c0879 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.649290 Jun 16 18:42:31.658715 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1471/2861] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:31 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:31.668502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:31.669452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 8444f566-46ac-448b-9633-cf3b6d16e2ba] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:31.678009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.678748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:31.679566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.680215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:31.700255 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] HTTP exception thrown: Instance 8444f566-46ac-448b-9633-cf3b6d16e2ba could not be found. Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Request method failure captured: Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba HTTP/1.1 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k7NeFFeBAIfQjgogVr1T2yOrrT8yjxOACOHzIc1q4IFzFPsqS7q4zaGmZvujBlhqhlH20XhR56g0HxzsYoQW2O_mG1wCmyL_WeUcaxJJDS79E6mcltrXtdJ4OsKxYnunZMFjX-iTnX_0uoKnKS9axSEa-uF0oZlpkfLTGSuyGXinw Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: a366b490a0ec4a6ca8fc55bd8dbce3b1 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a366b490a0ec4a6ca8fc55bd8dbce3b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: a366b490a0ec4a6ca8fc55bd8dbce3b1 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ListServerFiltersTestJSON-1620490628-project Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: e80291e8e5bb461383eeadddfb70162c Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ListServerFiltersTestJSON-1620490628-project Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 8444f566-46ac-448b-9633-cf3b6d16e2ba could not be found. Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '8444f566-46ac-448b-9633-cf3b6d16e2ba'} Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8444f566-46ac-448b-9633-cf3b6d16e2ba could not be found. Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8444f566-46ac-448b-9633-cf3b6d16e2ba could not be found. Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:31.702188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:31.707878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:31.707878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:31.707878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:31.707878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:31.707878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:31.707878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8444f566-46ac-448b-9633-cf3b6d16e2ba could not be found. Jun 16 18:42:31.707878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:31.709877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Returning 404 to user: Instance 8444f566-46ac-448b-9633-cf3b6d16e2ba could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:31.711572 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eeb9d77c-f437-4534-90f0-521f044de9d2 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba" status: 404 len: 111 microversion: 2.1 time: 0.047378 Jun 16 18:42:31.712641 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1472/2862] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:31 2022] GET /compute/v2.1/servers/8444f566-46ac-448b-9633-cf3b6d16e2ba => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:31.748436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:31.750614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:31.766810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.772287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:31.773405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:31.775337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.239167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:32.251593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-650a6e1a-2298-4103-a08c-81669c44f366 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1316 microversion: 2.1 time: 0.537038 Jun 16 18:42:32.251856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:32.252179 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1473/2863] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:31 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:32.268369 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-731af89d-f16e-480a-a898-b82f7aac0704 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.725245 Jun 16 18:42:32.269098 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1391/2864] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:31 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:32.272826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:32.273631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:32.289682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6623eb45-1766-48c0-8db5-0114d6da21df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:32.290275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6623eb45-1766-48c0-8db5-0114d6da21df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 25fd31fd-6bac-4073-a5e0-48eb6c422387] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:32.290962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.293269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.298833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.301815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.311996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-6623eb45-1766-48c0-8db5-0114d6da21df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 25fd31fd-6bac-4073-a5e0-48eb6c422387 could not be found. Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6623eb45-1766-48c0-8db5-0114d6da21df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/25fd31fd-6bac-4073-a5e0-48eb6c422387/action HTTP/1.1 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 15 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: {"restore": {}} Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 25fd31fd-6bac-4073-a5e0-48eb6c422387 could not be found. Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '25fd31fd-6bac-4073-a5e0-48eb6c422387', 'body': {'restore': {}}} Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fd31fd-6bac-4073-a5e0-48eb6c422387 could not be found. Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fd31fd-6bac-4073-a5e0-48eb6c422387 could not be found. Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:32.314238 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:32.319104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:32.319104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:32.319104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fd31fd-6bac-4073-a5e0-48eb6c422387 could not be found. Jun 16 18:42:32.319104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:32.319104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6623eb45-1766-48c0-8db5-0114d6da21df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 25fd31fd-6bac-4073-a5e0-48eb6c422387 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:32.319104 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6623eb45-1766-48c0-8db5-0114d6da21df tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/25fd31fd-6bac-4073-a5e0-48eb6c422387/action" status: 404 len: 111 microversion: 2.1 time: 0.031039 Jun 16 18:42:32.319104 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1392/2865] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:32 2022] POST /compute/v2.1/servers/25fd31fd-6bac-4073-a5e0-48eb6c422387/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:42:32.336413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:32.337038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:32.357045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:42:32.358512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.358974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.361071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.361563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.575654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-86ecb7cf-6b61-476b-b256-5dec55bd0a10 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 204 len: 0 microversion: 2.1 time: 0.309829 Jun 16 18:42:32.576370 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1474/2866] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:42:32 2022] DELETE /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:42:32.590325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8c5a2917-872f-4db8-971b-d353848348e7 req-b3ef23d3-710d-4fd7-b61a-c9e37fa5892b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6540ae2d-e393-4b2f-9a87-675fd48a8f50", "tag": "875e6417-2ae8-43ad-9b38-915043cdda45"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:32.627369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8c5a2917-872f-4db8-971b-d353848348e7 req-b3ef23d3-710d-4fd7-b61a-c9e37fa5892b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.629616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8c5a2917-872f-4db8-971b-d353848348e7 req-b3ef23d3-710d-4fd7-b61a-c9e37fa5892b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.652961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8c5a2917-872f-4db8-971b-d353848348e7 req-b3ef23d3-710d-4fd7-b61a-c9e37fa5892b service nova] Creating event network-changed:875e6417-2ae8-43ad-9b38-915043cdda45 for instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 on n-h2-846209-2 Jun 16 18:42:32.662075 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8c5a2917-872f-4db8-971b-d353848348e7 req-b3ef23d3-710d-4fd7-b61a-c9e37fa5892b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082307 Jun 16 18:42:32.667750 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1475/2867] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:32.675360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:32.676426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:32.685610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.686477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.687833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.688496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.767197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:32.778779 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-09caf50e-5a92-434d-9c47-1b3557a4c4a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.445637 Jun 16 18:42:32.795358 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1393/2868] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:32 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:32.802690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:32.803733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:32.812524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.813674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.815555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:32.816363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:32.994254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:33.005210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87d79b89-0a59-48bf-92a2-457ac0c483f1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1505 microversion: 2.1 time: 0.335739 Jun 16 18:42:33.010023 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1476/2869] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:32 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:33.021861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:33.022889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:33.030055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.030521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:33.031303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.032107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:33.083270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:33.095196 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0fc4dc74-bf77-4af5-a378-253627e28648 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1517 microversion: 2.1 time: 0.298146 Jun 16 18:42:33.097502 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1394/2870] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:32 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:33.103686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:33.103957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:33.123921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.124653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:33.125756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.126386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:33.646076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:33.654189 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c95e169a-d955-4fbe-a1bc-1a064ceed6af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.639188 Jun 16 18:42:33.654870 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1477/2871] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:33 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:33.659637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:33.660209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:33.666900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.667363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:33.668151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.668596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:33.912224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:33.927659 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c6d30f5-fd13-4f41-a07c-132aa2b314dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.828847 Jun 16 18:42:33.928252 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1395/2872] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:33 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:33.943464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:33.944105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:33.952777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.953243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:33.954071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:33.954518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.107322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:34.111231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:34.120772 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-17d34bd4-a5aa-4929-ae2d-eeff41ae2d2a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 200 len: 1505 microversion: 2.1 time: 0.464848 Jun 16 18:42:34.124634 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1478/2873] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:33 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:34.140209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:34.141562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:34.170962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.171723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.172670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.173259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.208354 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Cannot 'restore' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action HTTP/1.1 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 15 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: {"restore": {}} Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'restore' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'restore': {}}} Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e57881-9458-4864-a6d8-79555341a48e in vm_state active. Cannot restore while the instance is in this state. Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:34.210631 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:34.214603 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:34.214603 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:34.214603 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:34.214603 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:34.214603 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:34.216932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 409 to user: Cannot 'restore' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:34.218100 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-839cb582-7691-4c39-95d3-76daf335f471 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 409 len: 145 microversion: 2.1 time: 0.092227 Jun 16 18:42:34.219199 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1479/2874] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:34 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 145 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:42:34.227262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:34.228219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:34.237042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.238507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.239733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.240389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.383907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:34.503440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:34.515823 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1dc3e466-a607-4255-9b3f-220c37b45701 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1316 microversion: 2.1 time: 0.586481 Jun 16 18:42:34.517046 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1396/2875] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:33 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:34.533711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:34.534371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:34.549699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.550379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.550985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.551444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.588746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:34.597554 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af2766c6-973f-4715-9661-f13aab510f6c tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1517 microversion: 2.1 time: 0.376443 Jun 16 18:42:34.598294 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1480/2876] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:34 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1517 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:34.611144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:34.611780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:34.634968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.635449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.636269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.636716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.637008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:42:34.837682 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-18865cd9-33e4-44c3-bf9f-62b09a52e966 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 204 len: 0 microversion: 2.1 time: 0.309955 Jun 16 18:42:34.838716 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1397/2877] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:42:34 2022] DELETE /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:42:34.846738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:34.864325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:34.879881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.880667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:34.882592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:34.883272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:35.094557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:35.104504 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0bcadf44-d653-4f36-8227-1f1870fd7884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.505131 Jun 16 18:42:35.105644 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1481/2878] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:34 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:35.118304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1584047488", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "7c1caade-5c76-4a19-b9c2-824bd691941b"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:35.185608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] validate_networks() for [('7c1caade-5c76-4a19-b9c2-824bd691941b', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:42:35.398041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:35.410436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-de4fe879-7602-4d9e-84c1-b923753f997a tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.570266 Jun 16 18:42:35.418057 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1398/2879] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:34 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:35.435453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:35.436426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:35.443938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:35.444384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:35.445291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:35.445736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:35.827294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:35.841377 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa963479-85dd-4073-825c-cc84bb1322d1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.422085 Jun 16 18:42:35.842794 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1399/2880] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:35 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:35.850729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b07e88d8-58b1-4bab-bf6a-811b6712cd26 req-464aff00-2ab2-444b-8b85-288febf3bb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecaece79-6b31-482a-afaf-6a709098c3b5", "name": "network-vif-deleted", "tag": "db2e03bc-423e-4a49-aff9-599b23364af0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:35.864121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b07e88d8-58b1-4bab-bf6a-811b6712cd26 req-464aff00-2ab2-444b-8b85-288febf3bb2f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:35.864590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b07e88d8-58b1-4bab-bf6a-811b6712cd26 req-464aff00-2ab2-444b-8b85-288febf3bb2f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:35.881138 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b07e88d8-58b1-4bab-bf6a-811b6712cd26 req-464aff00-2ab2-444b-8b85-288febf3bb2f service nova] Creating event network-vif-deleted:db2e03bc-423e-4a49-aff9-599b23364af0 for instance ecaece79-6b31-482a-afaf-6a709098c3b5 on n-h2-846209-2 Jun 16 18:42:35.888248 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b07e88d8-58b1-4bab-bf6a-811b6712cd26 req-464aff00-2ab2-444b-8b85-288febf3bb2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043774 Jun 16 18:42:35.888991 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1400/2881] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:35.895441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:35.896182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:35.903756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:35.904213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:35.905149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:35.905792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.153611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:42:36.154706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:42:36.155364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:42:36.155940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:42:36.156562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:42:36.171791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.177736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.179177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.179841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.227902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Getting quotas for project 0aff614b1a6b4ad2ba352038b276799a. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:36.243566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Getting quotas for user 530daa1c9c814248b477c53f871e29d1 and project 0aff614b1a6b4ad2ba352038b276799a. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:36.272394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:42:36.276796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:42:36.283494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:36.298407 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-25de6d36-3a79-4a70-b760-db364a095787 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1316 microversion: 2.1 time: 0.406399 Jun 16 18:42:36.303022 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1401/2882] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:35 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:36.326240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:36.328938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:36.355062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cdfc3bbb-a590-4e23-991e-3487bdf7543b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245123 Jun 16 18:42:36.356013 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1482/2883] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:42:36.364144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.364340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.365121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.370121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a633d37-1d40-4798-afb5-dce74b4a4f6e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:36.371483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a633d37-1d40-4798-afb5-dce74b4a4f6e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 759f7197-3cef-432a-b2fb-445eed63320d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:36.376104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.383933 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2a633d37-1d40-4798-afb5-dce74b4a4f6e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 759f7197-3cef-432a-b2fb-445eed63320d could not be found. Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a633d37-1d40-4798-afb5-dce74b4a4f6e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/759f7197-3cef-432a-b2fb-445eed63320d/action HTTP/1.1 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 14 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: {"resume": {}} Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 759f7197-3cef-432a-b2fb-445eed63320d could not be found. Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '759f7197-3cef-432a-b2fb-445eed63320d', 'body': {'resume': {}}} Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759f7197-3cef-432a-b2fb-445eed63320d could not be found. Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759f7197-3cef-432a-b2fb-445eed63320d could not be found. Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:36.393519 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:36.399088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:36.399088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:36.399088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759f7197-3cef-432a-b2fb-445eed63320d could not be found. Jun 16 18:42:36.399088 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:36.400809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a633d37-1d40-4798-afb5-dce74b4a4f6e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 759f7197-3cef-432a-b2fb-445eed63320d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:36.401896 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a633d37-1d40-4798-afb5-dce74b4a4f6e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/759f7197-3cef-432a-b2fb-445eed63320d/action" status: 404 len: 111 microversion: 2.1 time: 0.036698 Jun 16 18:42:36.405824 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1483/2884] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:36 2022] POST /compute/v2.1/servers/759f7197-3cef-432a-b2fb-445eed63320d/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:36.422153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0be8699-a9f7-432b-ae6a-3bfaa6d3a56f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:36.424796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0be8699-a9f7-432b-ae6a-3bfaa6d3a56f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:36.480852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.481447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.488387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lazy-loading 'fault' on Instance uuid ecaece79-6b31-482a-afaf-6a709098c3b5 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:42:36.588144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:36.592846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:36.603917 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afd54c7d-869a-409b-b2d9-b2584172d4cd tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 200 len: 1310 microversion: 2.1 time: 0.298007 Jun 16 18:42:36.603917 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1402/2885] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:36 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 1310 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:36.609894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:36.610820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:36.613406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f0be8699-a9f7-432b-ae6a-3bfaa6d3a56f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:36.627004 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0be8699-a9f7-432b-ae6a-3bfaa6d3a56f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1218 microversion: 2.1 time: 0.217526 Jun 16 18:42:36.628912 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1484/2886] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:36 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:36.635910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:36.637225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:36.643187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.643187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.643187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.643187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.662348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.664679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:36.667851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:36.669837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:37.022633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=13 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:37.072061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:37.635942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:37.645155 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bd328b06-d7d8-42b2-b3ca-f66d4b34f6d5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 1.014073 Jun 16 18:42:37.646258 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1485/2887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:36 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:37.660810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:37.662257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:37.670203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:37.671008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:37.672018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:37.672692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:37.735951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:37.756924 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3fc81fa6-9843-47d0-b995-aaf70cf4864e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.151786 Jun 16 18:42:37.760685 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1403/2888] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:36 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:37.766820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:37.767838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: ecaece79-6b31-482a-afaf-6a709098c3b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:37.798868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:37.799726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:37.803004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:37.804728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:37.857824 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] HTTP exception thrown: Instance ecaece79-6b31-482a-afaf-6a709098c3b5 could not be found. Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Request method failure captured: Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 HTTP/1.1 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k7NeFFeBAIfQjgogVr1T2yOrrT8yjxOACOHzIc1q4IFzFPsqS7q4zaGmZvujBlhqhlH20XhR56g0HxzsYoQW2O_mG1wCmyL_WeUcaxJJDS79E6mcltrXtdJ4OsKxYnunZMFjX-iTnX_0uoKnKS9axSEa-uF0oZlpkfLTGSuyGXinw Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: a366b490a0ec4a6ca8fc55bd8dbce3b1 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a366b490a0ec4a6ca8fc55bd8dbce3b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: a366b490a0ec4a6ca8fc55bd8dbce3b1 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ListServerFiltersTestJSON-1620490628-project Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: e80291e8e5bb461383eeadddfb70162c Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ListServerFiltersTestJSON-1620490628-project Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance ecaece79-6b31-482a-afaf-6a709098c3b5 could not be found. Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ecaece79-6b31-482a-afaf-6a709098c3b5'} Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecaece79-6b31-482a-afaf-6a709098c3b5 could not be found. Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecaece79-6b31-482a-afaf-6a709098c3b5 could not be found. Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:37.862899 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:37.867744 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:37.867744 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:37.867744 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:37.867744 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:37.867744 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:37.867744 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecaece79-6b31-482a-afaf-6a709098c3b5 could not be found. Jun 16 18:42:37.867744 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:37.871556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Returning 404 to user: Instance ecaece79-6b31-482a-afaf-6a709098c3b5 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:37.872522 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ba8b102-bc40-48ce-b429-70a035de59b6 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5" status: 404 len: 111 microversion: 2.1 time: 0.110507 Jun 16 18:42:37.881241 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1404/2889] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:37 2022] GET /compute/v2.1/servers/ecaece79-6b31-482a-afaf-6a709098c3b5 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:37.889403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:37.890150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:37.914341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:37.914820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:37.915660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:37.916141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.085182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:38.095954 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b8a21c9-b2c6-42bf-97f2-01ac137fbe44 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1278 microversion: 2.1 time: 0.213468 Jun 16 18:42:38.105790 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1405/2890] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:37 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:38.111587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:38.113298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:38.134096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.134893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.135969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.136598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.253572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:38.264997 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2990b9f3-5014-4c73-b3e9-e6cb2bf8e7a9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1316 microversion: 2.1 time: 0.608302 Jun 16 18:42:38.278531 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1486/2891] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:37 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:38.290245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:38.290796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:38.299775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.300906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.302063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.302855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.339672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:42:38.497209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c5d49d87-3f75-4aaf-ab66-2b21254fe536 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 204 len: 0 microversion: 2.1 time: 0.216889 Jun 16 18:42:38.501630 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1487/2892] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:42:38 2022] DELETE /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:42:38.508571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:38.509289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:38.520181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.521020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.522277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.522909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.850575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:38.870525 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff64c9a3-0d09-45e9-aed9-f8d10bff4e19 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.763126 Jun 16 18:42:38.872666 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1406/2893] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:38 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:38.881026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:38.881821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:38.897973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.898437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:38.899224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:38.899663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.200028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:39.221436 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2c2f5d2-e982-4d78-b925-b6fe51115caa tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1518 microversion: 2.1 time: 0.718265 Jun 16 18:42:39.224073 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1488/2894] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:38 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1518 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:39.229994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:39.230640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:39.238237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.238685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.239573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.240098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.272892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Cannot 'resume' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action HTTP/1.1 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 14 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: {"resume": {}} Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'resume' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'resume': {}}} Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e57881-9458-4864-a6d8-79555341a48e in vm_state active. Cannot resume while the instance is in this state. Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:39.275214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:39.279900 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:39.279900 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:39.279900 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:39.279900 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:42:39.279900 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:39.279900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 409 to user: Cannot 'resume' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:39.281445 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12e1b424-a1dc-47ce-a636-c50a44293702 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 409 len: 144 microversion: 2.1 time: 0.056169 Jun 16 18:42:39.285660 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1489/2895] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:39 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 144 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:42:39.364849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b031b877-bff3-4843-9a7f-cb333ba4b86d req-3aa1ec5b-9d11-480d-bc6b-80f0ca4fb16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53623e30-af71-4962-8e71-267c0568a758", "name": "network-vif-deleted", "tag": "3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:39.376911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b031b877-bff3-4843-9a7f-cb333ba4b86d req-3aa1ec5b-9d11-480d-bc6b-80f0ca4fb16b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.378535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b031b877-bff3-4843-9a7f-cb333ba4b86d req-3aa1ec5b-9d11-480d-bc6b-80f0ca4fb16b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.392684 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b031b877-bff3-4843-9a7f-cb333ba4b86d req-3aa1ec5b-9d11-480d-bc6b-80f0ca4fb16b service nova] Creating event network-vif-deleted:3c9f55c9-0ddf-4e0e-8d32-61653c6b8a67 for instance 53623e30-af71-4962-8e71-267c0568a758 on n-h1-846209-2 Jun 16 18:42:39.400448 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b031b877-bff3-4843-9a7f-cb333ba4b86d req-3aa1ec5b-9d11-480d-bc6b-80f0ca4fb16b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116594 Jun 16 18:42:39.401508 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1490/2896] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:39.408986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:39.409987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:39.418566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.419112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.419980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.420500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.587065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:39.604045 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-45ee9f31-2f1d-4398-8d21-8996f5f6e43a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1276 microversion: 2.1 time: 0.201040 Jun 16 18:42:39.605695 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1491/2897] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:39 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:39.611197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:39.612112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:39.618249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:39.629677 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28a2d373-d39e-4273-aaf2-f0fba6156cf4 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.755060 Jun 16 18:42:39.630304 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1407/2898] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:38 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:39.647070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:39.650009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.651150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:39.661325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.662625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.663699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.670256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.671131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:39.671974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:39.672424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:40.243299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:40.260398 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-118adfa2-8b48-46cd-8eb0-39505fe780da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1316 microversion: 2.1 time: 0.652973 Jun 16 18:42:40.261418 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1492/2899] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:39 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:40.274177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:40.275178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:40.290013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:40.290722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:40.291708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:40.292336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:40.317734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:40.344670 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d66ed7c4-4afe-4ea2-9a05-474f7f7f765d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.701032 Jun 16 18:42:40.361189 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1408/2900] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:39 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:40.428648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:40.429249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:40.466449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:40.467045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:40.467726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:40.468463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:41.073252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80291e8e5bb461383eeadddfb70162c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a366b490a0ec4a6ca8fc55bd8dbce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:41.089501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eeaf8ee5-3b93-44c9-9259-4e8a174eeaa7 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 200 len: 1518 microversion: 2.1 time: 0.826137 Jun 16 18:42:41.102423 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1493/2901] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:40 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 1518 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:41.107966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:41.108614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:41.121495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:41.127853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:41.128426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:41.138070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:41.138070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:41.437077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:41.449596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52d3eb6c-c47f-4c52-9d22-fe3e5d7ffaa4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.060301 Jun 16 18:42:41.451537 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1409/2902] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:40 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:41.471489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:41.473214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:41.489850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:41.490522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:41.491435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:41.493354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:41.966999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:41.980406 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7feafa64-2b59-4faf-b44f-de5ff645251a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.876565 Jun 16 18:42:41.981035 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1494/2903] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:41 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:42.018215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:42.032552 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-607666f8-708c-46dd-bcc4-b85cae5910c9 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.577129 Jun 16 18:42:42.044822 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1410/2904] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:41 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:42.064491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:42.066922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:42.093002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.094094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:42.095189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.095441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:42.128949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-19cc2ef0-bd86-4c85-a24c-2e0abcce8e4d req-e5e6db64-7e0d-4cc5-924b-75c1ffb6bd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6540ae2d-e393-4b2f-9a87-675fd48a8f50", "name": "network-vif-plugged", "status": "completed", "tag": "875e6417-2ae8-43ad-9b38-915043cdda45"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:42.149829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-19cc2ef0-bd86-4c85-a24c-2e0abcce8e4d req-e5e6db64-7e0d-4cc5-924b-75c1ffb6bd20 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.156111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-19cc2ef0-bd86-4c85-a24c-2e0abcce8e4d req-e5e6db64-7e0d-4cc5-924b-75c1ffb6bd20 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:42.190236 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-19cc2ef0-bd86-4c85-a24c-2e0abcce8e4d req-e5e6db64-7e0d-4cc5-924b-75c1ffb6bd20 service nova] Creating event network-vif-plugged:875e6417-2ae8-43ad-9b38-915043cdda45 for instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 on n-h2-846209-2 Jun 16 18:42:42.203586 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-19cc2ef0-bd86-4c85-a24c-2e0abcce8e4d req-e5e6db64-7e0d-4cc5-924b-75c1ffb6bd20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214865 Jun 16 18:42:42.207852 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1495/2905] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:42.224293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3ae39f90-b477-47f8-beea-f9cf8f7785e1 req-03a2c77b-8860-48ba-a983-e8a13c081a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40991995-c40c-4086-86d5-49b27ba49a3e", "name": "network-vif-deleted", "tag": "d96e6e9e-da6e-4888-8c9d-cc965d4dd092"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:42.242919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3ae39f90-b477-47f8-beea-f9cf8f7785e1 req-03a2c77b-8860-48ba-a983-e8a13c081a10 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.243373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3ae39f90-b477-47f8-beea-f9cf8f7785e1 req-03a2c77b-8860-48ba-a983-e8a13c081a10 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:42.273154 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3ae39f90-b477-47f8-beea-f9cf8f7785e1 req-03a2c77b-8860-48ba-a983-e8a13c081a10 service nova] Creating event network-vif-deleted:d96e6e9e-da6e-4888-8c9d-cc965d4dd092 for instance 40991995-c40c-4086-86d5-49b27ba49a3e on n-h2-846209-2 Jun 16 18:42:42.291009 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3ae39f90-b477-47f8-beea-f9cf8f7785e1 req-03a2c77b-8860-48ba-a983-e8a13c081a10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080847 Jun 16 18:42:42.293142 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1496/2906] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:42.307752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9bef449-b012-4390-918f-04bce75a189d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9bef449-b012-4390-918f-04bce75a189d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 160 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "99bd8b9b-a897-4204-886b-50b9270a6c81"}]}} Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'networks': [{'uuid': '99bd8b9b-a897-4204-886b-50b9270a6c81'}]}}} Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi '' Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:42:42.310345 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:42:42.315371 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.318362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9bef449-b012-4390-918f-04bce75a189d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:42.319427 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9bef449-b012-4390-918f-04bce75a189d tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021592 Jun 16 18:42:42.320517 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1497/2907] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:42 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:42:42.326161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:42.327145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] [instance: 40991995-c40c-4086-86d5-49b27ba49a3e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:42.335541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.336267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:42.337391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.338147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:42.374994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] HTTP exception thrown: Instance 40991995-c40c-4086-86d5-49b27ba49a3e could not be found. Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Request method failure captured: Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e HTTP/1.1 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3k7NeFFeBAIfQjgogVr1T2yOrrT8yjxOACOHzIc1q4IFzFPsqS7q4zaGmZvujBlhqhlH20XhR56g0HxzsYoQW2O_mG1wCmyL_WeUcaxJJDS79E6mcltrXtdJ4OsKxYnunZMFjX-iTnX_0uoKnKS9axSEa-uF0oZlpkfLTGSuyGXinw Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: a366b490a0ec4a6ca8fc55bd8dbce3b1 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a366b490a0ec4a6ca8fc55bd8dbce3b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a366b490a0ec4a6ca8fc55bd8dbce3b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: a366b490a0ec4a6ca8fc55bd8dbce3b1 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1620490628 Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ListServerFiltersTestJSON-1620490628-project Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: e80291e8e5bb461383eeadddfb70162c Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ListServerFiltersTestJSON-1620490628-project Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 40991995-c40c-4086-86d5-49b27ba49a3e could not be found. Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '40991995-c40c-4086-86d5-49b27ba49a3e'} Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40991995-c40c-4086-86d5-49b27ba49a3e could not be found. Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40991995-c40c-4086-86d5-49b27ba49a3e could not be found. Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:42.376944 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.381541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:42.381541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:42.381541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:42.381541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:42.381541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:42.381541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40991995-c40c-4086-86d5-49b27ba49a3e could not be found. Jun 16 18:42:42.381541 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:42.382951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] Returning 404 to user: Instance 40991995-c40c-4086-86d5-49b27ba49a3e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:42.384227 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c08ecde-0a9c-42a9-9741-01337e698ac3 tempest-ListServerFiltersTestJSON-1620490628 tempest-ListServerFiltersTestJSON-1620490628-project] 10.222.0.27 "GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e" status: 404 len: 111 microversion: 2.1 time: 0.062369 Jun 16 18:42:42.385040 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1498/2908] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:42 2022] GET /compute/v2.1/servers/40991995-c40c-4086-86d5-49b27ba49a3e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:42.391149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:42.392076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:42.400071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.401256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:42.402390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:42.403376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:43.059806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:43.070279 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca396678-1211-4d05-bb2b-c51ddb49ecd4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.683557 Jun 16 18:42:43.071063 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1499/2909] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:42 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:43.076500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:43.077294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:43.085971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:43.086785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:43.087800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:43.088392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:43.182244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:43.201086 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d42f36d0-5f9d-4d01-849f-020380c3fd3f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1316 microversion: 2.1 time: 1.154762 Jun 16 18:42:43.203112 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1411/2910] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:42 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1316 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:43.210853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:43.211747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:43.232413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:43.232881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:43.233683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:43.234161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:43.493579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:43.497156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:43.502435 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-08f2a9a3-c0fa-4564-bfe1-6f3004475744 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.430073 Jun 16 18:42:43.503685 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1500/2911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:43 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:43.516085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:43.517082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:43.528321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:43.529312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:43.530451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:43.531156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:43.741524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:43.750224 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8ce7aacb-8b57-4bb3-acae-78b9583cf3de tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.545692 Jun 16 18:42:43.755730 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1412/2912] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:43 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:43.943962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:43.953228 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd91c187-c650-431b-9160-ea0c897b6238 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.448183 Jun 16 18:42:43.959844 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1501/2913] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:43 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:43.978104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1842ebce-0efb-48be-9d56-e0234334f582 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:43.979257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1842ebce-0efb-48be-9d56-e0234334f582 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: a5a9a9db-a9e7-4334-abf9-86ce91fadc50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:43.985546 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1842ebce-0efb-48be-9d56-e0234334f582 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance a5a9a9db-a9e7-4334-abf9-86ce91fadc50 could not be found. Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1842ebce-0efb-48be-9d56-e0234334f582 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/a5a9a9db-a9e7-4334-abf9-86ce91fadc50/action HTTP/1.1 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 14 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: {"shelve": {}} Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a5a9a9db-a9e7-4334-abf9-86ce91fadc50 could not be found. Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a5a9a9db-a9e7-4334-abf9-86ce91fadc50', 'body': {'shelve': {}}} Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a9a9db-a9e7-4334-abf9-86ce91fadc50 could not be found. Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a9a9db-a9e7-4334-abf9-86ce91fadc50 could not be found. Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:44.008764 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:44.013260 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:44.013260 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:44.013260 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a9a9db-a9e7-4334-abf9-86ce91fadc50 could not be found. Jun 16 18:42:44.013260 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:44.013260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1842ebce-0efb-48be-9d56-e0234334f582 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance a5a9a9db-a9e7-4334-abf9-86ce91fadc50 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:44.020071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1842ebce-0efb-48be-9d56-e0234334f582 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/a5a9a9db-a9e7-4334-abf9-86ce91fadc50/action" status: 404 len: 111 microversion: 2.1 time: 0.040793 Jun 16 18:42:44.026874 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1413/2914] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:43 2022] POST /compute/v2.1/servers/a5a9a9db-a9e7-4334-abf9-86ce91fadc50/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:44.037253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:44.038078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:44.052623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.053114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:44.055491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.055958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:44.220228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:44.221558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:44.243808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.246087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:44.247262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.250975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:44.593285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:44.612991 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d4673fa4-f50d-4d6a-8fa9-083302d8b31b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.579678 Jun 16 18:42:44.613265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:44.614156 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1502/2915] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:44 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:44.630416 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5bf5d5c7-bbbb-46f2-ae20-c04e0486882a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1466 microversion: 2.1 time: 0.411909 Jun 16 18:42:44.633166 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1414/2916] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:44 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1466 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:44.637450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:44.640177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:44.646708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:44.648370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:44.653746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.654294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:44.655149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.655597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:44.661500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.662351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:44.663385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:44.664000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:45.398202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:45.411416 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0462cc0a-0dcf-4fd2-b3c5-59c23722a8c0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.776998 Jun 16 18:42:45.415460 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1415/2917] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:44 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:45.415596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:45.422479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fcae4590-85ee-4918-8014-0381491f1222 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:45.424482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fcae4590-85ee-4918-8014-0381491f1222 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:45.428169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af6c1149-187f-4c30-952d-901e4ee049ba tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.809402 Jun 16 18:42:45.428780 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1503/2918] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:44 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:45.442573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3303d173-15d9-4b4f-aa0a-91a5145f655a req-93d38978-8601-4022-a9ef-f70bab5694c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b446cff3-9611-4d43-b11b-23d652af04a7", "tag": "fdd84aca-3892-45e3-8292-04a00a95f23f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:45.443903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcae4590-85ee-4918-8014-0381491f1222 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:45.444675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcae4590-85ee-4918-8014-0381491f1222 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:45.446557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcae4590-85ee-4918-8014-0381491f1222 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:45.448763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcae4590-85ee-4918-8014-0381491f1222 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:45.457820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3303d173-15d9-4b4f-aa0a-91a5145f655a req-93d38978-8601-4022-a9ef-f70bab5694c9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:45.458306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3303d173-15d9-4b4f-aa0a-91a5145f655a req-93d38978-8601-4022-a9ef-f70bab5694c9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:45.489325 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3303d173-15d9-4b4f-aa0a-91a5145f655a req-93d38978-8601-4022-a9ef-f70bab5694c9 service nova] Creating event network-changed:fdd84aca-3892-45e3-8292-04a00a95f23f for instance b446cff3-9611-4d43-b11b-23d652af04a7 on n-h1-846209-2 Jun 16 18:42:45.500686 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3303d173-15d9-4b4f-aa0a-91a5145f655a req-93d38978-8601-4022-a9ef-f70bab5694c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070651 Jun 16 18:42:45.502129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1504/2919] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:45.509970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:45.515704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:45.536310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:45.543122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:45.544165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:45.545657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:46.203583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:46.240351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:46.248283 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-277ab926-6693-4a7d-a1c8-e290be09de45 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.744202 Jun 16 18:42:46.249545 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1505/2920] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:45 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:46.256905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:46.257774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:46.259125 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fcae4590-85ee-4918-8014-0381491f1222 tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1617 microversion: 2.1 time: 0.842200 Jun 16 18:42:46.259723 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1416/2921] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:45 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1617 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:46.265249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:46.266068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:46.267119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:46.267783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:46.309155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lazy-loading 'flavor' on Instance uuid e5e57881-9458-4864-a6d8-79555341a48e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:42:46.451415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:46.453002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:46.466086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:46.469893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:46.475391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:46.476598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:46.735169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:46.842864 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51e69bdb-4d1f-41f0-8c05-6d5424a09f12 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.591654 Jun 16 18:42:46.843781 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1506/2922] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:42:46 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:42:46.850561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-637959938", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "42ff1dd7-0d48-479e-95f1-af7f8d2b2530"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:46.863904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:46.878560 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dcf1cd6e-b0d4-4c97-ba6b-b468beaa7764 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.433272 Jun 16 18:42:46.890682 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1417/2923] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:46 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:46.938364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:42:47.172030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2307913a-6106-4cf8-bf7d-36e8828ac0f0 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1507504962", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:47.182640 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-2307913a-6106-4cf8-bf7d-36e8828ac0f0 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] HTTP exception thrown: min_count must be <= max_count Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2307913a-6106-4cf8-bf7d-36e8828ac0f0 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Request method failure captured: Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 184 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3mmjF7g1fIIg383_JpIA29_i0wqsasfBmBft4m78VwSAxguDE9M0MYn8fmMEnWDJLkr_CsN--2cEM9PTpk5qQJTU6KMDirQAi4710k77dsB-M-AN-a8elub_E6ciPMzkSyaN1UwJUDcXpNGSMga4pEUUkrQnQuHAtEGSMxv6-yGdaw Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6d1b228ca8143cb8b4bd2d9ccda7810", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c71132781d2a4a3c94c1f6e0afa8c831 Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1507504962", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: exception: min_count must be <= max_count Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1507504962', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jun 16 18:42:47.188175 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.215490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2307913a-6106-4cf8-bf7d-36e8828ac0f0 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Returning 400 to user: min_count must be <= max_count {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:47.220559 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2307913a-6106-4cf8-bf7d-36e8828ac0f0 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.326617 Jun 16 18:42:47.226248 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1418/2924] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:46 2022] POST /compute/v2.1/servers => generated 74 bytes in 333 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:47.242733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:47.243374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:47.273269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:47.278300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:47.280004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:47.280653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:47.467921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:42:47.468419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:42:47.468836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:42:47.469258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:42:47.469679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:42:47.490209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:47.490971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:47.492846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:47.493527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:47.522592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:47.529947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Getting quotas for user 9d35e57eccbc41048e9e5cdb742688f3 and project 6a21d936370c4a5bbdd254cacc618708. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:47.570788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:42:47.573680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:42:47.601165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:47.617571 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5077f6dc-9720-4397-9c6e-bef4c92d9685 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1513 microversion: 2.1 time: 0.389182 Jun 16 18:42:47.634144 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1419/2925] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:47 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1513 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:47.651501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-635d3445-6e56-43da-aed2-330053c104bf tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806134 Jun 16 18:42:47.653717 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1507/2926] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:42:47.658768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:47.664806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:47.674826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b82c70f-8519-4d92-be4f-4390f0c6a528 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1924505643", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "max_count": 0}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b82c70f-8519-4d92-be4f-4390f0c6a528 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Request method failure captured: Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 168 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3mmjF7g1fIIg383_JpIA29_i0wqsasfBmBft4m78VwSAxguDE9M0MYn8fmMEnWDJLkr_CsN--2cEM9PTpk5qQJTU6KMDirQAi4710k77dsB-M-AN-a8elub_E6ciPMzkSyaN1UwJUDcXpNGSMga4pEUUkrQnQuHAtEGSMxv6-yGdaw Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6d1b228ca8143cb8b4bd2d9ccda7810", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c71132781d2a4a3c94c1f6e0afa8c831 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1924505643", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "max_count": 0}} Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1924505643', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'max_count': 0}}} Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 0 Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:42:47.680878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 16 18:42:47.685655 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:47.690129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b82c70f-8519-4d92-be4f-4390f0c6a528 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:47.695245 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b82c70f-8519-4d92-be4f-4390f0c6a528 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.040199 Jun 16 18:42:47.696744 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1508/2927] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:47 2022] POST /compute/v2.1/servers => generated 130 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:42:47.698335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:47.699008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:47.699994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:47.700756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:47.721206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-94ad8caf-cad2-4807-9530-ffae27fb1970 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:47.723987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-94ad8caf-cad2-4807-9530-ffae27fb1970 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:48.049224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-94ad8caf-cad2-4807-9530-ffae27fb1970 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:48.068033 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-94ad8caf-cad2-4807-9530-ffae27fb1970 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1216 microversion: 2.1 time: 0.370309 Jun 16 18:42:48.068642 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1509/2928] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:47 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1216 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:48.094419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-251dd908-a104-4669-a4e6-dbd6537dd7b2 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1972654400", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "max_count": 2.5}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-251dd908-a104-4669-a4e6-dbd6537dd7b2 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Request method failure captured: Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 170 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3mmjF7g1fIIg383_JpIA29_i0wqsasfBmBft4m78VwSAxguDE9M0MYn8fmMEnWDJLkr_CsN--2cEM9PTpk5qQJTU6KMDirQAi4710k77dsB-M-AN-a8elub_E6ciPMzkSyaN1UwJUDcXpNGSMga4pEUUkrQnQuHAtEGSMxv6-yGdaw Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6d1b228ca8143cb8b4bd2d9ccda7810", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c71132781d2a4a3c94c1f6e0afa8c831 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1972654400", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "max_count": 2.5}} Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1972654400', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'max_count': 2.5}}} Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 2.5 Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:42:48.111114 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-251dd908-a104-4669-a4e6-dbd6537dd7b2 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:48.115980 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-251dd908-a104-4669-a4e6-dbd6537dd7b2 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043497 Jun 16 18:42:48.119332 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1510/2929] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:48 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:42:48.144294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:48.144918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:48.158793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:48.159986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:48.160932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:48.161702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:48.991160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:49.004393 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fda654a2-65ca-409f-94ca-d11dc53660aa tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 1.363130 Jun 16 18:42:49.005568 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1420/2930] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:47 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:49.020103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32af0835-e21c-442a-8f69-d3012a224ce1 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1827316061", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 0}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32af0835-e21c-442a-8f69-d3012a224ce1 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Request method failure captured: Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 168 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3mmjF7g1fIIg383_JpIA29_i0wqsasfBmBft4m78VwSAxguDE9M0MYn8fmMEnWDJLkr_CsN--2cEM9PTpk5qQJTU6KMDirQAi4710k77dsB-M-AN-a8elub_E6ciPMzkSyaN1UwJUDcXpNGSMga4pEUUkrQnQuHAtEGSMxv6-yGdaw Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6d1b228ca8143cb8b4bd2d9ccda7810", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c71132781d2a4a3c94c1f6e0afa8c831 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1827316061", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 0}} Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1827316061', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'min_count': 0}}} Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 0 Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:42:49.028503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32af0835-e21c-442a-8f69-d3012a224ce1 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:49.033363 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32af0835-e21c-442a-8f69-d3012a224ce1 tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021475 Jun 16 18:42:49.036039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:49.044392 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1421/2931] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:42:49.047276 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-edd95dda-62af-4768-b8b5-301f84ea24e9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.919725 Jun 16 18:42:49.047779 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1511/2932] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:48 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:49.060153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:49.061224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1326962932", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "38274096-79f8-4421-a0ed-6bcd2e0e748c"}, {"uuid": "8bd608fe-81c5-4584-9d64-735ee321fccc"}, {"uuid": "38274096-79f8-4421-a0ed-6bcd2e0e748c"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:49.062563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:49.077789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:49.080465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:49.081409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:49.082405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:49.198210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] validate_networks() for [('38274096-79f8-4421-a0ed-6bcd2e0e748c', None, None, None, None, None), ('8bd608fe-81c5-4584-9d64-735ee321fccc', None, None, None, None, None), ('38274096-79f8-4421-a0ed-6bcd2e0e748c', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:42:49.807069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:49.821189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-da931abc-b9a3-4cba-b8c2-48299141e126 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1513 microversion: 2.1 time: 0.775069 Jun 16 18:42:49.831713 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1422/2933] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:49 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1513 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:49.831713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:49.831713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:49.839398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:49.840261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:49.841293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:49.841997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:49.852320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:50.023299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:50.059453 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d5de34ef-ef9d-43c3-98b8-7e4ab4b8a567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1274 microversion: 2.1 time: 0.235095 Jun 16 18:42:50.060828 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1423/2934] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:49 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:50.067996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3a1cb2f-8d34-4fa8-a13c-be2db069ab7e tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-658778289", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 2.5}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3a1cb2f-8d34-4fa8-a13c-be2db069ab7e tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Request method failure captured: Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 169 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3mmjF7g1fIIg383_JpIA29_i0wqsasfBmBft4m78VwSAxguDE9M0MYn8fmMEnWDJLkr_CsN--2cEM9PTpk5qQJTU6KMDirQAi4710k77dsB-M-AN-a8elub_E6ciPMzkSyaN1UwJUDcXpNGSMga4pEUUkrQnQuHAtEGSMxv6-yGdaw Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6d1b228ca8143cb8b4bd2d9ccda7810", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6d1b228ca8143cb8b4bd2d9ccda7810"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c6d1b228ca8143cb8b4bd2d9ccda7810 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2059607918 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c71132781d2a4a3c94c1f6e0afa8c831 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2059607918-project Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-658778289", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 2.5}} Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-658778289', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'min_count': 2.5}}} Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 2.5 Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:42:50.079199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 16 18:42:50.086851 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:42:50.090387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3a1cb2f-8d34-4fa8-a13c-be2db069ab7e tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:50.091255 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3a1cb2f-8d34-4fa8-a13c-be2db069ab7e tempest-MultipleCreateNegativeTestJSON-2059607918 tempest-MultipleCreateNegativeTestJSON-2059607918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028369 Jun 16 18:42:50.092437 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1424/2935] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:50 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:42:50.105350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:50.106954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:50.116624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:50.118643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:50.119637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:50.121094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:50.122414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:50.963356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:51.007440 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-24e23af8-6573-40c3-967c-63edeea24f6f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.913596 Jun 16 18:42:51.008433 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1425/2936] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:50 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:51.025449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:51.027393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:51.044397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:51.048274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:51.049516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:51.050573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:51.561649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:51.570539 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3674e5b4-cf3c-4637-b628-6553ba160ffb tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.560308 Jun 16 18:42:51.578738 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1426/2937] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:51 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:51.588940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:51.589859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:51.608415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:51.609262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:51.610289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:51.610919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.100812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:52.123921 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1fd668e6-205c-43a4-990b-830d17b75008 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1513 microversion: 2.1 time: 0.543754 Jun 16 18:42:52.125095 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1427/2938] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:51 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1513 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:52.142240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:52.143332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:52.155639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.156177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.157188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.157800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.389677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:42:52.390497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:42:52.390995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:42:52.391424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:42:52.391854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:42:52.410880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.411349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.416160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.416628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.499975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Getting quotas for project f81d5b935a7e4f9d90a68e8a488f136a. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:52.510142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Getting quotas for user b9d82e559e5b4ecdbc044ad52907050c and project f81d5b935a7e4f9d90a68e8a488f136a. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:52.546647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:42:52.548845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:42:52.629844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:52.655099 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50dfef0e-dffc-4f3b-8f24-2a08c883aee1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 0.526312 Jun 16 18:42:52.655732 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1428/2939] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:52 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:52.672169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-485c2704-2b1d-4bd8-a383-727566fe861a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.623277 Jun 16 18:42:52.673165 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1512/2940] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:42:52.679129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:52.679129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:52.687188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:52.688151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:52.696704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.697165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.697629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.697990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.698435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.698647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:52.699613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:52.701020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:53.470350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:53.491280 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fa748eae-832f-4587-9a40-f4103ce39c68 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.802418 Jun 16 18:42:53.502415 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1513/2941] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:52 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:53.507930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:53.508907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:53.517035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:53.517853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:53.519114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:53.519768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:53.575159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:53.592305 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-936bc5dd-9332-4fd8-9f22-6951e6596533 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.928860 Jun 16 18:42:53.604557 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1429/2942] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:52 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:53.610549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:53.611531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:53.620117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:53.636253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:53.637272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:53.638590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:53.639905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:53.641316 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9bf03df5-4f72-4275-a2c6-d6b9f829aa87 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1209 microversion: 2.1 time: 0.135168 Jun 16 18:42:53.642656 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1514/2943] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:53 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:53.673357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:53.674447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:53.684388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:53.684848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:53.688261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:53.688754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:54.124539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:54.143040 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-137b9314-48a1-4c08-889f-03e87c094567 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 0.473549 Jun 16 18:42:54.146344 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1515/2944] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:53 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:54.155392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:54.169319 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8a3465c9-7ea9-4f99-a59a-afaef2c6ff7a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1513 microversion: 2.1 time: 0.563140 Jun 16 18:42:54.170754 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1430/2945] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:53 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1513 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:54.509391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:54.511037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:54.523960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:54.528032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:54.530707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:54.531178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:54.611593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:54.612746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:54.631630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:54.632390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:54.633659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:54.634354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:55.108018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:55.122814 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-643724a5-f182-4160-b885-4ad55998a39c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.617428 Jun 16 18:42:55.123415 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1516/2946] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:54 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:55.140717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:55.141365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:55.157804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:55.158299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:55.159621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:55.160074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:55.191574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:55.205079 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a017c79-c5b7-444d-babe-1e7f20326734 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.597330 Jun 16 18:42:55.212177 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1431/2947] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:54 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:42:55.217756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:55.223325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:55.242464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:55.245508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:55.246641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:55.247875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:55.572191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:55.589543 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb0397fe-36cf-4669-8d03-d3387ff8c656 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1271 microversion: 2.1 time: 0.452960 Jun 16 18:42:55.589543 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1517/2948] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:55 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1271 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:55.598919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:55.599592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:55.612464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:55.613307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:55.614416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:55.617295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.070283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:56.084123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f5835a0-151b-4872-9305-d4f59ac3aa5f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 0.869968 Jun 16 18:42:56.084780 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1432/2949] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:55 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:56.095638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-60d47916-5f03-459b-b750-ac0d5e2b18d7 req-2ae42fce-f9b7-4eea-ab82-071dd0c87ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98632279-dab5-4f24-937d-8b8a6ee9da14", "tag": "6940e39c-c04d-4789-b122-69a89ca3167e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:56.127563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-60d47916-5f03-459b-b750-ac0d5e2b18d7 req-2ae42fce-f9b7-4eea-ab82-071dd0c87ad1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.128146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-60d47916-5f03-459b-b750-ac0d5e2b18d7 req-2ae42fce-f9b7-4eea-ab82-071dd0c87ad1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.150178 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-60d47916-5f03-459b-b750-ac0d5e2b18d7 req-2ae42fce-f9b7-4eea-ab82-071dd0c87ad1 service nova] Creating event network-changed:6940e39c-c04d-4789-b122-69a89ca3167e for instance 98632279-dab5-4f24-937d-8b8a6ee9da14 on n-h1-846209-2 Jun 16 18:42:56.167486 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-60d47916-5f03-459b-b750-ac0d5e2b18d7 req-2ae42fce-f9b7-4eea-ab82-071dd0c87ad1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081146 Jun 16 18:42:56.169396 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1433/2950] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:56.178870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:56.180432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:56.196282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.197063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.198123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.212268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.226163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:56.243236 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4781f31e-7d38-4046-832f-8b1ec64e5c7f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1513 microversion: 2.1 time: 0.654598 Jun 16 18:42:56.254215 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1518/2951] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:55 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1513 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:56.264086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:56.267998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:56.289036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.289614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.295158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.297080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.855402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:56.874170 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1c1bdd53-1ece-4f16-9190-731e7967bf4d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.698893 Jun 16 18:42:56.875287 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1434/2952] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:56 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:56.887587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-39473dd1-d353-4efb-a501-c252d1b92dfb req-7573b357-fc87-46cc-8b2f-6eab8e3b3dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b446cff3-9611-4d43-b11b-23d652af04a7", "name": "network-vif-plugged", "status": "completed", "tag": "fdd84aca-3892-45e3-8292-04a00a95f23f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:56.912972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-39473dd1-d353-4efb-a501-c252d1b92dfb req-7573b357-fc87-46cc-8b2f-6eab8e3b3dff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.913423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-39473dd1-d353-4efb-a501-c252d1b92dfb req-7573b357-fc87-46cc-8b2f-6eab8e3b3dff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.928311 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-39473dd1-d353-4efb-a501-c252d1b92dfb req-7573b357-fc87-46cc-8b2f-6eab8e3b3dff service nova] Creating event network-vif-plugged:fdd84aca-3892-45e3-8292-04a00a95f23f for instance b446cff3-9611-4d43-b11b-23d652af04a7 on n-h1-846209-2 Jun 16 18:42:56.934918 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-39473dd1-d353-4efb-a501-c252d1b92dfb req-7573b357-fc87-46cc-8b2f-6eab8e3b3dff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057976 Jun 16 18:42:56.936134 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1435/2953] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:56.943696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:56.944579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:56.953944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.954574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:56.955536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:56.956728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:57.014748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:57.029826 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bf24e6e4-d9ce-4265-abf7-09a03fe191f8 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.773984 Jun 16 18:42:57.031026 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1519/2954] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:56 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:57.105173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:57.105619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:57.133575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:57.134678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:57.135263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:57.135717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:57.188757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:58.164997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:58.193537 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-76ebaf72-ffa7-47d5-916e-f8e00a88656c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1313 microversion: 2.1 time: 1.255398 Jun 16 18:42:58.200104 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1436/2955] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:56 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1313 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:58.216879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:58.218908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:58.243646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:58.247782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:58.249102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:58.250502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:58.336713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:58.358260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b4f5e79-3779-48a3-964f-da9292f2d2ec tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 1.259269 Jun 16 18:42:58.373061 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1520/2956] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:57 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:58.382563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:58.390416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:58.421513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:58.422465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:58.423948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:58.425233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:58.741288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:58.756655 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-475601be-644e-4cf4-96a4-af6b020d67ed tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1534 microversion: 2.1 time: 0.553579 Jun 16 18:42:58.757892 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1437/2957] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:58 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1534 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:58.765451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:58.766415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:58.776588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:58.777418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:58.782949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:58.783700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:58.841305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:58.860682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81461ecf-4d9c-44e5-81dd-ec293a9e5e4a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1318 microversion: 2.1 time: 0.486117 Jun 16 18:42:58.861295 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1521/2958] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:58 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:59.154631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:59.204552 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b3eb1b4-e597-4d39-9b0b-ee7e29b3665b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 0.439312 Jun 16 18:42:59.208353 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1438/2959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:58 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:59.217161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:59.218152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:59.229460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:59.229949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:59.230757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:59.231218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:59.379614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:59.381124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:59.392740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:59.394448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:59.396572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:59.406739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:59.878673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:59.901948 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7d3a6c7-5ebe-4bfe-a6b1-7ddedd22cc3c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1313 microversion: 2.1 time: 0.684855 Jun 16 18:42:59.903201 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1522/2960] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:59 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:59.914688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f041cc1e-5354-47d1-af44-5fe1c373c472 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Action: 'create', calling method: .version_select at 0x7f866e3523a0>, body: {"keypair": {"name": "tempest-keypair-827571068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXS6nWYLtwpapOWqiNTv11HK46DvmBOmsU3MP5ciHGKzCDVVA09OM2R/uy1s1I2i5sV4OSDxIP5pg4DVFKFWaE6nfWbaQ4gtaLHwUl6oDNqwQAtq5Pqk2Mv/N60XOOUgA=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:59.936275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f041cc1e-5354-47d1-af44-5fe1c373c472 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Getting quotas for project 60605ca65e2e4016993b3f649c5bea44. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:59.945331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f041cc1e-5354-47d1-af44-5fe1c373c472 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Getting quotas for user 1bded9f5ba0a41b38e7bf0a13604bed5 and project 60605ca65e2e4016993b3f649c5bea44. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:59.992612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:00.010738 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b65a550b-7479-47d4-bd09-22e87a803e97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 0.628229 Jun 16 18:43:00.011493 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1439/2961] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:59 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:43:00.024648 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f041cc1e-5354-47d1-af44-5fe1c373c472 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.117714 Jun 16 18:43:00.031331 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1523/2962] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:42:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:43:00.033612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:00.034881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:00.038556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:00.047393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.053614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:00.054653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:00.055604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.056122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:00.071865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.072324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:00.073317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.073762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:00.695008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:00.705269 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f8bfdb99-9d44-4df6-bf6c-4aae1175e968 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1508 microversion: 2.1 time: 0.672301 Jun 16 18:43:00.705967 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1524/2963] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:00 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1508 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:00.727142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:00.734256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:00.747647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.748443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:00.749438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.751671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:00.778620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:00.788941 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2b8aaf3b-083f-43a7-bccb-9f63aa266fda tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1534 microversion: 2.1 time: 0.765318 Jun 16 18:43:00.794605 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1440/2964] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:00 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1534 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:00.799542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:00.810477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:00.832592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.839834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:00.843401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:00.843959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:01.647206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:01.661725 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa216f1c-bab6-4c0c-b104-bec8261b6e1c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1508 microversion: 2.1 time: 0.865910 Jun 16 18:43:01.667951 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1441/2965] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:00 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1508 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:01.685559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:01.687149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:01.723074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:01.723750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:01.726831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:01.731728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:01.731940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:01.747343 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-edc37ba9-99a1-4337-b94c-1721ff67844e tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 1.028485 Jun 16 18:43:01.748556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1525/2966] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:00 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:01.762049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:01.764672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:01.774871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:01.775600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:01.778554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:01.779220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:01.814830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:02.304277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:02.319113 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c77a1dc9-96f6-4c7d-a236-0b7d96b4c258 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1334 microversion: 2.1 time: 0.649955 Jun 16 18:43:02.329748 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1442/2967] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:01 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1334 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:02.408780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:02.422492 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28a6ac1c-5469-44ce-9d6d-9ba96e43827c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 0.672338 Jun 16 18:43:02.428847 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1526/2968] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:01 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:02.442213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-460e7240-532e-409b-b5e8-5e0cbcfdd8b3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:02.457794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-460e7240-532e-409b-b5e8-5e0cbcfdd8b3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:02.465955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:02.469743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:02.489083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-460e7240-532e-409b-b5e8-5e0cbcfdd8b3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:02.490349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-460e7240-532e-409b-b5e8-5e0cbcfdd8b3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:02.496256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-460e7240-532e-409b-b5e8-5e0cbcfdd8b3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:02.497683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-460e7240-532e-409b-b5e8-5e0cbcfdd8b3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:02.725888 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-460e7240-532e-409b-b5e8-5e0cbcfdd8b3 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "PUT /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1080 microversion: 2.1 time: 0.290683 Jun 16 18:43:02.729599 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1527/2969] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:43:02 2022] PUT /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1080 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:02.747502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:02.748719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:02.783731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:02.796593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1180887862", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "fefe7ae7-665c-42d2-af7a-3d8718963a27"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:02.802265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:02.811192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:02.811662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:02.939970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] validate_networks() for [('fefe7ae7-665c-42d2-af7a-3d8718963a27', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:43:03.260123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:03.275107 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-db847563-6ede-461c-bdfd-1ebf2d8d62dd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1529 microversion: 2.1 time: 0.542499 Jun 16 18:43:03.277385 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1528/2970] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:02 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1529 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:03.295332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:03.297053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:03.311526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:03.311994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:03.316025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:03.318525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:03.733642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:03.746701 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-352da7ee-3b77-46b5-95bc-c1aabab29e39 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1506 microversion: 2.1 time: 0.466862 Jun 16 18:43:03.748105 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1529/2971] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:03 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:03.753705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:03.754789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:03.770085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:03.770884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:03.771892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:03.772543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:04.757492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:04.767239 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69098e3a-d550-404f-84ba-77841b208e36 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1524 microversion: 2.1 time: 1.017395 Jun 16 18:43:04.771624 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1530/2972] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:03 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1524 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:04.784161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:04.790857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:04.805251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:04.809870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:04.818806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:04.819224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.005232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:43:05.006425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:43:05.006923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:43:05.007351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:43:05.007782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:43:05.038616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.042227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.048015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.051605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.123261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Getting quotas for project 3cb88c77bd3d4d6abe4f7c3931e35290. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:43:05.139206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Getting quotas for user 511eaeeddc084b19b0aae6e0eb9ab1e3 and project 3cb88c77bd3d4d6abe4f7c3931e35290. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:43:05.178981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:43:05.181457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:43:05.259183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:05.281351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e675ed25-eef0-4c0c-96a1-568767913ad3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.957569 Jun 16 18:43:05.282781 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1443/2973] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:43:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2959 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:43:05.286346 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-698ee7f7-679b-4e22-abda-91279a0aeb46 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.512936 Jun 16 18:43:05.298437 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1531/2974] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:04 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:05.300674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:05.301575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:05.304999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:05.309123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.309898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.310954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.311605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.312169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:05.326154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.326827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.328107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.329333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.795713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:05.804840 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a465f6e-b6e7-49a9-828a-39d1cb9fc8d9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1506 microversion: 2.1 time: 0.504866 Jun 16 18:43:05.827261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:05.829897 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1532/2975] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:05 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:05.853581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-22972952", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "debf693e-91db-4d4a-aa49-683efc031dc5"}, {"port": "314d811b-e77f-454b-9c34-1fe5fab9338b", "tag": "port-1"}, {"port": "8d17ac6b-6841-40b8-b764-916f547af808", "tag": "port-2"}, {"uuid": "93d93651-89cc-4bf8-9e6a-00fa044e0dbe", "tag": "net-1"}, {"uuid": "93d93651-89cc-4bf8-9e6a-00fa044e0dbe"}, {"uuid": "f813338f-2f39-4c35-b837-df381f07f2dc", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f813338f-2f39-4c35-b837-df381f07f2dc", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "59fd9fa4-d256-49f0-9830-b49e03716a44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f88956dc-1a85-4713-adfc-c5868ac087c2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0fedec50-29d4-470f-902b-2a0ce3571bb8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1354440151"}], "key_name": "tempest-keypair-827571068", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:05.856318 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1d0e6b99-7a09-44e0-8493-605fcc3d1a49 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 0.571976 Jun 16 18:43:05.869705 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1444/2976] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:05 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:05.887481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:05.890472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:05.932668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.933199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:05.933930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:05.934697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:06.261880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] validate_networks() for [('debf693e-91db-4d4a-aa49-683efc031dc5', None, None, None, None, None), (None, None, '314d811b-e77f-454b-9c34-1fe5fab9338b', None, None, None), (None, None, '8d17ac6b-6841-40b8-b764-916f547af808', None, None, None), ('93d93651-89cc-4bf8-9e6a-00fa044e0dbe', None, None, None, None, None), ('93d93651-89cc-4bf8-9e6a-00fa044e0dbe', None, None, None, None, None), ('f813338f-2f39-4c35-b837-df381f07f2dc', '10.2.2.100', None, None, None, None), ('f813338f-2f39-4c35-b837-df381f07f2dc', '10.2.2.200', None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:43:06.526493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:06.539172 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b35dcb6b-c62f-4e79-9cbf-71ea0c735ce4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1529 microversion: 2.1 time: 0.666007 Jun 16 18:43:06.540134 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1445/2977] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:05 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1529 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:06.545772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-597c1835-e5fe-4d13-b6b0-85e187380910 req-a108a27d-c979-42ef-9569-628513c92b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e57881-9458-4864-a6d8-79555341a48e", "name": "network-vif-plugged", "status": "completed", "tag": "f395f5ff-79af-48cc-8d9f-7b45e4bba8d9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:06.571147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-597c1835-e5fe-4d13-b6b0-85e187380910 req-a108a27d-c979-42ef-9569-628513c92b6d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:06.571610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-597c1835-e5fe-4d13-b6b0-85e187380910 req-a108a27d-c979-42ef-9569-628513c92b6d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:06.588984 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-597c1835-e5fe-4d13-b6b0-85e187380910 req-a108a27d-c979-42ef-9569-628513c92b6d service nova] Creating event network-vif-plugged:f395f5ff-79af-48cc-8d9f-7b45e4bba8d9 for instance e5e57881-9458-4864-a6d8-79555341a48e on n-h2-846209-2 Jun 16 18:43:06.598474 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-597c1835-e5fe-4d13-b6b0-85e187380910 req-a108a27d-c979-42ef-9569-628513c92b6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056455 Jun 16 18:43:06.604614 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1446/2978] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:06.610844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:06.612392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:06.621716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:06.622266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:06.623057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:06.623495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:07.029106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:07.039982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:07.051372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:07.052596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5cd7975-4035-46f5-bbeb-c885a46407e0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1258 microversion: 2.26 time: 0.446449 Jun 16 18:43:07.053187 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1447/2979] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:06 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1258 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:07.057950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:07.061611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:07.062435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Searching by: {'deleted': False, 'project_id': '139abd9c58324711ac867b920ee2ef7d'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:43:07.079362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:07.079831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:07.080638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:07.081174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:07.129100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:43:07.195588 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5d87dc14-b026-4f16-a541-f1d2eeca3c9a tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.140987 Jun 16 18:43:07.205503 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1448/2980] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:43:07 2022] GET /compute/v2.1/servers => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:07.212477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:07.214168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:07.224382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:07.225183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:07.227235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:07.228093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:07.579781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:07.598659 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8573f07e-3a3a-4111-85a1-47ccff596bd2 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1504 microversion: 2.1 time: 0.391084 Jun 16 18:43:07.599658 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1449/2981] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:07 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:07.619854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:07.621773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:07.640412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:07.640905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:07.641748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:07.645755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:07.847296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:43:07.847867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:43:07.848683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:43:07.854420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:43:07.854892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:43:08.149286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:08.188964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:08.207864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:08.216703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:08.223006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:08.408437 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-685cbd15-6849-40a0-aa31-48b84bb4b73b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "POST /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7/action" status: 202 len: 1112 microversion: 2.1 time: 0.805412 Jun 16 18:43:08.414320 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1450/2982] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:43:07 2022] POST /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7/action => generated 1112 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 16 18:43:08.432828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:08.442887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:08.476879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:08.481959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:08.482999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:08.485668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:09.519341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:09.529676 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bb282c46-3eac-4bec-a9ca-5b40b97f6fde tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 1.113347 Jun 16 18:43:09.530317 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1451/2983] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:08 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:09.543191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:09.562191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:09.570102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:09.570873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:09.571905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:09.573474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:09.984388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=18 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:10.723698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:10.746162 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-07f9ec90-5ee7-4618-9017-ecaa6ee8cbfb tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 1.213749 Jun 16 18:43:10.761802 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1452/2984] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:09 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:10.776976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:10.786529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:10.798817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Searching by: {'deleted': False, 'project_id': '139abd9c58324711ac867b920ee2ef7d'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:43:10.806134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:10.806901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:10.807978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:10.814283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:10.865576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:43:10.921703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:10.930309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:10.936839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:11.430833 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-451f2286-c100-4191-8d60-e98e2c397ecd tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.676652 Jun 16 18:43:11.432887 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1453/2985] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:43:10 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:11.459888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:11.465776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:11.481509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:11.484751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:11.486770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:11.487847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:12.656053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:12.680308 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ac56574-271e-4cfb-8a3a-589055f5629e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1529 microversion: 2.1 time: 1.232743 Jun 16 18:43:12.687800 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1454/2986] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:11 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1529 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:12.696448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-edd04500-0cac-4c9e-86fb-549ed66ff1fc tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'create', calling method: .version_select at 0x7f866e294160>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1632550860", "description": "tempest-description-1243650599"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:13.310729 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-edd04500-0cac-4c9e-86fb-549ed66ff1fc tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.621360 Jun 16 18:43:13.318798 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1455/2987] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:43:12 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:13.324347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-140d04aa-4e76-40cc-9304-a9e29fcc5c6b req-d900edad-8361-4c08-9f1b-02bddf1c3c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "tag": "acc30814-2c97-4181-ab6e-ce8ee1dd9456"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:13.337175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-140d04aa-4e76-40cc-9304-a9e29fcc5c6b req-d900edad-8361-4c08-9f1b-02bddf1c3c86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:13.338242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-140d04aa-4e76-40cc-9304-a9e29fcc5c6b req-d900edad-8361-4c08-9f1b-02bddf1c3c86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:13.374025 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-140d04aa-4e76-40cc-9304-a9e29fcc5c6b req-d900edad-8361-4c08-9f1b-02bddf1c3c86 service nova] Creating event network-changed:acc30814-2c97-4181-ab6e-ce8ee1dd9456 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:13.381002 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-140d04aa-4e76-40cc-9304-a9e29fcc5c6b req-d900edad-8361-4c08-9f1b-02bddf1c3c86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060108 Jun 16 18:43:13.382366 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1456/2988] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:13.391218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:13.392195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:13.400446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:13.400895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:13.401989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:13.402433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:13.904736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:13.926295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:13.928499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:13.929901 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d04c2cf-d6cd-4215-b06b-b827ca6a3f9b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1362 microversion: 2.26 time: 0.546078 Jun 16 18:43:13.931948 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1457/2989] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:13 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1362 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:13.943046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:13.944800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:13.953409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:13.953872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:13.954734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:13.955183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:14.433886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:14.438879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:14.446191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f46d1814-3672-4061-b6dd-d0d22a3b43d2 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1517 microversion: 2.1 time: 0.512835 Jun 16 18:43:14.446978 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1458/2990] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:13 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1517 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:14.461205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8dde5886-a1f5-4292-bd25-557d82796b0c req-cd9a7264-4f93-403d-a197-97c5aaa679cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98632279-dab5-4f24-937d-8b8a6ee9da14", "name": "network-vif-plugged", "status": "completed", "tag": "6940e39c-c04d-4789-b122-69a89ca3167e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:14.472602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8dde5886-a1f5-4292-bd25-557d82796b0c req-cd9a7264-4f93-403d-a197-97c5aaa679cd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:14.473215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8dde5886-a1f5-4292-bd25-557d82796b0c req-cd9a7264-4f93-403d-a197-97c5aaa679cd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:14.487704 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8dde5886-a1f5-4292-bd25-557d82796b0c req-cd9a7264-4f93-403d-a197-97c5aaa679cd service nova] Creating event network-vif-plugged:6940e39c-c04d-4789-b122-69a89ca3167e for instance 98632279-dab5-4f24-937d-8b8a6ee9da14 on n-h1-846209-2 Jun 16 18:43:14.493898 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8dde5886-a1f5-4292-bd25-557d82796b0c req-cd9a7264-4f93-403d-a197-97c5aaa679cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036119 Jun 16 18:43:14.499876 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1459/2991] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:14.519785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:14.520812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:14.530755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:14.531468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:14.532457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:14.533054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:14.886307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:43:14.886907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:43:14.887327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:43:14.887755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:43:14.888180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:43:14.923892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:14.924238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:14.936165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:14.936881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:14.966618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Getting quotas for project 60605ca65e2e4016993b3f649c5bea44. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:43:14.988833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Getting quotas for user 1bded9f5ba0a41b38e7bf0a13604bed5 and project 60605ca65e2e4016993b3f649c5bea44. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:43:15.168210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:15.188157 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-05dc2d39-bc24-4650-999e-d03f62abbbb8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.686063 Jun 16 18:43:15.191846 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1460/2992] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:14 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:15.197325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5649877-22a0-4b96-82a3-133ed187d840 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:15.221233 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5649877-22a0-4b96-82a3-133ed187d840 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027910 Jun 16 18:43:15.230288 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1461/2993] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:43:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:15.235115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:15.235757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:15.244929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:15.245391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:15.246210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:15.246649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:15.270003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:43:15.274125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='59fd9fa4-d256-49f0-9830-b49e03716a44',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f88956dc-1a85-4713-adfc-c5868ac087c2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fedec50-29d4-470f-902b-2a0ce3571bb8',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:43:15.497947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:15.517036 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e1dc9885-c652-4869-9f99-2f3c69e6582b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1316 microversion: 2.1 time: 0.285583 Jun 16 18:43:15.521703 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1462/2994] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:15 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:15.529109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5fb5a1d6-929a-447b-8059-7de8e84e4bd2 req-aeab33a7-e84f-4ee2-81fd-5e663e27fcbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d5d199-53f6-492e-b5af-086aa748a160", "tag": "416adbe8-a278-48e7-80ae-4a85a7b36ef1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:15.555237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5fb5a1d6-929a-447b-8059-7de8e84e4bd2 req-aeab33a7-e84f-4ee2-81fd-5e663e27fcbb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:15.556120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5fb5a1d6-929a-447b-8059-7de8e84e4bd2 req-aeab33a7-e84f-4ee2-81fd-5e663e27fcbb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:15.571903 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5fb5a1d6-929a-447b-8059-7de8e84e4bd2 req-aeab33a7-e84f-4ee2-81fd-5e663e27fcbb service nova] Creating event network-changed:416adbe8-a278-48e7-80ae-4a85a7b36ef1 for instance 39d5d199-53f6-492e-b5af-086aa748a160 on n-h2-846209-2 Jun 16 18:43:15.579205 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5fb5a1d6-929a-447b-8059-7de8e84e4bd2 req-aeab33a7-e84f-4ee2-81fd-5e663e27fcbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055876 Jun 16 18:43:15.581638 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1463/2995] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:15.589674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1632550860"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:15.590640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:15.604833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:15.605539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:15.606680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:15.607331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:15.748686 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c13ddd6-eab2-4ada-84c0-09069e80f117 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.917111 Jun 16 18:43:15.750210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1533/2996] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Jun 16 18:43:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 9920 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:43:15.755271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:15.756134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:15.763828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:15.764562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:15.765519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:15.766158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:15.936925 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.network.security_group_api [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Adding security group 4450fa73-ec7a-4019-94cf-525b33e35eec to port 6407cf64-ee37-44f6-b1c4-145da9892974 Jun 16 18:43:16.246305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:16.263072 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-95112138-49ec-4485-9eac-1924cebf4166 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1529 microversion: 2.1 time: 0.511447 Jun 16 18:43:16.274930 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1534/2997] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:15 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1529 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:16.303134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:16.306081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:16.317878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:16.318376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:16.319179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:16.319632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.307907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:17.324218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:17.325737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:17.327402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f3864138-dfe5-4e15-a5b7-6c2e89bd82c0 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1362 microversion: 2.26 time: 1.051446 Jun 16 18:43:17.328511 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1535/2998] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:16 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1362 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:17.334273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0b10a44a-ec94-4519-8e9d-91e3bb7b4954 req-e1bc83dd-2454-4e97-9c96-e51fff3de527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "tag": "e06d22a6-1df4-41ea-aaba-8ea87b1c39f8"}, {"name": "network-changed", "server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "tag": "321baa9d-5e59-4b65-9482-cde4e2abad51"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:17.347841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0b10a44a-ec94-4519-8e9d-91e3bb7b4954 req-e1bc83dd-2454-4e97-9c96-e51fff3de527 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.348690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0b10a44a-ec94-4519-8e9d-91e3bb7b4954 req-e1bc83dd-2454-4e97-9c96-e51fff3de527 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.361705 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0b10a44a-ec94-4519-8e9d-91e3bb7b4954 req-e1bc83dd-2454-4e97-9c96-e51fff3de527 service nova] Creating event network-changed:e06d22a6-1df4-41ea-aaba-8ea87b1c39f8 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:17.363604 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0b10a44a-ec94-4519-8e9d-91e3bb7b4954 req-e1bc83dd-2454-4e97-9c96-e51fff3de527 service nova] Creating event network-changed:321baa9d-5e59-4b65-9482-cde4e2abad51 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:17.369295 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0b10a44a-ec94-4519-8e9d-91e3bb7b4954 req-e1bc83dd-2454-4e97-9c96-e51fff3de527 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039371 Jun 16 18:43:17.371941 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1536/2999] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:17.384479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:17.385534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:17.395693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.397568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.398461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.399008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.498817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50abe476-e3f7-4a47-b863-01a01ed63cae tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action" status: 202 len: 0 microversion: 2.1 time: 1.915647 Jun 16 18:43:17.500694 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1464/3000] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:43:15 2022] POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action => generated 0 bytes in 1920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:43:17.507988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:17.508983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:17.524812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.525929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.527505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.528545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.569381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:17.702955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:17.715631 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d9604bfd-5615-491a-a795-14d1e0b4be4b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1517 microversion: 2.1 time: 0.338414 Jun 16 18:43:17.719370 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1537/3001] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:17 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1517 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:17.723407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:17.732992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:17.734077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:17.742442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.745960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.750683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.753449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.798059 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4104630f-c65f-476a-8599-6644aecc35c3 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 204 len: 0 microversion: 2.1 time: 0.294954 Jun 16 18:43:17.802204 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1465/3002] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:17 2022] DELETE /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:17.808850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:17.817051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:17.829154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.829715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.841338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.841925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.899810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:17.899810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:17.899810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:17.899810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:17.899810 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-78ead991-91e5-4875-8b07-faa8722f1d18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1581 microversion: 2.42 time: 0.165461 Jun 16 18:43:17.899810 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1538/3003] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:17 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1581 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:17.905430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:17.906285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:17.944768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.944768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:17.944768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:17.944768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:18.322719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:18.338963 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-49fd3f55-9ee4-45d6-97ca-cdb6c2059441 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.530338 Jun 16 18:43:18.341874 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1466/3004] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:17 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:18.357093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:18.358281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:18.382654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:18.385039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:18.386431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:18.388531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:18.468810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:18.478415 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-03b891dd-9865-4a1d-817d-06abc72d4866 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1466 microversion: 2.1 time: 0.579092 Jun 16 18:43:18.479358 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1539/3005] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:17 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1466 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:18.494215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1632550860"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:18.495288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:18.509800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:18.510340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:18.511136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:18.511618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:18.772940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:18.783993 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f8c4eded-2798-435b-b607-aa1449620653 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1529 microversion: 2.1 time: 0.440394 Jun 16 18:43:18.796749 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1467/3006] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:18 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1529 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:18.802579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:18.803409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:18.811070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:18.811532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:18.812317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:18.813015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:18.876481 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.network.security_group_api [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Removing security group 4450fa73-ec7a-4019-94cf-525b33e35eec from port 6407cf64-ee37-44f6-b1c4-145da9892974 Jun 16 18:43:19.085242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.094117 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6121c7b4-a2a2-4f92-a4d3-aa2e9c3de766 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1608 microversion: 2.1 time: 0.295887 Jun 16 18:43:19.094709 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1468/3007] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:18 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1608 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:19.100091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:19.100726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:19.107036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.107491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.108277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.108723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.354224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.368439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.370214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.371721 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3446d7cb-3ea0-45d9-9feb-2e3754a0e8ac tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1362 microversion: 2.26 time: 0.276067 Jun 16 18:43:19.372298 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1469/3008] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:19 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:19.377101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d4900d75-490c-4392-b4de-2b7669a9173e tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:19.378313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d4900d75-490c-4392-b4de-2b7669a9173e tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:19.385021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4900d75-490c-4392-b4de-2b7669a9173e tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.385637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4900d75-490c-4392-b4de-2b7669a9173e tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.386805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4900d75-490c-4392-b4de-2b7669a9173e tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.387244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4900d75-490c-4392-b4de-2b7669a9173e tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.515634 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-028b8eac-667d-40aa-93a9-c63a7eb2a70f tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action" status: 202 len: 0 microversion: 2.1 time: 1.034267 Jun 16 18:43:19.524318 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1540/3009] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:43:18 2022] POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:43:19.531426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8bd06b58-ca3d-495b-9c76-b51a24d078df req-e26587c0-09e5-4893-8fc0-a989538b1322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d5d199-53f6-492e-b5af-086aa748a160", "name": "network-vif-plugged", "status": "completed", "tag": "416adbe8-a278-48e7-80ae-4a85a7b36ef1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:19.542140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8bd06b58-ca3d-495b-9c76-b51a24d078df req-e26587c0-09e5-4893-8fc0-a989538b1322 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.543536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8bd06b58-ca3d-495b-9c76-b51a24d078df req-e26587c0-09e5-4893-8fc0-a989538b1322 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.561577 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8bd06b58-ca3d-495b-9c76-b51a24d078df req-e26587c0-09e5-4893-8fc0-a989538b1322 service nova] Creating event network-vif-plugged:416adbe8-a278-48e7-80ae-4a85a7b36ef1 for instance 39d5d199-53f6-492e-b5af-086aa748a160 on n-h2-846209-2 Jun 16 18:43:19.568756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8bd06b58-ca3d-495b-9c76-b51a24d078df req-e26587c0-09e5-4893-8fc0-a989538b1322 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042654 Jun 16 18:43:19.570126 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1541/3010] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:19.575761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:19.576871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:19.587265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.588088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.589424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.590199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.601812 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d4900d75-490c-4392-b4de-2b7669a9173e tempest-ServersOnMultiNodesTest-1021117177 tempest-ServersOnMultiNodesTest-1021117177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1617 microversion: 2.1 time: 0.227963 Jun 16 18:43:19.615913 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1470/3011] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:19 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1617 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:19.628260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:19.628843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:19.643741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.644193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.645812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.646642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.748053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.773049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.777482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.779114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b11d49ed-c160-42f2-a98a-3799a4d06215 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1591 microversion: 2.42 time: 0.161934 Jun 16 18:43:19.783061 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1471/3012] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:19 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1591 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:19.795269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:19.795269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:19.800307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.801083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.802170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.802744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.822463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:19.831653 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5e84b309-1cab-461c-83b1-7ae58fb172db tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1517 microversion: 2.1 time: 0.259898 Jun 16 18:43:19.832525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1542/3013] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:19 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1517 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:19.851858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d55d6b24-9a5a-4cfd-b6a9-8d0261810099 req-146f13ac-4d7f-4f9f-b844-3a611666db68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c200947-b0a2-4c31-94c7-35186b881d08", "tag": "6407cf64-ee37-44f6-b1c4-145da9892974"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:19.877439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d55d6b24-9a5a-4cfd-b6a9-8d0261810099 req-146f13ac-4d7f-4f9f-b844-3a611666db68 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:19.884205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d55d6b24-9a5a-4cfd-b6a9-8d0261810099 req-146f13ac-4d7f-4f9f-b844-3a611666db68 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:19.905507 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d55d6b24-9a5a-4cfd-b6a9-8d0261810099 req-146f13ac-4d7f-4f9f-b844-3a611666db68 service nova] Creating event network-changed:6407cf64-ee37-44f6-b1c4-145da9892974 for instance 5c200947-b0a2-4c31-94c7-35186b881d08 on n-h2-846209-2 Jun 16 18:43:19.915746 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d55d6b24-9a5a-4cfd-b6a9-8d0261810099 req-146f13ac-4d7f-4f9f-b844-3a611666db68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067216 Jun 16 18:43:19.917242 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1543/3014] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:19.932683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8285fc7-61a2-468b-b5b5-63eb300388cd tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'create', calling method: .version_select at 0x7f866e3a4ca0>, body: {"pool": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:20.286165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:20.295855 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e64ff8c-a8e1-4eb9-82f7-7943b11bae91 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.511664 Jun 16 18:43:20.308262 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1472/3015] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:19 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:20.313748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:20.314589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:20.323451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:20.324912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:20.326027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:20.326845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:20.370923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:20.498726 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f0c053a-500a-4bdf-bcc0-f372a10201c4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 204 len: 0 microversion: 2.1 time: 0.188729 Jun 16 18:43:20.502302 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1473/3016] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:20 2022] DELETE /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:20.508459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:20.509180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:20.516035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:20.516496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:20.517277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:20.517719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:20.838475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:20.921683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:20.927079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:20.931249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:20.948177 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab2c3277-3151-4642-ab45-1a6c969f00f2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1511 microversion: 2.1 time: 0.443867 Jun 16 18:43:20.957957 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1474/3017] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:20 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:20.963230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:20.964307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:20.982622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:20.983248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:20.984141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:20.988307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:21.333178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:21.349267 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6e6a6c5f-3e1a-4f7e-b36d-5aba43895ec6 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1608 microversion: 2.1 time: 0.389777 Jun 16 18:43:21.350786 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1475/3018] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:20 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1608 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:21.361544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:21.362586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:21.382070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:21.383081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:21.386267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:21.386821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:22.278772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:22.301743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:22.304352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:22.305763 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-068e477f-e226-468c-841a-3949a1aeacfd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1362 microversion: 2.26 time: 0.953705 Jun 16 18:43:22.319624 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1476/3019] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:21 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1362 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:22.329880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:22.339125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:22.347360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:22.354891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:22.355384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:22.356012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:23.051927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:23.070625 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ea5a97ba-4012-4cd8-a95a-f6c2abe19674 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 200 len: 1472 microversion: 2.1 time: 0.749500 Jun 16 18:43:23.071233 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1477/3020] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:22 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 1472 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:23.076444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:23.077473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:23.091277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:23.102744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:23.104014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:23.104667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:23.672734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:23.686341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:23.688722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:23.691632 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a6ede2c1-e002-4776-8e33-3cf51a5e197d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1753 microversion: 2.42 time: 0.619110 Jun 16 18:43:23.700893 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1478/3021] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:23 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1753 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:23.711055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:23.717094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:23.724481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:23.726559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:23.727509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:23.728061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:24.201631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:24.211606 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0fed1385-e5d8-47f6-a6d7-dcf07224da5f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1517 microversion: 2.1 time: 0.509290 Jun 16 18:43:24.219147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1479/3022] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:23 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:24.228400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:24.234903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:24.251048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:24.252015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:24.253788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:24.254453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:24.705303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:24.714208 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-99373092-ef1a-422c-b9b7-b9e802fa1c8e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.493516 Jun 16 18:43:24.728816 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1480/3023] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:24 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:24.734091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-64df9612-57c5-428d-ae27-1547891e5ed1 req-665e0be0-a952-46cb-8935-3e661b3bf282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c200947-b0a2-4c31-94c7-35186b881d08", "tag": "6407cf64-ee37-44f6-b1c4-145da9892974"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:24.763004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-64df9612-57c5-428d-ae27-1547891e5ed1 req-665e0be0-a952-46cb-8935-3e661b3bf282 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:24.763754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-64df9612-57c5-428d-ae27-1547891e5ed1 req-665e0be0-a952-46cb-8935-3e661b3bf282 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:24.798174 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-64df9612-57c5-428d-ae27-1547891e5ed1 req-665e0be0-a952-46cb-8935-3e661b3bf282 service nova] Creating event network-changed:6407cf64-ee37-44f6-b1c4-145da9892974 for instance 5c200947-b0a2-4c31-94c7-35186b881d08 on n-h2-846209-2 Jun 16 18:43:24.813216 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-64df9612-57c5-428d-ae27-1547891e5ed1 req-665e0be0-a952-46cb-8935-3e661b3bf282 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082137 Jun 16 18:43:24.813849 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1481/3024] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:24.828519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:24.830347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:24.845331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:24.846145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:24.849111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:24.850857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:24.954843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:24.999897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:25.888008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:25.909643 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3fdb197-3180-401c-a211-4789d76211ef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1514 microversion: 2.1 time: 1.091072 Jun 16 18:43:25.914759 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1482/3025] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:24 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1514 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:25.928781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d98be600-8384-4821-b656-54e42fcb5859 req-0b34f554-ade8-4a88-bbce-67af9dfc63ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e57881-9458-4864-a6d8-79555341a48e", "name": "network-vif-unplugged", "status": "completed", "tag": "f395f5ff-79af-48cc-8d9f-7b45e4bba8d9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:25.961436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d98be600-8384-4821-b656-54e42fcb5859 req-0b34f554-ade8-4a88-bbce-67af9dfc63ae service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:25.962118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d98be600-8384-4821-b656-54e42fcb5859 req-0b34f554-ade8-4a88-bbce-67af9dfc63ae service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:25.994029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.server_external_events [req-d98be600-8384-4821-b656-54e42fcb5859 req-0b34f554-ade8-4a88-bbce-67af9dfc63ae service nova] Unable to find a host for instance e5e57881-9458-4864-a6d8-79555341a48e. Dropping event network-vif-unplugged {{(pid=119207) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 18:43:25.997362 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d98be600-8384-4821-b656-54e42fcb5859 req-0b34f554-ade8-4a88-bbce-67af9dfc63ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.079116 Jun 16 18:43:25.999740 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1483/3026] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 18:43:26.011254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:26.014730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:26.016355 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8285fc7-61a2-468b-b5b5-63eb300388cd tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.097382 Jun 16 18:43:26.017291 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1544/3027] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:43:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:26.024591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:26.028678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:26.032436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.032947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.035920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.036388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.044116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.047360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.048315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.048774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.260523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:26.275009 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9899261-ff33-4860-bcec-8e11fb952807 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1252 microversion: 2.1 time: 0.273070 Jun 16 18:43:26.275949 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1484/3028] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:25 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1252 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:26.290555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:26.291676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 98632279-dab5-4f24-937d-8b8a6ee9da14] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:26.305597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.306452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.312339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.313095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.348073 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 98632279-dab5-4f24-937d-8b8a6ee9da14 could not be found. Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 HTTP/1.1 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 98632279-dab5-4f24-937d-8b8a6ee9da14 could not be found. Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '98632279-dab5-4f24-937d-8b8a6ee9da14'} Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98632279-dab5-4f24-937d-8b8a6ee9da14 could not be found. Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98632279-dab5-4f24-937d-8b8a6ee9da14 could not be found. Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:26.357758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98632279-dab5-4f24-937d-8b8a6ee9da14 could not be found. Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:26.366887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 98632279-dab5-4f24-937d-8b8a6ee9da14 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:26.378304 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-04b637a4-efb8-4594-9a61-c3e909272047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14" status: 404 len: 111 microversion: 2.1 time: 0.096491 Jun 16 18:43:26.379322 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1485/3029] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:26 2022] GET /compute/v2.1/servers/98632279-dab5-4f24-937d-8b8a6ee9da14 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:26.387517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:26.388148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:26.426816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.427659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.428863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.429535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.873102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:26.890138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:26.894694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:26.898764 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8791b438-07a9-4224-87f1-67e0307afa0b tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1546 microversion: 2.26 time: 0.878061 Jun 16 18:43:26.914593 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1545/3030] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:26 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1546 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:26.933404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:26.934051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:26.951880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.952724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:26.953844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:26.954656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:27.079758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:27.093985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:27.096742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:27.098586 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c26d9199-1ae7-4da5-94fb-4ef937d419d6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1847 microversion: 2.42 time: 0.718068 Jun 16 18:43:27.112554 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1486/3031] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:26 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1847 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:27.118409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:27.119367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:27.126702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:27.128058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:27.129101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:27.130442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:27.272826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:27.288060 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c4a7a1b-9945-4fc6-af1d-1873cd1986c9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1517 microversion: 2.1 time: 0.358580 Jun 16 18:43:27.288655 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1546/3032] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:26 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1517 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:27.293278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:27.296206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:27.321624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:27.322664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:27.323734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:27.325445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:27.328685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:27.339457 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-55736c71-fb00-4fa6-b305-c0dfd817a7be tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.224195 Jun 16 18:43:27.340149 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1487/3033] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:27 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:27.345074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.108"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:27.347195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:27.354818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:27.355817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:27.356981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:27.357623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:27.394624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Acquired lock "refresh_cache-5c200947-b0a2-4c31-94c7-35186b881d08" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:43:27.935933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:27.969449 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b75f1c44-c59d-4859-81ad-cc4d88aebce5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1454 microversion: 2.1 time: 0.674484 Jun 16 18:43:27.970713 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1547/3034] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:27 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1454 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:27.976739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:27.977484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:28.004358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.004831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.009434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.009932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.087616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:28.296245 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9d3eb0bc-0d56-4eae-b6e1-ef357bb36657 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 204 len: 0 microversion: 2.1 time: 0.323177 Jun 16 18:43:28.300515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1548/3035] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:27 2022] DELETE /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:28.309983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-352ab44e-ecb9-4786-9bb0-d984ad631d49 req-54a0e94a-f773-4f14-82bf-a287faf1a3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45f8f8b-681a-4973-bcf1-4d2891f69bbb", "name": "network-vif-deleted", "tag": "4794262c-b785-47f9-9f46-3dd28dcd4497"}, {"server_uuid": "98632279-dab5-4f24-937d-8b8a6ee9da14", "name": "network-vif-deleted", "tag": "6940e39c-c04d-4789-b122-69a89ca3167e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:28.322818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-352ab44e-ecb9-4786-9bb0-d984ad631d49 req-54a0e94a-f773-4f14-82bf-a287faf1a3cf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.324868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-352ab44e-ecb9-4786-9bb0-d984ad631d49 req-54a0e94a-f773-4f14-82bf-a287faf1a3cf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.343416 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-352ab44e-ecb9-4786-9bb0-d984ad631d49 req-54a0e94a-f773-4f14-82bf-a287faf1a3cf service nova] Creating event network-vif-deleted:4794262c-b785-47f9-9f46-3dd28dcd4497 for instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb on n-h2-846209-2 Jun 16 18:43:28.344711 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-352ab44e-ecb9-4786-9bb0-d984ad631d49 req-54a0e94a-f773-4f14-82bf-a287faf1a3cf service nova] Creating event network-vif-deleted:6940e39c-c04d-4789-b122-69a89ca3167e for instance 98632279-dab5-4f24-937d-8b8a6ee9da14 on n-h1-846209-2 Jun 16 18:43:28.359865 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-352ab44e-ecb9-4786-9bb0-d984ad631d49 req-54a0e94a-f773-4f14-82bf-a287faf1a3cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055975 Jun 16 18:43:28.361019 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1549/3036] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:28.369091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866ea6d430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:28.388023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.388606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.389548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:28.400727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.401478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.402564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.403104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.431439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.432158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.452307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.452893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.496840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:28.517121 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c836558-e210-4c02-bbb9-71341551e98a tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-759969790" status: 201 len: 0 microversion: 2.26 time: 0.154236 Jun 16 18:43:28.518312 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1550/3037] 10.222.0.27 () {62 vars in 1376 bytes} [Thu Jun 16 18:43:28 2022] PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-759969790 => generated 0 bytes in 156 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 16 18:43:28.523646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:28.524437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:28.547505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.548465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.550871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.551621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.695045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:28.704608 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b4f962a-dfb5-4c07-a3fb-f88817f84198 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1252 microversion: 2.1 time: 0.184772 Jun 16 18:43:28.715582 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1551/3038] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:28 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1252 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:28.715582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d5d7ed47-f199-47d3-8a45-fe68f1b1f2e7 req-0cdd0ea7-0dc6-4d8f-a7b0-257ada745a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "9d1b468a-2120-4f05-94a5-e5db40e872bf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:28.734063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d5d7ed47-f199-47d3-8a45-fe68f1b1f2e7 req-0cdd0ea7-0dc6-4d8f-a7b0-257ada745a9f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.734839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d5d7ed47-f199-47d3-8a45-fe68f1b1f2e7 req-0cdd0ea7-0dc6-4d8f-a7b0-257ada745a9f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.754199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d5d7ed47-f199-47d3-8a45-fe68f1b1f2e7 req-0cdd0ea7-0dc6-4d8f-a7b0-257ada745a9f service nova] Creating event network-changed:9d1b468a-2120-4f05-94a5-e5db40e872bf for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:43:28.765959 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d5d7ed47-f199-47d3-8a45-fe68f1b1f2e7 req-0cdd0ea7-0dc6-4d8f-a7b0-257ada745a9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054504 Jun 16 18:43:28.766552 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1552/3039] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:28.781799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:28.782566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:28.794549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.794995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.795789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.796235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.830602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lazy-loading 'flavor' on Instance uuid e5e57881-9458-4864-a6d8-79555341a48e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:28.868901 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Cannot 'shelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state shelved_offloaded Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action HTTP/1.1 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 14 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: {"shelve": {}} Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'shelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state shelved_offloaded Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'shelve': {}}} Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e57881-9458-4864-a6d8-79555341a48e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jun 16 18:43:28.874536 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state shelved_offloaded Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state shelved_offloaded Jun 16 18:43:28.880496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:28.884201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 409 to user: Cannot 'shelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state shelved_offloaded {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:28.885315 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ffea9b3e-48e0-4443-a696-a5d3eb51426f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 409 len: 155 microversion: 2.1 time: 0.117632 Jun 16 18:43:28.886452 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1553/3040] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:43:28 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 155 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:43:28.892320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:28.894063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:28.902149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.902812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:28.904122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:28.904589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:29.196663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:29.206438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:29.208678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:29.210066 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b2cc945-c164-46ea-b266-fdacd2029a46 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1868 microversion: 2.42 time: 0.322332 Jun 16 18:43:29.218441 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1554/3041] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:28 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1868 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:29.218441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:29.218441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:29.224485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:29.224939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:29.225714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:29.226181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:29.531398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Building network info cache for instance {{(pid=119207) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:43:29.552093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:29.565737 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-987d9620-97ad-4fec-a757-f10d34dc7123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1517 microversion: 2.1 time: 0.353016 Jun 16 18:43:29.567671 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1555/3042] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:29 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1517 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:29.574687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:29.575394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:29.593646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:29.598169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:29.601496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:29.602129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:29.628754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:29.995135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:30.008143 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72338a77-2004-459a-a3c4-f6738cbcd88c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1472 microversion: 2.1 time: 0.438079 Jun 16 18:43:30.009000 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1556/3043] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:29 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:30.013885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:30.014545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:30.034951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:30.035416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:30.036213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:30.036758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:30.396429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:30.410778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1f2ed3f-8eae-4f9f-88bc-e95a282b7e1d tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.398401 Jun 16 18:43:30.414139 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1557/3044] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:30 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:30.427626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-915bf145-8483-4f72-9e2d-377748a2007f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866edb21f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:30.443634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-915bf145-8483-4f72-9e2d-377748a2007f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:30.444098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-915bf145-8483-4f72-9e2d-377748a2007f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:30.461387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-915bf145-8483-4f72-9e2d-377748a2007f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-759969790" status: 204 len: 0 microversion: 2.26 time: 0.046012 Jun 16 18:43:30.468726 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1558/3045] 10.222.0.27 () {60 vars in 1357 bytes} [Thu Jun 16 18:43:30 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-759969790 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:30.484121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-27e79c69-5f65-4d31-97e9-d27bade99c83 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:30.484732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-27e79c69-5f65-4d31-97e9-d27bade99c83 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:30.504431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e79c69-5f65-4d31-97e9-d27bade99c83 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:30.504895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e79c69-5f65-4d31-97e9-d27bade99c83 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:30.505712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e79c69-5f65-4d31-97e9-d27bade99c83 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:30.511519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e79c69-5f65-4d31-97e9-d27bade99c83 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:30.807502 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-27e79c69-5f65-4d31-97e9-d27bade99c83 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.336194 Jun 16 18:43:30.817491 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1559/3046] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:43:30 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:43:30.829290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:30.832988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:30.854268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:30.854742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:30.859436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:30.859904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.005462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Updating instance_info_cache with network_info: [{"id": "6407cf64-ee37-44f6-b1c4-145da9892974", "address": "fa:16:3e:17:62:71", "network": {"id": "eb4ce95a-6a88-43dd-b945-b8df90fc19d9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-221510218-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ccdaad865e9746d582f1fbdb07cce5ae", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6407cf64-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119207) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:43:31.008150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5868f931c6342faa9e0c0b276ae5c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139abd9c58324711ac867b920ee2ef7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:31.034785 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d3813ca4-1058-489f-a1dd-0243fb0f74e7 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 200 len: 1252 microversion: 2.1 time: 0.212413 Jun 16 18:43:31.046860 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1560/3047] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:30 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 1252 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:31.061005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Releasing lock "refresh_cache-5c200947-b0a2-4c31-94c7-35186b881d08" {{(pid=119207) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:43:31.066123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4071c7da-22bd-44f0-bac9-9cd68a38a27b tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action" status: 202 len: 0 microversion: 2.1 time: 3.723780 Jun 16 18:43:31.068793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:31.069476 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1488/3048] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:43:27 2022] POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action => generated 0 bytes in 3728 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:43:31.071163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:31.077541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-eacc3ae9-bc3f-444a-b3e8-de61e8b2d6e0 req-00478a61-ef8a-4cee-aef6-67433d7dc259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-plugged", "status": "completed", "tag": "acc30814-2c97-4181-ab6e-ce8ee1dd9456"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:31.091865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.092336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.093217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.093586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.102440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-eacc3ae9-bc3f-444a-b3e8-de61e8b2d6e0 req-00478a61-ef8a-4cee-aef6-67433d7dc259 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.103429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-eacc3ae9-bc3f-444a-b3e8-de61e8b2d6e0 req-00478a61-ef8a-4cee-aef6-67433d7dc259 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.130244 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-eacc3ae9-bc3f-444a-b3e8-de61e8b2d6e0 req-00478a61-ef8a-4cee-aef6-67433d7dc259 service nova] Creating event network-vif-plugged:acc30814-2c97-4181-ab6e-ce8ee1dd9456 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:31.146837 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-eacc3ae9-bc3f-444a-b3e8-de61e8b2d6e0 req-00478a61-ef8a-4cee-aef6-67433d7dc259 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075146 Jun 16 18:43:31.147979 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1489/3049] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:31.158242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2bb72ce1-fea5-408e-9d37-a547d05a3dbc req-49583de3-a6bb-469b-973a-bac676a3f1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c200947-b0a2-4c31-94c7-35186b881d08", "tag": "6407cf64-ee37-44f6-b1c4-145da9892974"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:31.175162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2bb72ce1-fea5-408e-9d37-a547d05a3dbc req-49583de3-a6bb-469b-973a-bac676a3f1ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.175965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2bb72ce1-fea5-408e-9d37-a547d05a3dbc req-49583de3-a6bb-469b-973a-bac676a3f1ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.193513 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2bb72ce1-fea5-408e-9d37-a547d05a3dbc req-49583de3-a6bb-469b-973a-bac676a3f1ee service nova] Creating event network-changed:6407cf64-ee37-44f6-b1c4-145da9892974 for instance 5c200947-b0a2-4c31-94c7-35186b881d08 on n-h2-846209-2 Jun 16 18:43:31.200099 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2bb72ce1-fea5-408e-9d37-a547d05a3dbc req-49583de3-a6bb-469b-973a-bac676a3f1ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047281 Jun 16 18:43:31.200946 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1490/3050] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:31.226798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866e1bf0d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:31.240051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.242105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.243065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:31.253726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.255288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.256852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.257471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.342325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.342822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.403912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:31.444160 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10065eef-03d3-4a37-9e98-30229824662c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 204 len: 0 microversion: 2.26 time: 0.241569 Jun 16 18:43:31.447439 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1491/3051] 10.222.0.27 () {60 vars in 1294 bytes} [Thu Jun 16 18:43:31 2022] DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:31.456023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:31.456657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:31.491936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.492398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.493188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.493629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.749324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:31.760557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:31.773042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:31.774066 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28b44107-1db7-49da-8aa5-274935a4f2f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 0.726026 Jun 16 18:43:31.778656 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1561/3052] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:31 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:31.783483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0e16b33a-3512-4120-9cb2-1614130d98d7 req-5f540083-27c0-4700-a0af-b5264d565325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "314d811b-e77f-454b-9c34-1fe5fab9338b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:31.805442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0e16b33a-3512-4120-9cb2-1614130d98d7 req-5f540083-27c0-4700-a0af-b5264d565325 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.805676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0e16b33a-3512-4120-9cb2-1614130d98d7 req-5f540083-27c0-4700-a0af-b5264d565325 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.820683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:31.832021 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3bd62f70-c2e9-4d58-a747-cdaa28668b05 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1517 microversion: 2.1 time: 0.383281 Jun 16 18:43:31.832161 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0e16b33a-3512-4120-9cb2-1614130d98d7 req-5f540083-27c0-4700-a0af-b5264d565325 service nova] Creating event network-changed:314d811b-e77f-454b-9c34-1fe5fab9338b for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:43:31.835920 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1492/3053] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:31 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1517 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:31.842608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:31.843240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:31.862964 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0e16b33a-3512-4120-9cb2-1614130d98d7 req-5f540083-27c0-4700-a0af-b5264d565325 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082432 Jun 16 18:43:31.866843 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1562/3054] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:31.868191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.879827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:31.880559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:31.886063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.887299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.891252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.913162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.918538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.920037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:31.920501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:31.972551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:32.694294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:32.703414 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-475caf82-393c-473e-88dd-6503ea65a814 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 200 len: 1301 microversion: 2.1 time: 0.835242 Jun 16 18:43:32.716008 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1563/3055] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:31 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 1301 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:32.722734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.108"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:33.118782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:33.132019 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5394f74c-f785-45f6-8235-699cfffd3faf tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1462 microversion: 2.1 time: 1.295255 Jun 16 18:43:33.138305 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1493/3056] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:31 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1462 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:33.147013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:33.152433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:33.167355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:33.169212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:33.176683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:33.178333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:33.229735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:33.234075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:33.244940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:33.247151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:33.249526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:33.251640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:33.950374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:33.959543 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-54d6a584-350b-495d-9b5a-2ae6dcbf1d82 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.819756 Jun 16 18:43:33.974254 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1494/3057] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:33 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:33.976431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c5dd0be-907a-485c-8a23-5a6f9fec379e tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866f1261f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:33.992364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c5dd0be-907a-485c-8a23-5a6f9fec379e tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:33.996378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c5dd0be-907a-485c-8a23-5a6f9fec379e tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:34.019916 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3c5dd0be-907a-485c-8a23-5a6f9fec379e tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 200 len: 12 microversion: 2.26 time: 0.052896 Jun 16 18:43:34.032291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1495/3058] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:43:33 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 12 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:34.037829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:34.047201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] [instance: c45f8f8b-681a-4973-bcf1-4d2891f69bbb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:34.054091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:34.054926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:34.055943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:34.056708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:34.073142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] HTTP exception thrown: Instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb could not be found. Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Request method failure captured: Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb HTTP/1.1 Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3k45ZNwd4MDUw4lsLSfFBMmgu1ISvi3EfO9BnBSDUl30LuL7huiVyTu8VPwgtXdk_RusZHrfTtQ-SF_SiW2v64qIPzLBZlCxrmeid60WoVsaBKSsRLeNni32VEGm0eaayWhSPpVY3c5P5AK1KMtNT5RPC7LQwuYaOrVa_lo5_gb3wM Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 139abd9c58324711ac867b920ee2ef7d Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestBootFromVolume-1161834791 Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/139abd9c58324711ac867b920ee2ef7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/139abd9c58324711ac867b920ee2ef7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_139abd9c58324711ac867b920ee2ef7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/139abd9c58324711ac867b920ee2ef7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestBootFromVolume-1161834791 Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 139abd9c58324711ac867b920ee2ef7d Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1161834791 Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestBootFromVolume-1161834791-project Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a5868f931c6342faa9e0c0b276ae5c7d Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestBootFromVolume-1161834791-project Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb could not be found. Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'c45f8f8b-681a-4973-bcf1-4d2891f69bbb'} Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb could not be found. Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb could not be found. Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:34.075135 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb could not be found. Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Returning 404 to user: Instance c45f8f8b-681a-4973-bcf1-4d2891f69bbb could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c67489b-be8e-412d-b207-c53400c66d91 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb" status: 404 len: 111 microversion: 2.1 time: 0.042898 Jun 16 18:43:34.079268 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1496/3059] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:34 2022] GET /compute/v2.1/servers/c45f8f8b-681a-4973-bcf1-4d2891f69bbb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:34.087760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:34.088598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:34.098936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:34.099399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:34.101618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:34.102503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:34.135895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Acquired lock "refresh_cache-5c200947-b0a2-4c31-94c7-35186b881d08" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:43:34.581156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:34.599506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:34.601812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:34.603159 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ed6b7eb-c100-43d0-a005-ba2bb8080954 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 0.524912 Jun 16 18:43:34.603857 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1497/3060] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:34 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:34.610365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:34.611269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:34.622357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:34.622357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:34.622826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:34.623471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.064342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:35.076425 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e2795af0-74d9-4934-b9cf-017d4ad20162 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1523 microversion: 2.1 time: 0.471210 Jun 16 18:43:35.082438 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1498/3061] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:34 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:35.084729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0136824e-a2d4-4da5-8d6d-116f1f633897 req-a309aec6-81aa-4c23-bd03-21abbc1bcd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-plugged", "status": "completed", "tag": "e06d22a6-1df4-41ea-aaba-8ea87b1c39f8"}, {"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-plugged", "status": "completed", "tag": "321baa9d-5e59-4b65-9482-cde4e2abad51"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:35.100375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0136824e-a2d4-4da5-8d6d-116f1f633897 req-a309aec6-81aa-4c23-bd03-21abbc1bcd82 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.101234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0136824e-a2d4-4da5-8d6d-116f1f633897 req-a309aec6-81aa-4c23-bd03-21abbc1bcd82 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.115890 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0136824e-a2d4-4da5-8d6d-116f1f633897 req-a309aec6-81aa-4c23-bd03-21abbc1bcd82 service nova] Creating event network-vif-plugged:e06d22a6-1df4-41ea-aaba-8ea87b1c39f8 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:35.116413 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0136824e-a2d4-4da5-8d6d-116f1f633897 req-a309aec6-81aa-4c23-bd03-21abbc1bcd82 service nova] Creating event network-vif-plugged:321baa9d-5e59-4b65-9482-cde4e2abad51 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:35.125247 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0136824e-a2d4-4da5-8d6d-116f1f633897 req-a309aec6-81aa-4c23-bd03-21abbc1bcd82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045005 Jun 16 18:43:35.126247 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1499/3062] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:35.131961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:35.132676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 6540ae2d-e393-4b2f-9a87-675fd48a8f50] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:35.139910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.140369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.141184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.141624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.161553 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 could not be found. Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 HTTP/1.1 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 could not be found. Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '6540ae2d-e393-4b2f-9a87-675fd48a8f50'} Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 could not be found. Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 could not be found. Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:35.163829 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:35.168522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:35.168522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:35.168522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:35.168522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:35.168522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:35.168522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 could not be found. Jun 16 18:43:35.168522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:35.170873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:35.172017 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-42515ed8-2efd-4d0d-8e8f-edcec36f1921 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50" status: 404 len: 111 microversion: 2.1 time: 0.044630 Jun 16 18:43:35.173218 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1500/3063] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:35 2022] GET /compute/v2.1/servers/6540ae2d-e393-4b2f-9a87-675fd48a8f50 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:35.179230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ce3add9f-3824-4730-a3ab-06c677b6a524 req-1fe9f5af-26c8-47d9-88c8-2e914f7813e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6540ae2d-e393-4b2f-9a87-675fd48a8f50", "name": "network-vif-deleted", "tag": "875e6417-2ae8-43ad-9b38-915043cdda45"}, {"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "8d17ac6b-6841-40b8-b764-916f547af808"}, {"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "b3893116-c573-4d2e-b1ad-049449293671"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:35.191677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ce3add9f-3824-4730-a3ab-06c677b6a524 req-1fe9f5af-26c8-47d9-88c8-2e914f7813e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.192466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ce3add9f-3824-4730-a3ab-06c677b6a524 req-1fe9f5af-26c8-47d9-88c8-2e914f7813e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.207769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ce3add9f-3824-4730-a3ab-06c677b6a524 req-1fe9f5af-26c8-47d9-88c8-2e914f7813e8 service nova] Creating event network-vif-deleted:875e6417-2ae8-43ad-9b38-915043cdda45 for instance 6540ae2d-e393-4b2f-9a87-675fd48a8f50 on n-h2-846209-2 Jun 16 18:43:35.208687 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ce3add9f-3824-4730-a3ab-06c677b6a524 req-1fe9f5af-26c8-47d9-88c8-2e914f7813e8 service nova] Creating event network-changed:8d17ac6b-6841-40b8-b764-916f547af808 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:43:35.209453 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ce3add9f-3824-4730-a3ab-06c677b6a524 req-1fe9f5af-26c8-47d9-88c8-2e914f7813e8 service nova] Creating event network-changed:b3893116-c573-4d2e-b1ad-049449293671 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:43:35.217126 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ce3add9f-3824-4730-a3ab-06c677b6a524 req-1fe9f5af-26c8-47d9-88c8-2e914f7813e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.042239 Jun 16 18:43:35.218613 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1501/3064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:35.228475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866f25d310>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:35.237827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.238819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.239665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:35.248058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.248802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.249865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.250638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.280509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.281347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.293983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.295025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.344716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:35.383861 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e966fb30-bd27-4796-b753-bb039793d336 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1055256141" status: 201 len: 0 microversion: 2.26 time: 0.163471 Jun 16 18:43:35.385161 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1502/3065] 10.222.0.27 () {62 vars in 1379 bytes} [Thu Jun 16 18:43:35 2022] PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1055256141 => generated 0 bytes in 166 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 16 18:43:35.390736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69e9bca2-7b66-413f-90b7-3a352bc8eb79 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] Calling method '.version_select at 0x7f866f5d6a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:35.430348 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69e9bca2-7b66-413f-90b7-3a352bc8eb79 tempest-ServersTestBootFromVolume-1161834791 tempest-ServersTestBootFromVolume-1161834791-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-207491509" status: 202 len: 0 microversion: 2.1 time: 0.043645 Jun 16 18:43:35.431254 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1503/3066] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:43:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-207491509 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:43:35.436585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:35.438749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:35.458176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.458996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:35.460185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:35.460830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:36.547223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:36.559680 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c6baff7-ba17-4917-9e1e-d2984554a5ba tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 1.127113 Jun 16 18:43:36.560294 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1504/3067] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:35 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:36.578380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:36.579856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:36.592156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:36.592513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:36.596039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:36.596765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:37.258364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Building network info cache for instance {{(pid=119206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 18:43:37.394845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:37.410125 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-58504a1e-705d-4ea4-8d9c-a78adf813156 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1355 microversion: 2.1 time: 0.845841 Jun 16 18:43:37.411558 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1505/3068] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:36 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1355 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:37.416496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:37.420301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:37.432299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:37.435068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:37.436079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:37.438453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:37.493556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:37.584773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:37.621523 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3862ada8-2ece-4ae8-b1ec-a6cf937266e1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 204 len: 0 microversion: 2.1 time: 0.208407 Jun 16 18:43:37.622847 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1506/3069] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:37 2022] DELETE /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:37.635284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e780dca6-7c6a-4e55-b861-e1cf7bcdbbbd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f86740c2ca0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:37.645618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e780dca6-7c6a-4e55-b861-e1cf7bcdbbbd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:37.646405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e780dca6-7c6a-4e55-b861-e1cf7bcdbbbd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:37.660532 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e780dca6-7c6a-4e55-b861-e1cf7bcdbbbd tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 200 len: 36 microversion: 2.26 time: 0.035976 Jun 16 18:43:37.666411 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1507/3070] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:43:37 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 36 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:37.672328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:37.673358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:37.686380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:37.690705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:37.691943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:37.692451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:38.671513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:38.689579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:38.691630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:38.692837 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3b3f4c0-025d-431e-af79-c63d433a6875 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 1.025026 Jun 16 18:43:38.710084 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1508/3071] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:37 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:38.715425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:38.723904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:38.734283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:38.734984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:38.735948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:38.736637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:39.380525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:39.392945 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f132727-41c4-49e9-888d-18f1a70d1fb7 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1523 microversion: 2.1 time: 0.680647 Jun 16 18:43:39.396945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Updating instance_info_cache with network_info: [{"id": "6407cf64-ee37-44f6-b1c4-145da9892974", "address": "fa:16:3e:17:62:71", "network": {"id": "eb4ce95a-6a88-43dd-b945-b8df90fc19d9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-221510218-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ccdaad865e9746d582f1fbdb07cce5ae", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6407cf64-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:43:39.416505 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1509/3072] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:38 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1523 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:39.416505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f5bd1177-7113-4ac1-babf-84e102d5cea1 req-3dda34b6-dd54-4bc1-9b56-f33c75858ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b446cff3-9611-4d43-b11b-23d652af04a7", "name": "network-vif-unplugged", "status": "completed", "tag": "fdd84aca-3892-45e3-8292-04a00a95f23f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:39.416844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Releasing lock "refresh_cache-5c200947-b0a2-4c31-94c7-35186b881d08" {{(pid=119206) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:43:39.416844 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-241959ce-82c1-4a76-848a-2d9c1fdfd053 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action" status: 202 len: 0 microversion: 2.1 time: 6.697052 Jun 16 18:43:39.419107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1564/3073] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:43:32 2022] POST /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08/action => generated 0 bytes in 6702 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 18:43:39.426173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-dea2430b-dd05-4533-bdde-e030cd043750 req-8be6aa96-679b-4cd1-9f55-eac542cb0d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c200947-b0a2-4c31-94c7-35186b881d08", "tag": "6407cf64-ee37-44f6-b1c4-145da9892974"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:39.437470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dea2430b-dd05-4533-bdde-e030cd043750 req-8be6aa96-679b-4cd1-9f55-eac542cb0d91 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:39.438198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dea2430b-dd05-4533-bdde-e030cd043750 req-8be6aa96-679b-4cd1-9f55-eac542cb0d91 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:39.448363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f5bd1177-7113-4ac1-babf-84e102d5cea1 req-3dda34b6-dd54-4bc1-9b56-f33c75858ade service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:39.448831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f5bd1177-7113-4ac1-babf-84e102d5cea1 req-3dda34b6-dd54-4bc1-9b56-f33c75858ade service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:39.457202 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-dea2430b-dd05-4533-bdde-e030cd043750 req-8be6aa96-679b-4cd1-9f55-eac542cb0d91 service nova] Creating event network-changed:6407cf64-ee37-44f6-b1c4-145da9892974 for instance 5c200947-b0a2-4c31-94c7-35186b881d08 on n-h2-846209-2 Jun 16 18:43:39.464365 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-dea2430b-dd05-4533-bdde-e030cd043750 req-8be6aa96-679b-4cd1-9f55-eac542cb0d91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043309 Jun 16 18:43:39.465875 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1565/3074] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:39.474654 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f5bd1177-7113-4ac1-babf-84e102d5cea1 req-3dda34b6-dd54-4bc1-9b56-f33c75858ade service nova] Creating event network-vif-unplugged:fdd84aca-3892-45e3-8292-04a00a95f23f for instance b446cff3-9611-4d43-b11b-23d652af04a7 on n-h1-846209-2 Jun 16 18:43:39.486444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6dc40e63-95c3-4ffb-b8b7-e3be825ab87d req-0c83284d-3766-4312-b58f-6f97c315540f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "ba2ae7ab-69a0-4f82-8d6a-7c53590e8739"}, {"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "241f1fc5-16df-4f88-83bb-da75d25e2755"}, {"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "007a7fdc-42d7-466b-a1f0-28a9c6ab1600"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:39.499690 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f5bd1177-7113-4ac1-babf-84e102d5cea1 req-3dda34b6-dd54-4bc1-9b56-f33c75858ade service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092160 Jun 16 18:43:39.500740 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1510/3075] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:39.506638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:39.507366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:39.526712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6dc40e63-95c3-4ffb-b8b7-e3be825ab87d req-0c83284d-3766-4312-b58f-6f97c315540f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:39.529471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6dc40e63-95c3-4ffb-b8b7-e3be825ab87d req-0c83284d-3766-4312-b58f-6f97c315540f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:39.556848 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6dc40e63-95c3-4ffb-b8b7-e3be825ab87d req-0c83284d-3766-4312-b58f-6f97c315540f service nova] Creating event network-changed:ba2ae7ab-69a0-4f82-8d6a-7c53590e8739 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:43:39.560639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:39.561448 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6dc40e63-95c3-4ffb-b8b7-e3be825ab87d req-0c83284d-3766-4312-b58f-6f97c315540f service nova] Creating event network-changed:241f1fc5-16df-4f88-83bb-da75d25e2755 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:43:39.561612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:39.562013 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6dc40e63-95c3-4ffb-b8b7-e3be825ab87d req-0c83284d-3766-4312-b58f-6f97c315540f service nova] Creating event network-changed:007a7fdc-42d7-466b-a1f0-28a9c6ab1600 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:43:39.562413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:39.562865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:39.575968 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6dc40e63-95c3-4ffb-b8b7-e3be825ab87d req-0c83284d-3766-4312-b58f-6f97c315540f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.108260 Jun 16 18:43:39.576613 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1566/3076] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:39.586222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:39.589526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:39.611289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:39.613384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:39.613384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:39.613781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:40.146715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:40.160128 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a838ac5e-e906-430e-aeff-53805aeead9a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.658055 Jun 16 18:43:40.161047 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1511/3077] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:39 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:40.173573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866f1650d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:40.193124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:40.197752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:40.198619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:40.215784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:40.216595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:40.217639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:40.218330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:40.227243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:40.306107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:40.307520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:40.314325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:40.324423 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50688569-8e86-45bc-8806-90f8c1b1aae1 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 200 len: 1470 microversion: 2.1 time: 0.746562 Jun 16 18:43:40.328189 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1567/3078] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:39 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 1470 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:40.341250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:40.343395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:40.378273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:40.380346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:40.384629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:40.386938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:40.406514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:40.446598 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-04d447c9-8ad3-40f0-beb5-a129f1f82381 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1055256141" status: 204 len: 0 microversion: 2.26 time: 0.284236 Jun 16 18:43:40.447837 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1512/3079] 10.222.0.27 () {60 vars in 1363 bytes} [Thu Jun 16 18:43:40 2022] DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1055256141 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:40.456472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-09f93c97-9e84-4cb8-8f66-4c1b49939ce5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '.version_select at 0x7f866f25d9d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:40.989223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:40.999717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9193e977-cbc2-4761-be12-fd73bb12755a tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1803 microversion: 2.1 time: 0.667635 Jun 16 18:43:41.006783 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1568/3080] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:40 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1803 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:41.024147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:41.025306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:41.040512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:41.042651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:41.046084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:41.046938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:42.075168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:42.088170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:42.092609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:42.097595 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0f4fdf8e-10ba-4e2c-b192-7d0b6f221799 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 1.089245 Jun 16 18:43:42.129067 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1569/3081] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:41 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:42.144379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:42.145032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:42.177789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:42.179486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:42.180507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:42.181326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:43.807525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:43.833100 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15888991-c61c-4068-8ac9-5cc026957213 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1523 microversion: 2.1 time: 1.700743 Jun 16 18:43:43.834637 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1570/3082] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:42 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1523 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:43.858508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-741e2401-69d1-4e97-b815-56a4cf5d0d0f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866ea7bdc0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:43.891280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-741e2401-69d1-4e97-b815-56a4cf5d0d0f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:43.894672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-741e2401-69d1-4e97-b815-56a4cf5d0d0f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:43.937545 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-741e2401-69d1-4e97-b815-56a4cf5d0d0f tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 200 len: 12 microversion: 2.26 time: 0.099193 Jun 16 18:43:43.944069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1571/3083] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:43:43 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 12 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:43.958200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae82b827-29bc-4ef2-8879-f1e8f34a6e89 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:43.959384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ae82b827-29bc-4ef2-8879-f1e8f34a6e89 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:44.000687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae82b827-29bc-4ef2-8879-f1e8f34a6e89 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.003940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae82b827-29bc-4ef2-8879-f1e8f34a6e89 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:44.007838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae82b827-29bc-4ef2-8879-f1e8f34a6e89 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.010738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae82b827-29bc-4ef2-8879-f1e8f34a6e89 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:44.075705 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae82b827-29bc-4ef2-8879-f1e8f34a6e89 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e/ips" status: 200 len: 216 microversion: 2.1 time: 0.128193 Jun 16 18:43:44.076337 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1572/3084] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:43:43 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e/ips => generated 216 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:44.096912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:44.097862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:44.117710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.118206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:44.132370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.133088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:44.639506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:44.655690 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-39c70e0f-6fdb-4720-b69b-0dd75da48d6f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.578239 Jun 16 18:43:44.669443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1573/3085] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:44 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:44.675853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:44.684501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:44.716321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.717215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:44.727127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.735638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:44.742815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:44.793147 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc could not be found. Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc HTTP/1.1 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc could not be found. Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc'} Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc could not be found. Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc could not be found. Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:44.806772 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc could not be found. Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:44.812567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:44.817208 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24ea6604-e5b3-4995-b93c-4a04da4ff40b tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc" status: 404 len: 111 microversion: 2.1 time: 0.146170 Jun 16 18:43:44.822732 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1574/3086] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:44 2022] GET /compute/v2.1/servers/9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:44.843064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0329c71d-c3f6-4ee8-9dcc-005f2747b58b req-39968afe-7c94-4cbf-be6c-452c36f27e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b446cff3-9611-4d43-b11b-23d652af04a7", "name": "network-vif-plugged", "status": "completed", "tag": "fdd84aca-3892-45e3-8292-04a00a95f23f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:44.866802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0329c71d-c3f6-4ee8-9dcc-005f2747b58b req-39968afe-7c94-4cbf-be6c-452c36f27e52 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.867439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0329c71d-c3f6-4ee8-9dcc-005f2747b58b req-39968afe-7c94-4cbf-be6c-452c36f27e52 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:44.893894 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0329c71d-c3f6-4ee8-9dcc-005f2747b58b req-39968afe-7c94-4cbf-be6c-452c36f27e52 service nova] Creating event network-vif-plugged:fdd84aca-3892-45e3-8292-04a00a95f23f for instance b446cff3-9611-4d43-b11b-23d652af04a7 on n-h1-846209-2 Jun 16 18:43:44.909483 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0329c71d-c3f6-4ee8-9dcc-005f2747b58b req-39968afe-7c94-4cbf-be6c-452c36f27e52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083944 Jun 16 18:43:44.912688 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1575/3087] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:44.937370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5c61e2c3-265e-4821-8c7f-45fbda8ad3d4 req-acbb088e-0deb-4702-bafa-1d437e13e987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e57881-9458-4864-a6d8-79555341a48e", "tag": "f395f5ff-79af-48cc-8d9f-7b45e4bba8d9"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:44.962974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5c61e2c3-265e-4821-8c7f-45fbda8ad3d4 req-acbb088e-0deb-4702-bafa-1d437e13e987 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:44.976006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5c61e2c3-265e-4821-8c7f-45fbda8ad3d4 req-acbb088e-0deb-4702-bafa-1d437e13e987 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:45.008855 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5c61e2c3-265e-4821-8c7f-45fbda8ad3d4 req-acbb088e-0deb-4702-bafa-1d437e13e987 service nova] Creating event network-changed:f395f5ff-79af-48cc-8d9f-7b45e4bba8d9 for instance e5e57881-9458-4864-a6d8-79555341a48e on n-h1-846209-2 Jun 16 18:43:45.041128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5c61e2c3-265e-4821-8c7f-45fbda8ad3d4 req-acbb088e-0deb-4702-bafa-1d437e13e987 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125622 Jun 16 18:43:45.043232 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1576/3088] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:45.061450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-054234d6-19b4-41f1-b6ff-874376a7cc41 req-8de9fcea-8615-483f-a927-301e008badd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc", "name": "network-vif-deleted", "tag": "7ebb7f51-5959-443e-b794-15f9278558ca"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:45.091727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-054234d6-19b4-41f1-b6ff-874376a7cc41 req-8de9fcea-8615-483f-a927-301e008badd2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:45.092302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-054234d6-19b4-41f1-b6ff-874376a7cc41 req-8de9fcea-8615-483f-a927-301e008badd2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:45.138806 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-054234d6-19b4-41f1-b6ff-874376a7cc41 req-8de9fcea-8615-483f-a927-301e008badd2 service nova] Creating event network-vif-deleted:7ebb7f51-5959-443e-b794-15f9278558ca for instance 9817b1d6-0db9-4bb1-94c0-1a1cd178d9fc on n-h2-846209-2 Jun 16 18:43:45.160982 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-054234d6-19b4-41f1-b6ff-874376a7cc41 req-8de9fcea-8615-483f-a927-301e008badd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112038 Jun 16 18:43:45.169239 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1577/3089] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:45.189355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:45.194772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:45.226332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:45.230816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:45.234712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:45.235352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.730349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:46.745119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:46.758763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:46.762034 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c968bb36-3de4-4829-80c9-56771d46c7db tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 1.587611 Jun 16 18:43:46.769968 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1578/3090] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:45 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:46.776191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-09f93c97-9e84-4cb8-8f66-4c1b49939ce5 tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/a58dcd2b-b44f-4384-a578-7d3739f3d3b6" status: 202 len: 0 microversion: 2.1 time: 6.326923 Jun 16 18:43:46.777800 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1513/3091] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:43:40 2022] DELETE /compute/v2.1/os-floating-ips/a58dcd2b-b44f-4384-a578-7d3739f3d3b6 => generated 0 bytes in 6329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:43:46.782987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866ed59e50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:46.789558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:46.790390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:46.802268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.806250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.815959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:46.824479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.825275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.827918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.828589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.829410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.830317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.839074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.839972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.881138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.888948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.912355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:46.918454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:46.946688 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b7a07067-dce9-4a40-a3cb-b0a491170ebf tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 204 len: 0 microversion: 2.26 time: 0.180213 Jun 16 18:43:46.950146 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1579/3092] 10.222.0.27 () {60 vars in 1294 bytes} [Thu Jun 16 18:43:46 2022] DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:46.960410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:46.961309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:46.981147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.981879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:46.982907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:46.983540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.070101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:47.118533 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-542c41b1-42e5-4f4c-acba-53dc91fa90bd tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 204 len: 0 microversion: 2.1 time: 0.338806 Jun 16 18:43:47.119898 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1514/3093] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:46 2022] DELETE /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:47.131080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:47.134224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:47.152585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.153379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.154977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.155589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.347583 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c8676531-a051-47e2-9c7d-7d281dc10f97 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2" status: 204 len: 0 microversion: 2.1 time: 0.396056 Jun 16 18:43:47.348498 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1580/3094] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:46 2022] DELETE /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:47.359070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:47.359876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:47.377679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.380946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.381945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.382616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.718549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:47.738234 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4caf9268-f4e6-4db9-966c-f788e257f76f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1523 microversion: 2.1 time: 0.616494 Jun 16 18:43:47.742219 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1515/3095] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:47 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1523 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:47.765410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2eed7f94-efa3-44e2-bf68-6f8da71430af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '.version_select at 0x7f866e8c10d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:47.786334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:47.796972 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0009ff3a-8b21-4364-9dab-9c59a9026bef tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.447255 Jun 16 18:43:47.818891 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1581/3096] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:47 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:47.818891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f867805fca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:47.832101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.832562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.833034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:47.845835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.846332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.847205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.847817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.879328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.879905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.889759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:47.890257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:47.934157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:47.980140 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cae37439-e7bc-4376-a6e4-78043de80870 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1582114579" status: 201 len: 0 microversion: 2.26 time: 0.171204 Jun 16 18:43:47.982305 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1582/3097] 10.222.0.27 () {62 vars in 1379 bytes} [Thu Jun 16 18:43:47 2022] PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1582114579 => generated 0 bytes in 174 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 16 18:43:47.989462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:47.998549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:48.007872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.009347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.010712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.011375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.228255 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2eed7f94-efa3-44e2-bf68-6f8da71430af tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4450fa73-ec7a-4019-94cf-525b33e35eec" status: 202 len: 0 microversion: 2.1 time: 0.481598 Jun 16 18:43:48.229246 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1516/3098] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:43:47 2022] DELETE /compute/v2.1/os-security-groups/4450fa73-ec7a-4019-94cf-525b33e35eec => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:43:48.240067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:48.241092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:48.258974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.259813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.260641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.261073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.314160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:48.323898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:48.332408 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-82a2c467-ee2c-4dab-bbb0-97521f711bb1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1809 microversion: 2.1 time: 0.348749 Jun 16 18:43:48.342827 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1583/3099] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:47 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1809 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:48.348706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:48.349614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:48.358972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.359760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.360871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.362406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.467667 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72b222e3-b343-4bd3-8148-4606ef7f3245 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 204 len: 0 microversion: 2.1 time: 0.236625 Jun 16 18:43:48.468285 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1517/3100] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:48 2022] DELETE /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:48.477198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866e8c1d30>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:48.498235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.498702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.499327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:48.506911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.507470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.508265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.508835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.540069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.540545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.551130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.551594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.588911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:48.608268 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c7dfdf46-9ca8-4843-a3d0-c05ebb8b8bfe tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1645593340" status: 201 len: 0 microversion: 2.26 time: 0.138595 Jun 16 18:43:48.609224 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1518/3101] 10.222.0.27 () {62 vars in 1379 bytes} [Thu Jun 16 18:43:48 2022] PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1645593340 => generated 0 bytes in 140 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 16 18:43:48.630039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:48.630571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:48.644860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.645662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.648025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.648697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.691143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:48.732106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:48.750166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:48.753194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:48.758061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be1dc138-67f3-4af5-834f-0a069a38bebb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 0.411492 Jun 16 18:43:48.758905 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1584/3102] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:48 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:48.764070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:48.765319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:48.773131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.774046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.775082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.775781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.834412 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-77e57e6e-818c-482f-a6b5-22bc0f0a34be tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 204 len: 0 microversion: 2.1 time: 0.223753 Jun 16 18:43:48.835233 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1519/3103] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:48 2022] DELETE /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:48.849735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866e1440d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:48.868060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.872412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.873502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:48.883317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.883782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.884560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.891373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.945182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:48.945581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:48.977074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:49.006435 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-68316d0d-c063-435e-a92b-cf36fade8927 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 204 len: 0 microversion: 2.26 time: 0.166665 Jun 16 18:43:49.012493 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1520/3104] 10.222.0.27 () {60 vars in 1294 bytes} [Thu Jun 16 18:43:48 2022] DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:49.019577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:49.020207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:49.034222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.034679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.035467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.035912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.126718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:49.142723 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b146dd1d-b649-44b6-ace6-ede12209a4c3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2" status: 200 len: 1472 microversion: 2.1 time: 0.382105 Jun 16 18:43:49.143544 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1585/3105] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:48 2022] GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:49.158829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:49.160150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:49.177464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.179074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.179960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.182181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.218422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:49.228373 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8829cfee-ce6b-4284-a626-872781f49858 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1523 microversion: 2.1 time: 0.213285 Jun 16 18:43:49.230415 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1521/3106] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:49 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:49.237036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:49.237949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:49.245231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.245994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.247291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.247998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.279245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=2,nova_cell1:UPDATE=3,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:49.483116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:49.500271 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7f30bde3-0dd1-4783-8b18-cc20457f12a0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.354740 Jun 16 18:43:49.500890 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1586/3107] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:49 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:49.515127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2117fddf-3ca3-42d8-b0ee-e841c3764852 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866ed301f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:49.532953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2117fddf-3ca3-42d8-b0ee-e841c3764852 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.533459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2117fddf-3ca3-42d8-b0ee-e841c3764852 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.553515 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2117fddf-3ca3-42d8-b0ee-e841c3764852 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 200 len: 12 microversion: 2.26 time: 0.051481 Jun 16 18:43:49.554650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:49.555069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1587/3108] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:43:49 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 12 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:49.561864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:49.563366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:49.571400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.572107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.572297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fb61e39e-1f68-4558-ad84-5958facaabdb tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1510 microversion: 2.1 time: 0.339790 Jun 16 18:43:49.572838 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1522/3109] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:49 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:49.573565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.574034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.588170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-dd58817e-10c3-4c61-8ffc-d23f0e336aa1 req-944923c4-c345-4386-a29b-20eef49f8f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f7f779-3f3a-41b7-b2d8-cf4777355ee2", "name": "network-vif-deleted", "tag": "5f0e6c8b-f702-4cae-b887-89e04d9efdf4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:49.611063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dd58817e-10c3-4c61-8ffc-d23f0e336aa1 req-944923c4-c345-4386-a29b-20eef49f8f23 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.612617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dd58817e-10c3-4c61-8ffc-d23f0e336aa1 req-944923c4-c345-4386-a29b-20eef49f8f23 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.637423 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-dd58817e-10c3-4c61-8ffc-d23f0e336aa1 req-944923c4-c345-4386-a29b-20eef49f8f23 service nova] Creating event network-vif-deleted:5f0e6c8b-f702-4cae-b887-89e04d9efdf4 for instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 on n-h2-846209-2 Jun 16 18:43:49.645938 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-dd58817e-10c3-4c61-8ffc-d23f0e336aa1 req-944923c4-c345-4386-a29b-20eef49f8f23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071563 Jun 16 18:43:49.647633 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1523/3110] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:49.657718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f8678031ee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:49.669927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.670961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.672060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:49.681343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.682082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.683039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.683686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.709886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.710449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.749048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:49.818003 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6e19bab6-dd24-4976-bf61-d577770798ec tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 204 len: 0 microversion: 2.26 time: 0.167692 Jun 16 18:43:49.836004 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1524/3111] 10.222.0.27 () {60 vars in 1294 bytes} [Thu Jun 16 18:43:49 2022] DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:49.855762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:49.855762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:49.883121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.883605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:49.884393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:49.884837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.082718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:50.099049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f157ff62-d369-40a9-85e7-10491d682d49 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1809 microversion: 2.1 time: 0.541846 Jun 16 18:43:50.104923 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1588/3112] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:49 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1809 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:50.126532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866f570940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:50.167483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.168415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.170903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:50.184516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.186413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.188543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.191767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.261728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.262490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.284357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:50.298410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.299585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.379154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:50.420023 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa0e7538-f45b-431f-aebe-948b90b0fb70 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1403388289" status: 201 len: 0 microversion: 2.26 time: 0.312354 Jun 16 18:43:50.430043 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1589/3113] 10.222.0.27 () {62 vars in 1379 bytes} [Thu Jun 16 18:43:50 2022] PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1403388289 => generated 0 bytes in 323 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 16 18:43:50.441500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:50.443527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:50.466635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.467881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.470128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.472979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.497048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:50.512528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:50.514477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:50.532557 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-49119a76-eaf3-423a-9b76-0115630583d2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 0.697726 Jun 16 18:43:50.538170 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1525/3114] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:49 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:50.572011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:50.572706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:50.604351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.605160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.622916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.623785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.648255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:50.678232 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2cae6af6-e971-4d33-9904-1c8492ae43a5 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2" status: 200 len: 1430 microversion: 2.1 time: 0.243767 Jun 16 18:43:50.681766 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1590/3115] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:50 2022] GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 => generated 1430 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:50.699895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866ea4c0d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:50.733547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.738753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.740623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:50.763054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.766862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.775282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.776886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.881052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.882462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:50.930207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:50.932571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.040442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:51.068199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fbc6b94d-e93a-4a84-a7bc-a9ced81a4db3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1434436992" status: 201 len: 0 microversion: 2.26 time: 0.384543 Jun 16 18:43:51.069632 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1591/3116] 10.222.0.27 () {62 vars in 1379 bytes} [Thu Jun 16 18:43:50 2022] PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags/tempest-tag-1434436992 => generated 0 bytes in 387 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 16 18:43:51.076553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:51.076807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:51.085398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.086083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.086889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.087344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.594574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:51.599268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:51.610307 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-df6e03a3-2f52-4e7d-9cb3-36643ef006fa tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.536837 Jun 16 18:43:51.610307 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1592/3117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:51 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:51.622380 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3422ba28-d7f0-4b29-9887-d2b3573fcf5b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1523 microversion: 2.1 time: 1.081059 Jun 16 18:43:51.624570 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1526/3118] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:50 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1523 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:51.626223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:51.627662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:51.631793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Action: 'update_all', calling method: .version_select at 0x7f866f5d6ca0>, body: {"tags": ["tempest-tag-903310919", "tempest-tag-819092263"]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:51.641312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.642103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.643475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.644094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.644609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:51.644839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.645460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.651321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.652812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.654247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.655113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.692062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.692813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.724310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:51.755241 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5651b0a2-1f1b-4432-931e-fb6b58340cd3 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 200 len: 60 microversion: 2.26 time: 0.129265 Jun 16 18:43:51.756255 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1527/3119] 10.222.0.27 () {62 vars in 1311 bytes} [Thu Jun 16 18:43:51 2022] PUT /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 60 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:51.762191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:51.762902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:51.769669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.770259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.772823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.773329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.808643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65eae1745f34a5599af74ac260ed634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaad865e9746d582f1fbdb07cce5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:51.821716 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-38108df1-4416-485b-bb11-0f7d1820af1c tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 200 len: 1468 microversion: 2.1 time: 0.210802 Jun 16 18:43:51.822580 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1593/3120] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:51 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:51.827381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:51.828005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:51.854895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.855438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:51.856379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:51.857039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.104110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:52.115400 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3063455f-d864-477b-ab02-7149bf72594c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1809 microversion: 2.1 time: 0.358014 Jun 16 18:43:52.125961 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1528/3121] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:51 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1809 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:52.161932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:52.165571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 64f7f779-3f3a-41b7-b2d8-cf4777355ee2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:52.199775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.202388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.203933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.204971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.260286 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 could not be found. Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 HTTP/1.1 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 could not be found. Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '64f7f779-3f3a-41b7-b2d8-cf4777355ee2'} Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 could not be found. Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 could not be found. Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:52.266949 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:52.286947 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:52.286947 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:52.286947 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:52.286947 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:52.286947 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:52.286947 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 could not be found. Jun 16 18:43:52.286947 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:52.291851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 64f7f779-3f3a-41b7-b2d8-cf4777355ee2 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:52.297322 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-020db234-c89c-466e-857e-7365071022d9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2" status: 404 len: 111 microversion: 2.1 time: 0.168985 Jun 16 18:43:52.304910 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1529/3122] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:52 2022] GET /compute/v2.1/servers/64f7f779-3f3a-41b7-b2d8-cf4777355ee2 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:52.323393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc8dfa3b-4539-42b5-ac4f-c155c887b6a9 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866f1bce50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:52.349367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc8dfa3b-4539-42b5-ac4f-c155c887b6a9 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.352108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc8dfa3b-4539-42b5-ac4f-c155c887b6a9 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.365440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:52.382087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:52.383676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:52.384955 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-99cf84fa-1203-435e-9ed1-56d433d250d3 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1889 microversion: 2.42 time: 0.561477 Jun 16 18:43:52.398280 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1594/3123] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:51 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1889 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:52.404348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-417eafd7-63b0-4004-81a1-04f6a960a118 req-9d14595c-638a-4be8-b503-6cff4849f74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c200947-b0a2-4c31-94c7-35186b881d08", "name": "network-vif-deleted", "tag": "6407cf64-ee37-44f6-b1c4-145da9892974"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:52.419429 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cc8dfa3b-4539-42b5-ac4f-c155c887b6a9 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 200 len: 60 microversion: 2.26 time: 0.109295 Jun 16 18:43:52.429059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-417eafd7-63b0-4004-81a1-04f6a960a118 req-9d14595c-638a-4be8-b503-6cff4849f74a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.430034 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1530/3124] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jun 16 18:43:52 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 60 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:52.431383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-417eafd7-63b0-4004-81a1-04f6a960a118 req-9d14595c-638a-4be8-b503-6cff4849f74a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.449803 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-417eafd7-63b0-4004-81a1-04f6a960a118 req-9d14595c-638a-4be8-b503-6cff4849f74a service nova] Creating event network-vif-deleted:6407cf64-ee37-44f6-b1c4-145da9892974 for instance 5c200947-b0a2-4c31-94c7-35186b881d08 on n-h2-846209-2 Jun 16 18:43:52.457672 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-417eafd7-63b0-4004-81a1-04f6a960a118 req-9d14595c-638a-4be8-b503-6cff4849f74a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057553 Jun 16 18:43:52.459182 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1595/3125] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:52.467222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:52.467550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '.version_select at 0x7f866e3a4af0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:52.467861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:52.489183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.490661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.491648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:52.502743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.503270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.508803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.512660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.524653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.525708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.526268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.527280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.611949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.612633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.660275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lazy-loading 'flavor' on Instance uuid 39d5d199-53f6-492e-b5af-086aa748a160 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:43:52.699805 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6b01e0e-a35d-436c-ae29-bbc826156bff tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags" status: 204 len: 0 microversion: 2.26 time: 0.239007 Jun 16 18:43:52.700746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1596/3126] 10.222.0.27 () {60 vars in 1294 bytes} [Thu Jun 16 18:43:52 2022] DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160/tags => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:52.709151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:52.716932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:52.735193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.735984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:52.737207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:52.738538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:53.794802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:53.805674 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59b89913-6f42-4dc4-b196-a97d625d0648 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 1.103518 Jun 16 18:43:53.806520 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1597/3127] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:52 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:53.821110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:53.821698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:53.831965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:53.832913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:53.834122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:53.834820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:53.982738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:53.993685 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8f753d69-ab73-486d-a116-400c2294cce4 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1473 microversion: 2.1 time: 1.561822 Jun 16 18:43:54.003902 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1531/3128] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:52 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1473 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:54.016003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:54.016522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:54.036632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.037368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.039300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.041083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.106138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:54.313182 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dc929b6c-8b30-4a53-ae46-207c9b85b545 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 204 len: 0 microversion: 2.26 time: 0.307817 Jun 16 18:43:54.314946 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1532/3129] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:43:54 2022] DELETE /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:43:54.328030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:54.337395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] [instance: 5c200947-b0a2-4c31-94c7-35186b881d08] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:54.357348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.357849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.360115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.361163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.394127 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] HTTP exception thrown: Instance 5c200947-b0a2-4c31-94c7-35186b881d08 could not be found. Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Request method failure captured: Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 HTTP/1.1 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3l3R7sXDdadBUCRs8VMgoH86ZbMYMIvbj7LeKCc_w-NSRBydggkkQUvrJIxtUwjftgE0aaWlgMbdQznKHjlRtYgDkNSZ1M-CKjeMM2VXf3vtkOYRnD8s0awE5dthWZ7bLkCvJA59ADw82J3vQKSc1i6QKhH80QS6zl6yVqwWFe__Fc Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ccdaad865e9746d582f1fbdb07cce5ae Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2126500017 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccdaad865e9746d582f1fbdb07cce5ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ccdaad865e9746d582f1fbdb07cce5ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ccdaad865e9746d582f1fbdb07cce5ae", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccdaad865e9746d582f1fbdb07cce5ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2126500017 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ccdaad865e9746d582f1fbdb07cce5ae Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2126500017 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerRescueTestJSONUnderV235-2126500017-project Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: a65eae1745f34a5599af74ac260ed634 Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2126500017-project Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 5c200947-b0a2-4c31-94c7-35186b881d08 could not be found. Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5c200947-b0a2-4c31-94c7-35186b881d08'} Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c200947-b0a2-4c31-94c7-35186b881d08 could not be found. Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c200947-b0a2-4c31-94c7-35186b881d08 could not be found. Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:54.396017 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c200947-b0a2-4c31-94c7-35186b881d08 could not be found. Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:54.401031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] Returning 404 to user: Instance 5c200947-b0a2-4c31-94c7-35186b881d08 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:54.403065 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-56751273-1352-4079-a9ef-e5a7ffc14e5d tempest-ServerRescueTestJSONUnderV235-2126500017 tempest-ServerRescueTestJSONUnderV235-2126500017-project] 10.222.0.27 "GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08" status: 404 len: 111 microversion: 2.1 time: 0.086575 Jun 16 18:43:54.404296 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1533/3130] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:54 2022] GET /compute/v2.1/servers/5c200947-b0a2-4c31-94c7-35186b881d08 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:54.417688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:54.423524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:54.442153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.442768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.443660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.444223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.509031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:54.531105 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6614efd-9884-4fb0-bcc9-5a61df804b6c tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1508 microversion: 2.1 time: 0.714189 Jun 16 18:43:54.532172 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1598/3131] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:53 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1508 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:54.545050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:54.545679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:54.564343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.565347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.566295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.571300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.929120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:54.941769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19ba4639-64bd-47a9-8b49-a4031f2f5424 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1809 microversion: 2.1 time: 0.535884 Jun 16 18:43:54.942978 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1534/3132] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:54 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1809 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:54.952313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:54.953636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:54.965417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.966289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:54.967596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:54.968329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:55.020216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:55.036800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:55.038350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:55.039704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0dc7af9f-bc52-4cb6-91ce-a8ca959de57b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.504389 Jun 16 18:43:55.040904 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1599/3133] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:54 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:55.053812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:55.054589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:55.063341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:55.063803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:55.065201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:55.065794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:55.528535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:55.537748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:55.544479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:55.546272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:55.547825 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c36045ab-00e1-4196-8311-df2a7a24742c tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1552 microversion: 2.26 time: 0.603606 Jun 16 18:43:55.549489 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1535/3134] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:54 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1552 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:55.555019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:55.555642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:55.561985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:55.562679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:55.563865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:55.565041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:55.584280 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-892249d8-62ce-47f8-ad78-dbaca59455a9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 200 len: 1508 microversion: 2.1 time: 0.541263 Jun 16 18:43:55.587317 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1600/3135] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:55 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:55.598274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:55.605092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:55.616654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:55.617116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:55.622730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:55.623458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:56.207963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:56.225384 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-82de952b-9385-41d8-9a29-c29a825cb50f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.673852 Jun 16 18:43:56.226694 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1536/3136] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:55 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:56.233587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:56.235810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:56.255315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:56.258436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:56.261070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:56.262429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:56.306195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:43:56.322839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:56.338608 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a6a0da46-5947-48a6-aa06-cac0d49a1b74 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 200 len: 1473 microversion: 2.1 time: 0.749853 Jun 16 18:43:56.340738 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1601/3137] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:55 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 1473 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:56.358449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:56.359512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:56.372105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:56.372853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:56.376637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:56.377793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:56.378450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:56.427997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:56.445207 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2a38cad3-5a34-4920-9179-e2f36b7ca4b8 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 204 len: 0 microversion: 2.1 time: 0.216933 Jun 16 18:43:56.446854 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1537/3138] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:43:56 2022] DELETE /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:56.453132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a786e4a3-15af-4da0-8d1b-4788dbe6740f req-1a0e9606-8af3-40b2-a914-35f1161eeb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-unplugged", "status": "completed", "tag": "acc30814-2c97-4181-ab6e-ce8ee1dd9456"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:56.463423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a786e4a3-15af-4da0-8d1b-4788dbe6740f req-1a0e9606-8af3-40b2-a914-35f1161eeb84 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:56.463951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a786e4a3-15af-4da0-8d1b-4788dbe6740f req-1a0e9606-8af3-40b2-a914-35f1161eeb84 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:56.480144 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a786e4a3-15af-4da0-8d1b-4788dbe6740f req-1a0e9606-8af3-40b2-a914-35f1161eeb84 service nova] Creating event network-vif-unplugged:acc30814-2c97-4181-ab6e-ce8ee1dd9456 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:56.488378 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a786e4a3-15af-4da0-8d1b-4788dbe6740f req-1a0e9606-8af3-40b2-a914-35f1161eeb84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039882 Jun 16 18:43:56.489334 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1538/3139] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:56.496576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:56.497204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:56.504868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:56.505342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:56.506277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:56.506736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:57.405188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:57.419083 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-729596c6-dd5f-4a54-92b3-509cbff946ad tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1809 microversion: 2.1 time: 1.077049 Jun 16 18:43:57.419676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1602/3140] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:56 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1809 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:57.443755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:57.444530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:57.461361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:57.463230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:57.469169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:57.470211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:57.505401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:57.642783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:57.670156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:57.679881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:57.687205 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22e5e0ff-3a61-48b8-b101-68c593f2eada tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 1.196580 Jun 16 18:43:57.690693 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1539/3141] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:56 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:57.704167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1766766390", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "7c1caade-5c76-4a19-b9c2-824bd691941b"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:57.844794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] validate_networks() for [('7c1caade-5c76-4a19-b9c2-824bd691941b', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:43:57.958100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:57.990775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:57.992620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511eaeeddc084b19b0aae6e0eb9ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb88c77bd3d4d6abe4f7c3931e35290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:57.993896 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-432e6fbd-cf9c-48b7-9312-d5b1538dba8d tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 200 len: 1510 microversion: 2.26 time: 0.564719 Jun 16 18:43:58.029461 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1603/3142] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:57 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:43:58.045597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:58.047358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:58.067725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.068560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:58.070073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.071503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:58.815456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:58.824720 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8cf0aa4-0c3f-4015-a889-30fd18c714de tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.793000 Jun 16 18:43:58.825321 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1604/3143] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:58 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:58.834618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:58.836286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 302e189f-94eb-433b-aa76-79508173e361] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:58.842848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.844891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:58.846149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.846653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:58.863146 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 302e189f-94eb-433b-aa76-79508173e361 could not be found. Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 HTTP/1.1 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 302e189f-94eb-433b-aa76-79508173e361 could not be found. Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '302e189f-94eb-433b-aa76-79508173e361'} Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302e189f-94eb-433b-aa76-79508173e361 could not be found. Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302e189f-94eb-433b-aa76-79508173e361 could not be found. Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:58.864750 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302e189f-94eb-433b-aa76-79508173e361 could not be found. Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 302e189f-94eb-433b-aa76-79508173e361 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:58.869030 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ebc1727-a0cb-4e12-89f5-6371a3f0ff95 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361" status: 404 len: 111 microversion: 2.1 time: 0.039549 Jun 16 18:43:58.869899 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1605/3144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:58 2022] GET /compute/v2.1/servers/302e189f-94eb-433b-aa76-79508173e361 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:58.875155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7230c8d4-a522-4429-9a93-c7216b9907d5 req-ba5c658d-b0ca-42d3-85c6-c8fdc99d4cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d5d199-53f6-492e-b5af-086aa748a160", "name": "network-vif-deleted", "tag": "416adbe8-a278-48e7-80ae-4a85a7b36ef1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:58.879518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:58.885594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7230c8d4-a522-4429-9a93-c7216b9907d5 req-ba5c658d-b0ca-42d3-85c6-c8fdc99d4cf1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.886364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7230c8d4-a522-4429-9a93-c7216b9907d5 req-ba5c658d-b0ca-42d3-85c6-c8fdc99d4cf1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:58.903346 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7230c8d4-a522-4429-9a93-c7216b9907d5 req-ba5c658d-b0ca-42d3-85c6-c8fdc99d4cf1 service nova] Creating event network-vif-deleted:416adbe8-a278-48e7-80ae-4a85a7b36ef1 for instance 39d5d199-53f6-492e-b5af-086aa748a160 on n-h2-846209-2 Jun 16 18:43:58.910850 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7230c8d4-a522-4429-9a93-c7216b9907d5 req-ba5c658d-b0ca-42d3-85c6-c8fdc99d4cf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038963 Jun 16 18:43:58.911666 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1606/3145] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:58.917104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0b8bbfa1-6fb6-4b92-b227-c4437eb737ef req-714acdc5-f673-4980-8715-3518166fabe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-deleted", "tag": "321baa9d-5e59-4b65-9482-cde4e2abad51"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:58.927919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0b8bbfa1-6fb6-4b92-b227-c4437eb737ef req-714acdc5-f673-4980-8715-3518166fabe1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.929251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0b8bbfa1-6fb6-4b92-b227-c4437eb737ef req-714acdc5-f673-4980-8715-3518166fabe1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:58.943979 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0b8bbfa1-6fb6-4b92-b227-c4437eb737ef req-714acdc5-f673-4980-8715-3518166fabe1 service nova] Creating event network-vif-deleted:321baa9d-5e59-4b65-9482-cde4e2abad51 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:58.950574 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0b8bbfa1-6fb6-4b92-b227-c4437eb737ef req-714acdc5-f673-4980-8715-3518166fabe1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037636 Jun 16 18:43:58.952243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1607/3146] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:58.958726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:58.959777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:58.968837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.969623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:58.972240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:58.972966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.583236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:43:59.584610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:43:59.585534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:43:59.587040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:43:59.587518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:43:59.603495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:59.604703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.606344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:59.607153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.632808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Getting quotas for project 0aff614b1a6b4ad2ba352038b276799a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:43:59.652159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:43:59.655881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Getting quotas for user 530daa1c9c814248b477c53f871e29d1 and project 0aff614b1a6b4ad2ba352038b276799a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:43:59.671992 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9a90d2c9-8ba3-4494-89ab-b6d4df322803 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1788 microversion: 2.1 time: 0.714677 Jun 16 18:43:59.672680 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1608/3147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:58 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1788 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:43:59.675419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:43:59.678934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:43:59.687934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-305554e0-9329-468a-9156-56c2936ebbb4 req-ae8d8cc5-7ce2-42ba-ac05-9beb026defaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-unplugged", "status": "completed", "tag": "321baa9d-5e59-4b65-9482-cde4e2abad51"}, {"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-unplugged", "status": "completed", "tag": "e06d22a6-1df4-41ea-aaba-8ea87b1c39f8"}, {"server_uuid": "302e189f-94eb-433b-aa76-79508173e361", "name": "network-vif-unplugged", "status": "completed", "tag": "e5588220-578a-4b30-96d4-eee64d0ab7b2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:43:59.707436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-305554e0-9329-468a-9156-56c2936ebbb4 req-ae8d8cc5-7ce2-42ba-ac05-9beb026defaa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:59.707893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-305554e0-9329-468a-9156-56c2936ebbb4 req-ae8d8cc5-7ce2-42ba-ac05-9beb026defaa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.744556 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-305554e0-9329-468a-9156-56c2936ebbb4 req-ae8d8cc5-7ce2-42ba-ac05-9beb026defaa service nova] Creating event network-vif-unplugged:321baa9d-5e59-4b65-9482-cde4e2abad51 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:59.745529 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-305554e0-9329-468a-9156-56c2936ebbb4 req-ae8d8cc5-7ce2-42ba-ac05-9beb026defaa service nova] Creating event network-vif-unplugged:e06d22a6-1df4-41ea-aaba-8ea87b1c39f8 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:43:59.746266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-305554e0-9329-468a-9156-56c2936ebbb4 req-ae8d8cc5-7ce2-42ba-ac05-9beb026defaa service nova] Creating event network-vif-unplugged:e5588220-578a-4b30-96d4-eee64d0ab7b2 for instance 302e189f-94eb-433b-aa76-79508173e361 on n-h1-846209-2 Jun 16 18:43:59.757690 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a6d259a-4890-4b46-a72b-9dbac41d4f29 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.064702 Jun 16 18:43:59.758649 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-305554e0-9329-468a-9156-56c2936ebbb4 req-ae8d8cc5-7ce2-42ba-ac05-9beb026defaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.082757 Jun 16 18:43:59.759739 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1609/3148] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:59.760489 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1540/3149] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:43:59.770163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-48c67c1f-f80d-463d-a47c-4803eca32bd3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:59.772477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:59.774189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:59.794679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:59.795401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.796277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:59.796948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.847731 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-48c67c1f-f80d-463d-a47c-4803eca32bd3 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/730465d5-116f-4450-aab7-b91f80d00816" status: 204 len: 0 microversion: 2.1 time: 0.084614 Jun 16 18:43:59.851957 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1541/3150] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:43:59 2022] DELETE /compute/v2.1/os-server-groups/730465d5-116f-4450-aab7-b91f80d00816 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:43:59.854351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:59.866870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] [instance: 39d5d199-53f6-492e-b5af-086aa748a160] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:43:59.887255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:59.894601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.895612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:43:59.896142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:43:59.924340 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] HTTP exception thrown: Instance 39d5d199-53f6-492e-b5af-086aa748a160 could not be found. Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Request method failure captured: Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 HTTP/1.1 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3m1qfgI774GnnmxkABU_4IzhfpCY4aESsWr6TW2iVVdoFanDSzYS6SvC50KmRY7YQUrdEE03VFx00UuUPDiQQRXPTwzSNnmA60Dak6u54WiIOz3tDLe_vtuOcK1Tr7Z21XACUObZoR262ve8o3z56phQu4Vz4uVu-xhBfC_GwsArc8 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.26 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 3cb88c77bd3d4d6abe4f7c3931e35290 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerTagsTestJSON-2026401728 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cb88c77bd3d4d6abe4f7c3931e35290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3cb88c77bd3d4d6abe4f7c3931e35290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3cb88c77bd3d4d6abe4f7c3931e35290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cb88c77bd3d4d6abe4f7c3931e35290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerTagsTestJSON-2026401728 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 3cb88c77bd3d4d6abe4f7c3931e35290 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerTagsTestJSON-2026401728 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerTagsTestJSON-2026401728-project Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 511eaeeddc084b19b0aae6e0eb9ab1e3 Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerTagsTestJSON-2026401728-project Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 39d5d199-53f6-492e-b5af-086aa748a160 could not be found. Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '39d5d199-53f6-492e-b5af-086aa748a160'} Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d5d199-53f6-492e-b5af-086aa748a160 could not be found. Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d5d199-53f6-492e-b5af-086aa748a160 could not be found. Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:43:59.934325 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:59.939223 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:43:59.939223 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:43:59.939223 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:43:59.939223 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:43:59.939223 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:43:59.939223 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d5d199-53f6-492e-b5af-086aa748a160 could not be found. Jun 16 18:43:59.939223 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:43:59.941851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] Returning 404 to user: Instance 39d5d199-53f6-492e-b5af-086aa748a160 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:43:59.942839 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bdb26ad7-4df0-4490-b397-3b6e97643860 tempest-ServerTagsTestJSON-2026401728 tempest-ServerTagsTestJSON-2026401728-project] 10.222.0.27 "GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160" status: 404 len: 111 microversion: 2.26 time: 0.092898 Jun 16 18:43:59.944587 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1542/3151] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:59 2022] GET /compute/v2.1/servers/39d5d199-53f6-492e-b5af-086aa748a160 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:43:59.962743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-88f30a6b-e478-4c80-a1e1-7d6ab43d1a73 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:43:59.966531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-88f30a6b-e478-4c80-a1e1-7d6ab43d1a73 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:00.688298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-88f30a6b-e478-4c80-a1e1-7d6ab43d1a73 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:00.702998 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-88f30a6b-e478-4c80-a1e1-7d6ab43d1a73 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1218 microversion: 2.1 time: 0.756139 Jun 16 18:44:00.705887 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1543/3152] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:43:59 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1218 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:00.713557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:00.714445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:00.724956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:00.725497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:00.726660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:00.727175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.103662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:01.115672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:01.117279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:01.118880 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ccbcae73-fe14-4906-a7fe-bfb2d4c65ed2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 1.356925 Jun 16 18:44:01.130435 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1610/3153] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:43:59 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:01.136112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:01.136896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:01.144601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.145265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.146248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.148595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.177663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:01.187512 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-09164149-08ba-48d6-9c8a-49ba19bbd7e2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.479540 Jun 16 18:44:01.197643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:01.198439 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1544/3154] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:00 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:01.204566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:01.205506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:01.212995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.213661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.214673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.215369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.316607 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b9c5364-45b8-4651-81df-cb6addcb1cf6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 204 len: 0 microversion: 2.1 time: 0.184195 Jun 16 18:44:01.321829 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1611/3155] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:01 2022] DELETE /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:01.332704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-dee35f21-7a00-43c1-bd92-ec7a371b6c3a req-b4d0f29d-876e-4949-91eb-1b5774d63557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-deleted", "tag": "acc30814-2c97-4181-ab6e-ce8ee1dd9456"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:01.343639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dee35f21-7a00-43c1-bd92-ec7a371b6c3a req-b4d0f29d-876e-4949-91eb-1b5774d63557 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.344903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dee35f21-7a00-43c1-bd92-ec7a371b6c3a req-b4d0f29d-876e-4949-91eb-1b5774d63557 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.423456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-dee35f21-7a00-43c1-bd92-ec7a371b6c3a req-b4d0f29d-876e-4949-91eb-1b5774d63557 service nova] Creating event network-vif-deleted:acc30814-2c97-4181-ab6e-ce8ee1dd9456 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:44:01.431728 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-dee35f21-7a00-43c1-bd92-ec7a371b6c3a req-b4d0f29d-876e-4949-91eb-1b5774d63557 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106743 Jun 16 18:44:01.437848 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1612/3156] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:01.451452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:01.452110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:01.468974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.472447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.474225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.476369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.513477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:01.654792 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-746a213b-6970-411d-b4f5-f5e66b67abf9 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 204 len: 0 microversion: 2.1 time: 0.214215 Jun 16 18:44:01.656841 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1613/3157] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:01 2022] DELETE /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:01.664399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5ad791f7-818b-4b9c-93be-c9e86444d1e6 req-32a6d284-b6bb-462e-80ee-cc2f8c7715b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302e189f-94eb-433b-aa76-79508173e361", "name": "network-vif-deleted", "tag": "e5588220-578a-4b30-96d4-eee64d0ab7b2"}, {"server_uuid": "b446cff3-9611-4d43-b11b-23d652af04a7", "name": "network-vif-deleted", "tag": "fdd84aca-3892-45e3-8292-04a00a95f23f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:01.684041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5ad791f7-818b-4b9c-93be-c9e86444d1e6 req-32a6d284-b6bb-462e-80ee-cc2f8c7715b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.684898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5ad791f7-818b-4b9c-93be-c9e86444d1e6 req-32a6d284-b6bb-462e-80ee-cc2f8c7715b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.714557 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5ad791f7-818b-4b9c-93be-c9e86444d1e6 req-32a6d284-b6bb-462e-80ee-cc2f8c7715b9 service nova] Creating event network-vif-deleted:e5588220-578a-4b30-96d4-eee64d0ab7b2 for instance 302e189f-94eb-433b-aa76-79508173e361 on n-h1-846209-2 Jun 16 18:44:01.716997 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5ad791f7-818b-4b9c-93be-c9e86444d1e6 req-32a6d284-b6bb-462e-80ee-cc2f8c7715b9 service nova] Creating event network-vif-deleted:fdd84aca-3892-45e3-8292-04a00a95f23f for instance b446cff3-9611-4d43-b11b-23d652af04a7 on n-h1-846209-2 Jun 16 18:44:01.725963 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5ad791f7-818b-4b9c-93be-c9e86444d1e6 req-32a6d284-b6bb-462e-80ee-cc2f8c7715b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067250 Jun 16 18:44:01.726591 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1614/3158] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:01.734377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:01.735293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:01.748319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.748786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.753126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.753595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.943135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:01.956607 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2ad8f793-68bb-4c5c-8501-8d630a95a38e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1653 microversion: 2.1 time: 0.756627 Jun 16 18:44:01.959088 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1545/3159] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:01 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1653 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:01.964111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:01.965144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:01.982237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.982941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:01.983900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:01.985422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:02.147385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:02.178455 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8ef4444d-c712-41ca-af4c-30bc7bbd390f tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1276 microversion: 2.1 time: 0.217591 Jun 16 18:44:02.182876 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1546/3160] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:01 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:02.191551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-afb95d1b-1aa8-4ee0-af48-8519d9055da0 req-306ee311-4019-445b-934c-3cf5394a433f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e57881-9458-4864-a6d8-79555341a48e", "name": "network-vif-plugged", "status": "completed", "tag": "f395f5ff-79af-48cc-8d9f-7b45e4bba8d9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:02.201281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-afb95d1b-1aa8-4ee0-af48-8519d9055da0 req-306ee311-4019-445b-934c-3cf5394a433f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:02.202163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-afb95d1b-1aa8-4ee0-af48-8519d9055da0 req-306ee311-4019-445b-934c-3cf5394a433f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:02.235140 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-afb95d1b-1aa8-4ee0-af48-8519d9055da0 req-306ee311-4019-445b-934c-3cf5394a433f service nova] Creating event network-vif-plugged:f395f5ff-79af-48cc-8d9f-7b45e4bba8d9 for instance e5e57881-9458-4864-a6d8-79555341a48e on n-h1-846209-2 Jun 16 18:44:02.249254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-afb95d1b-1aa8-4ee0-af48-8519d9055da0 req-306ee311-4019-445b-934c-3cf5394a433f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063546 Jun 16 18:44:02.254066 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1547/3161] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:02.265221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:02.266946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:02.285736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:02.287364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:02.293792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:02.299006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:02.328032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:02.354210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9233353f-45e6-4d47-9ade-67f561a28f54 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 200 len: 1472 microversion: 2.1 time: 0.612955 Jun 16 18:44:02.378105 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1615/3162] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:01 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 1472 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:02.385405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:02.386069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:02.398973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:02.399231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:02.400129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:02.400579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.245203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:03.265113 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d3a9c6e5-cdf5-43e1-8e4a-42a80b0884d8 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 0.885427 Jun 16 18:44:03.267271 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1616/3163] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:02 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:03.283050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:03.284468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:03.294533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:03.295777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.297131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:03.297939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.340294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:03.357938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:03.359513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:03.360692 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f7050dc-2c09-4c5e-9c05-e5d267cbd60e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 1.104502 Jun 16 18:44:03.378149 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1548/3164] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:02 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:03.400912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:03.401548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:03.415698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:03.416431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.417355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:03.417762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.567393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:03.577880 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-22f830b5-312c-4875-8049-0f8826f69b41 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 200 len: 1454 microversion: 2.1 time: 0.305809 Jun 16 18:44:03.580691 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1617/3165] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:03 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 1454 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:03.593888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:03.594897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:03.628346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:03.628806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.629612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:03.630092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.839305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:03.854653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f54d4467-858c-4c3c-9216-549667a348e4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.477639 Jun 16 18:44:03.855843 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1549/3166] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:03 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:03.860926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e4e77be8-f33e-4c4f-9abd-5de89bd07cd1 req-75a4aa42-9c26-4270-971a-83db3dc30a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1733ea-9ee5-418d-a402-711efabd252e", "name": "network-vif-deleted", "tag": "e06d22a6-1df4-41ea-aaba-8ea87b1c39f8"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:03.879098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e4e77be8-f33e-4c4f-9abd-5de89bd07cd1 req-75a4aa42-9c26-4270-971a-83db3dc30a95 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:03.879867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e4e77be8-f33e-4c4f-9abd-5de89bd07cd1 req-75a4aa42-9c26-4270-971a-83db3dc30a95 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:03.917277 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e4e77be8-f33e-4c4f-9abd-5de89bd07cd1 req-75a4aa42-9c26-4270-971a-83db3dc30a95 service nova] Creating event network-vif-deleted:e06d22a6-1df4-41ea-aaba-8ea87b1c39f8 for instance dd1733ea-9ee5-418d-a402-711efabd252e on n-h1-846209-2 Jun 16 18:44:03.926632 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e4e77be8-f33e-4c4f-9abd-5de89bd07cd1 req-75a4aa42-9c26-4270-971a-83db3dc30a95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069298 Jun 16 18:44:03.927253 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1550/3167] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:03.950762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:03.964452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9298395b-f826-4a17-8991-fed26c9dc047 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 200 len: 1472 microversion: 2.1 time: 0.375580 Jun 16 18:44:03.967780 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1618/3168] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:03 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 1472 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:04.287082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:04.288189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:04.299038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:04.299656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:04.300866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:04.301510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:04.396758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:04.397971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:04.406785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:04.407692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:04.409404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:04.410336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:05.341737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:05.362274 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d60387d7-0328-46d2-93af-8fc072896de3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 1.078775 Jun 16 18:44:05.364679 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1551/3169] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:04 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:05.389007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:05.389998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:05.399796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:05.400556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:05.401525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:05.402155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:05.418928 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] HTTP exception thrown: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Request method failure captured: Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e HTTP/1.1 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3mjGNC4Z6pGlj6BfS3lCagsmGYr-4ZXVbH-lAc-UFKKrRCC1JNEvUU4qUgdD1qNyTpnTK-Zq0hVpOOhr2x5Ww40n2MTySVEM31BBkyAVnVM43KTcQZTc1DB0zmBL72sAgj-prpXCnpI5id_1h3B9MBOmjKfPXp4RqAXYhajh5oAfs8 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f81d5b935a7e4f9d90a68e8a488f136a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestMultiNic-2095324463 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9d82e559e5b4ecdbc044ad52907050c Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'dd1733ea-9ee5-418d-a402-711efabd252e'} Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:05.421006 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:05.427304 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:05.427304 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:05.427304 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:05.427304 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:05.427304 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:05.427304 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:44:05.427304 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:05.428583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Returning 404 to user: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:05.429762 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-663bf204-6ba8-4da8-adca-63f329b860d8 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 404 len: 111 microversion: 2.1 time: 0.063588 Jun 16 18:44:05.432744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:05.434029 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1552/3170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:05 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:05.439387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:05.441191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:05.448066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:05.449869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:05.451367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:05.453116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:05.456304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:05.456858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:05.459378 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc45aef7-417e-434a-87f2-7faed2f8bff0 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 1.066782 Jun 16 18:44:05.460306 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1619/3171] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:04 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:44:05.464919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:05.465598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:05.488661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:05.489504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:05.490979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:05.491190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:05.534089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:06.127972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:06.140705 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-04cda5b4-c88f-4b90-8cf0-3fe3c3b45597 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.705343 Jun 16 18:44:06.155852 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1553/3172] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:05 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:06.241679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:06.255771 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e2c45c5-fc27-4590-bc45-7aeb157b86ed tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 200 len: 1472 microversion: 2.1 time: 0.794352 Jun 16 18:44:06.262321 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1620/3173] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:05 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 1472 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:06.384278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:06.385795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:06.411310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:06.413750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:06.415030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:06.417480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:06.481580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:06.482989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:06.504973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:06.506892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:06.507851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:06.511485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:07.372789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:07.402917 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9e76b733-7356-4015-85fd-aeae9cf7fe31 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1520 microversion: 2.1 time: 1.022718 Jun 16 18:44:07.408181 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1554/3174] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:06 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1520 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:07.415134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f50db823-f901-40ed-ba84-54692a548108 req-58a654f1-06b7-4237-b06f-2633bff78579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2cf7c4-c45f-48b5-9dab-0c6fb001607b", "name": "network-vif-deleted", "tag": "82a723c9-0fce-4bcc-9671-f6b6a82d07e2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:07.455525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:07.462500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f50db823-f901-40ed-ba84-54692a548108 req-58a654f1-06b7-4237-b06f-2633bff78579 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:07.463184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f50db823-f901-40ed-ba84-54692a548108 req-58a654f1-06b7-4237-b06f-2633bff78579 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:07.488884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:07.497102 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f50db823-f901-40ed-ba84-54692a548108 req-58a654f1-06b7-4237-b06f-2633bff78579 service nova] Creating event network-vif-deleted:82a723c9-0fce-4bcc-9671-f6b6a82d07e2 for instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b on n-h1-846209-2 Jun 16 18:44:07.507719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:07.510288 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f50db823-f901-40ed-ba84-54692a548108 req-58a654f1-06b7-4237-b06f-2633bff78579 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100381 Jun 16 18:44:07.514026 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1555/3175] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:07.516520 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5310579a-4f3c-462f-afed-766081df2912 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 1.038464 Jun 16 18:44:07.521828 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1621/3176] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:06 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:07.525971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:07.535319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:07.547045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:07.549584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:07.556697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:07.557635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:07.560074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:07.562890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:07.575698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:07.577790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:07.580472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:07.582659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:08.285867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:08.333820 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e3b18d2-4d05-431c-a11f-5915f4277ad6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 200 len: 1430 microversion: 2.1 time: 0.808103 Jun 16 18:44:08.334500 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1622/3177] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:07 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 1430 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:08.353219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bd1dfbc6-1316-418e-8670-64dd1fbccdcc req-46eacff6-d575-4017-a910-6606a2f0a80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b48f1e6-0ad5-4be0-829f-d237ed920db5", "name": "network-vif-deleted", "tag": "db25f6b3-1d13-48f5-959e-6b3818cab47e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:08.388397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bd1dfbc6-1316-418e-8670-64dd1fbccdcc req-46eacff6-d575-4017-a910-6606a2f0a80a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:08.388856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bd1dfbc6-1316-418e-8670-64dd1fbccdcc req-46eacff6-d575-4017-a910-6606a2f0a80a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:08.413853 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bd1dfbc6-1316-418e-8670-64dd1fbccdcc req-46eacff6-d575-4017-a910-6606a2f0a80a service nova] Creating event network-vif-deleted:db25f6b3-1d13-48f5-959e-6b3818cab47e for instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 on n-h1-846209-2 Jun 16 18:44:08.427983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bd1dfbc6-1316-418e-8670-64dd1fbccdcc req-46eacff6-d575-4017-a910-6606a2f0a80a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088099 Jun 16 18:44:08.428539 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1623/3178] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:08.448080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:08.449612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:08.466534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:08.467091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:08.467948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:08.468403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:08.470338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:08.485130 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-79a06241-1bd3-4d68-b816-d5ea60b1f9ff tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.969439 Jun 16 18:44:08.493073 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1556/3179] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:07 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:08.541218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:08.541894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:08.560515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:08.560967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:08.561762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:08.562217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.130439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:09.142194 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-113ddbb6-f5a8-4fb9-98ab-5adb5432184e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.712207 Jun 16 18:44:09.155861 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1624/3180] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:08 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:09.161741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:09.162657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:09.172480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.173208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.174834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.175855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.354668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:09.382768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:09.384684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:09.386166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-44571a3a-84b7-47f6-a0b4-1d7b2110582a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.849552 Jun 16 18:44:09.399716 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1557/3181] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:08 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:44:09.405461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:09.406363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 3b48f1e6-0ad5-4be0-829f-d237ed920db5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:09.418378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.421312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.424116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.425110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.456560 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 could not be found. Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 HTTP/1.1 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 could not be found. Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '3b48f1e6-0ad5-4be0-829f-d237ed920db5'} Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 could not be found. Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 could not be found. Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:09.465615 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 could not be found. Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 3b48f1e6-0ad5-4be0-829f-d237ed920db5 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:09.471573 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5237cfca-aab4-497c-ad49-ebde507f213a tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5" status: 404 len: 111 microversion: 2.1 time: 0.068630 Jun 16 18:44:09.473722 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1558/3182] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:09 2022] GET /compute/v2.1/servers/3b48f1e6-0ad5-4be0-829f-d237ed920db5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:09.479953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:09.480944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:09.491375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.492104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.493375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.494108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.520963 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b could not be found. Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b HTTP/1.1 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b could not be found. Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '7c2cf7c4-c45f-48b5-9dab-0c6fb001607b'} Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b could not be found. Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b could not be found. Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:09.522628 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b could not be found. Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 7c2cf7c4-c45f-48b5-9dab-0c6fb001607b could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ab610d6-0ea9-40cf-ba99-eb985523c6be tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b" status: 404 len: 111 microversion: 2.1 time: 0.049287 Jun 16 18:44:09.530952 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1559/3183] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:09 2022] GET /compute/v2.1/servers/7c2cf7c4-c45f-48b5-9dab-0c6fb001607b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:09.533883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:09.534555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:09.541322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.542170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.543492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.544160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.624872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:09.662325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:09.673208 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-26300bb6-e3ad-4363-b25b-61278facd86e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.515656 Jun 16 18:44:09.690042 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1625/3184] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:09 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:09.698751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-981d7238-bdc2-43ad-ad71-5664d7bf38f6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:09.747052 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-981d7238-bdc2-43ad-ad71-5664d7bf38f6 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/8bab66f8-5fa8-408a-bcdc-a0a8d2d6293e" status: 204 len: 0 microversion: 2.1 time: 0.054631 Jun 16 18:44:09.753955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1626/3185] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:44:09 2022] DELETE /compute/v2.1/os-server-groups/8bab66f8-5fa8-408a-bcdc-a0a8d2d6293e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:09.761516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:09.762498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:09.772627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.773409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:09.775104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:09.775733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:10.693682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:10.740693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:10.760541 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-20c22afa-87f0-4e1b-b1ce-0423234cfe48 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 1.230500 Jun 16 18:44:10.770552 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1560/3186] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:09 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:10.770552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:10.770552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:10.790437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:10.793591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:10.794134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:10.796021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:10.796763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:10.802945 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0f2e4044-7afc-4cf1-936c-5f7d52ed3c14 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 1.043451 Jun 16 18:44:10.803683 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1627/3187] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:09 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:10.820556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-84ce6283-da7f-4234-923b-4a464bd6352c req-6aea5a2a-35d8-43ef-98eb-221c7c5ce3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c4b3e1-54b2-48d1-915d-8c4a8439d230", "tag": "77ce3fa6-2efb-4de0-a5d5-dc0c1267f1a4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:10.831757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-84ce6283-da7f-4234-923b-4a464bd6352c req-6aea5a2a-35d8-43ef-98eb-221c7c5ce3ab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:10.832557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-84ce6283-da7f-4234-923b-4a464bd6352c req-6aea5a2a-35d8-43ef-98eb-221c7c5ce3ab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:10.848071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:10.848607 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-84ce6283-da7f-4234-923b-4a464bd6352c req-6aea5a2a-35d8-43ef-98eb-221c7c5ce3ab service nova] Creating event network-changed:77ce3fa6-2efb-4de0-a5d5-dc0c1267f1a4 for instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 on n-h2-846209-2 Jun 16 18:44:10.861724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:10.871393 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-84ce6283-da7f-4234-923b-4a464bd6352c req-6aea5a2a-35d8-43ef-98eb-221c7c5ce3ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054858 Jun 16 18:44:10.872771 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1628/3188] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:10.879803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:10.880820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:10.894940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:10.895727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:10.896597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:10.897052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:11.096258 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e713ec09-ee5d-4b20-b330-41d005e2c240 tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "DELETE /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 204 len: 0 microversion: 2.1 time: 0.332929 Jun 16 18:44:11.096925 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1561/3189] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:10 2022] DELETE /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:11.106822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-89d7a6bc-5166-4cb4-af39-dc9a9672c129 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:11.114563 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-89d7a6bc-5166-4cb4-af39-dc9a9672c129 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 71b9ee40-a45f-40e3-ba64-477c4737f644 has no mapping to a cell. Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-89d7a6bc-5166-4cb4-af39-dc9a9672c129 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/71b9ee40-a45f-40e3-ba64-477c4737f644/action HTTP/1.1 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 15 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: {"os-stop": {}} Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 71b9ee40-a45f-40e3-ba64-477c4737f644 has no mapping to a cell. Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '71b9ee40-a45f-40e3-ba64-477c4737f644', 'body': {'os-stop': {}}} Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 71b9ee40-a45f-40e3-ba64-477c4737f644 has no mapping to a cell. Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:11.122625 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b9ee40-a45f-40e3-ba64-477c4737f644 has no mapping to a cell. Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b9ee40-a45f-40e3-ba64-477c4737f644 has no mapping to a cell. Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-89d7a6bc-5166-4cb4-af39-dc9a9672c129 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 71b9ee40-a45f-40e3-ba64-477c4737f644 has no mapping to a cell. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-89d7a6bc-5166-4cb4-af39-dc9a9672c129 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/71b9ee40-a45f-40e3-ba64-477c4737f644/action" status: 404 len: 117 microversion: 2.1 time: 0.022226 Jun 16 18:44:11.129094 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1562/3190] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:11 2022] POST /compute/v2.1/servers/71b9ee40-a45f-40e3-ba64-477c4737f644/action => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:11.134393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:11.135647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:11.147047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:11.148104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:11.150238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:11.153493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:11.693675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:11.709269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:11.719230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:11.722225 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d34abe85-7f83-4f0f-bc7f-84b362050e6f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1472 microversion: 2.1 time: 0.595885 Jun 16 18:44:11.723035 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1563/3191] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:11 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1472 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:11.723441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:11.724904 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d8793c0-c977-49f3-bfb9-acb1962e2e5e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.850798 Jun 16 18:44:11.725881 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1629/3192] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:10 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:11.741798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:11.743565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:11.755945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:11.756971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:11.758598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:11.759202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:11.779499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:11.780226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:11.800189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:11.800827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:11.801707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:11.802263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:12.353374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:12.366828 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eecff9e2-8bb2-4bff-be62-9bcbff66f13b tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.642892 Jun 16 18:44:12.373160 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1564/3193] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:11 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:12.395505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:12.409410 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f30ffa9-f0c8-4441-affb-8dfeb269bedc tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.634720 Jun 16 18:44:12.419484 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1630/3194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:11 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:12.425480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:12.426149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:12.435153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:12.435917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:12.438089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:12.438992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:12.779703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-559446222", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "9713825e-118e-4922-97c5-1a624ac5bd90"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:12.870894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] validate_networks() for [('9713825e-118e-4922-97c5-1a624ac5bd90', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:44:12.873411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:12.884095 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-10a452af-8c62-48a6-9661-e417330f3966 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.462695 Jun 16 18:44:12.897965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1631/3195] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:12 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:12.897965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:12.897965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:12.916357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:12.916849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:12.917698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:12.918510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:13.531442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:13.543942 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c13ae51-9523-4eec-b85f-fdd6e9e86b2f tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1472 microversion: 2.1 time: 0.657372 Jun 16 18:44:13.561355 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1632/3196] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:12 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1472 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:13.571429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:13.575974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:13.606229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:13.607083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:13.608172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:13.609069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:14.256861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:14.268532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:14.270250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:14.271548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-488fcac0-a695-45aa-ba76-1921dbe1ca47 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.708396 Jun 16 18:44:14.272176 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1633/3197] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:13 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:14.317038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebea2291-ada1-42fa-af11-75e6239679fd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:14.319950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ebea2291-ada1-42fa-af11-75e6239679fd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: ee25668d-e327-4b2c-ba05-81bc9e990d8a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:14.333475 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ebea2291-ada1-42fa-af11-75e6239679fd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance ee25668d-e327-4b2c-ba05-81bc9e990d8a could not be found. Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebea2291-ada1-42fa-af11-75e6239679fd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/ee25668d-e327-4b2c-ba05-81bc9e990d8a/action HTTP/1.1 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 15 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: {"suspend": {}} Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance ee25668d-e327-4b2c-ba05-81bc9e990d8a could not be found. Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ee25668d-e327-4b2c-ba05-81bc9e990d8a', 'body': {'suspend': {}}} Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee25668d-e327-4b2c-ba05-81bc9e990d8a could not be found. Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee25668d-e327-4b2c-ba05-81bc9e990d8a could not be found. Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:14.335523 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:14.339808 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:14.339808 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:14.339808 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee25668d-e327-4b2c-ba05-81bc9e990d8a could not be found. Jun 16 18:44:14.339808 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:14.339808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebea2291-ada1-42fa-af11-75e6239679fd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance ee25668d-e327-4b2c-ba05-81bc9e990d8a could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:14.339808 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ebea2291-ada1-42fa-af11-75e6239679fd tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/ee25668d-e327-4b2c-ba05-81bc9e990d8a/action" status: 404 len: 111 microversion: 2.1 time: 0.043884 Jun 16 18:44:14.339808 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1634/3198] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:14 2022] POST /compute/v2.1/servers/ee25668d-e327-4b2c-ba05-81bc9e990d8a/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:14.344078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:14.344697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:14.354345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:14.355081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:14.356090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:14.356686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.281527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:44:15.282182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:44:15.282459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:44:15.283207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:44:15.283926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:44:15.317974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.325577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.330912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.331634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.373365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:15.386707 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28257946-e6a7-486b-87a8-9d9265bc40c5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 1.047042 Jun 16 18:44:15.394280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Getting quotas for project 1d59bf2fe9b34d92b263ffb4fd3cec04. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:44:15.397449 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1635/3199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:14 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:15.400772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Getting quotas for user 0ee0f2c208dc467999b3b8f33e5bcc53 and project 1d59bf2fe9b34d92b263ffb4fd3cec04. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:44:15.408729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:15.409367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:15.420550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:44:15.421653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.422250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.423433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.423957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.424970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:44:15.471907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:15.538943 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4fd390f7-e91d-4893-8dd1-9bfe9dbe366b tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.162482 Jun 16 18:44:15.542972 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1565/3200] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:44:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:44:15.552028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:15.552958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:15.562851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.564511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.565892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.566679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.838053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d35e57eccbc41048e9e5cdb742688f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a21d936370c4a5bbdd254cacc618708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:15.849493 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f2a4f5c6-886a-44af-bf84-ddd0a6722c3c tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 200 len: 1430 microversion: 2.1 time: 0.304166 Jun 16 18:44:15.850439 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1566/3201] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:15 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 1430 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:15.857035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:15.858053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:15.865693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.867123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.874385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.875163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:16.311294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:16.320753 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b047a92d-44de-4ac2-bb28-dc15d4fdf833 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.922109 Jun 16 18:44:16.326294 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1636/3202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:15 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:16.337665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:16.339008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:16.346128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:16.347509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:16.348842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:16.349540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:16.434779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:16.447829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:16.450228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:16.451954 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5b113ed8-8849-4c3e-86cc-68f2f095b8e1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.599843 Jun 16 18:44:16.453091 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1567/3203] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:15 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:16.460896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1543724073", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "a332d6b1-c71a-474b-a658-e559a1071744"}, {"uuid": "5bba8ca5-3964-4603-89ef-099d698824f6"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:16.461117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:16.471551 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-968dfee2-318f-406b-929f-2b9561a352c9 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1228 microversion: 2.1 time: 0.147676 Jun 16 18:44:16.476725 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1637/3204] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:16 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1228 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:16.488610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4f956fb2-ce1f-4d88-8c57-22aa57a892e2 req-7c389040-21d3-45df-990c-b5bb9ffdbf18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ff1dd7-0d48-479e-95f1-af7f8d2b2530", "name": "network-vif-deleted", "tag": "a136882d-37aa-4b9f-8921-5f8b4b2da24f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:16.506900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4f956fb2-ce1f-4d88-8c57-22aa57a892e2 req-7c389040-21d3-45df-990c-b5bb9ffdbf18 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:16.507358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4f956fb2-ce1f-4d88-8c57-22aa57a892e2 req-7c389040-21d3-45df-990c-b5bb9ffdbf18 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:16.542267 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4f956fb2-ce1f-4d88-8c57-22aa57a892e2 req-7c389040-21d3-45df-990c-b5bb9ffdbf18 service nova] Creating event network-vif-deleted:a136882d-37aa-4b9f-8921-5f8b4b2da24f for instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 on n-h1-846209-2 Jun 16 18:44:16.552386 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4f956fb2-ce1f-4d88-8c57-22aa57a892e2 req-7c389040-21d3-45df-990c-b5bb9ffdbf18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074010 Jun 16 18:44:16.553685 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1638/3205] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:16.559777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:16.560814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:16.576248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:16.578345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:16.579408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:16.580627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:16.622354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] validate_networks() for [('a332d6b1-c71a-474b-a658-e559a1071744', None, None, None, None, None), ('5bba8ca5-3964-4603-89ef-099d698824f6', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:44:17.067217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:17.088417 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c8890df9-d3e3-4fee-870e-34e03985c996 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.533236 Jun 16 18:44:17.089726 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1639/3206] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:16 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:17.100236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:17.107520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:17.126402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:17.127506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:17.128690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:17.129391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:17.623078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:17.639131 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6bd414e-3ed5-4031-b808-fcf472547439 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.548032 Jun 16 18:44:17.649316 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1640/3207] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:17 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:17.658946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:17.667505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] [instance: 42ff1dd7-0d48-479e-95f1-af7f8d2b2530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:17.681173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:17.681947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:17.683082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:17.683762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:17.690068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:17.722801 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] HTTP exception thrown: Instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 could not be found. Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Request method failure captured: Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 HTTP/1.1 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kUVmLvDJx9BjM4HT7htAU2VowZqCLGgBpiRnNHWkUt6w7wM1C3JEYybj6HmJAd-mAtiyv8ENky9-140PZ8o-rJ40HSNU_meEaZOWkEjB_j1L-kcAs-BoRZP6hnanLWdyCMJ8_d2mox_qBtTwYfhIhfkpxBtBBhCW_08eBl-Et5T2Q Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a21d936370c4a5bbdd254cacc618708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a21d936370c4a5bbdd254cacc618708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6a21d936370c4a5bbdd254cacc618708 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-716099275 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9d35e57eccbc41048e9e5cdb742688f3 Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersOnMultiNodesTest-716099275-project Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 could not be found. Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '42ff1dd7-0d48-479e-95f1-af7f8d2b2530'} Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 could not be found. Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 could not be found. Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:17.732491 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:17.737287 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:17.737287 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:17.737287 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:17.737287 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:17.737287 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:17.737287 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 could not be found. Jun 16 18:44:17.737287 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:17.739338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] Returning 404 to user: Instance 42ff1dd7-0d48-479e-95f1-af7f8d2b2530 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:17.740499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9037e94c-8221-4e48-a8ce-807c4752b0da tempest-ServersOnMultiNodesTest-716099275 tempest-ServersOnMultiNodesTest-716099275-project] 10.222.0.27 "GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530" status: 404 len: 111 microversion: 2.1 time: 0.089741 Jun 16 18:44:17.741634 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1641/3208] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:17 2022] GET /compute/v2.1/servers/42ff1dd7-0d48-479e-95f1-af7f8d2b2530 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:17.751087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:17.755964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:17.770505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:17.782674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:17.784211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:17.784906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:17.833992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lazy-loading 'flavor' on Instance uuid e5e57881-9458-4864-a6d8-79555341a48e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:44:17.990102 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54bdaadb-175e-413e-997f-5f0271d490a5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.246827 Jun 16 18:44:17.994623 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1642/3209] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:17 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:44:18.001524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:18.003037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:18.019138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.019717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.020624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.021755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.503907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:44:18.505317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:44:18.507205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:44:18.509178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:44:18.511914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:44:18.535235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.536692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.537644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.539743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.642462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Getting quotas for project f81d5b935a7e4f9d90a68e8a488f136a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:44:18.655158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Getting quotas for user b9d82e559e5b4ecdbc044ad52907050c and project f81d5b935a7e4f9d90a68e8a488f136a. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:44:18.663879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:18.682887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:18.685422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:18.687274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ee9c0f3-0b9f-4f12-83b4-a8e5bb1fc5f8 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.690346 Jun 16 18:44:18.687913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:44:18.688217 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1643/3210] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:17 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:18.694588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:44:18.703793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:18.705371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:18.718500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.718958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.719787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.720183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.833966 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1b7d578-dcc4-4444-b712-a20003ae5844 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.379458 Jun 16 18:44:18.841069 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1568/3211] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:44:18.848254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:18.849197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:18.856954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.857678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.858687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.859293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:19.544128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:19.556797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5be372c3-d364-4c88-a3d1-bdd15e1651ce tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1282 microversion: 2.1 time: 0.867336 Jun 16 18:44:19.564629 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1644/3212] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:18 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1282 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:19.574166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:19.579104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:19.595229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:19.600770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:19.602903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:19.605018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.039856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:20.061898 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-12ab8809-19a8-463f-b3d3-b0f8a152fbf1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1498 microversion: 2.1 time: 1.218760 Jun 16 18:44:20.067048 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1569/3213] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:18 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1498 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:20.109855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:20.111535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:20.146259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.156678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.160322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.162600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.471952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:20.491782 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b942cb04-6a3e-4cb0-b14a-4b117248e1f1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1209 microversion: 2.1 time: 0.423235 Jun 16 18:44:20.496149 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1570/3214] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:20 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1209 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:20.509515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:20.510999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:20.529840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.534174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.540244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.540949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.573006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:20.590392 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1469480f-6deb-4491-b9eb-129c10bdfd26 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 1.023875 Jun 16 18:44:20.596160 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1645/3215] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:19 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:20.605830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:20.609137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:20.676988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.678784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.680244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.683821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.766930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lazy-loading 'flavor' on Instance uuid e5e57881-9458-4864-a6d8-79555341a48e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:44:20.804257 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Cannot 'suspend' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state suspended Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action HTTP/1.1 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 15 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: {"suspend": {}} Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'suspend' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state suspended Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'suspend': {}}} Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e57881-9458-4864-a6d8-79555341a48e in vm_state suspended. Cannot suspend while the instance is in this state. Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jun 16 18:44:20.809849 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state suspended Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state suspended Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 409 to user: Cannot 'suspend' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state suspended {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:20.816214 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c29ae65-86db-4290-bd0d-16524099fe51 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 409 len: 148 microversion: 2.1 time: 0.214300 Jun 16 18:44:20.821620 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1646/3216] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:20 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 148 bytes in 225 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:44:20.835782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:20.837260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:20.860541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:20.863665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.864608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.865774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.871867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.161940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:21.186393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:21.192193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:21.195295 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4cb7603a-00e4-4203-8ae0-056987e361ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.697271 Jun 16 18:44:21.197303 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1571/3217] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:20 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:21.226932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2489d468-f891-41bd-8ac8-211e4a35ae3f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:21.230536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2489d468-f891-41bd-8ac8-211e4a35ae3f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:21.254888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2489d468-f891-41bd-8ac8-211e4a35ae3f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.257978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2489d468-f891-41bd-8ac8-211e4a35ae3f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.261292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2489d468-f891-41bd-8ac8-211e4a35ae3f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.262464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2489d468-f891-41bd-8ac8-211e4a35ae3f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.493039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2489d468-f891-41bd-8ac8-211e4a35ae3f tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.279036 Jun 16 18:44:21.494448 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1572/3218] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:21 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:44:21.541331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:21.544089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:21.564222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.567977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.569278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.569925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.615532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:21.633309 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-680588d8-0fd4-47af-8cf7-9555e94289e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 0.808645 Jun 16 18:44:21.634271 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1647/3219] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:20 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:21.651116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:21.651756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:21.684333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.694125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.695317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.695941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.879509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:21.893736 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ce9926a-42cd-4136-90a9-5601721d0a2e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1271 microversion: 2.1 time: 0.255806 Jun 16 18:44:21.895104 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1648/3220] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:21 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:21.900220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:21.901314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:21.912313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.913150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:21.916078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:21.917306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:22.105435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:22.117219 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f84d874e-97e9-4b44-bce3-fce4cfc9e320 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1504 microversion: 2.1 time: 0.618259 Jun 16 18:44:22.123219 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1573/3221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:21 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1504 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:22.224266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:22.224981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:22.247789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:22.248710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:22.250013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:22.251055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:22.665772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:22.677155 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-caa6f379-91fa-4fbb-8998-426813d3cfc9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.780702 Jun 16 18:44:22.683886 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1649/3222] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:21 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:22.695664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:22.696685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:22.711458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:22.712176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:22.713524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:22.714180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:23.656493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:23.680029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:23.685418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:23.686949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67abc788-5974-49e7-b3ec-4a83c148291d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 1.473172 Jun 16 18:44:23.697278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:23.721440 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89661b2d-18e3-48d1-8126-84c17f1e16fd tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 1.035470 Jun 16 18:44:23.723805 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1574/3223] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:22 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:23.740631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:23.741496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:23.746586 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1650/3224] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:22 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:23.758646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:23.760891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:23.761773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:23.762259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:23.773044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:23.774233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:23.784357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:23.785113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:23.786889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:23.788776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:24.502162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:24.537141 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-96820a22-475a-491e-861a-45ea1d0c91ff tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1313 microversion: 2.1 time: 0.811898 Jun 16 18:44:24.544425 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1575/3225] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:23 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:24.577926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:24.583127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:24.609103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:24.612475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:24.615779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:24.616940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:24.620520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:24.631950 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9d0840f7-7aab-4a5f-b4d4-b99e7d3323c3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1504 microversion: 2.1 time: 0.882235 Jun 16 18:44:24.637522 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1651/3226] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:23 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1504 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:24.724487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:24.725866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:24.739400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:24.745607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:24.749002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:24.749784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.447930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:25.463204 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dc6b71ea-e361-4d3f-b326-dc53f2631355 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.915119 Jun 16 18:44:25.475968 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1576/3227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:24 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:25.482197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:25.483534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:25.494199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.495921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.497159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.497782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.744735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:25.791132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:25.795030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:25.806406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:25.811846 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a0b3aaa-6fec-40f6-bccf-2f9988af5321 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 0.333716 Jun 16 18:44:25.815034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:25.818904 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e8ce51ea-9b4c-490b-aea4-6b09db61fc23 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 1.099067 Jun 16 18:44:25.824278 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1577/3228] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:25 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:25.831431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6f9df0ca-1804-4a60-a409-c49bed6acba5 req-aaaa5abb-0077-4ef7-baaf-1bc58382c494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2b0a3a-8c87-48ae-9824-a0f271429616", "tag": "5fe20bcc-7bda-4feb-a813-ff45dbc68e63"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:25.836706 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1652/3229] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:24 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:25.846184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6f9df0ca-1804-4a60-a409-c49bed6acba5 req-aaaa5abb-0077-4ef7-baaf-1bc58382c494 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.847097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6f9df0ca-1804-4a60-a409-c49bed6acba5 req-aaaa5abb-0077-4ef7-baaf-1bc58382c494 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.847705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:25.848482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:25.867661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6f9df0ca-1804-4a60-a409-c49bed6acba5 req-aaaa5abb-0077-4ef7-baaf-1bc58382c494 service nova] Creating event network-changed:5fe20bcc-7bda-4feb-a813-ff45dbc68e63 for instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 on n-h1-846209-2 Jun 16 18:44:25.874110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6f9df0ca-1804-4a60-a409-c49bed6acba5 req-aaaa5abb-0077-4ef7-baaf-1bc58382c494 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047098 Jun 16 18:44:25.876305 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1578/3230] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:25.879505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.879967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.880762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.881204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.883993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:25.885038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:25.898123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.899812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.900930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.901838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.351639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:26.361360 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e7d7ee45-3fbb-4603-8c60-6b81032718ee tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1313 microversion: 2.1 time: 0.522634 Jun 16 18:44:26.368757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:26.381364 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f93b375-00f9-4a84-8900-75d78e4031be tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.502744 Jun 16 18:44:26.382133 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1653/3231] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:25 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:26.383105 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1579/3232] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:25 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:26.406983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:26.407907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:26.416708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.418115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.419092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.420276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.630646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d989101a-1634-41f1-960c-620a2a4ee81e tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:26.633620 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:26.633620 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:44:26.636564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d989101a-1634-41f1-960c-620a2a4ee81e tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.637035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d989101a-1634-41f1-960c-620a2a4ee81e tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.638964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d989101a-1634-41f1-960c-620a2a4ee81e tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.639456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d989101a-1634-41f1-960c-620a2a4ee81e tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.648470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:26.663577 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e44bc1e2-b06c-4cfc-9117-a13cb818f7dc tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.263535 Jun 16 18:44:26.665694 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1580/3233] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:26 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:26.692373 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d989101a-1634-41f1-960c-620a2a4ee81e tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.308790 Jun 16 18:44:26.693177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:26.696002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:26.696751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1654/3234] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:44:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:26.706013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cca05605-c0f0-4492-9948-a017819fa658 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:26.706275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.706722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.707962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.708402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.709025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cca05605-c0f0-4492-9948-a017819fa658 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 694cfd68-9d0e-4fe6-b3e1-532d14db46b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:26.721987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-cca05605-c0f0-4492-9948-a017819fa658 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 694cfd68-9d0e-4fe6-b3e1-532d14db46b4 could not be found. Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cca05605-c0f0-4492-9948-a017819fa658 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/694cfd68-9d0e-4fe6-b3e1-532d14db46b4/action HTTP/1.1 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 15 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: {"unpause": {}} Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 694cfd68-9d0e-4fe6-b3e1-532d14db46b4 could not be found. Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '694cfd68-9d0e-4fe6-b3e1-532d14db46b4', 'body': {'unpause': {}}} Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694cfd68-9d0e-4fe6-b3e1-532d14db46b4 could not be found. Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694cfd68-9d0e-4fe6-b3e1-532d14db46b4 could not be found. Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:26.724097 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:26.729755 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:26.729755 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:26.729755 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694cfd68-9d0e-4fe6-b3e1-532d14db46b4 could not be found. Jun 16 18:44:26.729755 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:26.729755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cca05605-c0f0-4492-9948-a017819fa658 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 694cfd68-9d0e-4fe6-b3e1-532d14db46b4 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:26.730312 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cca05605-c0f0-4492-9948-a017819fa658 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/694cfd68-9d0e-4fe6-b3e1-532d14db46b4/action" status: 404 len: 111 microversion: 2.1 time: 0.030836 Jun 16 18:44:26.731523 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1655/3235] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:26 2022] POST /compute/v2.1/servers/694cfd68-9d0e-4fe6-b3e1-532d14db46b4/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:26.741371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9c25f97c-518c-4d64-8d2f-055892759119 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:26.742996 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:26.742996 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:44:26.744406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c25f97c-518c-4d64-8d2f-055892759119 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.744860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c25f97c-518c-4d64-8d2f-055892759119 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.745670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c25f97c-518c-4d64-8d2f-055892759119 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.746178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c25f97c-518c-4d64-8d2f-055892759119 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.791819 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9c25f97c-518c-4d64-8d2f-055892759119 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.058256 Jun 16 18:44:26.793538 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1656/3236] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jun 16 18:44:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:26.800630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:26.801534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:26.809483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.809978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.811089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.811540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.983216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:26.993503 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1c141cf1-5e8c-4a90-8419-80261ef6def4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.326377 Jun 16 18:44:27.005416 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1581/3237] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:26 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:27.010250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92ee3579-804f-425a-bacd-6b11b2f0a738 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:27.011661 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:27.011661 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:44:27.012954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92ee3579-804f-425a-bacd-6b11b2f0a738 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.013410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92ee3579-804f-425a-bacd-6b11b2f0a738 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.037374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92ee3579-804f-425a-bacd-6b11b2f0a738 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.037644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92ee3579-804f-425a-bacd-6b11b2f0a738 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.089041 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92ee3579-804f-425a-bacd-6b11b2f0a738 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082363 Jun 16 18:44:27.090252 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1582/3238] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:44:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:27.103918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:27.105722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:27.130770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.134105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.135311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.138152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.144529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:27.153843 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa1dd628-da1a-4d6a-9f8a-f4e1c664a748 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.358822 Jun 16 18:44:27.167651 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1657/3239] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:26 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:27.177507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:27.178513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:27.186638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.187798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.188809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.190245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.679488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:27.689149 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98d40ee4-77f1-4baf-955d-89a36eb23264 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 0.596871 Jun 16 18:44:27.699268 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1583/3240] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:27 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:27.707732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27a8dcc5-eeff-4f28-97c3-1837b2ae4187 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:27.709843 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:27.709843 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:44:27.711525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a8dcc5-eeff-4f28-97c3-1837b2ae4187 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.712235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a8dcc5-eeff-4f28-97c3-1837b2ae4187 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.713324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a8dcc5-eeff-4f28-97c3-1837b2ae4187 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.714048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a8dcc5-eeff-4f28-97c3-1837b2ae4187 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.743047 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27a8dcc5-eeff-4f28-97c3-1837b2ae4187 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-846209-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042186 Jun 16 18:44:27.751689 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1584/3241] 10.222.0.27 () {58 vars in 1193 bytes} [Thu Jun 16 18:44:27 2022] GET /compute/v2.1/os-services?host=n-d-846209-2&binary=xxx => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:44:27.757653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:27.758812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:27.768488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.769466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.770642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.771354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.830582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:27.847135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:27.849685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:27.856272 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a32eaa57-a5d0-407d-b075-117cbf0b581a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.683556 Jun 16 18:44:27.858072 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1658/3242] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:27 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:27.881677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:27.882882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:27.896007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.897222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.898301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.899745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.909693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:28.320751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:28.335818 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c184b75e-629c-49f0-8d14-9c114768f498 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.577060 Jun 16 18:44:28.337210 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1585/3243] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:27 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:28.346526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7e587c9-eb32-423d-b7e6-aa8bc895dc8c tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:28.353007 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:28.353007 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:44:28.355433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7e587c9-eb32-423d-b7e6-aa8bc895dc8c tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:28.362480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7e587c9-eb32-423d-b7e6-aa8bc895dc8c tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:28.364161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7e587c9-eb32-423d-b7e6-aa8bc895dc8c tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:28.364952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7e587c9-eb32-423d-b7e6-aa8bc895dc8c tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:28.437171 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d7e587c9-eb32-423d-b7e6-aa8bc895dc8c tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.094370 Jun 16 18:44:28.444264 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1586/3244] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:44:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:28.450966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:28.451978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:28.466948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:28.468365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:28.475169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:28.476195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:28.564060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:28.574288 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b3a79d3f-54e1-436e-8bb3-e83194942b47 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.713804 Jun 16 18:44:28.577965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1659/3245] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:27 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:28.604158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-231e7477-5f90-41eb-a13b-80dfc9ea3641 req-49f95287-dca6-4dc9-b29b-641f82d6848c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c4b3e1-54b2-48d1-915d-8c4a8439d230", "name": "network-vif-plugged", "status": "completed", "tag": "77ce3fa6-2efb-4de0-a5d5-dc0c1267f1a4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:28.622219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-231e7477-5f90-41eb-a13b-80dfc9ea3641 req-49f95287-dca6-4dc9-b29b-641f82d6848c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:28.631222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-231e7477-5f90-41eb-a13b-80dfc9ea3641 req-49f95287-dca6-4dc9-b29b-641f82d6848c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:28.671977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:28.681517 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-231e7477-5f90-41eb-a13b-80dfc9ea3641 req-49f95287-dca6-4dc9-b29b-641f82d6848c service nova] Creating event network-vif-plugged:77ce3fa6-2efb-4de0-a5d5-dc0c1267f1a4 for instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 on n-h2-846209-2 Jun 16 18:44:28.716396 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-231e7477-5f90-41eb-a13b-80dfc9ea3641 req-49f95287-dca6-4dc9-b29b-641f82d6848c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115846 Jun 16 18:44:28.726050 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1660/3246] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:28.854291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-503113788", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:28.967488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] validate_networks() for [('b5bae4cd-c89e-4d76-ac0b-eedd098439e4', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:44:29.398708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:29.421472 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d81441be-2da3-42f1-aba3-c7834e961d25 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1318 microversion: 2.1 time: 0.975086 Jun 16 18:44:29.434059 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1587/3247] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:28 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1318 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:29.440627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:29.444670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:29.460629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:29.464956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:29.466201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:29.466835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:29.531976 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Cannot 'unpause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action HTTP/1.1 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 15 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: {"unpause": {}} Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: exception: Cannot 'unpause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'unpause': {}}} Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e57881-9458-4864-a6d8-79555341a48e in vm_state active. Cannot unpause while the instance is in this state. Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:29.534114 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:29.538912 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:29.538912 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:29.538912 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:29.538912 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:29.538912 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:29.538912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 409 to user: Cannot 'unpause' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:29.538912 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a4d5d2cf-9eac-458d-ae09-ad4ec0ada60e tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 409 len: 145 microversion: 2.1 time: 0.102517 Jun 16 18:44:29.541840 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1588/3248] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:29 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 145 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:44:29.552132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f4ed51a3-c0d8-4c15-a6bd-6abfc9cebbd5 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:29.556467 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:29.556467 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 18:44:29.566292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ed51a3-c0d8-4c15-a6bd-6abfc9cebbd5 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:29.566889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ed51a3-c0d8-4c15-a6bd-6abfc9cebbd5 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:29.568468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ed51a3-c0d8-4c15-a6bd-6abfc9cebbd5 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:29.569114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ed51a3-c0d8-4c15-a6bd-6abfc9cebbd5 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:29.627112 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f4ed51a3-c0d8-4c15-a6bd-6abfc9cebbd5 tempest-ServicesAdminNegativeTestJSON-1922602075 tempest-ServicesAdminNegativeTestJSON-1922602075-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.080777 Jun 16 18:44:29.628238 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1589/3249] 10.222.0.27 () {58 vars in 1197 bytes} [Thu Jun 16 18:44:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:44:29.633394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:29.638910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:29.648083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:29.648852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:29.650338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:29.651141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:30.644445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:30.662190 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3e55f44-a2c6-4ecf-9715-d855b4f97632 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 1.032502 Jun 16 18:44:30.662842 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1590/3250] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:29 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:30.676982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:30.678247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:30.691299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:30.692135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:30.693189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:30.693822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:30.711309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:44:30.712412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:44:30.712932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:44:30.713435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:44:30.713898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:44:30.739878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:30.740351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:30.749359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:30.749838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:30.803341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for project bce48b6c6c6d441db054c828687ad6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:44:30.835406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for user ea59542886884867a7db703105cd495e and project bce48b6c6c6d441db054c828687ad6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:44:30.870942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:44:30.894210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:44:30.984155 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a649abda-30c6-4b3b-b2e0-569c695e76fe tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.256319 Jun 16 18:44:30.992003 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1661/3251] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:44:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:44:31.009344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:31.012738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:31.025359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:31.035579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:31.036886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:31.037619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:31.282091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:31.295276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:31.301228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:31.302510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a7771e5-f2b7-4fcd-9a9a-c367b5d434a9 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.638332 Jun 16 18:44:31.318872 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1591/3252] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:30 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:31.331366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:31.332140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:31.343897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:31.344369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:31.349499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:31.350213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:31.369089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:31.386737 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3ddae87-8278-43f4-8c29-85084a471a53 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.391080 Jun 16 18:44:31.393355 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1662/3253] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:30 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:31.599098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23635242-e5d2-486e-a2ad-abe1c9f32ef2 tempest-ServicesAdminNegativeTestJSON-473202854 tempest-ServicesAdminNegativeTestJSON-473202854-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:31.600733 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:31.600733 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:44:31.602458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-23635242-e5d2-486e-a2ad-abe1c9f32ef2 tempest-ServicesAdminNegativeTestJSON-473202854 tempest-ServicesAdminNegativeTestJSON-473202854-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '44225b8baa0640b8adf2d2bd11f1b813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4935d78d074dcfbb84d5736307d96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23635242-e5d2-486e-a2ad-abe1c9f32ef2 tempest-ServicesAdminNegativeTestJSON-473202854 tempest-ServicesAdminNegativeTestJSON-473202854-project] Request method failure captured: Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oIXO9RtIU-RhKeQul1uiZUXou7lp1Q9IVUWe8jhHlz4whfDmTSxS3iJt7TkuLA3M0PaC1zeZHHN6b_212OtnFwYJzVlAXjfOIvOiuNoRO4ZDZCkdOe9szLDxNbSD78Nj8mmlpjLjJEkZG7dKx_4eQqjRqNr8QdkeL2flBQ1H2ucG0 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5f4935d78d074dcfbb84d5736307d96d Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-473202854 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f4935d78d074dcfbb84d5736307d96d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f4935d78d074dcfbb84d5736307d96d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f4935d78d074dcfbb84d5736307d96d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f4935d78d074dcfbb84d5736307d96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-473202854 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5f4935d78d074dcfbb84d5736307d96d Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-473202854 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServicesAdminNegativeTestJSON-473202854-project Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 44225b8baa0640b8adf2d2bd11f1b813 Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-473202854-project Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: action_args: {} Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 18:44:31.605429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:31.611360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23635242-e5d2-486e-a2ad-abe1c9f32ef2 tempest-ServicesAdminNegativeTestJSON-473202854 tempest-ServicesAdminNegativeTestJSON-473202854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:31.613025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-23635242-e5d2-486e-a2ad-abe1c9f32ef2 tempest-ServicesAdminNegativeTestJSON-473202854 tempest-ServicesAdminNegativeTestJSON-473202854-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.217459 Jun 16 18:44:31.613687 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1663/3254] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:44:31 2022] GET /compute/v2.1/os-services => generated 112 bytes in 219 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:31.648617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:31.650886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:31.685008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:31.686714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:31.689727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:31.690533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:31.696513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:31.713501 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd006585-6928-40a9-aca9-2270349ad385 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.388970 Jun 16 18:44:31.717569 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1592/3255] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:31 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:31.738936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-badadff0-2cc9-44cd-a617-0069971d4184 req-3567c138-8e43-4236-b424-883aaaaa9c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9132789-6b38-433a-a9f5-77012d9c56d2", "tag": "476d9a66-52ec-4a25-8ad9-16e341219373"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:31.763999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-badadff0-2cc9-44cd-a617-0069971d4184 req-3567c138-8e43-4236-b424-883aaaaa9c0c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:31.764475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-badadff0-2cc9-44cd-a617-0069971d4184 req-3567c138-8e43-4236-b424-883aaaaa9c0c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:31.793106 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-badadff0-2cc9-44cd-a617-0069971d4184 req-3567c138-8e43-4236-b424-883aaaaa9c0c service nova] Creating event network-changed:476d9a66-52ec-4a25-8ad9-16e341219373 for instance f9132789-6b38-433a-a9f5-77012d9c56d2 on n-h1-846209-2 Jun 16 18:44:31.807526 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-badadff0-2cc9-44cd-a617-0069971d4184 req-3567c138-8e43-4236-b424-883aaaaa9c0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085982 Jun 16 18:44:31.808599 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1593/3256] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:31.827470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ec9248a-81bf-4e04-bbdb-359ae3229cfb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:31.829330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0ec9248a-81bf-4e04-bbdb-359ae3229cfb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:32.085701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0ec9248a-81bf-4e04-bbdb-359ae3229cfb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:32.092744 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0ec9248a-81bf-4e04-bbdb-359ae3229cfb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1221 microversion: 2.1 time: 0.282871 Jun 16 18:44:32.101637 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1594/3257] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:31 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1221 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:32.116048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:32.125329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:32.136608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:32.137072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:32.137867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:32.138332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:32.401176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:32.419385 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-981ec11b-f4ad-44e9-9412-657f41f8e951 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1508 microversion: 2.1 time: 0.800298 Jun 16 18:44:32.422553 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1664/3258] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:31 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1508 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:32.445478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:32.446538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:32.481559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:32.484441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:32.489711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:32.490336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:33.027804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:33.041133 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f77e1850-ff67-4ef9-90f6-fc18b7ce8479 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.938218 Jun 16 18:44:33.043719 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1595/3259] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:32 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:33.055283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-86945202", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:33.066636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:33.082307 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ede74e0e-f5e2-47fe-99e5-db7996449f02 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 0.655318 Jun 16 18:44:33.085380 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1665/3260] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:32 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:33.096840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:33.098431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:33.118437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:33.119304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:33.120362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:33.121033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:33.193782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] validate_networks() for [('b5bae4cd-c89e-4d76-ac0b-eedd098439e4', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:44:33.534953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:33.548567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:33.550123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:33.551737 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e46ed06a-74be-4073-b00b-2c1a70e28273 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.464992 Jun 16 18:44:33.553613 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1666/3261] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:33 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:33.560419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:33.561376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:33.568888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:33.569445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:33.570339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:33.570998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:33.812170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:33.826450 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4c6d4d49-635c-43a0-88fb-d0f85f7d10e6 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1508 microversion: 2.1 time: 0.271440 Jun 16 18:44:33.830417 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1667/3262] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:33 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:33.847705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:33.848342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:33.865712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:33.866444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:33.867420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:33.868028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.271314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:44:34.272478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:44:34.273132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:44:34.273735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:44:34.274371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:44:34.305734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.309358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.311698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.313059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.314229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:34.323498 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b7dddea7-7968-4219-ae4b-c41e79ee5648 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.491594 Jun 16 18:44:34.330284 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1668/3263] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:33 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:34.389995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for project bce48b6c6c6d441db054c828687ad6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:44:34.403602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for user ea59542886884867a7db703105cd495e and project bce48b6c6c6d441db054c828687ad6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:44:34.446031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:44:34.448485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:44:34.509518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:34.573277 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ddfebc87-ef62-4457-83a3-cad0f8a0874e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.522079 Jun 16 18:44:34.578631 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1596/3264] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:44:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:44:34.586675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-addc4ea6-8857-43d2-b13f-4bc245407745 req-ba77c528-6e2c-4208-b6fb-84b24c7069f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-plugged", "status": "completed", "tag": "9d1b468a-2120-4f05-94a5-e5db40e872bf"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:34.611957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-addc4ea6-8857-43d2-b13f-4bc245407745 req-ba77c528-6e2c-4208-b6fb-84b24c7069f5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.612085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-addc4ea6-8857-43d2-b13f-4bc245407745 req-ba77c528-6e2c-4208-b6fb-84b24c7069f5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.632474 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-addc4ea6-8857-43d2-b13f-4bc245407745 req-ba77c528-6e2c-4208-b6fb-84b24c7069f5 service nova] Creating event network-vif-plugged:9d1b468a-2120-4f05-94a5-e5db40e872bf for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:34.646733 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-addc4ea6-8857-43d2-b13f-4bc245407745 req-ba77c528-6e2c-4208-b6fb-84b24c7069f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071036 Jun 16 18:44:34.649573 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1597/3265] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:34.662499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ab49554-ea76-49df-b1cc-9ae54f894164 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:34.664776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8ab49554-ea76-49df-b1cc-9ae54f894164 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 311aa2d0-3ec7-433f-905a-9839758c1ee3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:34.680409 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8ab49554-ea76-49df-b1cc-9ae54f894164 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 311aa2d0-3ec7-433f-905a-9839758c1ee3 could not be found. Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ab49554-ea76-49df-b1cc-9ae54f894164 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/311aa2d0-3ec7-433f-905a-9839758c1ee3/action HTTP/1.1 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 18 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: {"unshelve": null} Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 311aa2d0-3ec7-433f-905a-9839758c1ee3 could not be found. Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '311aa2d0-3ec7-433f-905a-9839758c1ee3', 'body': {'unshelve': None}} Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311aa2d0-3ec7-433f-905a-9839758c1ee3 could not be found. Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311aa2d0-3ec7-433f-905a-9839758c1ee3 could not be found. Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:34.684709 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:34.690383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:34.690383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:34.690383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:34.690383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311aa2d0-3ec7-433f-905a-9839758c1ee3 could not be found. Jun 16 18:44:34.690383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:34.692034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ab49554-ea76-49df-b1cc-9ae54f894164 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 311aa2d0-3ec7-433f-905a-9839758c1ee3 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:34.695108 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8ab49554-ea76-49df-b1cc-9ae54f894164 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/311aa2d0-3ec7-433f-905a-9839758c1ee3/action" status: 404 len: 111 microversion: 2.1 time: 0.044026 Jun 16 18:44:34.698189 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1598/3266] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:34 2022] POST /compute/v2.1/servers/311aa2d0-3ec7-433f-905a-9839758c1ee3/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:34.714057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c698fb16-c045-40e0-a7c0-e7978e140b55 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:34.715422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c698fb16-c045-40e0-a7c0-e7978e140b55 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:34.736131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c698fb16-c045-40e0-a7c0-e7978e140b55 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.736885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c698fb16-c045-40e0-a7c0-e7978e140b55 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.737938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c698fb16-c045-40e0-a7c0-e7978e140b55 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.740565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c698fb16-c045-40e0-a7c0-e7978e140b55 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.833220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4bf647f0-b88a-4d6b-932c-5149e16dedff tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'create', calling method: .version_select at 0x7f866ea544c0>, body: {"keypair": {"name": "tempest-keypair-1063212738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClISiFzSOzh4FqhvHNljDTdQupM/Z91tykpSu+DlX+kRd/uYWZdcDchGiW81fIpWeoWHbX15QlcrjM7wazrlp138Y6vSr7jycjuyrdhI0iR1nQfTXPq33Z0Y4BCwVteIQ=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:34.860513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4bf647f0-b88a-4d6b-932c-5149e16dedff tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for project 8493b9facda24bb6849d297a47afd81b. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:44:34.874742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4bf647f0-b88a-4d6b-932c-5149e16dedff tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for user 1e1faf1cce864fa4b65a67074b879065 and project 8493b9facda24bb6849d297a47afd81b. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:44:34.894648 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c698fb16-c045-40e0-a7c0-e7978e140b55 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "PUT /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1080 microversion: 2.1 time: 0.191725 Jun 16 18:44:34.896006 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1599/3267] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:44:34 2022] PUT /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1080 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:34.902323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-dcf75750-1e87-4f49-9cb8-3713ace7f39a req-63b55d1a-b524-4d28-83b8-6ee0802f0c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9132789-6b38-433a-a9f5-77012d9c56d2", "tag": "22a48654-bcba-4f46-91cb-026e3ec41e2f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:34.913988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dcf75750-1e87-4f49-9cb8-3713ace7f39a req-63b55d1a-b524-4d28-83b8-6ee0802f0c2c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.914741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dcf75750-1e87-4f49-9cb8-3713ace7f39a req-63b55d1a-b524-4d28-83b8-6ee0802f0c2c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.949300 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-dcf75750-1e87-4f49-9cb8-3713ace7f39a req-63b55d1a-b524-4d28-83b8-6ee0802f0c2c service nova] Creating event network-changed:22a48654-bcba-4f46-91cb-026e3ec41e2f for instance f9132789-6b38-433a-a9f5-77012d9c56d2 on n-h1-846209-2 Jun 16 18:44:34.950265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4bf647f0-b88a-4d6b-932c-5149e16dedff tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.618478 Jun 16 18:44:34.960682 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-dcf75750-1e87-4f49-9cb8-3713ace7f39a req-63b55d1a-b524-4d28-83b8-6ee0802f0c2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060100 Jun 16 18:44:34.961015 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1669/3268] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:44:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 630 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:44:34.961666 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1600/3269] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:34.971379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:34.972522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:34.977162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:34.978234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:34.991784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.992248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.995055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.997014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:34.998423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.998704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:34.999169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:35.002653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:35.828618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:35.846608 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3a610c37-14f7-4680-9cdd-dbc1615e698e tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 0.884323 Jun 16 18:44:35.858316 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1670/3270] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:34 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:35.864598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:35.865575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:35.881491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:35.882253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:35.883241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:35.883869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:35.913689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:35.929873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:35.939758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:35.955499 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af714306-c520-4218-8181-8691bbb4ac66 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.991689 Jun 16 18:44:35.956095 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1601/3271] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:34 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:35.967590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:35.968679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:35.987870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:35.988329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:35.989125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:35.989574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:35.993305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:36.144226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:36.180384 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-124b8281-1900-450f-a915-7d57ae4f9b7c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1216 microversion: 2.1 time: 0.320476 Jun 16 18:44:36.207672 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1671/3272] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:35 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1216 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:36.213697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:36.216798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:36.227952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:36.228788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:36.230157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:36.230846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:36.431461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:36.444495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc408d5a-e904-44df-ba5a-222cb37f98b2 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.482638 Jun 16 18:44:36.445079 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1602/3273] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:35 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:36.465054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:36.465681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:36.484642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:36.485105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:36.487408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:36.487871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:36.723664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:36.736743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41963896-2420-418b-88c9-4f701ae96ab5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1506 microversion: 2.1 time: 0.527357 Jun 16 18:44:36.745422 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1672/3274] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:36 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:36.766349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:36.768048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:36.787940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:36.788783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:36.789868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:36.791175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:36.930464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:36.955390 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a11be9a-b674-4e80-85c9-c2949bf87edb tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.492480 Jun 16 18:44:36.959983 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1603/3275] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:36 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:36.970691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2b0a3a-8c87-48ae-9824-a0f271429616", "name": "network-vif-plugged", "status": "completed", "tag": "5fe20bcc-7bda-4feb-a813-ff45dbc68e63"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-plugged", "status": "completed", "tag": "314d811b-e77f-454b-9c34-1fe5fab9338b"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-plugged", "status": "completed", "tag": "8d17ac6b-6841-40b8-b764-916f547af808"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-plugged", "status": "completed", "tag": "241f1fc5-16df-4f88-83bb-da75d25e2755"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-plugged", "status": "completed", "tag": "b3893116-c573-4d2e-b1ad-049449293671"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:36.999900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:37.000773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:37.049236 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Creating event network-vif-plugged:5fe20bcc-7bda-4feb-a813-ff45dbc68e63 for instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 on n-h1-846209-2 Jun 16 18:44:37.051349 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Creating event network-vif-plugged:314d811b-e77f-454b-9c34-1fe5fab9338b for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:37.052121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Creating event network-vif-plugged:8d17ac6b-6841-40b8-b764-916f547af808 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:37.052652 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Creating event network-vif-plugged:241f1fc5-16df-4f88-83bb-da75d25e2755 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:37.053174 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] Creating event network-vif-plugged:b3893116-c573-4d2e-b1ad-049449293671 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:37.087381 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5f270197-ed74-4ace-b6fa-d8091acd1082 req-338da2ce-1b8a-4d5b-b7d0-45a948b5c324 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.125545 Jun 16 18:44:37.090875 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1604/3276] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:37.108975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:37.114586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:37.123654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:37.133863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:37.138871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:37.139558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:37.187082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:37.196280 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-320c6179-9a78-4166-98b1-f7b00f69b837 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.439446 Jun 16 18:44:37.212608 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1673/3277] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:36 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:37.228702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:37.229550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:37.245306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:37.245978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:37.248776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:37.251909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:37.669484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:37.686234 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ef24851-ebff-423f-88d9-503bccbc6505 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1506 microversion: 2.1 time: 0.593450 Jun 16 18:44:37.707356 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1605/3278] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:37 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:37.714328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:37.723034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:37.753519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:37.757683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:37.758766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:37.759403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.059719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:38.070752 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e633bc23-2f63-4ab8-8088-cd11942e42e4 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1324 microversion: 2.1 time: 0.856025 Jun 16 18:44:38.084206 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1674/3279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:37 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1324 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:38.093250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f17e4519-d773-40a4-844a-351235a552f6 req-540a6270-41df-4156-a2d2-6011bf7bb44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253e4a8a-f499-447c-a0ec-2cf88b67abad", "tag": "40ce37ea-67c1-48ca-ae0e-e6c814830c0a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:38.115909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f17e4519-d773-40a4-844a-351235a552f6 req-540a6270-41df-4156-a2d2-6011bf7bb44b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.120404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f17e4519-d773-40a4-844a-351235a552f6 req-540a6270-41df-4156-a2d2-6011bf7bb44b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.136704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f17e4519-d773-40a4-844a-351235a552f6 req-540a6270-41df-4156-a2d2-6011bf7bb44b service nova] Creating event network-changed:40ce37ea-67c1-48ca-ae0e-e6c814830c0a for instance 253e4a8a-f499-447c-a0ec-2cf88b67abad on n-h2-846209-2 Jun 16 18:44:38.142780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f17e4519-d773-40a4-844a-351235a552f6 req-540a6270-41df-4156-a2d2-6011bf7bb44b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056791 Jun 16 18:44:38.144050 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1675/3280] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:38.159613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:38.165516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:38.176885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:38.183176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:38.193166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:38.195276 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a9750b8-7cd0-4264-8bb9-ab4d6c7482cf tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.486512 Jun 16 18:44:38.195501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.196976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.198072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.198925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.206885 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1606/3281] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:37 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:38.226601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:38.227584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:38.244834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.246823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.248129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.250055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.334679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:38.343467 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-149c488a-af49-4e2f-86dd-7e653e348df4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1278 microversion: 2.1 time: 0.197980 Jun 16 18:44:38.356145 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1676/3282] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:38 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:38.356731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf6c4011-80a6-427b-ab2c-02c3749e2b7b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:38.378456 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Cannot 'unshelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action HTTP/1.1 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 18 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: {"unshelve": null} Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: exception: Cannot 'unshelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'unshelve': None}} Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5e57881-9458-4864-a6d8-79555341a48e in vm_state active. Cannot unshelve while the instance is in this state. Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:38.381399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active Jun 16 18:44:38.385724 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:38.386460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf6c4011-80a6-427b-ab2c-02c3749e2b7b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:38.388033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 409 to user: Cannot 'unshelve' instance e5e57881-9458-4864-a6d8-79555341a48e while it is in vm_state active {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:38.389385 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e1ddf97-b8db-4612-b023-5ff1380d3d93 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action" status: 409 len: 146 microversion: 2.1 time: 0.180966 Jun 16 18:44:38.390655 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1607/3283] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:38 2022] POST /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e/action => generated 146 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:44:38.392874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf6c4011-80a6-427b-ab2c-02c3749e2b7b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.393338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf6c4011-80a6-427b-ab2c-02c3749e2b7b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.394572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf6c4011-80a6-427b-ab2c-02c3749e2b7b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.395027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf6c4011-80a6-427b-ab2c-02c3749e2b7b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.398266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:38.399234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:38.407512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.408907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.410347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.412007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.536443 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf6c4011-80a6-427b-ab2c-02c3749e2b7b tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "PUT /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1082 microversion: 2.1 time: 0.187661 Jun 16 18:44:38.537612 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1677/3284] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:44:38 2022] PUT /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1082 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:38.544387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:38.545270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:38.553026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.554637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.557784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.560133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.837513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:38.853651 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b62a4f49-aaae-46aa-87bb-863ba12bee6c tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.460972 Jun 16 18:44:38.856257 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1608/3285] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:38 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:38.867002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:38.868347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:38.880709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.881727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.882828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.884018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.931577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:38.939878 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9dd3a4b-9008-4cd6-8730-2882afa84efb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.400942 Jun 16 18:44:38.942050 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1678/3286] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:38 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:38.959527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:38.960537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:38.967793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.968610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.969632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:38.971088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:38.976008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:39.365334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:39.379111 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-969ecb72-541a-4708-8dee-89866d897bf4 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1508 microversion: 2.1 time: 0.515739 Jun 16 18:44:39.379962 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1609/3287] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:38 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:39.386827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:39.395127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:39.412922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:39.413774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:39.415529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:39.415912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:39.487845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:39.503238 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e4e2979e-d72c-4136-a478-86bd0cc29660 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.549729 Jun 16 18:44:39.505286 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1679/3288] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:38 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:39.511416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:39.512083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:39.521284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:39.522019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:39.522983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:39.524186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:40.033249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:40.045474 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3da0fc5f-21e4-48cc-ae2f-07912205182c tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1520 microversion: 2.1 time: 0.662317 Jun 16 18:44:40.046136 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1610/3289] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:39 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1520 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:40.061688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4060bdf7-8535-4d6e-985f-1dcc52adb6bd req-df1ac568-f964-4a07-a4e8-e27dc736b853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-plugged", "status": "completed", "tag": "ba2ae7ab-69a0-4f82-8d6a-7c53590e8739"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-plugged", "status": "completed", "tag": "007a7fdc-42d7-466b-a1f0-28a9c6ab1600"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:40.083254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4060bdf7-8535-4d6e-985f-1dcc52adb6bd req-df1ac568-f964-4a07-a4e8-e27dc736b853 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:40.083955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4060bdf7-8535-4d6e-985f-1dcc52adb6bd req-df1ac568-f964-4a07-a4e8-e27dc736b853 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:40.107639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4060bdf7-8535-4d6e-985f-1dcc52adb6bd req-df1ac568-f964-4a07-a4e8-e27dc736b853 service nova] Creating event network-vif-plugged:ba2ae7ab-69a0-4f82-8d6a-7c53590e8739 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:40.108777 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4060bdf7-8535-4d6e-985f-1dcc52adb6bd req-df1ac568-f964-4a07-a4e8-e27dc736b853 service nova] Creating event network-vif-plugged:007a7fdc-42d7-466b-a1f0-28a9c6ab1600 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:40.122261 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4060bdf7-8535-4d6e-985f-1dcc52adb6bd req-df1ac568-f964-4a07-a4e8-e27dc736b853 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074595 Jun 16 18:44:40.123173 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1611/3290] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:40.139817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:40.148852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:40.159928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:40.171051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:40.172389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:40.177806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:40.484112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:40.494411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:40.497134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:40.498861 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ebc29f29-9946-4bce-8c23-0e3cdc873dde tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1877 microversion: 2.42 time: 0.992348 Jun 16 18:44:40.500247 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1680/3291] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:39 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1877 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:40.515649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:40.516637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:40.525311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:40.526377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:40.527683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:40.528360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:40.743211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:40.754061 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5462842e-487f-4a1e-89df-2c14c2dc4e00 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 0.629406 Jun 16 18:44:40.755574 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1612/3292] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:40 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:40.766667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:40.778526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d8c651d-5fec-4c59-98c9-ef82ded8d572 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1051244313_updated"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:40.780911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3d8c651d-5fec-4c59-98c9-ef82ded8d572 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 48fef8c6-76a8-4fa8-8855-16c61624f9e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:40.790359 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-3d8c651d-5fec-4c59-98c9-ef82ded8d572 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 48fef8c6-76a8-4fa8-8855-16c61624f9e5 could not be found. Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d8c651d-5fec-4c59-98c9-ef82ded8d572 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/servers/48fef8c6-76a8-4fa8-8855-16c61624f9e5 HTTP/1.1 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 81 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1051244313_updated"}} Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 48fef8c6-76a8-4fa8-8855-16c61624f9e5 could not be found. Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '48fef8c6-76a8-4fa8-8855-16c61624f9e5', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1051244313_updated'}}} Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48fef8c6-76a8-4fa8-8855-16c61624f9e5 could not be found. Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 16 18:44:40.792959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48fef8c6-76a8-4fa8-8855-16c61624f9e5 could not be found. Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48fef8c6-76a8-4fa8-8855-16c61624f9e5 could not be found. Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d8c651d-5fec-4c59-98c9-ef82ded8d572 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 48fef8c6-76a8-4fa8-8855-16c61624f9e5 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d8c651d-5fec-4c59-98c9-ef82ded8d572 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "PUT /compute/v2.1/servers/48fef8c6-76a8-4fa8-8855-16c61624f9e5" status: 404 len: 111 microversion: 2.1 time: 0.038376 Jun 16 18:44:40.797148 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1613/3293] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:44:40 2022] PUT /compute/v2.1/servers/48fef8c6-76a8-4fa8-8855-16c61624f9e5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:40.805041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-593557566", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "448a9d16-1568-4616-82e9-7c0185274295"}], "security_groups": [{"name": "tempest-securitygroup--596892629"}], "key_name": "tempest-keypair-1063212738", "user_data": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:41.578941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] validate_networks() for [('448a9d16-1568-4616-82e9-7c0185274295', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:44:41.593365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:41.607792 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c057b307-7c17-4483-9795-71b5ff32712a tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1508 microversion: 2.1 time: 1.104854 Jun 16 18:44:41.612523 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1681/3294] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:40 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1508 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:41.621829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:41.622494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:41.648803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:41.651190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:41.652035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:41.652483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.105101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:42.115510 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-94dec77d-8ea5-47d7-b2c8-1bd43855c8e0 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.498045 Jun 16 18:44:42.116210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1682/3295] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:41 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:42.124594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:42.125405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:42.134224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.135857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.136747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.137284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.166702 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] HTTP exception thrown: Instance is not a member of specified network Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Request method failure captured: Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616/ips/invalid HTTP/1.1 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3n7VTgr6NkgY7m1du8hnP47qm-PQ5obVGKoU1iLW-jalGCic1-OCPnYobyzvfIQ0ji5WrZGou9a5z71UStNFr7M-ioEycWLKphtWVkAWbbdSXh5GdmDNeeljyRFXDznQbYO54hsyGiifg1M_xD4SLiQG4wiVwr9Pe7B1IkSbPgXuJ4 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1d59bf2fe9b34d92b263ffb4fd3cec04 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1d59bf2fe9b34d92b263ffb4fd3cec04", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1d59bf2fe9b34d92b263ffb4fd3cec04 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerAddressesNegativeTestJSON-1651088112-project Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0ee0f2c208dc467999b3b8f33e5bcc53 Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1651088112-project Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance is not a member of specified network Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'server_id': '3f2b0a3a-8c87-48ae-9824-a0f271429616', 'id': 'invalid'} Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jun 16 18:44:42.175774 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:42.183148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:42.185446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-67d44c86-ed51-458f-96c0-74757b293314 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.067852 Jun 16 18:44:42.186938 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1683/3296] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:44:42 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616/ips/invalid => generated 91 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:44:42.196354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:42.198540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:42.207608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:42.210241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.210982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.211982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.214423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.579038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:42.593988 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-427f35d0-e3f6-433c-bbbc-d4b657b806d7 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.405162 Jun 16 18:44:42.597134 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1684/3297] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:42 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:42.602849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:42.604216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:42.616339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.617118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.619090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.619602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.770754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:44:42.771772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:44:42.772427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:44:42.773002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:44:42.773616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:44:42.784438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.785196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.786241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.787000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.809686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=15 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:42.840135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for project 8493b9facda24bb6849d297a47afd81b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:44:42.858426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for user 1e1faf1cce864fa4b65a67074b879065 and project 8493b9facda24bb6849d297a47afd81b. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:44:42.884159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:44:42.886885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:44:42.977549 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a6ab68b8-6055-4547-ac1d-84346e463010 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.180086 Jun 16 18:44:42.979056 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1614/3298] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:44:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:44:42.986446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:42.987145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:42.995374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.996751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:42.997759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:42.998384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.040847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:43.162582 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b8680c9d-2268-4e46-beae-44f2b56efec9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 204 len: 0 microversion: 2.1 time: 0.181164 Jun 16 18:44:43.169215 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1615/3299] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:42 2022] DELETE /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:43.178672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:43.180301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:43.191798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.192628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.194255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.194910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.255105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.271429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.277557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.280266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fbe97e11-1a48-4174-b59a-8141e0ed8e84 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2835 microversion: 2.42 time: 0.680675 Jun 16 18:44:43.283339 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1685/3300] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:42 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2835 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:43.298014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c35d3768-be2e-47b1-ac83-8dbd13e85a88 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:43.299334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c35d3768-be2e-47b1-ac83-8dbd13e85a88 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Failed to fetch instance by id 999 {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 18:44:43.300057 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-c35d3768-be2e-47b1-ac83-8dbd13e85a88 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] HTTP exception thrown: Instance 999 could not be found. Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c35d3768-be2e-47b1-ac83-8dbd13e85a88 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Request method failure captured: Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3n7VTgr6NkgY7m1du8hnP47qm-PQ5obVGKoU1iLW-jalGCic1-OCPnYobyzvfIQ0ji5WrZGou9a5z71UStNFr7M-ioEycWLKphtWVkAWbbdSXh5GdmDNeeljyRFXDznQbYO54hsyGiifg1M_xD4SLiQG4wiVwr9Pe7B1IkSbPgXuJ4 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1d59bf2fe9b34d92b263ffb4fd3cec04 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1d59bf2fe9b34d92b263ffb4fd3cec04", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1d59bf2fe9b34d92b263ffb4fd3cec04 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerAddressesNegativeTestJSON-1651088112-project Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0ee0f2c208dc467999b3b8f33e5bcc53 Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1651088112-project Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 999 could not be found. Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'server_id': '999'} Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 16 18:44:43.301828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:43.306959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c35d3768-be2e-47b1-ac83-8dbd13e85a88 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:43.308752 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c35d3768-be2e-47b1-ac83-8dbd13e85a88 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024257 Jun 16 18:44:43.309439 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1686/3301] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:44:43 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:44:43.320032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:43.320859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:43.329934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.330549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.331456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.332282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.788219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.807302 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-569b06dd-b64c-4961-9d5e-855770e2f4f1 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.491880 Jun 16 18:44:43.809149 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1687/3302] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:43 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:43.809842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.815697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d38d9b19-b3c6-4247-b134-7688c9ca1f18 req-a7750212-67bd-4e59-b77b-403bff08cb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9132789-6b38-433a-a9f5-77012d9c56d2", "name": "network-vif-plugged", "status": "completed", "tag": "22a48654-bcba-4f46-91cb-026e3ec41e2f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:43.828922 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03f09dfa-1f85-4910-b9cf-f04fbd5461e7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 0.657520 Jun 16 18:44:43.830756 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1616/3303] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:43 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:43.835660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:43.838785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:43.850746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d38d9b19-b3c6-4247-b134-7688c9ca1f18 req-a7750212-67bd-4e59-b77b-403bff08cb7a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.857211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.857951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.858922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.859538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.862757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d38d9b19-b3c6-4247-b134-7688c9ca1f18 req-a7750212-67bd-4e59-b77b-403bff08cb7a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.895521 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d38d9b19-b3c6-4247-b134-7688c9ca1f18 req-a7750212-67bd-4e59-b77b-403bff08cb7a service nova] Creating event network-vif-plugged:22a48654-bcba-4f46-91cb-026e3ec41e2f for instance f9132789-6b38-433a-a9f5-77012d9c56d2 on n-h1-846209-2 Jun 16 18:44:43.904899 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d38d9b19-b3c6-4247-b134-7688c9ca1f18 req-a7750212-67bd-4e59-b77b-403bff08cb7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093850 Jun 16 18:44:43.906127 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1688/3304] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:43.913525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:43.914535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:43.922113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.924425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.925445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:43.926351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:43.955475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.965540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.967517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:43.969048 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eaa94e8b-dfad-4746-ab33-3d8674ceccfe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1285 microversion: 2.20 time: 0.137105 Jun 16 18:44:43.970015 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1617/3305] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:43 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:43.980211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:43.982258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:43.999609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.007361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.008507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.009114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.052465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:44.181476 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.compute.api [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Instance is already in deleting state, ignoring this request Jun 16 18:44:44.182668 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ecf76bd7-e804-405f-89e3-bff74bb0cb1d tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 204 len: 0 microversion: 2.1 time: 0.211289 Jun 16 18:44:44.194526 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1618/3306] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:43 2022] DELETE /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:44.217328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c778054-bfa4-4f7c-b2e1-44940de7c11b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:44.217833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c778054-bfa4-4f7c-b2e1-44940de7c11b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:44.227885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c778054-bfa4-4f7c-b2e1-44940de7c11b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.228332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c778054-bfa4-4f7c-b2e1-44940de7c11b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.229307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c778054-bfa4-4f7c-b2e1-44940de7c11b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.230186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c778054-bfa4-4f7c-b2e1-44940de7c11b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.236199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:44.303892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:44.313529 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c68536d-5714-4643-9cc6-63f25ee1130f tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.405608 Jun 16 18:44:44.315078 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1689/3307] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:43 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:44.319850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:44.322979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:44.337099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.337536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.347049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.347593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.428656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:44.429224 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c778054-bfa4-4f7c-b2e1-44940de7c11b tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.232757 Jun 16 18:44:44.430229 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1619/3308] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:44:44 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556/os-interface => generated 1831 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:44.437570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f15e3c4b-a12c-4d9a-8eb0-fe500ba8a84a req-74d4574d-1000-410c-af8c-0f9f964e0ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75991cfb-7591-4816-8042-289915225a1f", "tag": "3338b564-46d1-472b-8a31-e0b31bc011ae"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:44.492245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f15e3c4b-a12c-4d9a-8eb0-fe500ba8a84a req-74d4574d-1000-410c-af8c-0f9f964e0ecc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.493125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f15e3c4b-a12c-4d9a-8eb0-fe500ba8a84a req-74d4574d-1000-410c-af8c-0f9f964e0ecc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.512737 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f15e3c4b-a12c-4d9a-8eb0-fe500ba8a84a req-74d4574d-1000-410c-af8c-0f9f964e0ecc service nova] Creating event network-changed:3338b564-46d1-472b-8a31-e0b31bc011ae for instance 75991cfb-7591-4816-8042-289915225a1f on n-h1-846209-2 Jun 16 18:44:44.525003 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f15e3c4b-a12c-4d9a-8eb0-fe500ba8a84a req-74d4574d-1000-410c-af8c-0f9f964e0ecc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092733 Jun 16 18:44:44.530612 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1620/3309] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:44.541143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ab9ff34-006e-4745-bd9e-8b8f85d76884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ab9ff34-006e-4745-bd9e-8b8f85d76884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e HTTP/1.1 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 280 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:44.545650 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 18:44:44.549271 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:44.553724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ab9ff34-006e-4745-bd9e-8b8f85d76884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:44.557843 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ab9ff34-006e-4745-bd9e-8b8f85d76884 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "PUT /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 400 len: 619 microversion: 2.1 time: 0.020932 Jun 16 18:44:44.564956 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1621/3310] 10.222.0.27 () {60 vars in 1256 bytes} [Thu Jun 16 18:44:44 2022] PUT /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:44:44.598692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:44.603681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:44.634908 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-336551a3-2ec3-4146-b5ee-264dc6f3993f tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 204 len: 0 microversion: 2.1 time: 0.318359 Jun 16 18:44:44.636294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.637055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.637659 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1690/3311] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:44 2022] DELETE /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:44.638086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.638530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.645625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:44.646638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:44.665499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.665869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.670210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:44.671872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:44.896205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:45.037057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:45.050959 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14da7e31-7509-4dbd-92b8-7b38039c2bb5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.410161 Jun 16 18:44:45.052020 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1691/3312] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:44 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:45.057485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:45.058849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:45.083116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.084917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.086112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.087063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.125077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:45.136584 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8c7ee5b2-20c0-4ce2-be46-5009c4b34b33 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1514 microversion: 2.1 time: 0.570415 Jun 16 18:44:45.149156 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1622/3313] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:44 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1514 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:45.154211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:45.159646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:45.177679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.178164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.178954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.179397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.460034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:45.473176 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eccabe98-31a5-4205-9b30-5dfb459a6ba8 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1526 microversion: 2.1 time: 0.419809 Jun 16 18:44:45.477616 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1692/3314] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:45 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1526 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:45.491973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:45.497835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:45.508824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.510131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.511043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.511569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.711316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:45.728310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:45.729883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:45.736334 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3333552-e535-4a24-aa27-855fe6eed4a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1339 microversion: 2.20 time: 0.256706 Jun 16 18:44:45.737322 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1693/3315] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:45 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:45.745577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:45.746263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:45.767579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.768720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.770837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.772641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.875537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:45.895757 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a3c7119c-415a-4d15-8909-78d76d0a49a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 0.750188 Jun 16 18:44:45.896348 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1623/3316] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:45 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:45.901182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:45.902037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:45.915535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.916257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:45.922661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:45.923431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:46.092872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:46.104661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3a98bd90-787f-4760-952e-d7e3d21cb801 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.365469 Jun 16 18:44:46.117706 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1694/3317] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:45 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:46.123057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d08a491c-584d-4a8f-97ca-4837e62d9059 req-ce709c6a-b2da-4097-957d-61d78e6dbf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9132789-6b38-433a-a9f5-77012d9c56d2", "name": "network-vif-plugged", "status": "completed", "tag": "476d9a66-52ec-4a25-8ad9-16e341219373"}, {"server_uuid": "253e4a8a-f499-447c-a0ec-2cf88b67abad", "name": "network-vif-plugged", "status": "completed", "tag": "40ce37ea-67c1-48ca-ae0e-e6c814830c0a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:46.133750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d08a491c-584d-4a8f-97ca-4837e62d9059 req-ce709c6a-b2da-4097-957d-61d78e6dbf67 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:46.134484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d08a491c-584d-4a8f-97ca-4837e62d9059 req-ce709c6a-b2da-4097-957d-61d78e6dbf67 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:46.148684 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d08a491c-584d-4a8f-97ca-4837e62d9059 req-ce709c6a-b2da-4097-957d-61d78e6dbf67 service nova] Creating event network-vif-plugged:476d9a66-52ec-4a25-8ad9-16e341219373 for instance f9132789-6b38-433a-a9f5-77012d9c56d2 on n-h1-846209-2 Jun 16 18:44:46.149520 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d08a491c-584d-4a8f-97ca-4837e62d9059 req-ce709c6a-b2da-4097-957d-61d78e6dbf67 service nova] Creating event network-vif-plugged:40ce37ea-67c1-48ca-ae0e-e6c814830c0a for instance 253e4a8a-f499-447c-a0ec-2cf88b67abad on n-h2-846209-2 Jun 16 18:44:46.160530 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d08a491c-584d-4a8f-97ca-4837e62d9059 req-ce709c6a-b2da-4097-957d-61d78e6dbf67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041091 Jun 16 18:44:46.161761 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1695/3318] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:46.180633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba8d07be-2093-4cdf-a728-d7f6e69b877a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba8d07be-2093-4cdf-a728-d7f6e69b877a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e HTTP/1.1 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 24 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": ""}} Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e', 'body': {'server': {'name': ''}}} Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi '' Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:44:46.191844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 16 18:44:46.199449 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:46.207180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba8d07be-2093-4cdf-a728-d7f6e69b877a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:46.208395 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ba8d07be-2093-4cdf-a728-d7f6e69b877a tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "PUT /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 400 len: 108 microversion: 2.1 time: 0.045344 Jun 16 18:44:46.212939 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1696/3319] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:44:46 2022] PUT /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 108 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:44:46.226375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:46.227563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:46.252856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:46.254343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:46.259168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:46.259958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:46.566659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:46.586315 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-49d1fac7-e3b9-4317-b4f4-cf498e50fbf6 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 0.688590 Jun 16 18:44:46.587279 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1624/3320] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:45 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:46.592313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:46.593152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:46.605169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:46.608383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:46.609446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:46.609932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:46.763913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530daa1c9c814248b477c53f871e29d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aff614b1a6b4ad2ba352038b276799a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:46.767899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:46.777818 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c0be7baf-2d7f-43a3-b487-cc09a97638a1 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 200 len: 1514 microversion: 2.1 time: 0.563411 Jun 16 18:44:46.778667 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1697/3321] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:46 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 1514 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:46.807049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:46.807683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:46.819867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:46.820605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:46.821580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:46.825410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:47.035617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:47.043816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19f20c1a-af11-44c4-acfe-319fe3d9ceeb tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1507 microversion: 2.1 time: 0.455473 Jun 16 18:44:47.044607 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1625/3322] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:46 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:47.067913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:47.070770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:47.087831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:47.088328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:47.089119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:47.089561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:47.119536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:47.136974 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1ada6c85-915b-463b-a98b-edc6e03c3fd2 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1526 microversion: 2.1 time: 0.333829 Jun 16 18:44:47.139338 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1698/3323] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:46 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1526 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:47.147358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2fbf7250-7598-40db-b372-04cf268d225b req-8160b6a7-6f77-4a87-a1d4-bde2822a9e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c4b3e1-54b2-48d1-915d-8c4a8439d230", "name": "network-vif-deleted", "tag": "77ce3fa6-2efb-4de0-a5d5-dc0c1267f1a4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:47.168571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2fbf7250-7598-40db-b372-04cf268d225b req-8160b6a7-6f77-4a87-a1d4-bde2822a9e1d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:47.169639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2fbf7250-7598-40db-b372-04cf268d225b req-8160b6a7-6f77-4a87-a1d4-bde2822a9e1d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:47.195907 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2fbf7250-7598-40db-b372-04cf268d225b req-8160b6a7-6f77-4a87-a1d4-bde2822a9e1d service nova] Creating event network-vif-deleted:77ce3fa6-2efb-4de0-a5d5-dc0c1267f1a4 for instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 on n-h2-846209-2 Jun 16 18:44:47.215452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2fbf7250-7598-40db-b372-04cf268d225b req-8160b6a7-6f77-4a87-a1d4-bde2822a9e1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074008 Jun 16 18:44:47.216210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1699/3324] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:47.224278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:47.225542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:47.226041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:47.245731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:47.248321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:47.249392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:47.250013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:47.250765 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bcfe891f-8ae6-4b6f-b707-834f510c0515 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1339 microversion: 2.20 time: 0.191396 Jun 16 18:44:47.250916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:47.254343 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1626/3325] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:47 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:47.268033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:47.605121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:47.606127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:47.630114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:47.633300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:47.634469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:47.634952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.090026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:48.102527 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15b7607b-6e00-4a45-8f8a-e80d50234c83 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 0.884078 Jun 16 18:44:48.103130 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1700/3326] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:47 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:48.109550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:48.114977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 30c4b3e1-54b2-48d1-915d-8c4a8439d230] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:48.133215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.134517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.135723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.136526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.177707 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] HTTP exception thrown: Instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 could not be found. Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Request method failure captured: Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 HTTP/1.1 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3lTUTjePjmrOdFjzesccOzvSD2iJweIKvg4AMJaf5UrQX2c483KD-9HYsFJM26hV_n8M0Gjmqxas37X_89qupbwwQdmox7iz0FO9K2T_zDc2Kh8MTxdA4120ex_A7DGisWDF7ukNWIOBHB_Pufb-ZewsZ2eyqk3QVetnvQq9w0XWr8 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0aff614b1a6b4ad2ba352038b276799a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 530daa1c9c814248b477c53f871e29d1 Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 could not be found. Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '30c4b3e1-54b2-48d1-915d-8c4a8439d230'} Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 could not be found. Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 could not be found. Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:48.180217 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.184555 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:48.184555 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:48.184555 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:48.184555 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:48.184555 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:48.184555 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 could not be found. Jun 16 18:44:48.184555 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.187512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Returning 404 to user: Instance 30c4b3e1-54b2-48d1-915d-8c4a8439d230 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:48.189625 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c95113e-1510-48c7-82ec-145faa9f6699 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230" status: 404 len: 111 microversion: 2.1 time: 0.084705 Jun 16 18:44:48.195339 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1701/3327] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:48 2022] GET /compute/v2.1/servers/30c4b3e1-54b2-48d1-915d-8c4a8439d230 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:48.212618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:48.234651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:48.248383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.249204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.250683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.252163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.754996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:48.764688 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d2f9b18b-b229-4ffe-9ab3-dd278398cadf tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1334 microversion: 2.1 time: 1.163988 Jun 16 18:44:48.768544 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1627/3328] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:47 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1334 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:48.773807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:48.778803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:48.802858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.803594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.804669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.805326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.820877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] HTTP exception thrown: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Request method failure captured: Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 HTTP/1.1 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3lTUTjePjmrOdFjzesccOzvSD2iJweIKvg4AMJaf5UrQX2c483KD-9HYsFJM26hV_n8M0Gjmqxas37X_89qupbwwQdmox7iz0FO9K2T_zDc2Kh8MTxdA4120ex_A7DGisWDF7ukNWIOBHB_Pufb-ZewsZ2eyqk3QVetnvQq9w0XWr8 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0aff614b1a6b4ad2ba352038b276799a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 530daa1c9c814248b477c53f871e29d1 Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'b446cff3-9611-4d43-b11b-23d652af04a7'} Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:48.835889 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:48.839983 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:48.842358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Returning 404 to user: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:48.843449 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-59caf43d-fb30-488f-b1d4-420fef3f3ee9 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 404 len: 111 microversion: 2.1 time: 0.073720 Jun 16 18:44:48.844539 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1628/3329] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:48 2022] DELETE /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:48.852471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:48.859211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:48.872147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.873292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:48.874448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:48.875472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.043262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:49.055885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:49.057662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:49.063982 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-327d4725-124f-4548-898e-240d7fa0cafa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1339 microversion: 2.20 time: 0.217018 Jun 16 18:44:49.069353 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1629/3330] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:48 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:49.080486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:49.081375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: b446cff3-9611-4d43-b11b-23d652af04a7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:49.104253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.104789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.105617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.106308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.146808 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] HTTP exception thrown: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Request method failure captured: Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 HTTP/1.1 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3lTUTjePjmrOdFjzesccOzvSD2iJweIKvg4AMJaf5UrQX2c483KD-9HYsFJM26hV_n8M0Gjmqxas37X_89qupbwwQdmox7iz0FO9K2T_zDc2Kh8MTxdA4120ex_A7DGisWDF7ukNWIOBHB_Pufb-ZewsZ2eyqk3QVetnvQq9w0XWr8 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0aff614b1a6b4ad2ba352038b276799a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 530daa1c9c814248b477c53f871e29d1 Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'b446cff3-9611-4d43-b11b-23d652af04a7'} Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:49.148422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Returning 404 to user: Instance b446cff3-9611-4d43-b11b-23d652af04a7 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:49.154253 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fbe7c348-d488-4a26-9b0e-21acf4db3123 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7" status: 404 len: 111 microversion: 2.1 time: 0.078474 Jun 16 18:44:49.156406 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1630/3331] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:49 2022] GET /compute/v2.1/servers/b446cff3-9611-4d43-b11b-23d652af04a7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:49.162887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:49.163521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:49.175352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.175820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.176664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.177112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.207173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:49.215461 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51fe8568-9107-452e-8042-8aa4a4ef7c16 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1526 microversion: 2.1 time: 1.017412 Jun 16 18:44:49.216096 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1702/3332] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:48 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1526 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:49.237691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1e03af3f-c968-4ee7-a303-d44a13d47a78 req-89ad89bb-08ac-40de-b169-874d9c829230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "tag": "9d1b468a-2120-4f05-94a5-e5db40e872bf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:49.266925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1e03af3f-c968-4ee7-a303-d44a13d47a78 req-89ad89bb-08ac-40de-b169-874d9c829230 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.267373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1e03af3f-c968-4ee7-a303-d44a13d47a78 req-89ad89bb-08ac-40de-b169-874d9c829230 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.312795 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1e03af3f-c968-4ee7-a303-d44a13d47a78 req-89ad89bb-08ac-40de-b169-874d9c829230 service nova] Creating event network-changed:9d1b468a-2120-4f05-94a5-e5db40e872bf for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:44:49.335717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1e03af3f-c968-4ee7-a303-d44a13d47a78 req-89ad89bb-08ac-40de-b169-874d9c829230 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115303 Jun 16 18:44:49.336348 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1703/3333] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:49.379943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:49.380475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:49.405506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.406969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.407999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.408452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.472302 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] HTTP exception thrown: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Request method failure captured: Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 HTTP/1.1 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3lTUTjePjmrOdFjzesccOzvSD2iJweIKvg4AMJaf5UrQX2c483KD-9HYsFJM26hV_n8M0Gjmqxas37X_89qupbwwQdmox7iz0FO9K2T_zDc2Kh8MTxdA4120ex_A7DGisWDF7ukNWIOBHB_Pufb-ZewsZ2eyqk3QVetnvQq9w0XWr8 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0aff614b1a6b4ad2ba352038b276799a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 530daa1c9c814248b477c53f871e29d1 Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '53623e30-af71-4962-8e71-267c0568a758'} Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:49.474701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Returning 404 to user: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc36a5bf-9903-44ed-a14b-882c7c50a583 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 404 len: 111 microversion: 2.1 time: 0.138610 Jun 16 18:44:49.478722 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1704/3334] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:49 2022] DELETE /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:49.490612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:49.491307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] [instance: 53623e30-af71-4962-8e71-267c0568a758] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:49.517301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.517775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.531481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.532234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.584846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] HTTP exception thrown: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Request method failure captured: Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 HTTP/1.1 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3lTUTjePjmrOdFjzesccOzvSD2iJweIKvg4AMJaf5UrQX2c483KD-9HYsFJM26hV_n8M0Gjmqxas37X_89qupbwwQdmox7iz0FO9K2T_zDc2Kh8MTxdA4120ex_A7DGisWDF7ukNWIOBHB_Pufb-ZewsZ2eyqk3QVetnvQq9w0XWr8 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0aff614b1a6b4ad2ba352038b276799a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0aff614b1a6b4ad2ba352038b276799a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 0aff614b1a6b4ad2ba352038b276799a Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-69303115 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 530daa1c9c814248b477c53f871e29d1 Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerDiskConfigTestJSON-69303115-project Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '53623e30-af71-4962-8e71-267c0568a758'} Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:49.599757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.603993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:49.603993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:49.603993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:49.603993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:49.603993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:49.603993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. Jun 16 18:44:49.603993 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:49.606182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] Returning 404 to user: Instance 53623e30-af71-4962-8e71-267c0568a758 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:49.607283 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48fb6bb6-e416-4209-9e93-55e37cc38fa5 tempest-ServerDiskConfigTestJSON-69303115 tempest-ServerDiskConfigTestJSON-69303115-project] 10.222.0.27 "GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758" status: 404 len: 111 microversion: 2.1 time: 0.123133 Jun 16 18:44:49.608382 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1705/3335] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:49 2022] GET /compute/v2.1/servers/53623e30-af71-4962-8e71-267c0568a758 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:49.782546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:49.783632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:49.800789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.801626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.802740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:49.803447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:49.992955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:50.002333 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6b049726-d252-48a6-b63b-975ea238952e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 0.845685 Jun 16 18:44:50.015171 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1631/3336] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:49 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:50.084157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:50.085036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:50.099322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.102649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.103679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.104284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.542708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:50.556055 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2f3430a-026e-4e9b-9584-f7296d52eae1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1669 microversion: 2.1 time: 0.777679 Jun 16 18:44:50.569273 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1706/3337] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:49 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1669 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:50.586904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:50.587454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:50.612367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.613564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.615001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.616266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.664024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.665109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.665798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lazy-loading 'fault' on Instance uuid 3f2b0a3a-8c87-48ae-9824-a0f271429616 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:44:50.894580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:50.898234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee0f2c208dc467999b3b8f33e5bcc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d59bf2fe9b34d92b263ffb4fd3cec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:50.909878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:50.911348 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3beac90f-0cc3-4a02-9c9a-84edaefd1c00 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 200 len: 1314 microversion: 2.1 time: 0.340762 Jun 16 18:44:50.912474 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1707/3338] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:50 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:50.914410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:50.920324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-580db786-3497-4644-af5e-0b95a73567e2 req-d088bb69-50b3-4336-8e89-ce81af281725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2b0a3a-8c87-48ae-9824-a0f271429616", "name": "network-vif-deleted", "tag": "5fe20bcc-7bda-4feb-a813-ff45dbc68e63"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:50.923355 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f6bd292-12d1-426c-8640-00d650cd84bc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1406 microversion: 2.20 time: 0.842551 Jun 16 18:44:50.936557 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1632/3339] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:50 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1406 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:50.943185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d739cbc-6a2e-48ae-a950-ec1bdfe5a795 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:50.943923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3d739cbc-6a2e-48ae-a950-ec1bdfe5a795 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:50.951635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-580db786-3497-4644-af5e-0b95a73567e2 req-d088bb69-50b3-4336-8e89-ce81af281725 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.952714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-580db786-3497-4644-af5e-0b95a73567e2 req-d088bb69-50b3-4336-8e89-ce81af281725 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.954340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d739cbc-6a2e-48ae-a950-ec1bdfe5a795 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.957102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d739cbc-6a2e-48ae-a950-ec1bdfe5a795 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.960450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d739cbc-6a2e-48ae-a950-ec1bdfe5a795 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:50.967341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d739cbc-6a2e-48ae-a950-ec1bdfe5a795 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:50.987943 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-580db786-3497-4644-af5e-0b95a73567e2 req-d088bb69-50b3-4336-8e89-ce81af281725 service nova] Creating event network-vif-deleted:5fe20bcc-7bda-4feb-a813-ff45dbc68e63 for instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 on n-h1-846209-2 Jun 16 18:44:51.005508 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-580db786-3497-4644-af5e-0b95a73567e2 req-d088bb69-50b3-4336-8e89-ce81af281725 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091543 Jun 16 18:44:51.015167 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1708/3340] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:51.023051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:51.023773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:51.040124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d739cbc-6a2e-48ae-a950-ec1bdfe5a795 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2/ips" status: 200 len: 179 microversion: 2.1 time: 0.102072 Jun 16 18:44:51.046785 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1633/3341] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:44:50 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2/ips => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:51.054868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.055335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:51.056130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.056584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:51.060233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:51.061048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:51.078495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.090710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:51.093479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.099789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:51.186339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:51.368071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:51.397523 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69c3fe5c-8e74-46fd-a712-fb5ab74b4d3e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 204 len: 0 microversion: 2.1 time: 0.348868 Jun 16 18:44:51.402841 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1634/3342] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:51 2022] DELETE /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:51.409685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:51.411475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:51.419314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.421039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:51.422119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.422813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:51.681012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:51.700768 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-319c717a-7d2b-4f0d-a920-e0777ef746f3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 0.681897 Jun 16 18:44:51.701882 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1709/3343] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:51 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:51.929896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:51.930864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] [instance: 3f2b0a3a-8c87-48ae-9824-a0f271429616] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:51.946186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.961254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:51.971332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:51.971332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:52.047631 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] HTTP exception thrown: Instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 could not be found. Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Request method failure captured: Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 HTTP/1.1 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3n7VTgr6NkgY7m1du8hnP47qm-PQ5obVGKoU1iLW-jalGCic1-OCPnYobyzvfIQ0ji5WrZGou9a5z71UStNFr7M-ioEycWLKphtWVkAWbbdSXh5GdmDNeeljyRFXDznQbYO54hsyGiifg1M_xD4SLiQG4wiVwr9Pe7B1IkSbPgXuJ4 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1d59bf2fe9b34d92b263ffb4fd3cec04 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1d59bf2fe9b34d92b263ffb4fd3cec04", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1d59bf2fe9b34d92b263ffb4fd3cec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1d59bf2fe9b34d92b263ffb4fd3cec04 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1651088112 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerAddressesNegativeTestJSON-1651088112-project Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0ee0f2c208dc467999b3b8f33e5bcc53 Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1651088112-project Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 could not be found. Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3f2b0a3a-8c87-48ae-9824-a0f271429616'} Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 could not be found. Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 could not be found. Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:52.051454 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 could not be found. Jun 16 18:44:52.055938 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:52.060588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] Returning 404 to user: Instance 3f2b0a3a-8c87-48ae-9824-a0f271429616 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:52.067221 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-863f1f9a-7b2c-4a66-bfd6-e2151e814f11 tempest-ServerAddressesNegativeTestJSON-1651088112 tempest-ServerAddressesNegativeTestJSON-1651088112-project] 10.222.0.27 "GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616" status: 404 len: 111 microversion: 2.1 time: 0.137101 Jun 16 18:44:52.069087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1710/3344] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:51 2022] GET /compute/v2.1/servers/3f2b0a3a-8c87-48ae-9824-a0f271429616 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:52.086840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:52.087970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:52.112345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:52.112972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:52.114127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:52.114790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:52.156086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:52.169957 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5b350f68-7f47-4173-b126-fff6a0ef7cd2 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1675 microversion: 2.1 time: 0.764545 Jun 16 18:44:52.176916 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1635/3345] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:51 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1675 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:52.459044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-43d8dfac-cf04-42bf-b4ed-308bc4ddf82f req-c1d979ed-8278-4522-855c-53e137d248c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b6c0e5-0374-409e-928e-fef329282b9d", "tag": "1d6556a3-3abe-405b-9851-474f0b6ab80f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:52.483377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-43d8dfac-cf04-42bf-b4ed-308bc4ddf82f req-c1d979ed-8278-4522-855c-53e137d248c4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:52.495026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-43d8dfac-cf04-42bf-b4ed-308bc4ddf82f req-c1d979ed-8278-4522-855c-53e137d248c4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:52.546838 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-43d8dfac-cf04-42bf-b4ed-308bc4ddf82f req-c1d979ed-8278-4522-855c-53e137d248c4 service nova] Creating event network-changed:1d6556a3-3abe-405b-9851-474f0b6ab80f for instance 31b6c0e5-0374-409e-928e-fef329282b9d on n-h2-846209-2 Jun 16 18:44:52.563791 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-43d8dfac-cf04-42bf-b4ed-308bc4ddf82f req-c1d979ed-8278-4522-855c-53e137d248c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110467 Jun 16 18:44:52.564462 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1636/3346] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:44:52.723796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:52.724657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:52.746703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:52.748089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:52.752200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:52.758534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:52.876839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:52.878249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:53.209971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:53.221068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:53.223218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:53.230715 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-21238858-40f9-4fbd-b4cd-d0c4b1ba45f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1406 microversion: 2.20 time: 1.154796 Jun 16 18:44:53.231312 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1711/3347] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:52 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1406 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:53.250022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:53.250653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:53.270184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:53.270950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:53.272365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:53.273219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:53.358898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:53.382218 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cbc9846e-ed0b-4f34-b693-ce3d0b34d672 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 0.664876 Jun 16 18:44:53.383041 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1637/3348] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:52 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:53.402827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a266ccaf-25e2-45a7-a666-509325213037 req-c244327d-882a-4b09-ba7d-6f714dc02d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75991cfb-7591-4816-8042-289915225a1f", "name": "network-vif-plugged", "status": "completed", "tag": "3338b564-46d1-472b-8a31-e0b31bc011ae"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:53.444898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a266ccaf-25e2-45a7-a666-509325213037 req-c244327d-882a-4b09-ba7d-6f714dc02d2d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:53.444898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a266ccaf-25e2-45a7-a666-509325213037 req-c244327d-882a-4b09-ba7d-6f714dc02d2d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:53.493329 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a266ccaf-25e2-45a7-a666-509325213037 req-c244327d-882a-4b09-ba7d-6f714dc02d2d service nova] Creating event network-vif-plugged:3338b564-46d1-472b-8a31-e0b31bc011ae for instance 75991cfb-7591-4816-8042-289915225a1f on n-h1-846209-2 Jun 16 18:44:53.505494 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a266ccaf-25e2-45a7-a666-509325213037 req-c244327d-882a-4b09-ba7d-6f714dc02d2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120943 Jun 16 18:44:53.509511 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1638/3349] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:54.250523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:54.251651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:54.268119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:54.269085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:54.270139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:54.273648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:54.279224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:54.343850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:54.359930 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4d0122a-a64d-4988-9526-0adcd0fdad2b tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1675 microversion: 2.1 time: 1.112514 Jun 16 18:44:54.363489 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1712/3350] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:53 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1675 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:54.419757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:54.420456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:54.450105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:54.450577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:54.456810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:54.457290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:55.959254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:55.971725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:55.978310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:55.979639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-01223f6e-c159-4e01-95d2-535e9a836fd1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1406 microversion: 2.20 time: 1.734454 Jun 16 18:44:55.988798 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1639/3351] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:54 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1406 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:55.994052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:55.994946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:56.009859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.011301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.014970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.015328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.046213 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 HTTP/1.1 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '7fe57ae7-55c2-4e56-a339-23aa640c8204'} Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:56.049198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.058384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.060340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:56.060847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:56.064886 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b0754945-505a-4fbd-aeb7-7de5104a9819 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 404 len: 111 microversion: 2.1 time: 0.074221 Jun 16 18:44:56.072064 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1640/3352] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:55 2022] DELETE /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:56.078317 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e2392044-8d57-4d72-a34d-1b70f5feb906 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1320 microversion: 2.1 time: 1.673334 Jun 16 18:44:56.080540 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1713/3353] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:54 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1320 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:56.092141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:56.092413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:56.093062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:56.094473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: 7fe57ae7-55c2-4e56-a339-23aa640c8204] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:56.101445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.102857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.104032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.104731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.111470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.112006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.119485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.119953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.157841 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 HTTP/1.1 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '7fe57ae7-55c2-4e56-a339-23aa640c8204'} Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:44:56.160964 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance 7fe57ae7-55c2-4e56-a339-23aa640c8204 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59d20619-235c-4a3c-a7ad-ae000ab05fa5 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204" status: 404 len: 111 microversion: 2.1 time: 0.080782 Jun 16 18:44:56.166661 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1714/3354] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:56 2022] GET /compute/v2.1/servers/7fe57ae7-55c2-4e56-a339-23aa640c8204 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:44:56.180446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:56.180980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:56.198344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.198808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.199625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.200072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.274870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:44:56.453426 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b3b765d-9e53-4f1b-94eb-e57cfbd20a80 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 204 len: 0 microversion: 2.1 time: 0.281606 Jun 16 18:44:56.455320 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1715/3355] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:44:56 2022] DELETE /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:44:56.467249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:56.471415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:56.480148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.480875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:56.481865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:56.482648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:57.045973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:57.056357 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c7bf4460-23b8-44e8-a4f4-f67c4a125caa tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1675 microversion: 2.1 time: 0.980967 Jun 16 18:44:57.056965 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1641/3356] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:56 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1675 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:57.061656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:57.070523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:57.086726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:57.087505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:57.088534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:57.089127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:57.260614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:57.272786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2921e03b-f75f-4ef2-bf91-b3b6b85a04a6 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1513 microversion: 2.1 time: 0.809211 Jun 16 18:44:57.287287 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1716/3357] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:56 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1513 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:57.293526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:57.296668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:57.321356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:57.321870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:57.324565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:57.325731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:57.898623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:57.932005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:57.933596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:57.945739 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab5a177d-6d2d-4337-80ba-520615e4f3b0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1406 microversion: 2.20 time: 0.887487 Jun 16 18:44:57.958533 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1642/3358] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:57 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1406 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:44:57.975561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3497262d-7b6f-47b5-8a26-ad539c200f8a req-bc4b9408-167e-4ced-a5a0-d2b6c42c2f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9132789-6b38-433a-a9f5-77012d9c56d2", "name": "network-vif-unplugged", "status": "completed", "tag": "22a48654-bcba-4f46-91cb-026e3ec41e2f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:57.993170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3497262d-7b6f-47b5-8a26-ad539c200f8a req-bc4b9408-167e-4ced-a5a0-d2b6c42c2f46 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:57.993684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3497262d-7b6f-47b5-8a26-ad539c200f8a req-bc4b9408-167e-4ced-a5a0-d2b6c42c2f46 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:57.994499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:57.998406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:58.013224 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf1132ef-b093-46b8-901d-5fb7ceaf1883 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1513 microversion: 2.1 time: 0.724318 Jun 16 18:44:58.018009 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1717/3359] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:57 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1513 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:58.023975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-65acd6a7-e19f-4307-90fc-90bad82dc2d0 req-5a750d49-21c6-4fef-94eb-e3188955ce86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9132789-6b38-433a-a9f5-77012d9c56d2", "name": "network-vif-deleted", "tag": "476d9a66-52ec-4a25-8ad9-16e341219373"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:58.024436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3497262d-7b6f-47b5-8a26-ad539c200f8a req-bc4b9408-167e-4ced-a5a0-d2b6c42c2f46 service nova] Creating event network-vif-unplugged:22a48654-bcba-4f46-91cb-026e3ec41e2f for instance f9132789-6b38-433a-a9f5-77012d9c56d2 on n-h1-846209-2 Jun 16 18:44:58.032899 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3497262d-7b6f-47b5-8a26-ad539c200f8a req-bc4b9408-167e-4ced-a5a0-d2b6c42c2f46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071193 Jun 16 18:44:58.034369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-65acd6a7-e19f-4307-90fc-90bad82dc2d0 req-5a750d49-21c6-4fef-94eb-e3188955ce86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.035029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-65acd6a7-e19f-4307-90fc-90bad82dc2d0 req-5a750d49-21c6-4fef-94eb-e3188955ce86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.038030 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1643/3360] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:58.048519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:58.049602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:58.064748 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-65acd6a7-e19f-4307-90fc-90bad82dc2d0 req-5a750d49-21c6-4fef-94eb-e3188955ce86 service nova] Creating event network-vif-deleted:476d9a66-52ec-4a25-8ad9-16e341219373 for instance f9132789-6b38-433a-a9f5-77012d9c56d2 on n-h1-846209-2 Jun 16 18:44:58.065009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.065412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.066273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.066717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.081268 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-65acd6a7-e19f-4307-90fc-90bad82dc2d0 req-5a750d49-21c6-4fef-94eb-e3188955ce86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061664 Jun 16 18:44:58.082572 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1718/3361] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:58.096581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:58.098970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:58.105578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lazy-loading 'flavor' on Instance uuid 75991cfb-7591-4816-8042-289915225a1f {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:44:58.107516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.107986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.109027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.109482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.211823 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-787991c9-da97-42a1-b0e2-6c48d004038b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action" status: 200 len: 32 microversion: 2.1 time: 0.171524 Jun 16 18:44:58.212509 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1644/3362] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:44:58 2022] POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:44:58.224811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:58.225540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:58.233147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.233510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.234534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.234982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.784518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:58.796430 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4ac134e-d445-4586-8880-7d2b48f78c95 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1654 microversion: 2.1 time: 0.712405 Jun 16 18:44:58.800230 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1719/3363] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:58 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1654 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:58.807655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:58.808289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:58.825675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.826170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:58.826971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:58.827420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:59.426801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:59.443100 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50e5d387-8879-4e89-90d6-14e22cfbec69 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 1.222955 Jun 16 18:44:59.460768 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1645/3364] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:58 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:59.488729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:59.489454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:59.519352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:59.521505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:59.525450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:59.528223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:59.976113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:59.985730 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85c12d93-4c53-4eef-b0aa-2d727b7980a4 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1513 microversion: 2.1 time: 1.183641 Jun 16 18:44:59.994726 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1720/3365] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:58 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1513 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:00.000604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:00.001581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:00.019618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:00.020518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:00.021599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:00.022320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:00.390183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:00.411059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:00.412459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:00.413630 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-21df7d01-a1f0-4d11-90f1-1293fe819142 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1406 microversion: 2.20 time: 0.950586 Jun 16 18:45:00.414222 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1646/3366] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:44:59 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1406 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:00.438360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-348e6983-a793-456d-8a90-78759690e4e5 req-596fa376-39cd-43b1-a8f0-ac8d4f170254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b6c0e5-0374-409e-928e-fef329282b9d", "name": "network-vif-plugged", "status": "completed", "tag": "1d6556a3-3abe-405b-9851-474f0b6ab80f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:00.470698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-348e6983-a793-456d-8a90-78759690e4e5 req-596fa376-39cd-43b1-a8f0-ac8d4f170254 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:00.471403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-348e6983-a793-456d-8a90-78759690e4e5 req-596fa376-39cd-43b1-a8f0-ac8d4f170254 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:00.495977 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-348e6983-a793-456d-8a90-78759690e4e5 req-596fa376-39cd-43b1-a8f0-ac8d4f170254 service nova] Creating event network-vif-plugged:1d6556a3-3abe-405b-9851-474f0b6ab80f for instance 31b6c0e5-0374-409e-928e-fef329282b9d on n-h2-846209-2 Jun 16 18:45:00.502671 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-348e6983-a793-456d-8a90-78759690e4e5 req-596fa376-39cd-43b1-a8f0-ac8d4f170254 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075377 Jun 16 18:45:00.503863 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1647/3367] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:00.512875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4368fb01-f527-4fdf-9d8c-01b926c60a41 req-94620eab-4d5b-417f-a119-9f7b1be66df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e57881-9458-4864-a6d8-79555341a48e", "name": "network-vif-deleted", "tag": "f395f5ff-79af-48cc-8d9f-7b45e4bba8d9"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:00.523740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4368fb01-f527-4fdf-9d8c-01b926c60a41 req-94620eab-4d5b-417f-a119-9f7b1be66df0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:00.524443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4368fb01-f527-4fdf-9d8c-01b926c60a41 req-94620eab-4d5b-417f-a119-9f7b1be66df0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:00.539352 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4368fb01-f527-4fdf-9d8c-01b926c60a41 req-94620eab-4d5b-417f-a119-9f7b1be66df0 service nova] Creating event network-vif-deleted:f395f5ff-79af-48cc-8d9f-7b45e4bba8d9 for instance e5e57881-9458-4864-a6d8-79555341a48e on n-h1-846209-2 Jun 16 18:45:00.555061 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4368fb01-f527-4fdf-9d8c-01b926c60a41 req-94620eab-4d5b-417f-a119-9f7b1be66df0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046709 Jun 16 18:45:00.556352 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1648/3368] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:00.567293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:00.569737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:00.578253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:00.581135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:00.582429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:00.583117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:00.736482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:00.751472 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-205858a8-c3b6-41f4-9b12-a1bba96bf6cc tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1495 microversion: 2.1 time: 0.755236 Jun 16 18:45:00.752422 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1721/3369] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:59 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1495 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:01.014291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:01.015695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:01.035329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.039210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.040381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.042122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.138784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.141644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.143702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lazy-loading 'fault' on Instance uuid e5e57881-9458-4864-a6d8-79555341a48e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:45:01.275711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:01.278111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b297ccf84406465c9a45f467baf469a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4435bd19f8854d8ba3bbedb71ecfbe56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:01.289477 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f8c2ef72-38d9-4a03-ab9a-6288f569ea8f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.731501 Jun 16 18:45:01.291324 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1649/3370] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:00 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:01.292641 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c6792359-e576-4871-9801-69069f829bd3 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 200 len: 1307 microversion: 2.1 time: 0.284114 Jun 16 18:45:01.294876 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1722/3371] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:01 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:45:01.435251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:01.436393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:01.463172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.465250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.468835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.469669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.754559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3ce14d83-2dc4-43ef-9d3a-86b4f6bd078e req-c4dfcd57-f456-4f66-9c9f-c83a6def3b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9132789-6b38-433a-a9f5-77012d9c56d2", "name": "network-vif-deleted", "tag": "22a48654-bcba-4f46-91cb-026e3ec41e2f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:01.776361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3ce14d83-2dc4-43ef-9d3a-86b4f6bd078e req-c4dfcd57-f456-4f66-9c9f-c83a6def3b1a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.789241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3ce14d83-2dc4-43ef-9d3a-86b4f6bd078e req-c4dfcd57-f456-4f66-9c9f-c83a6def3b1a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.819531 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3ce14d83-2dc4-43ef-9d3a-86b4f6bd078e req-c4dfcd57-f456-4f66-9c9f-c83a6def3b1a service nova] Creating event network-vif-deleted:22a48654-bcba-4f46-91cb-026e3ec41e2f for instance f9132789-6b38-433a-a9f5-77012d9c56d2 on n-h1-846209-2 Jun 16 18:45:01.834359 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3ce14d83-2dc4-43ef-9d3a-86b4f6bd078e req-c4dfcd57-f456-4f66-9c9f-c83a6def3b1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084495 Jun 16 18:45:01.835930 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1723/3372] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:45:01.851279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:01.854646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:01.878397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.880317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.881380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.882069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:01.999153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:01.999773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:02.005184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lazy-loading 'fault' on Instance uuid f9132789-6b38-433a-a9f5-77012d9c56d2 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:45:02.378114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d82e559e5b4ecdbc044ad52907050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d5b935a7e4f9d90a68e8a488f136a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:02.399265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ffc791f5-17ce-4c9b-9cb6-d5cde14c54b1 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 200 len: 1303 microversion: 2.1 time: 0.561445 Jun 16 18:45:02.409586 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1724/3373] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:01 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 1303 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:02.431917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:02.441819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:02.458078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:02.462071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:02.463365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:02.463822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:02.465053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:02.490253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:02.494780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:02.498635 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eae4f247-498c-468f-968f-ebe7f5d82ccf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1406 microversion: 2.20 time: 1.067447 Jun 16 18:45:02.505089 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1650/3374] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:01 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1406 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:02.539675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:02.547466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] [instance: e5e57881-9458-4864-a6d8-79555341a48e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:02.615711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:02.616172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:02.632676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:02.640127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:02.683129 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] HTTP exception thrown: Instance e5e57881-9458-4864-a6d8-79555341a48e could not be found. Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Request method failure captured: Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e HTTP/1.1 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3kEFy-F8AcrgSgaDLz7RK-QUiJUCxjVfuO54uqba98ZXZVP3ZJC2yXWmGw1Zxw106ERrcbS6FQK92HIlt0sINI7wbSyA-lIL0OQL2N8ayNt8gBRfXQHLJSCJPMozRh73JNc3wAeloEkr0ZuuFZS70PlTlp8_aJI0gHk6kMMGQJJCpU Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4435bd19f8854d8ba3bbedb71ecfbe56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4435bd19f8854d8ba3bbedb71ecfbe56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 4435bd19f8854d8ba3bbedb71ecfbe56 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-342683263 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b297ccf84406465c9a45f467baf469a6 Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-342683263-project Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance e5e57881-9458-4864-a6d8-79555341a48e could not be found. Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e5e57881-9458-4864-a6d8-79555341a48e'} Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e57881-9458-4864-a6d8-79555341a48e could not be found. Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e57881-9458-4864-a6d8-79555341a48e could not be found. Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:02.691522 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:02.699844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:02.699844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:02.699844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:02.699844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:02.699844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:02.699844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e57881-9458-4864-a6d8-79555341a48e could not be found. Jun 16 18:45:02.699844 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:02.717231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] Returning 404 to user: Instance e5e57881-9458-4864-a6d8-79555341a48e could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:02.720411 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d7ee1596-07e4-47ba-94a2-813da5ccabc0 tempest-ServersNegativeTestJSON-342683263 tempest-ServersNegativeTestJSON-342683263-project] 10.222.0.27 "GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e" status: 404 len: 111 microversion: 2.1 time: 0.213214 Jun 16 18:45:02.725347 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1651/3375] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:02 2022] GET /compute/v2.1/servers/e5e57881-9458-4864-a6d8-79555341a48e => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:45:02.853642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:02.865499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef95ded9-e668-4d19-8a00-d10229e81e8a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.452409 Jun 16 18:45:02.866944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1725/3376] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:02 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:03.425062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:03.425966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:03.447483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:03.448081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:03.449324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:03.450270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:03.488329 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] HTTP exception thrown: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Request method failure captured: Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 HTTP/1.1 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3mjGNC4Z6pGlj6BfS3lCagsmGYr-4ZXVbH-lAc-UFKKrRCC1JNEvUU4qUgdD1qNyTpnTK-Zq0hVpOOhr2x5Ww40n2MTySVEM31BBkyAVnVM43KTcQZTc1DB0zmBL72sAgj-prpXCnpI5id_1h3B9MBOmjKfPXp4RqAXYhajh5oAfs8 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f81d5b935a7e4f9d90a68e8a488f136a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9d82e559e5b4ecdbc044ad52907050c Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'f9132789-6b38-433a-a9f5-77012d9c56d2'} Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:03.492562 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Returning 404 to user: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:03.496890 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cef5515a-973e-4145-adb6-725e66369bba tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 404 len: 111 microversion: 2.1 time: 0.076733 Jun 16 18:45:03.502095 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1652/3377] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:03 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:45:03.535317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:03.536793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:03.551125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:03.558508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:03.559794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:03.560602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:03.947041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1dd9e8f-3834-49d9-9dff-0b7fe45535a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Action: 'create', calling method: .version_select at 0x7f866ded11f0>, body: {"keypair": {"name": "tempest-keypair-1006190216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk0UMuMtTPPgNqDv5PH2RmybQu6s4EOE9C8OkPsypfAUMmUyw+Dcd8JTcttuHQYBAgRy0N0dcq/LWUnAtnCQI2IFfrLdldn8w9TOyyxpNDTIpFx1eC2IWXutddFC8ukMQ=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:03.997021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f1dd9e8f-3834-49d9-9dff-0b7fe45535a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Getting quotas for project ad9838adc91d4481b89c898b0fedf24c. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:45:04.023684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f1dd9e8f-3834-49d9-9dff-0b7fe45535a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Getting quotas for user 4b2ef3108bed4dbd9911a6e681799d57 and project ad9838adc91d4481b89c898b0fedf24c. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:45:04.102841 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f1dd9e8f-3834-49d9-9dff-0b7fe45535a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.514482 Jun 16 18:45:04.109311 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1653/3378] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:45:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:04.126958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:04.128791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:04.137205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:04.138695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:04.139902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:04.142298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:04.737874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:04.783384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:04.786266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:04.787821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-57847695-b513-44d6-bb1b-fae3a5d014dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1599 microversion: 2.20 time: 1.261291 Jun 16 18:45:04.788671 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1726/3379] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:03 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1599 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:04.813029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca84fa43-09c2-4681-90df-653828447742 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:04.813029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ca84fa43-09c2-4681-90df-653828447742 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:04.815642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:04.832293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca84fa43-09c2-4681-90df-653828447742 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:04.832747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca84fa43-09c2-4681-90df-653828447742 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:04.833750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca84fa43-09c2-4681-90df-653828447742 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:04.834379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca84fa43-09c2-4681-90df-653828447742 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:05.060043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:05.068347 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d2e1667b-fabb-49fd-85ba-10cd98cc0c53 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.956921 Jun 16 18:45:05.073158 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1654/3380] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:04 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:05.131477 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca84fa43-09c2-4681-90df-653828447742 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.321540 Jun 16 18:45:05.133166 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1727/3381] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:45:04 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-interface => generated 285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:45:06.089893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:06.091674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:06.104345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:06.114711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:06.115579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:06.116098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:06.754332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:06.776442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a7697bf8-727c-495a-9884-e81cbf4b18d8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.691810 Jun 16 18:45:06.795084 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1655/3382] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:06 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:07.805755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:07.812503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:07.828235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:07.834491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:07.835718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:07.836429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:08.008531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1752603489", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "d2ce3f71-08e8-4dc0-9036-15309e3e1841"}], "security_groups": [{"name": "tempest-securitygroup--172577893"}], "key_name": "tempest-keypair-1006190216", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:08.667448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] validate_networks() for [('d2ce3f71-08e8-4dc0-9036-15309e3e1841', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:45:08.861645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:08.888363 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3782072f-c583-4e80-9c44-3411bc2b898b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 1.090399 Jun 16 18:45:08.912446 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1728/3383] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:07 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:09.930423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:09.932069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:09.947453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:09.948903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:09.952243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:09.953494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:10.907422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:10.930542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e683aabf-e5fb-45c0-b6ac-ef5fc78059c8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 1.004261 Jun 16 18:45:10.936498 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1729/3384] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:09 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:45:10.960831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d765a60b-78b7-455e-9ac5-b2a4e15cc025 req-adce0c66-a22c-436d-9386-6b9c8332abcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b6c0e5-0374-409e-928e-fef329282b9d", "tag": "1d6556a3-3abe-405b-9851-474f0b6ab80f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:10.993640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d765a60b-78b7-455e-9ac5-b2a4e15cc025 req-adce0c66-a22c-436d-9386-6b9c8332abcb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:10.996772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d765a60b-78b7-455e-9ac5-b2a4e15cc025 req-adce0c66-a22c-436d-9386-6b9c8332abcb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.041604 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d765a60b-78b7-455e-9ac5-b2a4e15cc025 req-adce0c66-a22c-436d-9386-6b9c8332abcb service nova] Creating event network-changed:1d6556a3-3abe-405b-9851-474f0b6ab80f for instance 31b6c0e5-0374-409e-928e-fef329282b9d on n-h2-846209-2 Jun 16 18:45:11.062250 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d765a60b-78b7-455e-9ac5-b2a4e15cc025 req-adce0c66-a22c-436d-9386-6b9c8332abcb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118898 Jun 16 18:45:11.081416 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1730/3385] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:11.404257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:11.405154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:11.434647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.436706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.440406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.441397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.494650 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] HTTP exception thrown: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Request method failure captured: Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 HTTP/1.1 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3mjGNC4Z6pGlj6BfS3lCagsmGYr-4ZXVbH-lAc-UFKKrRCC1JNEvUU4qUgdD1qNyTpnTK-Zq0hVpOOhr2x5Ww40n2MTySVEM31BBkyAVnVM43KTcQZTc1DB0zmBL72sAgj-prpXCnpI5id_1h3B9MBOmjKfPXp4RqAXYhajh5oAfs8 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f81d5b935a7e4f9d90a68e8a488f136a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9d82e559e5b4ecdbc044ad52907050c Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f9132789-6b38-433a-a9f5-77012d9c56d2'} Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:45:11.498666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Returning 404 to user: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:11.503701 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4e3074c1-6b33-4e21-a8c0-246dbb22ad1e tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 404 len: 111 microversion: 2.1 time: 0.111052 Jun 16 18:45:11.509817 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1731/3386] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:45:11 2022] DELETE /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:45:11.522890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:11.525713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: f9132789-6b38-433a-a9f5-77012d9c56d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:11.547006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.549161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.551691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.553734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.611198 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] HTTP exception thrown: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Request method failure captured: Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 HTTP/1.1 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3mjGNC4Z6pGlj6BfS3lCagsmGYr-4ZXVbH-lAc-UFKKrRCC1JNEvUU4qUgdD1qNyTpnTK-Zq0hVpOOhr2x5Ww40n2MTySVEM31BBkyAVnVM43KTcQZTc1DB0zmBL72sAgj-prpXCnpI5id_1h3B9MBOmjKfPXp4RqAXYhajh5oAfs8 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f81d5b935a7e4f9d90a68e8a488f136a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9d82e559e5b4ecdbc044ad52907050c Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f9132789-6b38-433a-a9f5-77012d9c56d2'} Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.613223 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.622490 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.622490 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.622490 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.622490 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:11.622490 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:11.622490 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. Jun 16 18:45:11.622490 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.624735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Returning 404 to user: Instance f9132789-6b38-433a-a9f5-77012d9c56d2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:11.626836 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0bd1fa3e-4c17-41f5-9832-5b3b41788949 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2" status: 404 len: 111 microversion: 2.1 time: 0.115989 Jun 16 18:45:11.629239 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1732/3387] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:11 2022] GET /compute/v2.1/servers/f9132789-6b38-433a-a9f5-77012d9c56d2 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:45:11.643144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:11.643674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:11.652740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.653249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.654391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.655442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.676131 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] HTTP exception thrown: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Request method failure captured: Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e HTTP/1.1 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3mjGNC4Z6pGlj6BfS3lCagsmGYr-4ZXVbH-lAc-UFKKrRCC1JNEvUU4qUgdD1qNyTpnTK-Zq0hVpOOhr2x5Ww40n2MTySVEM31BBkyAVnVM43KTcQZTc1DB0zmBL72sAgj-prpXCnpI5id_1h3B9MBOmjKfPXp4RqAXYhajh5oAfs8 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f81d5b935a7e4f9d90a68e8a488f136a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9d82e559e5b4ecdbc044ad52907050c Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'dd1733ea-9ee5-418d-a402-711efabd252e'} Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:45:11.678167 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.683657 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.686746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Returning 404 to user: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:11.688171 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fc545bbc-38ba-437b-84df-2c70b992d053 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 404 len: 111 microversion: 2.1 time: 0.052727 Jun 16 18:45:11.689471 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1733/3388] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:45:11 2022] DELETE /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:45:11.698556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:11.699696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] [instance: dd1733ea-9ee5-418d-a402-711efabd252e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:11.708512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.709381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.710744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.711640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.754934 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] HTTP exception thrown: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Request method failure captured: Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e HTTP/1.1 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3mjGNC4Z6pGlj6BfS3lCagsmGYr-4ZXVbH-lAc-UFKKrRCC1JNEvUU4qUgdD1qNyTpnTK-Zq0hVpOOhr2x5Ww40n2MTySVEM31BBkyAVnVM43KTcQZTc1DB0zmBL72sAgj-prpXCnpI5id_1h3B9MBOmjKfPXp4RqAXYhajh5oAfs8 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f81d5b935a7e4f9d90a68e8a488f136a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f81d5b935a7e4f9d90a68e8a488f136a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f81d5b935a7e4f9d90a68e8a488f136a Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersTestMultiNic-2095324463 Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9d82e559e5b4ecdbc044ad52907050c Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersTestMultiNic-2095324463-project Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'dd1733ea-9ee5-418d-a402-711efabd252e'} Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:11.757460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.762991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:11.762991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:11.762991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:11.762991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:11.762991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:11.762991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. Jun 16 18:45:11.762991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:11.768697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] Returning 404 to user: Instance dd1733ea-9ee5-418d-a402-711efabd252e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:11.774979 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2ac75cc0-00aa-4e0c-af62-ada971dd1e55 tempest-ServersTestMultiNic-2095324463 tempest-ServersTestMultiNic-2095324463-project] 10.222.0.27 "GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e" status: 404 len: 111 microversion: 2.1 time: 0.081350 Jun 16 18:45:11.776511 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1734/3389] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:11 2022] GET /compute/v2.1/servers/dd1733ea-9ee5-418d-a402-711efabd252e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:45:11.960646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:11.966701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:11.984004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.985479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:11.991409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:11.992362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:12.214164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:45:12.215192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:45:12.216074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:45:12.216633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:45:12.217429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:45:12.229996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:12.231040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:12.232132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:12.232855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:12.265218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Getting quotas for project ad9838adc91d4481b89c898b0fedf24c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:45:12.278062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Getting quotas for user 4b2ef3108bed4dbd9911a6e681799d57 and project ad9838adc91d4481b89c898b0fedf24c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:45:12.309428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:45:12.314883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:45:12.479669 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bae41bec-f05b-491d-a727-46258fdf4298 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.478624 Jun 16 18:45:12.482796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1656/3390] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:45:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 4483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:45:12.495728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0383579d-f836-4cf1-b078-185c8dd05a85 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:12.497338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0383579d-f836-4cf1-b078-185c8dd05a85 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:12.741174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:12.758829 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-26f58176-dfd7-4cff-b094-e8277b9335fd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.809831 Jun 16 18:45:12.761046 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1735/3391] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:11 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:12.778021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0383579d-f836-4cf1-b078-185c8dd05a85 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:12.787962 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0383579d-f836-4cf1-b078-185c8dd05a85 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1242 microversion: 2.1 time: 0.296499 Jun 16 18:45:12.800127 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1657/3392] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:12 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1242 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:13.776876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:13.777794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:13.791166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:13.791735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:13.792583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:13.793215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:13.810443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:13.814829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:13.830811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:13.831714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:13.833129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:13.833890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:14.050335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:14.060400 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3c71f9b-63b2-4258-ac8e-3520e7c4f4a1 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1294 microversion: 2.1 time: 0.256826 Jun 16 18:45:14.062014 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1658/3393] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:13 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1294 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:14.318613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:14.336779 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9f33beb8-45be-47e5-8562-09f2db3ef871 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.563826 Jun 16 18:45:14.357489 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1736/3394] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:13 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:15.078660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:15.079998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:15.099277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:15.099277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:15.099277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:15.103857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:15.242958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:15.254618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4cc2022b-9319-4671-8b45-0e4a9f262da2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1300 microversion: 2.1 time: 0.180011 Jun 16 18:45:15.255856 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1659/3395] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:15 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:15.361727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:15.363012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:15.379861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:15.382259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:15.383760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:15.386508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:15.809838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:15.826661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8e48fbd-94d9-4264-b7c1-e6a798a2d440 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.475359 Jun 16 18:45:15.827629 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1737/3396] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:15 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:16.274405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:16.275849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:16.284711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:16.285438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:16.286464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:16.287077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:16.312652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:16.401687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:16.416039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a56a7a7-00da-4e33-9de0-045757698518 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1300 microversion: 2.1 time: 0.145191 Jun 16 18:45:16.419405 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1660/3397] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:16 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1300 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:16.844593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:16.845397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:16.854658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:16.855116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:16.858065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:16.860985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:17.401055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:17.419100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:17.437562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:17.446884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:17.463536 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be35eed7-f983-47bc-b984-1f275bff05cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.622901 Jun 16 18:45:17.468875 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1738/3398] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:16 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:17.482955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:17.483565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:17.484629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:17.487127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:18.462768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:18.474842 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c2f9418-fcc7-47d3-b2ac-7dc8bdd3f722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 1.043378 Jun 16 18:45:18.487142 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1661/3399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:17 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:18.493382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:18.494590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:18.508325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:18.509076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:18.510238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:18.510840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:19.081393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:19.104794 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-45d54ffc-bccc-4e16-9215-ba50321a0f04 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.613044 Jun 16 18:45:19.108991 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1739/3400] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:18 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:19.500748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:19.501823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:19.524117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:19.525145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:19.526474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:19.527066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:20.133017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:20.134666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:20.148076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:20.153275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:20.155311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:20.157421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:20.561241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:20.572693 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f98cb86-00b5-485b-8734-4f5b4dfc3017 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 1.079952 Jun 16 18:45:20.592908 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1662/3401] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:19 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:20.653287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-dad63985-eeb1-4854-bee0-45c657442ac8 req-bf2a2f18-b002-43d9-8ed4-4b10a511b216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cc723a-7d61-4241-bc08-1309b6674872", "tag": "d2307271-c4cf-4845-a3fb-ea0cc26b2a43"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:20.675824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dad63985-eeb1-4854-bee0-45c657442ac8 req-bf2a2f18-b002-43d9-8ed4-4b10a511b216 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:20.676267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-dad63985-eeb1-4854-bee0-45c657442ac8 req-bf2a2f18-b002-43d9-8ed4-4b10a511b216 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:20.720495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-dad63985-eeb1-4854-bee0-45c657442ac8 req-bf2a2f18-b002-43d9-8ed4-4b10a511b216 service nova] Creating event network-changed:d2307271-c4cf-4845-a3fb-ea0cc26b2a43 for instance 11cc723a-7d61-4241-bc08-1309b6674872 on n-h2-846209-2 Jun 16 18:45:20.732745 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-dad63985-eeb1-4854-bee0-45c657442ac8 req-bf2a2f18-b002-43d9-8ed4-4b10a511b216 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083598 Jun 16 18:45:20.733526 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1663/3402] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:45:20.962632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:20.973149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-711343cb-03c5-4c55-bfb8-49b2bf70beb0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.846262 Jun 16 18:45:20.979731 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1740/3403] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:20 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:45:21.604729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:21.605618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:21.619395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:21.626456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:21.627039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:21.627880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:21.628961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:22.001863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:22.002608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:22.019935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:22.020390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:22.021367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:22.022017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:22.216446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:22.234042 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-80ba8ca2-74ea-45dc-b97e-e42d5f694b1b tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 0.636493 Jun 16 18:45:22.246481 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1664/3404] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:21 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:22.461785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:22.472160 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b5e967a5-a54d-4df0-b028-b661488b9d0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.475182 Jun 16 18:45:22.472825 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1741/3405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:21 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:23.254920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:23.255640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:23.257589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:23.264092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:23.281577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:23.284158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:23.285759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:23.286464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:23.491484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:23.493225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:23.518870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:23.520633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:23.521658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:23.522263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:24.053571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:24.065185 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d92ba8c4-ac3f-4109-91c0-a2b2cc2ad8f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 0.816064 Jun 16 18:45:24.076468 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1665/3406] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:23 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:24.293826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:24.313720 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0aa0e60-5aef-4589-9fdc-2a078b5f2d52 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.826399 Jun 16 18:45:24.315555 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1742/3407] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:23 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:25.086154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:25.087548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:25.106548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:25.108378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:25.112934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:25.114631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:25.337478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:25.338448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:25.363882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:25.364685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:25.367844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:25.368359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:26.229070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:26.241853 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0f3e6e4f-8ea7-428b-aa6f-00a9edc71e1c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 0.910417 Jun 16 18:45:26.249361 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1743/3408] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:25 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:26.381368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:26.400027 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aabdb7c7-9f5b-4755-8e7f-26ba4788639e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 1.319488 Jun 16 18:45:26.403421 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1666/3409] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:25 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:26.687694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-66966984", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d3dc63ce-1ddf-46da-a68c-ab9f716ae23d"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:26.779703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] validate_networks() for [('d3dc63ce-1ddf-46da-a68c-ab9f716ae23d', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:45:27.261939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:27.262624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:27.276408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:27.276856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:27.277642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:27.278112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:28.308858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:28.325450 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16f36cd6-3e6f-4fe3-9d79-62b206b8452b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 1.068399 Jun 16 18:45:28.331443 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1667/3410] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:27 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:45:28.336876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:28.337997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:28.355965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:28.356703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:28.358173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:28.358907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:28.421488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:45:28.424665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:45:28.425386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:45:28.426664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:45:28.427641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:45:28.452986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:28.456245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:28.457426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:28.458683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:28.532940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Getting quotas for project 845d9dbb0e09427486fc555e684ce26e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:45:28.541466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Getting quotas for user 771965bf0ff449829821757417b58fc1 and project 845d9dbb0e09427486fc555e684ce26e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:45:28.565360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Going to run 2 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:45:28.567211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: 74904cf8-9949-4a87-abad-18b8a3995fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:45:28.641156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=74904cf8-9949-4a87-abad-18b8a3995fa8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:45:28.760299 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-70a0e965-d6aa-42a1-80cf-bd7ae5174392 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.509247 Jun 16 18:45:28.762239 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1744/3411] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:45:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:45:28.774312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:28.780647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:28.782372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Searching by: {'deleted': False, 'project_id': '845d9dbb0e09427486fc555e684ce26e'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:45:28.869582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:28.870083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:28.870905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:28.871492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:28.905355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:28.918564 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a66f093-5982-4275-9459-1661f85f5ce8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 0.582693 Jun 16 18:45:28.919202 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1668/3412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:28 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:28.929855 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12de6b2c-4ae8-4c9b-a359-1aad2b15f412 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.162159 Jun 16 18:45:28.942777 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1745/3413] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:45:28 2022] GET /compute/v2.1/servers => generated 673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:28.950402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b73a12b-9c30-4fe3-8365-66854ecf1df7 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:28.951306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b73a12b-9c30-4fe3-8365-66854ecf1df7 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:29.196465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3b73a12b-9c30-4fe3-8365-66854ecf1df7 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:29.212980 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b73a12b-9c30-4fe3-8365-66854ecf1df7 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1218 microversion: 2.1 time: 0.265146 Jun 16 18:45:29.216111 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1669/3414] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:28 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:29.346342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:29.347283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:29.361612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:29.362105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:29.362948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:29.363400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:29.732506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d217b1a7-c6bc-4119-a862-71435318436f tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Action: 'create', calling method: .version_select at 0x7f866dea01f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:29.763979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d217b1a7-c6bc-4119-a862-71435318436f tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Getting quotas for project 9f51884dd18d452bbe4f2f39e80473bb. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:45:29.784914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d217b1a7-c6bc-4119-a862-71435318436f tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Getting quotas for user cb786015a9bb49818a650d200848c9df and project 9f51884dd18d452bbe4f2f39e80473bb. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:45:29.951494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d217b1a7-c6bc-4119-a862-71435318436f tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Getting quotas for project 9f51884dd18d452bbe4f2f39e80473bb. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:45:29.970149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d217b1a7-c6bc-4119-a862-71435318436f tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Getting quotas for user cb786015a9bb49818a650d200848c9df and project 9f51884dd18d452bbe4f2f39e80473bb. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:45:30.027353 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d217b1a7-c6bc-4119-a862-71435318436f tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.582888 Jun 16 18:45:30.034016 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1670/3415] 10.222.0.27 () {62 vars in 1213 bytes} [Thu Jun 16 18:45:29 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:45:30.048432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:30.050001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:30.059960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:30.060659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:30.061799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:30.062513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:30.327093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:30.352086 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9919b0f-cff5-4877-a403-447b4c75fa1d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1519 microversion: 2.1 time: 1.010506 Jun 16 18:45:30.361305 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1746/3416] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:29 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1519 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:30.374698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f8215aa-da30-46ea-b6ac-b01cb7191974 tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:30.413664 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f8215aa-da30-46ea-b6ac-b01cb7191974 tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.050821 Jun 16 18:45:30.419850 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1747/3417] 10.222.0.27 () {60 vars in 1192 bytes} [Thu Jun 16 18:45:30 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:45:30.430030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:30.431117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:30.455200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:30.455776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:30.456830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:30.457517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:31.069148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:31.079827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:31.091606 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6e3868ea-8ef1-457b-9851-2ba3e7f407a9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 1.061630 Jun 16 18:45:31.092518 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1671/3418] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:30 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:31.113561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d5163a5-3190-465b-a312-b43087ca1511 tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:31.115313 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef5e3395-2b7f-46f2-8a01-14da2e7e71a1 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1222 microversion: 2.1 time: 0.691296 Jun 16 18:45:31.120209 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1748/3419] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:30 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1222 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:31.154393 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d5163a5-3190-465b-a312-b43087ca1511 tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/ad8c00e5-72ad-4bf0-bb5d-77886d667b9b" status: 200 len: 235 microversion: 2.64 time: 0.049092 Jun 16 18:45:31.155220 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1672/3420] 10.222.0.27 () {60 vars in 1303 bytes} [Thu Jun 16 18:45:31 2022] GET /compute/v2.1/os-server-groups/ad8c00e5-72ad-4bf0-bb5d-77886d667b9b => generated 235 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:45:31.167442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22b8ffa0-9ba9-4835-8f41-6732444b99f1 tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:31.218477 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-22b8ffa0-9ba9-4835-8f41-6732444b99f1 tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ad8c00e5-72ad-4bf0-bb5d-77886d667b9b" status: 204 len: 0 microversion: 2.64 time: 0.056211 Jun 16 18:45:31.232698 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1749/3421] 10.222.0.27 () {60 vars in 1306 bytes} [Thu Jun 16 18:45:31 2022] DELETE /compute/v2.1/os-server-groups/ad8c00e5-72ad-4bf0-bb5d-77886d667b9b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:45:31.244316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ebd76176-c356-4942-9926-0b530039dddc tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:31.254425 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-ebd76176-c356-4942-9926-0b530039dddc tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] HTTP exception thrown: Instance group ad8c00e5-72ad-4bf0-bb5d-77886d667b9b could not be found. Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ebd76176-c356-4942-9926-0b530039dddc tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Request method failure captured: Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-server-groups/ad8c00e5-72ad-4bf0-bb5d-77886d667b9b HTTP/1.1 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3pJMq43VbRu1mrqSWPZ5ILXTCWXghXMrk_gkU3BVapfpsKmj8l8--IPBZDVLU3AEhRIzj4pKxGk9xM0pPPTiswc_YkH5bqGhvPBEreEOvFUGSJahBLQToV9mExcBijpB0BeFvT5KnSxAVx3b8kdZeqYZH_n5mbf9aqHZ7S-3vEAEbE Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.64 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 9f51884dd18d452bbe4f2f39e80473bb Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerGroup264TestJSON-1340238192 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f51884dd18d452bbe4f2f39e80473bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f51884dd18d452bbe4f2f39e80473bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f51884dd18d452bbe4f2f39e80473bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f51884dd18d452bbe4f2f39e80473bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerGroup264TestJSON-1340238192 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 9f51884dd18d452bbe4f2f39e80473bb Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1340238192 Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerGroup264TestJSON-1340238192-project Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: cb786015a9bb49818a650d200848c9df Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerGroup264TestJSON-1340238192-project Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance group ad8c00e5-72ad-4bf0-bb5d-77886d667b9b could not be found. Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ad8c00e5-72ad-4bf0-bb5d-77886d667b9b'} Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ad8c00e5-72ad-4bf0-bb5d-77886d667b9b could not be found. Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ad8c00e5-72ad-4bf0-bb5d-77886d667b9b could not be found. Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:31.261130 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:31.268192 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:31.268192 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:31.268192 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:31.268192 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:31.268192 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ad8c00e5-72ad-4bf0-bb5d-77886d667b9b could not be found. Jun 16 18:45:31.268192 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:45:31.273074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ebd76176-c356-4942-9926-0b530039dddc tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] Returning 404 to user: Instance group ad8c00e5-72ad-4bf0-bb5d-77886d667b9b could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:31.275563 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ebd76176-c356-4942-9926-0b530039dddc tempest-ServerGroup264TestJSON-1340238192 tempest-ServerGroup264TestJSON-1340238192-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ad8c00e5-72ad-4bf0-bb5d-77886d667b9b" status: 404 len: 117 microversion: 2.64 time: 0.035678 Jun 16 18:45:31.283453 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1673/3422] 10.222.0.27 () {60 vars in 1306 bytes} [Thu Jun 16 18:45:31 2022] DELETE /compute/v2.1/os-server-groups/ad8c00e5-72ad-4bf0-bb5d-77886d667b9b => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:45:31.382083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:31.383384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:31.396079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:31.399353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:31.400537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:31.402697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:31.623849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-86cf209b-76b3-4375-a43b-c067ecc6e94f req-55407ad0-5ddf-47d4-bdd5-86f09ee501d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cc723a-7d61-4241-bc08-1309b6674872", "name": "network-vif-plugged", "status": "completed", "tag": "d2307271-c4cf-4845-a3fb-ea0cc26b2a43"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:31.635678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-86cf209b-76b3-4375-a43b-c067ecc6e94f req-55407ad0-5ddf-47d4-bdd5-86f09ee501d2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:31.636512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-86cf209b-76b3-4375-a43b-c067ecc6e94f req-55407ad0-5ddf-47d4-bdd5-86f09ee501d2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:31.654609 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-86cf209b-76b3-4375-a43b-c067ecc6e94f req-55407ad0-5ddf-47d4-bdd5-86f09ee501d2 service nova] Creating event network-vif-plugged:d2307271-c4cf-4845-a3fb-ea0cc26b2a43 for instance 11cc723a-7d61-4241-bc08-1309b6674872 on n-h2-846209-2 Jun 16 18:45:31.670470 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-86cf209b-76b3-4375-a43b-c067ecc6e94f req-55407ad0-5ddf-47d4-bdd5-86f09ee501d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048137 Jun 16 18:45:31.678620 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1674/3423] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:45:31.934234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:31.971238 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-caa8821f-bc30-45a6-80e9-285bf4a55286 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1499 microversion: 2.1 time: 0.595358 Jun 16 18:45:31.972127 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1750/3424] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:31 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1499 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:31.995290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:31.996277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:32.018466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.020990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:32.023122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.028115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:32.109666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:32.111274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:32.124979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.125695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:32.126970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.145604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:32.675920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:32.684068 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-adec130f-de43-41d4-ab3f-7157618d1ab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1514 microversion: 2.1 time: 0.698916 Jun 16 18:45:32.688436 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1675/3425] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:31 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1514 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:32.705523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:32.706189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:32.723515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.723980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:32.724783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.727419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:32.790555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:32.809016 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ed14a834-976b-45de-bfcc-28fa083b3942 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1367 microversion: 2.1 time: 0.703210 Jun 16 18:45:32.809629 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1751/3426] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:32 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1367 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:32.814826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-987a388f-aac2-4a15-a9a8-d763a53baab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:32.826493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-987a388f-aac2-4a15-a9a8-d763a53baab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 0d5a456a-3f7a-4b41-aea0-07adcf659c96] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:32.842547 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-987a388f-aac2-4a15-a9a8-d763a53baab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Instance 0d5a456a-3f7a-4b41-aea0-07adcf659c96 could not be found. Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-987a388f-aac2-4a15-a9a8-d763a53baab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/0d5a456a-3f7a-4b41-aea0-07adcf659c96/action HTTP/1.1 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 14 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: {"rescue": {}} Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 0d5a456a-3f7a-4b41-aea0-07adcf659c96 could not be found. Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '0d5a456a-3f7a-4b41-aea0-07adcf659c96', 'body': {'rescue': {}}} Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5a456a-3f7a-4b41-aea0-07adcf659c96 could not be found. Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5a456a-3f7a-4b41-aea0-07adcf659c96 could not be found. Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:32.853834 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:32.858586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:32.858586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:32.858586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:32.858586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:32.858586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5a456a-3f7a-4b41-aea0-07adcf659c96 could not be found. Jun 16 18:45:32.858586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:32.861523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-987a388f-aac2-4a15-a9a8-d763a53baab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 404 to user: Instance 0d5a456a-3f7a-4b41-aea0-07adcf659c96 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:32.862743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-987a388f-aac2-4a15-a9a8-d763a53baab1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/0d5a456a-3f7a-4b41-aea0-07adcf659c96/action" status: 404 len: 111 microversion: 2.1 time: 0.051872 Jun 16 18:45:32.863712 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1752/3427] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:45:32 2022] POST /compute/v2.1/servers/0d5a456a-3f7a-4b41-aea0-07adcf659c96/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:45:32.881219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0af33668-3cbf-41ee-bbe9-bf18522ce6b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:32.882155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0af33668-3cbf-41ee-bbe9-bf18522ce6b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:32.896960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0af33668-3cbf-41ee-bbe9-bf18522ce6b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.900572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0af33668-3cbf-41ee-bbe9-bf18522ce6b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:32.902304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0af33668-3cbf-41ee-bbe9-bf18522ce6b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:32.903210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0af33668-3cbf-41ee-bbe9-bf18522ce6b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:33.061243 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0af33668-3cbf-41ee-bbe9-bf18522ce6b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action" status: 202 len: 0 microversion: 2.1 time: 0.185043 Jun 16 18:45:33.062447 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1753/3428] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:45:32 2022] POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:45:33.075066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:33.076209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:33.100052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:33.101031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:33.102153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:33.103115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:34.540200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:34.549121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e75b6126-f33a-4f40-90be-b88e23e5cb4f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1318 microversion: 2.1 time: 1.859259 Jun 16 18:45:34.557190 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1676/3429] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:32 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1318 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:34.576129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:34.577222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:34.604446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:34.605215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:34.608914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:34.609553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:34.888573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:34.899696 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3a0de7f-0bcd-4a5a-9bf4-eff1df4b1f51 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1519 microversion: 2.1 time: 1.829402 Jun 16 18:45:34.914411 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1754/3430] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:33 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1519 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:45:35.579412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:35.580067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:35.592300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:35.598098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:35.601158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:35.608102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:35.611247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:35.832824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:35.847181 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2274441a-f304-447b-81a7-7ca1a1f8dfbb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1556 microversion: 2.1 time: 1.286948 Jun 16 18:45:35.851615 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1677/3431] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:34 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1556 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:35.872897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-deb8c14d-c1b9-46e6-9577-830273f92e68 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:35.879648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-deb8c14d-c1b9-46e6-9577-830273f92e68 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:35.902895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-deb8c14d-c1b9-46e6-9577-830273f92e68 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:35.906117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-deb8c14d-c1b9-46e6-9577-830273f92e68 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:35.909293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-deb8c14d-c1b9-46e6-9577-830273f92e68 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:35.910003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-deb8c14d-c1b9-46e6-9577-830273f92e68 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:36.301472 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-deb8c14d-c1b9-46e6-9577-830273f92e68 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.438585 Jun 16 18:45:36.305180 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1678/3432] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:45:35 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-interface => generated 284 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:45:36.315276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:36.316549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:36.327571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:36.329066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:36.331173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:36.332463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:36.939554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:36.958464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-edddbb4d-b21f-48f6-8076-39d44ca4af7b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1318 microversion: 2.1 time: 1.388277 Jun 16 18:45:36.960973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1755/3433] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:35 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1318 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:37.478624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:37.499973 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-42d9c5c2-fa22-48cb-9652-41d95e4af6ca tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1499 microversion: 2.1 time: 1.192229 Jun 16 18:45:37.502152 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1679/3434] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:36 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1499 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:37.529060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:37.531171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:37.552776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.553650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:37.555738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.556404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:37.620419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lazy-loading 'flavor' on Instance uuid 253e4a8a-f499-447c-a0ec-2cf88b67abad {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:45:37.646678 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Cannot 'rescue' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state paused Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action HTTP/1.1 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 14 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: {"rescue": {}} Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'rescue' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state paused Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '253e4a8a-f499-447c-a0ec-2cf88b67abad', 'body': {'rescue': {}}} Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad in vm_state paused. Cannot rescue while the instance is in this state. Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state paused Jun 16 18:45:37.649039 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state paused Jun 16 18:45:37.654586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:45:37.661630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 409 to user: Cannot 'rescue' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state paused {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:45:37.663089 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bdfa959b-714a-4bc3-9788-1735cab433ab tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action" status: 409 len: 144 microversion: 2.1 time: 0.143006 Jun 16 18:45:37.665201 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1756/3435] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:45:37 2022] POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action => generated 144 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:45:37.677830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3618181-a5b0-4513-8089-754f057a49b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:37.678997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b3618181-a5b0-4513-8089-754f057a49b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:37.698107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3618181-a5b0-4513-8089-754f057a49b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.698850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3618181-a5b0-4513-8089-754f057a49b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:37.703584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3618181-a5b0-4513-8089-754f057a49b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.704454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b3618181-a5b0-4513-8089-754f057a49b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:37.871714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:37.872341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:37.890373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.893171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:37.901373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.902341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:37.911405 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3618181-a5b0-4513-8089-754f057a49b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action" status: 202 len: 0 microversion: 2.1 time: 0.239721 Jun 16 18:45:37.912927 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1680/3436] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:45:37 2022] POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:45:37.925702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:37.927017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:37.936198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.937316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:37.939788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:37.940765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:38.552549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:38.737859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:38.742515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:38.745055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:38.756665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e54e375e-851c-4d17-a57b-85501a779aa9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1506 microversion: 2.1 time: 0.838031 Jun 16 18:45:38.757675 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1681/3437] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:37 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1506 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:38.760117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:38.762223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:38.765533 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b83c240-c036-4cd6-80c2-53df5a620cdd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2954 microversion: 2.42 time: 0.898231 Jun 16 18:45:38.767051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:38.769746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1757/3438] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:37 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2954 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:45:38.783094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:38.790472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:38.790933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:38.791759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:38.792214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:38.801008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-82d0b2f1-7b4e-437a-a30d-1569dd1b69eb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:38.802539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-82d0b2f1-7b4e-437a-a30d-1569dd1b69eb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:38.816443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82d0b2f1-7b4e-437a-a30d-1569dd1b69eb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:38.817328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82d0b2f1-7b4e-437a-a30d-1569dd1b69eb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:38.818530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82d0b2f1-7b4e-437a-a30d-1569dd1b69eb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:38.819357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82d0b2f1-7b4e-437a-a30d-1569dd1b69eb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:38.901418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:39.150207 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-82d0b2f1-7b4e-437a-a30d-1569dd1b69eb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.355382 Jun 16 18:45:39.152188 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1758/3439] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:45:38 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556/os-interface => generated 1831 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:39.247633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-91b16f09-1ac9-415f-a388-6ca2f08aa2f0 req-2b116aeb-70e8-402e-9a1f-f77c3e058870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beeed3db-d792-4526-ae49-36b22c4fc6be", "tag": "b9814f48-4372-43ab-9fc7-e9564acb685a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:39.263814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-91b16f09-1ac9-415f-a388-6ca2f08aa2f0 req-2b116aeb-70e8-402e-9a1f-f77c3e058870 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:39.264527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-91b16f09-1ac9-415f-a388-6ca2f08aa2f0 req-2b116aeb-70e8-402e-9a1f-f77c3e058870 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:39.302667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:39.305836 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-91b16f09-1ac9-415f-a388-6ca2f08aa2f0 req-2b116aeb-70e8-402e-9a1f-f77c3e058870 service nova] Creating event network-changed:b9814f48-4372-43ab-9fc7-e9564acb685a for instance beeed3db-d792-4526-ae49-36b22c4fc6be on n-h2-846209-2 Jun 16 18:45:39.314311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-91b16f09-1ac9-415f-a388-6ca2f08aa2f0 req-2b116aeb-70e8-402e-9a1f-f77c3e058870 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070995 Jun 16 18:45:39.317876 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1759/3440] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:39.674694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:39.688962 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f64bb9d-3ef9-4491-be29-ffc62480b429 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1318 microversion: 2.1 time: 0.925162 Jun 16 18:45:39.722561 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1682/3441] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:38 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:39.782339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:39.783109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:39.800354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:39.814607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:39.815651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:39.816119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:40.717165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:40.718002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:40.720578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:40.746029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:40.746741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:40.747583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:40.748024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:41.529020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:41.551972 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b95f6f93-c095-402b-8dea-d2097dcbc64f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1514 microversion: 2.1 time: 1.779392 Jun 16 18:45:41.561458 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1760/3442] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:39 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1514 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:41.585137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2c0b5c02-ec1d-4f8b-8850-f0cc9c639a68 req-ca61d43b-b7c6-44f7-8229-87ebaecd8083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cc723a-7d61-4241-bc08-1309b6674872", "tag": "d2307271-c4cf-4845-a3fb-ea0cc26b2a43"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:41.623164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2c0b5c02-ec1d-4f8b-8850-f0cc9c639a68 req-ca61d43b-b7c6-44f7-8229-87ebaecd8083 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:41.633716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2c0b5c02-ec1d-4f8b-8850-f0cc9c639a68 req-ca61d43b-b7c6-44f7-8229-87ebaecd8083 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:41.637845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:41.652624 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-38607e3b-4f6b-479e-8240-25b9c5e3524a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1318 microversion: 2.1 time: 0.941019 Jun 16 18:45:41.653476 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1683/3443] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:40 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1318 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:45:41.682967 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2c0b5c02-ec1d-4f8b-8850-f0cc9c639a68 req-ca61d43b-b7c6-44f7-8229-87ebaecd8083 service nova] Creating event network-changed:d2307271-c4cf-4845-a3fb-ea0cc26b2a43 for instance 11cc723a-7d61-4241-bc08-1309b6674872 on n-h2-846209-2 Jun 16 18:45:41.698298 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2c0b5c02-ec1d-4f8b-8850-f0cc9c639a68 req-ca61d43b-b7c6-44f7-8229-87ebaecd8083 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131539 Jun 16 18:45:41.700581 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1761/3444] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:41.840470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-706729679", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "29f8cdde-f20a-4bf7-8727-9b74906e6c49"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:41.988552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] validate_networks() for [('29f8cdde-f20a-4bf7-8727-9b74906e6c49', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:45:42.677109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:42.678576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:42.695882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:42.699463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:42.700849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:42.701446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:43.767036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:43.778576 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-73283b05-0c09-4364-b2f7-0a459cd84be4 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1318 microversion: 2.1 time: 1.107647 Jun 16 18:45:43.781107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1762/3445] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:42 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1318 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:45:43.787302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7c30757-6509-437c-b753-168a8c5dfcb5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:43.788090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a7c30757-6509-437c-b753-168a8c5dfcb5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:43.796492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7c30757-6509-437c-b753-168a8c5dfcb5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:43.809932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7c30757-6509-437c-b753-168a8c5dfcb5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:43.810813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7c30757-6509-437c-b753-168a8c5dfcb5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:43.811328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7c30757-6509-437c-b753-168a8c5dfcb5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:43.868123 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a7c30757-6509-437c-b753-168a8c5dfcb5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/ips" status: 200 len: 153 microversion: 2.20 time: 0.082483 Jun 16 18:45:43.868750 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1763/3446] 10.222.0.27 () {60 vars in 1288 bytes} [Thu Jun 16 18:45:43 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/ips => generated 153 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:45:43.874148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2a6c25dc-c1a1-436c-91d4-c80225ea17d8 req-de8d0025-49e0-4e6a-b08b-8b5dff42c9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74904cf8-9949-4a87-abad-18b8a3995fa8", "tag": "f9ae924c-23ff-45d7-b8d4-3468bc2c67d8"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:43.889505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2a6c25dc-c1a1-436c-91d4-c80225ea17d8 req-de8d0025-49e0-4e6a-b08b-8b5dff42c9b3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:43.890267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2a6c25dc-c1a1-436c-91d4-c80225ea17d8 req-de8d0025-49e0-4e6a-b08b-8b5dff42c9b3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:43.924617 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2a6c25dc-c1a1-436c-91d4-c80225ea17d8 req-de8d0025-49e0-4e6a-b08b-8b5dff42c9b3 service nova] Creating event network-changed:f9ae924c-23ff-45d7-b8d4-3468bc2c67d8 for instance 74904cf8-9949-4a87-abad-18b8a3995fa8 on n-h1-846209-2 Jun 16 18:45:43.935006 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2a6c25dc-c1a1-436c-91d4-c80225ea17d8 req-de8d0025-49e0-4e6a-b08b-8b5dff42c9b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064675 Jun 16 18:45:43.936600 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1764/3447] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:44.533784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:44.534908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:44.550341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:44.550803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:44.551599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:44.552041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:44.628814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lazy-loading 'flavor' on Instance uuid 253e4a8a-f499-447c-a0ec-2cf88b67abad {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:45:44.797792 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-243ede0c-3ab9-45ff-99af-3a56e4eab578 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action" status: 200 len: 32 microversion: 2.1 time: 0.269131 Jun 16 18:45:44.800306 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1765/3448] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:45:44 2022] POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action => generated 32 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:45:44.823162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:44.827933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:44.845299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:44.846738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:44.860765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:44.861234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:45.085252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:45:45.086941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:45:45.087712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:45:45.088552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:45:45.089198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:45:45.133270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:45.134184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:45.135630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:45.142034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:45.192080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Getting quotas for project 41bd58029bf84b1e841db019919f9c78. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:45:45.215416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Getting quotas for user 5860cdc086504e048f6bdd84aa420a89 and project 41bd58029bf84b1e841db019919f9c78. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:45:45.247132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:45:45.249453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:45:45.372303 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c4b1e733-204b-4713-aa62-3ff407d8ce97 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.708570 Jun 16 18:45:45.386013 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1684/3449] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:45:45.395852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:45.400240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:45.420794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:45.423221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:45.424987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:45.430028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:45.568117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:45.582725 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9263b130-d299-4a2a-9454-9c201b8fb2a8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1318 microversion: 2.1 time: 0.780676 Jun 16 18:45:45.596118 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1766/3450] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:44 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1318 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:45.610731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:45.618275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:45.780869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:45.801070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:45.809413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:45.811198 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1258 microversion: 2.21 time: 0.213628 Jun 16 18:45:45.823312 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1767/3451] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:45 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:45.824730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:45.831114 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6bfaf4e-a52f-4b63-ace5-88fab1394389 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006525 Jun 16 18:45:45.838316 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1768/3452] 10.222.0.27 () {56 vars in 885 bytes} [Thu Jun 16 18:45:45 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 16 18:45:45.875096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:45.896647 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-04779d7b-c527-4ea8-b2cd-b6c6278f519e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.508783 Jun 16 18:45:45.900754 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1685/3453] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:45 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:46.358469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-efb0e10a-ac32-4701-b9e8-c1116389b717 req-0efadcdc-b39d-4890-95d8-42179e874c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beeed3db-d792-4526-ae49-36b22c4fc6be", "name": "network-vif-plugged", "status": "completed", "tag": "b9814f48-4372-43ab-9fc7-e9564acb685a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:46.378320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-efb0e10a-ac32-4701-b9e8-c1116389b717 req-0efadcdc-b39d-4890-95d8-42179e874c04 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:46.378783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-efb0e10a-ac32-4701-b9e8-c1116389b717 req-0efadcdc-b39d-4890-95d8-42179e874c04 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:46.431328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-efb0e10a-ac32-4701-b9e8-c1116389b717 req-0efadcdc-b39d-4890-95d8-42179e874c04 service nova] Creating event network-vif-plugged:b9814f48-4372-43ab-9fc7-e9564acb685a for instance beeed3db-d792-4526-ae49-36b22c4fc6be on n-h2-846209-2 Jun 16 18:45:46.447019 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-efb0e10a-ac32-4701-b9e8-c1116389b717 req-0efadcdc-b39d-4890-95d8-42179e874c04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092119 Jun 16 18:45:46.451811 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1769/3454] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:46.626032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:46.627358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:46.648335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:46.648802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:46.649614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:46.650095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:46.830835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:46.831918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:46.851096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:46.851932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:46.853152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:46.853962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:47.080442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:47.088975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:47.093649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:47.097120 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ea8f793b-5bc6-4ac8-bec9-75a2026aea2a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1254 microversion: 2.21 time: 0.271056 Jun 16 18:45:47.099223 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1770/3455] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:46 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1254 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:47.105389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:47.106572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:47.121314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:47.122501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:47.124327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:47.125736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:47.376813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:47.401195 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b52a89d-cadf-47b5-8539-d9dc05cdc59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1318 microversion: 2.1 time: 0.786625 Jun 16 18:45:47.402185 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1686/3456] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:46 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1318 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:47.419472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:47.424517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:47.452814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:47.457257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:47.462930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:47.463404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:47.495330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lazy-loading 'flavor' on Instance uuid 31b6c0e5-0374-409e-928e-fef329282b9d {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:45:47.901458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:47.914925 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f44d343-7055-4c01-89da-edb3303cce45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.814272 Jun 16 18:45:47.915577 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1771/3457] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:47 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:48.043298 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a2b95a13-efb3-4370-8b43-212f8703d87f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/action" status: 202 len: 0 microversion: 2.20 time: 0.638144 Jun 16 18:45:48.045189 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1687/3458] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:45:47 2022] POST /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:45:48.054376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:48.055298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:48.067559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:48.068240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:48.069259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:48.078873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:48.116973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:48.117687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:48.139186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:48.139645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:48.140946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:48.141424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:48.384984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:48.396552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:48.398145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:48.399291 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-65850d74-441f-4861-a73b-3b4f168dee73 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1316 microversion: 2.21 time: 0.286609 Jun 16 18:45:48.399857 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1688/3459] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:48 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:45:48.428874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:48.429720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:48.455770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:48.456427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:48.457655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:48.459451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:49.357211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.367751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.370163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.371559 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-30b33ef1-4318-42bc-8196-5c0e2d7412b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 1.321098 Jun 16 18:45:49.386592 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1772/3460] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:48 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:49.392454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:49.393026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:49.400470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:49.401339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:49.402361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:49.402361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:49.580633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.588684 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0fc61c5b-fd41-44de-81d2-efbb105d8fca tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 200 len: 1505 microversion: 2.1 time: 1.168756 Jun 16 18:45:49.600674 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1689/3461] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:48 2022] GET /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 1505 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:49.600674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:49.600674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:49.607446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:49.607915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:49.608707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:49.609391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:49.805055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.826053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.828201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.833405 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5cf4880e-6d53-4919-a0e8-3f988b914f0c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1316 microversion: 2.21 time: 0.242253 Jun 16 18:45:49.834012 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1690/3462] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:49 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:49.838937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:49.840694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: 74904cf8-9949-4a87-abad-18b8a3995fa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:49.848575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:49.850110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:49.851104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:49.851781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:49.956569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:49.966657 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34b89bef-0121-470e-bb8a-323d4dca41c3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.578079 Jun 16 18:45:49.967074 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1773/3463] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:49 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:50.167714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:50.176700 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2398539c-41f2-4330-b195-bb26edf6d59e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8" status: 200 len: 1318 microversion: 2.1 time: 0.341458 Jun 16 18:45:50.177378 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1691/3464] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:49 2022] GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:50.393433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:50.394884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:50.402180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:50.402976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:50.404088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:50.404691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:50.853426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:50.854128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:50.868541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:50.869003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:50.869815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:50.870857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:51.101230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.117857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.121386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.135425 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92111f9c-8d6a-4030-ab41-67d835700bd0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.735445 Jun 16 18:45:51.136398 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1774/3465] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:50 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:51.157800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f93c4ad3-e89f-4fb7-ab35-9aaa91344762 req-8814baf8-226c-4d4b-8940-0107011c9c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74904cf8-9949-4a87-abad-18b8a3995fa8", "name": "network-vif-plugged", "status": "completed", "tag": "f9ae924c-23ff-45d7-b8d4-3468bc2c67d8"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:51.176865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f93c4ad3-e89f-4fb7-ab35-9aaa91344762 req-8814baf8-226c-4d4b-8940-0107011c9c1e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:51.177411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f93c4ad3-e89f-4fb7-ab35-9aaa91344762 req-8814baf8-226c-4d4b-8940-0107011c9c1e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:51.193197 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f93c4ad3-e89f-4fb7-ab35-9aaa91344762 req-8814baf8-226c-4d4b-8940-0107011c9c1e service nova] Creating event network-vif-plugged:f9ae924c-23ff-45d7-b8d4-3468bc2c67d8 for instance 74904cf8-9949-4a87-abad-18b8a3995fa8 on n-h1-846209-2 Jun 16 18:45:51.199093 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f93c4ad3-e89f-4fb7-ab35-9aaa91344762 req-8814baf8-226c-4d4b-8940-0107011c9c1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047636 Jun 16 18:45:51.200058 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1775/3466] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:51.209245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:51.210505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:51.217817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:51.219647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:51.226725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:51.227545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:51.353790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.365580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.367370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.369022 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aae5fc58-70cd-42e2-a838-6e3066801848 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1358 microversion: 2.21 time: 0.520065 Jun 16 18:45:51.380503 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1692/3467] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:50 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1358 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:51.385726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:51.386439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: 74904cf8-9949-4a87-abad-18b8a3995fa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:51.392828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:51.394742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:51.395251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:51.396046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:51.396490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:51.831693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.848978 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-80c68c9d-50ff-45d7-b249-87ab6e9dcf2f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.647424 Jun 16 18:45:51.863729 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1776/3468] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:51 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:51.882371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:51.898441 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd0b3e63-baaf-4fd4-9100-4b57afdcfc24 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8" status: 200 len: 1318 microversion: 2.1 time: 0.519003 Jun 16 18:45:51.901063 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1693/3469] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:51 2022] GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:52.154247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:52.154877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:52.170066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:52.170907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:52.172445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:52.173602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:52.387925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:52.388962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:52.396831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:52.397831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:52.398887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:52.399513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:52.990908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.011216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.013633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.015379 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ec5a8190-3294-4836-b184-cbb019cafc74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.865167 Jun 16 18:45:53.016644 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1777/3470] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:52 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:53.022821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:53.023792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:53.040973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:53.042220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:53.044295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:53.045973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:53.084839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.102866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.110764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.113602 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-260c259e-f931-4d7a-aecb-c4c18b8b8ba3 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1358 microversion: 2.21 time: 0.729790 Jun 16 18:45:53.116092 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1694/3471] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:52 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1358 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:53.135591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:53.144601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: 74904cf8-9949-4a87-abad-18b8a3995fa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:53.176293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:53.178783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:53.180066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:53.181677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:53.893564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.906546 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2deeefe2-9470-4a57-ba46-a6a973e5bccf tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8" status: 200 len: 1318 microversion: 2.1 time: 0.788484 Jun 16 18:45:53.918150 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1695/3472] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:53 2022] GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8 => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:53.926512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d6e69111-5f4d-4fec-ac10-ca2ae47c55fc req-f270162d-8432-4134-8228-a275cfe8c8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922a0d69-95d2-4f22-806a-a0f16a344362", "tag": "309ad808-0b63-460f-a3ae-6c106ebda8a5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:53.934379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:53.944142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d6e69111-5f4d-4fec-ac10-ca2ae47c55fc req-f270162d-8432-4134-8228-a275cfe8c8e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:53.944769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d6e69111-5f4d-4fec-ac10-ca2ae47c55fc req-f270162d-8432-4134-8228-a275cfe8c8e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:53.956842 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9d3ba14f-d336-4beb-8c3a-1edcf03a4bdb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.938189 Jun 16 18:45:53.957445 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1778/3473] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:53 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:53.965153 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d6e69111-5f4d-4fec-ac10-ca2ae47c55fc req-f270162d-8432-4134-8228-a275cfe8c8e8 service nova] Creating event network-changed:309ad808-0b63-460f-a3ae-6c106ebda8a5 for instance 922a0d69-95d2-4f22-806a-a0f16a344362 on n-h1-846209-2 Jun 16 18:45:53.972787 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d6e69111-5f4d-4fec-ac10-ca2ae47c55fc req-f270162d-8432-4134-8228-a275cfe8c8e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052427 Jun 16 18:45:53.973599 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1696/3474] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:54.034153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:54.035454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:54.050238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.050723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:54.051512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.053415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:54.087358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:54.133898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:54.135062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:54.142657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.143080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:54.144335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.145314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:54.752935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:54.772762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:54.775355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:54.777453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:54.779650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:54.782370 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c892502-7fe2-457a-8af0-2be78bee17d3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.752382 Jun 16 18:45:54.783167 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1779/3475] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:54 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:54.785846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:54.787887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:54.789157 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6499a257-1813-425a-ae66-a351c1ed0405 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1358 microversion: 2.21 time: 0.659431 Jun 16 18:45:54.789608 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1697/3476] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:54 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1358 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:45:54.925198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:54.926111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: 74904cf8-9949-4a87-abad-18b8a3995fa8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:54.938097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.938567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:54.939368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.939804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:54.976093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:54.976959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:54.991718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.992332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:54.993211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:54.993676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.158759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:55.230420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:55.264383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:55.272799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:55.274390 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-008ea466-c361-4334-9f03-94aec7aac736 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.304431 Jun 16 18:45:55.283960 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1698/3477] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:54 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:55.284210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c008b079-d080-4574-8f5d-f19485b44bbc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8" status: 200 len: 1505 microversion: 2.1 time: 0.363633 Jun 16 18:45:55.284821 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1780/3478] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:54 2022] GET /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:55.307548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:55.308071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: 74904cf8-9949-4a87-abad-18b8a3995fa8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:55.314964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.316083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.317211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.317658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.366378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: 74904cf8-9949-4a87-abad-18b8a3995fa8] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:45:55.504915 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00933a24-fdf7-439e-8c43-79d80ae2af50 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "DELETE /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8" status: 204 len: 0 microversion: 2.1 time: 0.199334 Jun 16 18:45:55.509276 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1699/3479] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:45:55 2022] DELETE /compute/v2.1/servers/74904cf8-9949-4a87-abad-18b8a3995fa8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:45:55.517587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:55.518168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:55.526004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.526724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.528117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.528561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.562897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: beeed3db-d792-4526-ae49-36b22c4fc6be] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:45:55.683667 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-279ce24f-eb16-4f12-8783-a8e3d1ff69bc tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "DELETE /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be" status: 204 len: 0 microversion: 2.1 time: 0.172544 Jun 16 18:45:55.695353 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1781/3480] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:45:55 2022] DELETE /compute/v2.1/servers/beeed3db-d792-4526-ae49-36b22c4fc6be => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:45:55.805691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:55.806610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:55.809051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:55.809860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:55.826821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.827233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.833387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.833611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:45:55.834034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.837478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.837965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:55.841189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:55.841646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:56.181373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:56.195093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:56.196631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:56.197786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d5a79c15-e74f-471e-87c0-eae1284aa418 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1358 microversion: 2.21 time: 0.393831 Jun 16 18:45:56.198388 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1782/3481] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:55 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:56.222053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1762998272", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d3dc63ce-1ddf-46da-a68c-ab9f716ae23d"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:56.234621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:56.250739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:56.259159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:56.260008 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c0172628-a4c7-4683-a4a8-1b60b806d016 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.461930 Jun 16 18:45:56.270247 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1700/3482] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:55 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:56.294508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:56.296004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:56.308937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:56.309414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:56.310352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:56.310801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:56.324019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] validate_networks() for [('d3dc63ce-1ddf-46da-a68c-ab9f716ae23d', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:45:56.676823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:56.689036 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.399548 Jun 16 18:45:56.699167 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1701/3483] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:56 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:56.700488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:56.701486 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1b072fe2-d713-4e66-a1e0-a002b1fe0f27 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001390 Jun 16 18:45:56.701836 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1702/3484] 10.222.0.27 () {56 vars in 885 bytes} [Thu Jun 16 18:45:56 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 16 18:45:57.223403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:57.224034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:57.231844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:57.232302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:57.233090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:57.233539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:58.106130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:45:58.107813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:45:58.108962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:45:58.110634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:45:58.111606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:45:58.141541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:58.142294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:58.143613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:58.144225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:58.166302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Getting quotas for project 845d9dbb0e09427486fc555e684ce26e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:45:58.173783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Getting quotas for user 771965bf0ff449829821757417b58fc1 and project 845d9dbb0e09427486fc555e684ce26e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:45:58.189206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Going to run 2 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:45:58.191780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:45:58.224386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:58.231417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=a20f110f-2d96-4548-a622-84b1c4ceda64,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:45:58.237439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:58.241065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:58.243747 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-59ff0fc3-349a-48c6-8689-3e6ca00f3a1c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1358 microversion: 2.21 time: 1.026262 Jun 16 18:45:58.245033 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1703/3485] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:57 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1358 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:58.254371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:58.255251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:58.267484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:58.268546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:58.269723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:58.270496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:58.386662 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-00acc836-795b-4b00-8974-72e6651abe35 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.169081 Jun 16 18:45:58.389222 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1783/3486] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:45:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 16 18:45:58.397439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:58.399084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:58.408255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:58.408726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:58.409673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:58.410248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:59.169151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:59.184293 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3e73bbe0-0e91-4374-9d31-8260e119dfe9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.793606 Jun 16 18:45:59.187072 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1784/3487] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:58 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:59.192478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:59.215221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-da0b2a84-6f80-4cd4-9d27-13f084d75c13 req-39aaa13a-8a39-4c7b-ba9a-e8fc59e1c506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beeed3db-d792-4526-ae49-36b22c4fc6be", "name": "network-vif-deleted", "tag": "b9814f48-4372-43ab-9fc7-e9564acb685a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:59.232498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:59.238649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:59.240374 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b3f53f2-2362-48d1-980c-28af8f2624e6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.993858 Jun 16 18:45:59.241101 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1704/3488] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:58 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:45:59.257032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:59.257384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-da0b2a84-6f80-4cd4-9d27-13f084d75c13 req-39aaa13a-8a39-4c7b-ba9a-e8fc59e1c506 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:59.257788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-da0b2a84-6f80-4cd4-9d27-13f084d75c13 req-39aaa13a-8a39-4c7b-ba9a-e8fc59e1c506 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:59.272057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:59.275817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Searching by: {'deleted': False, 'project_id': '845d9dbb0e09427486fc555e684ce26e'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:45:59.310565 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-da0b2a84-6f80-4cd4-9d27-13f084d75c13 req-39aaa13a-8a39-4c7b-ba9a-e8fc59e1c506 service nova] Creating event network-vif-deleted:b9814f48-4372-43ab-9fc7-e9564acb685a for instance beeed3db-d792-4526-ae49-36b22c4fc6be on n-h2-846209-2 Jun 16 18:45:59.318438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:59.324823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:59.326707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:59.332206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:59.332672 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-da0b2a84-6f80-4cd4-9d27-13f084d75c13 req-39aaa13a-8a39-4c7b-ba9a-e8fc59e1c506 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118463 Jun 16 18:45:59.337451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1785/3489] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:59.360411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-75eb59f4-4112-4834-a76a-ce7a53b16b84 req-efecb8d1-39be-4aea-83fc-76e4517f36dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922a0d69-95d2-4f22-806a-a0f16a344362", "name": "network-vif-plugged", "status": "completed", "tag": "309ad808-0b63-460f-a3ae-6c106ebda8a5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:45:59.387776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75eb59f4-4112-4834-a76a-ce7a53b16b84 req-efecb8d1-39be-4aea-83fc-76e4517f36dd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:59.393339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75eb59f4-4112-4834-a76a-ce7a53b16b84 req-efecb8d1-39be-4aea-83fc-76e4517f36dd service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:59.427573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:45:59.458274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-75eb59f4-4112-4834-a76a-ce7a53b16b84 req-efecb8d1-39be-4aea-83fc-76e4517f36dd service nova] Creating event network-vif-plugged:309ad808-0b63-460f-a3ae-6c106ebda8a5 for instance 922a0d69-95d2-4f22-806a-a0f16a344362 on n-h1-846209-2 Jun 16 18:45:59.470740 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-667f8a9a-708f-4e14-b64f-395a1187eeb0 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.223528 Jun 16 18:45:59.471838 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1705/3490] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:45:59 2022] GET /compute/v2.1/servers => generated 1003 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:45:59.478223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:59.479260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:59.484249 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-75eb59f4-4112-4834-a76a-ce7a53b16b84 req-efecb8d1-39be-4aea-83fc-76e4517f36dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142401 Jun 16 18:45:59.486067 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1786/3491] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:45:59.496806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce1adabe-ca95-4e3c-8e89-8427874d7c7e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:45:59.500538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:59.502810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:59.505165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:45:59.507598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:45:59.509174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ce1adabe-ca95-4e3c-8e89-8427874d7c7e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:45:59.925363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ce1adabe-ca95-4e3c-8e89-8427874d7c7e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:45:59.952518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ce1adabe-ca95-4e3c-8e89-8427874d7c7e tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1218 microversion: 2.1 time: 0.464563 Jun 16 18:45:59.956363 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1787/3492] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:45:59 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1218 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:00.206125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:00.208675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:00.230586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.234368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.238421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.240957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.505303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:00.549956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:00.557407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:00.568636 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5f6b093c-6424-4d32-80cd-3ae922fa022a tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1358 microversion: 2.21 time: 1.092629 Jun 16 18:46:00.573747 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1706/3493] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:45:59 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1358 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:00.601267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:00.603915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:00.681512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.682271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.683587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.684311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:01.191755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:01.212557 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a35a33ab-7ae5-4629-9b54-c7cc117ed473 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 1.009516 Jun 16 18:46:01.214424 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1788/3494] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:00 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:01.223475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:01.239535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:01.263730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:01.270647 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5f10667c-b9be-49ca-b328-825e4ef7a5f7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1745 microversion: 2.20 time: 0.693311 Jun 16 18:46:01.273372 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1707/3495] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:00 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1745 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:01.295393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:01.302581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:01.350091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:01.358340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:01.362513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:01.364957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:01.648520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:01.658841 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e23df33a-5556-4343-b975-6a0755b08043 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1278 microversion: 2.1 time: 0.382033 Jun 16 18:46:01.659446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1708/3496] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:01 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1278 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:01.668633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-31ec40c8-ab16-4cef-87a8-9f48dcc09614 req-b9f8319b-9183-4859-8aec-32ac2b749ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74904cf8-9949-4a87-abad-18b8a3995fa8", "name": "network-vif-deleted", "tag": "f9ae924c-23ff-45d7-b8d4-3468bc2c67d8"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:01.702094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e6b30c1-9656-4574-a2ac-62af317c5364 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Action: 'create', calling method: .version_select at 0x7f866de9b700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-787475691"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:01.708938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-31ec40c8-ab16-4cef-87a8-9f48dcc09614 req-b9f8319b-9183-4859-8aec-32ac2b749ef7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:01.709279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-31ec40c8-ab16-4cef-87a8-9f48dcc09614 req-b9f8319b-9183-4859-8aec-32ac2b749ef7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:01.766931 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-31ec40c8-ab16-4cef-87a8-9f48dcc09614 req-b9f8319b-9183-4859-8aec-32ac2b749ef7 service nova] Creating event network-vif-deleted:f9ae924c-23ff-45d7-b8d4-3468bc2c67d8 for instance 74904cf8-9949-4a87-abad-18b8a3995fa8 on n-h1-846209-2 Jun 16 18:46:01.780949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-31ec40c8-ab16-4cef-87a8-9f48dcc09614 req-b9f8319b-9183-4859-8aec-32ac2b749ef7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114698 Jun 16 18:46:01.793257 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1709/3497] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:01.827214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:01.830579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:01.858848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:01.872040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:01.878210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:01.879148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:02.265886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:02.314502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:02.324678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:02.333579 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00df545b-ac03-4f46-914f-e75fc2f82a18 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1551 microversion: 2.21 time: 0.537973 Jun 16 18:46:02.335814 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1710/3498] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:01 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1551 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:02.354409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:02.356143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:02.391022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:02.393779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:02.395902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:02.403358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:02.902027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e6b30c1-9656-4574-a2ac-62af317c5364 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.684853 Jun 16 18:46:02.903368 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1789/3499] 10.222.0.27 () {60 vars in 1154 bytes} [Thu Jun 16 18:46:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1688 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:46:02.939277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:02.940785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:02.978350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:02.980022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:02.990105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.007934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:03.012846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:03.017334 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5fe75bc1-5ba8-47d8-b642-fb51b0456f5a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.679466 Jun 16 18:46:03.031830 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1711/3500] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:02 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:03.047801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-005714e8-50eb-41ca-b3eb-cc6c918cce87 req-4db89ad5-1783-44ca-a4e3-a0e801e2c294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b6c0e5-0374-409e-928e-fef329282b9d", "name": "network-vif-plugged", "status": "completed", "tag": "1d6556a3-3abe-405b-9851-474f0b6ab80f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:03.073055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-005714e8-50eb-41ca-b3eb-cc6c918cce87 req-4db89ad5-1783-44ca-a4e3-a0e801e2c294 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.076977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-005714e8-50eb-41ca-b3eb-cc6c918cce87 req-4db89ad5-1783-44ca-a4e3-a0e801e2c294 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:03.200545 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-005714e8-50eb-41ca-b3eb-cc6c918cce87 req-4db89ad5-1783-44ca-a4e3-a0e801e2c294 service nova] Creating event network-vif-plugged:1d6556a3-3abe-405b-9851-474f0b6ab80f for instance 31b6c0e5-0374-409e-928e-fef329282b9d on n-h2-846209-2 Jun 16 18:46:03.230470 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-005714e8-50eb-41ca-b3eb-cc6c918cce87 req-4db89ad5-1783-44ca-a4e3-a0e801e2c294 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195681 Jun 16 18:46:03.235445 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1712/3501] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:03.266728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:03.283775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:03.338854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.339604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:03.345479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.353201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:03.507714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:46:03.678333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:03.855744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:03.867892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:03.874122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:03.877312 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ed5cce2c-7311-4da8-9dc2-eb441d5a1959 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.972121 Jun 16 18:46:03.880757 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1790/3502] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:02 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:03.892242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:03.894538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:03.894706 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-409d81a5-6da2-4ef9-aedb-0b08a1f82bcf tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "DELETE /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 204 len: 0 microversion: 2.21 time: 0.645291 Jun 16 18:46:03.897268 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1713/3503] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:46:03 2022] DELETE /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:46:03.935623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c0a02088-9da6-41f9-8d2c-505ce0a3a5cf tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866de42f70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:03.940691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.942781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:03.946166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.951050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:04.037915 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c0a02088-9da6-41f9-8d2c-505ce0a3a5cf tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 200 len: 344 microversion: 2.1 time: 0.132338 Jun 16 18:46:04.039637 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1714/3504] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:03 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:04.151197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:04.171111 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-479bfac3-87de-466f-b891-069112b36737 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1276 microversion: 2.1 time: 0.287526 Jun 16 18:46:04.173887 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1791/3505] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:03 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:04.186786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:04.188419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:04.212628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24599196-b4e5-4c39-a572-01b668c8fdb4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Action: 'create', calling method: .version_select at 0x7f866f769dc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-569086401", "policies": ["affinity"]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:04.213147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:04.218117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:04.223891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:04.227681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:04.312802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-24599196-b4e5-4c39-a572-01b668c8fdb4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:04.384034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-24599196-b4e5-4c39-a572-01b668c8fdb4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:04.634951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-24599196-b4e5-4c39-a572-01b668c8fdb4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:04.679961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-24599196-b4e5-4c39-a572-01b668c8fdb4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:04.740830 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-24599196-b4e5-4c39-a572-01b668c8fdb4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.699589 Jun 16 18:46:04.741459 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1715/3506] 10.222.0.27 () {60 vars in 1173 bytes} [Thu Jun 16 18:46:04 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:04.756645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:04.758241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:04.776962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:04.782153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:04.786420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:04.787088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:04.876541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:04.915910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:04.925748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:04.931796 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-345e20aa-ee57-4595-a356-17c32242cbe4 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1557 microversion: 2.21 time: 0.755378 Jun 16 18:46:04.935960 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1792/3507] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:04 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1557 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:04.965707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b6e7914-dcf2-4b2e-8431-06896a36b7f0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Action: 'create', calling method: .version_select at 0x7f866de9b430>, body: {"server_group": {"name": "tempest-server-group-1949759832", "policies": ["affinity"]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:04.987544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:05.060908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2b6e7914-dcf2-4b2e-8431-06896a36b7f0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:05.086604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2b6e7914-dcf2-4b2e-8431-06896a36b7f0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:05.259674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:05.263819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2b6e7914-dcf2-4b2e-8431-06896a36b7f0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:05.271123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d424cf4e-576c-49bc-81e8-2ae88fa22d87 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.526941 Jun 16 18:46:05.273241 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1716/3508] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:04 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:05.280017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2b6e7914-dcf2-4b2e-8431-06896a36b7f0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:05.292869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:05.294696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:05.304999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:05.305470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:05.308076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:05.308549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:05.320310 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b6e7914-dcf2-4b2e-8431-06896a36b7f0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.380339 Jun 16 18:46:05.320983 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1793/3509] 10.222.0.27 () {60 vars in 1172 bytes} [Thu Jun 16 18:46:04 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:05.332931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-572023f8-9294-48e7-b16f-b0d1194dcef0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866e1783a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:05.448262 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-572023f8-9294-48e7-b16f-b0d1194dcef0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 200 len: 344 microversion: 2.1 time: 0.126042 Jun 16 18:46:05.449768 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1794/3510] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:05 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:05.457842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:05.458668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:05.466750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:05.467209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:05.467996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:05.469620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:05.652782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:05.669522 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4ed1a61d-1b32-4d56-8e23-f0cdb3b4c47d tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1276 microversion: 2.1 time: 0.215676 Jun 16 18:46:05.670530 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1795/3511] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:05 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:05.682805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1fe35661-2a05-42b4-a896-cfff6a5d6d79 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Action: 'create', calling method: .version_select at 0x7f866de65b80>, body: {"server_group": {"name": "tempest-server-group-1949759832", "policies": ["affinity"]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:05.729897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1fe35661-2a05-42b4-a896-cfff6a5d6d79 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:05.750477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1fe35661-2a05-42b4-a896-cfff6a5d6d79 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:05.913465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:05.927683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:05.931095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:05.935636 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f32b0868-eec7-4f05-9fd1-92972e69db29 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.661014 Jun 16 18:46:05.936432 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1717/3512] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:05 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:05.939297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1fe35661-2a05-42b4-a896-cfff6a5d6d79 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:05.959286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1fe35661-2a05-42b4-a896-cfff6a5d6d79 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:05.960257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:05.960887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:05.978375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:05.980319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1fe35661-2a05-42b4-a896-cfff6a5d6d79 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.301466 Jun 16 18:46:05.981169 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1796/3513] 10.222.0.27 () {60 vars in 1172 bytes} [Thu Jun 16 18:46:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:05.985860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:05.987313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:05.987780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:05.993836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-797abe2d-40eb-463d-9ec1-d93d26ec08e4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:06.042681 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-797abe2d-40eb-463d-9ec1-d93d26ec08e4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/11e30ea6-58cf-452d-9ae2-09c7ec33ebc4" status: 204 len: 0 microversion: 2.1 time: 0.052668 Jun 16 18:46:06.049421 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1797/3514] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:05 2022] DELETE /compute/v2.1/os-server-groups/11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:06.056350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0eea6cad-af9d-4cd6-bc27-8946afc1be25 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:06.074474 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0eea6cad-af9d-4cd6-bc27-8946afc1be25 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.023120 Jun 16 18:46:06.081276 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1798/3515] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:46:06 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:06.089078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d0763e03-9d9f-4f62-889f-82641354e18b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:06.168774 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d0763e03-9d9f-4f62-889f-82641354e18b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ea9a500b-63a0-4137-849a-66eebeb5a189" status: 204 len: 0 microversion: 2.1 time: 0.084404 Jun 16 18:46:06.169949 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1799/3516] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:06 2022] DELETE /compute/v2.1/os-server-groups/ea9a500b-63a0-4137-849a-66eebeb5a189 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:06.191596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ade3314-1542-4020-8269-262ffe54b20e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:06.206878 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ade3314-1542-4020-8269-262ffe54b20e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.026458 Jun 16 18:46:06.213976 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1800/3517] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:46:06 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:06.230144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bd021ed1-4a92-4398-8cc2-1966f000d7c2 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Action: 'create', calling method: .version_select at 0x7f866eb9cca0>, body: {"server_group": {"name": "tempest-server-group-1496980274", "policies": ["affinity"]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:06.267250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-bd021ed1-4a92-4398-8cc2-1966f000d7c2 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:06.286338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-bd021ed1-4a92-4398-8cc2-1966f000d7c2 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:06.300462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:06.312865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:06.317023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5860cdc086504e048f6bdd84aa420a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bd58029bf84b1e841db019919f9c78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:06.322273 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bb1dc484-0eb8-485f-8f8e-d4157752c00c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 200 len: 1557 microversion: 2.21 time: 0.367978 Jun 16 18:46:06.323602 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1718/3518] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:05 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 1557 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:06.331858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:06.332477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:06.373670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:06.375693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:06.382027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:06.383024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:06.419106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-bd021ed1-4a92-4398-8cc2-1966f000d7c2 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:06.437461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-bd021ed1-4a92-4398-8cc2-1966f000d7c2 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:06.444084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:06.492918 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bd021ed1-4a92-4398-8cc2-1966f000d7c2 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.277076 Jun 16 18:46:06.493499 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1801/3519] 10.222.0.27 () {60 vars in 1172 bytes} [Thu Jun 16 18:46:06 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:06.533060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f644cc1f-6803-469b-b61c-11c56c392711 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866dea9b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:06.662118 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f644cc1f-6803-469b-b61c-11c56c392711 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 200 len: 345 microversion: 2.1 time: 0.151806 Jun 16 18:46:06.662980 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1802/3520] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:06 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:06.669115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef3c13f7-1e9c-4b79-8025-5d14bf197e39 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:06.772513 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef3c13f7-1e9c-4b79-8025-5d14bf197e39 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec" status: 204 len: 0 microversion: 2.1 time: 0.107758 Jun 16 18:46:06.781765 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1803/3521] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:06 2022] DELETE /compute/v2.1/os-server-groups/dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:06.806928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-98ea57e4-ae87-4686-b195-60b06b94f2d6 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Action: 'create', calling method: .version_select at 0x7f866e178160>, body: {"snapshot": {"volume_id": "264c1f80-02e7-40fe-baac-162a19aa62d3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-270354036"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:07.089201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:07.113029 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4291d62e-0833-4830-aac8-90c02e8fe503 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1500 microversion: 2.1 time: 0.787433 Jun 16 18:46:07.132710 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1719/3522] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:06 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1500 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:07.139419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:07.146443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:07.166799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.180320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.182138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.182138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.478902 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-98ea57e4-ae87-4686-b195-60b06b94f2d6 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.694875 Jun 16 18:46:07.486508 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1804/3523] 10.222.0.27 () {60 vars in 1161 bytes} [Thu Jun 16 18:46:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:07.491739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890c78cb-8ed8-42c6-b04a-00de6a946dac tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:07.514295 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-890c78cb-8ed8-42c6-b04a-00de6a946dac tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025676 Jun 16 18:46:07.521829 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1805/3524] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:46:07 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:07.537410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:07.539111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:07.551438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.554872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.558484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.558949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.833146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:07.849656 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ef1f8daf-0706-44c7-bf82-795efbf0d6ea tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 0.714969 Jun 16 18:46:07.853741 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1720/3525] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:07 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:07.868434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6bb7a5e5-7798-4eab-a7ea-df2ba076d93a req-898ec099-1968-485b-af39-4aa38483fd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922a0d69-95d2-4f22-806a-a0f16a344362", "name": "network-vif-deleted", "tag": "309ad808-0b63-460f-a3ae-6c106ebda8a5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:07.893469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6bb7a5e5-7798-4eab-a7ea-df2ba076d93a req-898ec099-1968-485b-af39-4aa38483fd5a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.896010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6bb7a5e5-7798-4eab-a7ea-df2ba076d93a req-898ec099-1968-485b-af39-4aa38483fd5a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.955170 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6bb7a5e5-7798-4eab-a7ea-df2ba076d93a req-898ec099-1968-485b-af39-4aa38483fd5a service nova] Creating event network-vif-deleted:309ad808-0b63-460f-a3ae-6c106ebda8a5 for instance 922a0d69-95d2-4f22-806a-a0f16a344362 on n-h1-846209-2 Jun 16 18:46:07.974584 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6bb7a5e5-7798-4eab-a7ea-df2ba076d93a req-898ec099-1968-485b-af39-4aa38483fd5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117761 Jun 16 18:46:07.985750 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1721/3526] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:07.991997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "512a9520-e16d-4ce9-95ed-82dfe5ee9e1a"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:08.005734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:08.033353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.040868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.043829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.057502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.126218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:08.139362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:08.139915 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Cannot 'attach_volume' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state rescued Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/os-volume_attachments HTTP/1.1 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 74 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: {"volumeAttachment": {"volumeId": "512a9520-e16d-4ce9-95ed-82dfe5ee9e1a"}} Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: exception: Cannot 'attach_volume' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state rescued Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': '253e4a8a-f499-447c-a0ec-2cf88b67abad', 'body': {'volumeAttachment': {'volumeId': '512a9520-e16d-4ce9-95ed-82dfe5ee9e1a'}}} Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 18:46:08.151587 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state rescued Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state rescued Jun 16 18:46:08.157361 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.158573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:08.159605 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-56aa5d3f-7a10-473f-a248-b8de3bf47f74 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.635425 Jun 16 18:46:08.159751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 409 to user: Cannot 'attach_volume' instance 253e4a8a-f499-447c-a0ec-2cf88b67abad while it is in vm_state rescued {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:08.160813 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f93e113b-8189-4890-8324-ec0827229be4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.173580 Jun 16 18:46:08.161675 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1806/3527] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:07 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:08.162174 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1722/3528] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:46:07 2022] POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/os-volume_attachments => generated 152 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:46:08.173382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc0114b5-c42e-4f9a-b629-686e5dd61b45 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866de7d280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:08.184711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:08.185351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:08.209170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:08.233245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.236175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.243069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.245092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.284940 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] HTTP exception thrown: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Request method failure captured: Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 HTTP/1.1 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pVVteKOpulb7MlSB1hsWvm2hAbPdop_jzUh76vCD58vbDHzqicx6udHflpuIRCv1gomnrO9IPuli5HBaCZe7fFaT0T5O2z3T7L_9Sd3nxghRbRa1DadsZSxIic2n3mABoNmNe4EWyFUJ4glBK6AUG4r1KP80yI5_gOfKeoGaAh1qo Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.21 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 41bd58029bf84b1e841db019919f9c78 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41bd58029bf84b1e841db019919f9c78", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 41bd58029bf84b1e841db019919f9c78 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-InstanceActionsV221TestJSON-268903788-project Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 5860cdc086504e048f6bdd84aa420a89 Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-InstanceActionsV221TestJSON-268903788-project Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '922a0d69-95d2-4f22-806a-a0f16a344362'} Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.295583 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:08.300502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:08.303502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Returning 404 to user: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:08.309287 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-415b1589-508f-43b3-9750-cfc61e0c45da tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 404 len: 111 microversion: 2.21 time: 0.144297 Jun 16 18:46:08.315326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1807/3529] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:08 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:46:08.346345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8e163c49-50fa-44fe-9c69-bc5042afffdf tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Action: 'create', calling method: .version_select at 0x7f866de9e0d0>, body: {"server_group": {"name": "tempest-server-group-34581406", "policies": ["anti-affinity"]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:08.369373 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dc0114b5-c42e-4f9a-b629-686e5dd61b45 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b" status: 200 len: 286 microversion: 2.1 time: 0.205811 Jun 16 18:46:08.370528 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1723/3530] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:46:08 2022] GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b => generated 286 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:08.376221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3d834c7c-02b1-4bb8-988d-91365a5831ee req-6c22532b-2685-4ede-8914-e8d3d0baaf76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20f110f-2d96-4548-a622-84b1c4ceda64", "tag": "cc05cc16-6566-4443-9482-9d93e9371137"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:08.396026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3d834c7c-02b1-4bb8-988d-91365a5831ee req-6c22532b-2685-4ede-8914-e8d3d0baaf76 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.398136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3d834c7c-02b1-4bb8-988d-91365a5831ee req-6c22532b-2685-4ede-8914-e8d3d0baaf76 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.428769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3d834c7c-02b1-4bb8-988d-91365a5831ee req-6c22532b-2685-4ede-8914-e8d3d0baaf76 service nova] Creating event network-changed:cc05cc16-6566-4443-9482-9d93e9371137 for instance a20f110f-2d96-4548-a622-84b1c4ceda64 on n-h2-846209-2 Jun 16 18:46:08.436251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8e163c49-50fa-44fe-9c69-bc5042afffdf tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:08.442081 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3d834c7c-02b1-4bb8-988d-91365a5831ee req-6c22532b-2685-4ede-8914-e8d3d0baaf76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070058 Jun 16 18:46:08.442709 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1724/3531] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:08.459634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8e163c49-50fa-44fe-9c69-bc5042afffdf tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:08.463765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cbf1e54b-7886-4e34-9685-252a9beb3411 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:08.464484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cbf1e54b-7886-4e34-9685-252a9beb3411 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:08.489925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbf1e54b-7886-4e34-9685-252a9beb3411 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.502931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbf1e54b-7886-4e34-9685-252a9beb3411 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.503808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbf1e54b-7886-4e34-9685-252a9beb3411 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.504258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbf1e54b-7886-4e34-9685-252a9beb3411 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.691698 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cbf1e54b-7886-4e34-9685-252a9beb3411 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action" status: 202 len: 0 microversion: 2.1 time: 0.244514 Jun 16 18:46:08.705282 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1725/3532] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:46:08 2022] POST /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:46:08.724709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8e163c49-50fa-44fe-9c69-bc5042afffdf tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:08.726552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dba55c6e-05b1-4fb6-9683-15f91252f32c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '.version_select at 0x7f866deba280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:08.730794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dba55c6e-05b1-4fb6-9683-15f91252f32c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:08.744243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba55c6e-05b1-4fb6-9683-15f91252f32c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.745392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba55c6e-05b1-4fb6-9683-15f91252f32c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.748132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba55c6e-05b1-4fb6-9683-15f91252f32c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.748868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba55c6e-05b1-4fb6-9683-15f91252f32c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.764020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8e163c49-50fa-44fe-9c69-bc5042afffdf tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_groups'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:08.857824 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8e163c49-50fa-44fe-9c69-bc5042afffdf tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.534866 Jun 16 18:46:08.860733 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dba55c6e-05b1-4fb6-9683-15f91252f32c tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.153779 Jun 16 18:46:08.874561 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1726/3533] 10.222.0.27 () {60 vars in 1336 bytes} [Thu Jun 16 18:46:08 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362/os-instance-actions => generated 611 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:46:08.874561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f4f238c-2994-4293-89b0-ca6b8b38c91e tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866f579dc0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:08.875215 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1808/3534] 10.222.0.27 () {60 vars in 1172 bytes} [Thu Jun 16 18:46:08 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:08.922887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:08.923588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:08.945280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.945878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.959826 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f4f238c-2994-4293-89b0-ca6b8b38c91e tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096627 Jun 16 18:46:08.960809 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1727/3535] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jun 16 18:46:08 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:08.968906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:08.971567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:08.972035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.975359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:09.010786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:09.014189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:09.015363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:09.017153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:09.375165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:10.158312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:10.175470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:10.185786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81776891-b3eb-40b3-a730-25b4a95dd365 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1508 microversion: 2.1 time: 1.286212 Jun 16 18:46:10.201431 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1809/3536] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:08 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1508 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:10.202301 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b95ed49f-2438-44ea-b720-8b8f995c995a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 1.239581 Jun 16 18:46:10.208751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c972f26d-d3b1-4d4b-95d5-9b1eb17b9e34 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:10.216985 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1728/3537] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:08 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:10.230762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:10.231550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:10.248395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:10.253657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.258102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.259617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.260247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.279387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c972f26d-d3b1-4d4b-95d5-9b1eb17b9e34 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b9be92e5-04ab-43b9-b295-d63cfc8858bb" status: 204 len: 0 microversion: 2.1 time: 0.076546 Jun 16 18:46:10.280817 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1810/3538] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:10 2022] DELETE /compute/v2.1/os-server-groups/b9be92e5-04ab-43b9-b295-d63cfc8858bb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:10.292811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46fff6ed-911a-4578-ade9-40080ba70522 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866de9e550>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:10.295794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] HTTP exception thrown: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Request method failure captured: Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 HTTP/1.1 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3pVVteKOpulb7MlSB1hsWvm2hAbPdop_jzUh76vCD58vbDHzqicx6udHflpuIRCv1gomnrO9IPuli5HBaCZe7fFaT0T5O2z3T7L_9Sd3nxghRbRa1DadsZSxIic2n3mABoNmNe4EWyFUJ4glBK6AUG4r1KP80yI5_gOfKeoGaAh1qo Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.21 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 41bd58029bf84b1e841db019919f9c78 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41bd58029bf84b1e841db019919f9c78", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 41bd58029bf84b1e841db019919f9c78 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-InstanceActionsV221TestJSON-268903788-project Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 5860cdc086504e048f6bdd84aa420a89 Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-InstanceActionsV221TestJSON-268903788-project Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '922a0d69-95d2-4f22-806a-a0f16a344362'} Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:10.305750 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.310872 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.314618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Returning 404 to user: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:10.315801 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0dca66d9-eacb-43e1-9f66-10ed48930155 tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "DELETE /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 404 len: 111 microversion: 2.21 time: 0.097486 Jun 16 18:46:10.316867 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1729/3539] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:46:10 2022] DELETE /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:46:10.346492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:10.347582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:10.367408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.368319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.369456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.370242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.414364 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46fff6ed-911a-4578-ade9-40080ba70522 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b" status: 200 len: 286 microversion: 2.1 time: 0.131736 Jun 16 18:46:10.415975 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1811/3540] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:46:10 2022] GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b => generated 286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:10.420908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6758b70-992d-4f0b-beec-109cc106fa7f tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:10.456200 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6758b70-992d-4f0b-beec-109cc106fa7f tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.039072 Jun 16 18:46:10.466515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1812/3541] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:46:10 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:10.489631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:10.490334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] [instance: 922a0d69-95d2-4f22-806a-a0f16a344362] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:10.517902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.523560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.524906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.525390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.580887 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] HTTP exception thrown: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Request method failure captured: Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 HTTP/1.1 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pVVteKOpulb7MlSB1hsWvm2hAbPdop_jzUh76vCD58vbDHzqicx6udHflpuIRCv1gomnrO9IPuli5HBaCZe7fFaT0T5O2z3T7L_9Sd3nxghRbRa1DadsZSxIic2n3mABoNmNe4EWyFUJ4glBK6AUG4r1KP80yI5_gOfKeoGaAh1qo Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.21 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 41bd58029bf84b1e841db019919f9c78 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41bd58029bf84b1e841db019919f9c78", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41bd58029bf84b1e841db019919f9c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 41bd58029bf84b1e841db019919f9c78 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-268903788 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-InstanceActionsV221TestJSON-268903788-project Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 5860cdc086504e048f6bdd84aa420a89 Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-InstanceActionsV221TestJSON-268903788-project Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '922a0d69-95d2-4f22-806a-a0f16a344362'} Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.594475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:10.599701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] Returning 404 to user: Instance 922a0d69-95d2-4f22-806a-a0f16a344362 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:10.601454 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-39b8eb0a-4771-4094-b6a5-76374e1cf87b tempest-InstanceActionsV221TestJSON-268903788 tempest-InstanceActionsV221TestJSON-268903788-project] 10.222.0.27 "GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362" status: 404 len: 111 microversion: 2.21 time: 0.133724 Jun 16 18:46:10.606722 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1813/3542] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:10 2022] GET /compute/v2.1/servers/922a0d69-95d2-4f22-806a-a0f16a344362 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:46:10.616215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-53af661a-7a98-42a8-a1eb-3146a0affa55 req-21785d4a-251b-4108-a459-992c02b7b6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60fe531-bb99-4b2f-9d97-e7d46455fd6c", "tag": "26bcc148-51d6-41e8-a63e-78386bc5b193"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:10.635386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-53af661a-7a98-42a8-a1eb-3146a0affa55 req-21785d4a-251b-4108-a459-992c02b7b6c5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.639215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-53af661a-7a98-42a8-a1eb-3146a0affa55 req-21785d4a-251b-4108-a459-992c02b7b6c5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.663906 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-53af661a-7a98-42a8-a1eb-3146a0affa55 req-21785d4a-251b-4108-a459-992c02b7b6c5 service nova] Creating event network-changed:26bcc148-51d6-41e8-a63e-78386bc5b193 for instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c on n-h2-846209-2 Jun 16 18:46:10.677254 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-53af661a-7a98-42a8-a1eb-3146a0affa55 req-21785d4a-251b-4108-a459-992c02b7b6c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073345 Jun 16 18:46:10.678593 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1814/3543] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:10.686707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1293440086", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "26e50f3a-63b4-4172-8b94-a847b8da0517"}]}, "os:scheduler_hints": {"group": "64704c54-d31c-454d-889f-f67d3db7647d"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:10.836756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] validate_networks() for [('26e50f3a-63b4-4172-8b94-a847b8da0517', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:46:10.939011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:10.955051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:10.969221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:10.971060 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d34ac097-32ba-4350-8122-5b2034c94285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.652815 Jun 16 18:46:10.972403 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1730/3544] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:10 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:11.235469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:11.236157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:11.281964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:11.291533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:11.297454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:11.302406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:12.654717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:12.681963 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b824adce-0528-464c-91ae-09bc8c0f1fc2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1508 microversion: 2.1 time: 1.476966 Jun 16 18:46:12.682831 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1731/3545] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:11 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1508 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:12.695830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:12.698575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:12.751318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:12.751933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:12.752832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:12.753371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:13.250277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:46:13.250986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:46:13.251662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:46:13.252292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:46:13.252894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:46:13.284969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:13.286035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:13.300714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:13.303339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:13.330371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:13.337640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:13.362306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:13.380511 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-220130a9-c1ad-4bb9-82b8-af2d0f4150aa tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 0.694160 Jun 16 18:46:13.382878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:46:13.395586 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1732/3546] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:12 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:13.402186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:46:13.421754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54009243-b62f-47aa-99ad-e644f9c8a4a7 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866ddbc040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:13.494384 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-54009243-b62f-47aa-99ad-e644f9c8a4a7 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b" status: 200 len: 287 microversion: 2.1 time: 0.097214 Jun 16 18:46:13.495159 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1733/3547] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:46:13 2022] GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:13.501648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:13.503440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:13.511996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:13.513422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:13.514594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:13.515778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:13.532150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:13.548846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:13.615230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:13.628088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Getting quotas for user c5ff206b8a2c4e3ea6fd96f4dcd4478c and project 3abc0d0ecb5e4f12b8be9a1c0c18e682. Resources: {'server_group_members'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:13.642540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:13.689616 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a47b78c-2900-4b80-9c18-b2769e014c01 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.008154 Jun 16 18:46:13.693221 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1815/3548] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:46:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:46:13.708908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1518478e-66e6-447b-a85f-acc5fc1273df tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866de5eee0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:13.824996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:13.845840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:13.847913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:13.851779 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a4a069fa-6791-41ea-8d74-7f35506667dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.353850 Jun 16 18:46:13.853599 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1734/3549] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:13 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:13.859468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f922baca-dab6-46a2-9638-70b94155688a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:13.860351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f922baca-dab6-46a2-9638-70b94155688a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:13.866539 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1518478e-66e6-447b-a85f-acc5fc1273df tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b" status: 202 len: 0 microversion: 2.1 time: 0.167351 Jun 16 18:46:13.867126 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1816/3550] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jun 16 18:46:13 2022] DELETE /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:46:13.877556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:13.878973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:13.890862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:13.891662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:13.892678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:13.893307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:14.006077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f922baca-dab6-46a2-9638-70b94155688a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:14.013611 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f922baca-dab6-46a2-9638-70b94155688a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1213 microversion: 2.1 time: 0.158711 Jun 16 18:46:14.020852 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1735/3551] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:13 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:14.036295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4345764-7467-487e-a52d-663177278ab0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866ddbb430>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:14.127191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4345764-7467-487e-a52d-663177278ab0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b" status: 200 len: 286 microversion: 2.1 time: 0.104844 Jun 16 18:46:14.128220 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1736/3552] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:46:14 2022] GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:14.312434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:14.324555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-acf57516-6e0f-4a32-8b37-f94b95d06721 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1514 microversion: 2.1 time: 0.453102 Jun 16 18:46:14.326563 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1817/3553] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:13 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:14.401095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:14.402110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:14.420505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:14.422879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:14.425533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:14.428053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:14.823686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5bb3a940-ef98-4eac-86a7-43c81e750dd6 req-33817116-0077-4d35-a89f-210dc95ccb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20f110f-2d96-4548-a622-84b1c4ceda64", "name": "network-vif-plugged", "status": "completed", "tag": "cc05cc16-6566-4443-9482-9d93e9371137"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:14.837776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5bb3a940-ef98-4eac-86a7-43c81e750dd6 req-33817116-0077-4d35-a89f-210dc95ccb64 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:14.849877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5bb3a940-ef98-4eac-86a7-43c81e750dd6 req-33817116-0077-4d35-a89f-210dc95ccb64 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:14.886842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:14.894572 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5bb3a940-ef98-4eac-86a7-43c81e750dd6 req-33817116-0077-4d35-a89f-210dc95ccb64 service nova] Creating event network-vif-plugged:cc05cc16-6566-4443-9482-9d93e9371137 for instance a20f110f-2d96-4548-a622-84b1c4ceda64 on n-h2-846209-2 Jun 16 18:46:14.929588 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5bb3a940-ef98-4eac-86a7-43c81e750dd6 req-33817116-0077-4d35-a89f-210dc95ccb64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112562 Jun 16 18:46:14.930586 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1818/3554] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:46:14.954875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:14.955705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:14.979603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:14.980082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:14.980882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:14.981318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:15.709119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:15.732175 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3ddd7f92-a0a0-41a2-8752-d8b7e50992fb tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 1.331515 Jun 16 18:46:15.747866 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1737/3555] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:14 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:15.772187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:15.773057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:15.783372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:15.792707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:15.793336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:15.796129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:15.797622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:15.799634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:15.802165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:15.807960 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f88defcb-5a29-480b-bf1b-a8e623cd27e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.871605 Jun 16 18:46:15.809676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1819/3556] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:14 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:15.819919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f928557e-3135-40f7-bfba-3943ebff59c5 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866de65790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:15.822504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:15.910291 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f928557e-3135-40f7-bfba-3943ebff59c5 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b" status: 200 len: 286 microversion: 2.1 time: 0.099050 Jun 16 18:46:15.915569 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1820/3557] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:46:15 2022] GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:16.104642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:16.116634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52497393-6d77-4b5d-9359-1b0d7cda494e tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1209 microversion: 2.1 time: 0.366963 Jun 16 18:46:16.131113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1738/3558] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:15 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1209 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:16.755130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:16.757342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:16.789943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:16.791369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:16.797185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:16.801423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:16.843719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:16.845610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:16.865900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:16.872018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:16.876317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:16.878540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:17.902192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:17.913180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:17.933457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:17.937599 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-08686dc7-149e-439e-9c5a-c761ec07f7fa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 1.099172 Jun 16 18:46:17.946414 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1739/3559] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:16 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:46:17.955155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c18f64a5-7ec9-469d-90c4-070f52664c2f tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866dd48700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:18.039968 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-c18f64a5-7ec9-469d-90c4-070f52664c2f tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] HTTP exception thrown: Snapshot 69f91b31-d1fc-41b6-9578-c94301ab157b could not be found. Jun 16 18:46:18.060944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c18f64a5-7ec9-469d-90c4-070f52664c2f tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Request method failure captured: Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b HTTP/1.1 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3porAMD99ueYu7Nt_u5Ax2GdfihKSZeTWgXNOTRQ1WAtBCnt47hdEeljeKBsI6YHYJUKV2Meqptfg0TyfEtsq2cT6y9HDM1ELResP-aJyrS75Q3736EfbjPT-NWcumT2fERfRrnS59BJratNf3wNVYM5bu-oJwfzXkMW9dJf8iyUCE Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3cd9caf178374ff3944677858c1ebd3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: aa6fd2652bae447d8339dd84f1e85ca4 Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: exception: Snapshot 69f91b31-d1fc-41b6-9578-c94301ab157b could not be found. Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '69f91b31-d1fc-41b6-9578-c94301ab157b'} Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 69f91b31-d1fc-41b6-9578-c94301ab157b could not be found. (HTTP 404) (Request-ID: req-66a29591-bd0b-4145-8c4d-7ea2c40bbf35) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:46:18.075790 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 69f91b31-d1fc-41b6-9578-c94301ab157b could not be found. Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 69f91b31-d1fc-41b6-9578-c94301ab157b could not be found. Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 69f91b31-d1fc-41b6-9578-c94301ab157b could not be found. Jun 16 18:46:18.082371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:18.087862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c18f64a5-7ec9-469d-90c4-070f52664c2f tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Returning 404 to user: Snapshot 69f91b31-d1fc-41b6-9578-c94301ab157b could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:18.088739 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c18f64a5-7ec9-469d-90c4-070f52664c2f tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b" status: 404 len: 111 microversion: 2.1 time: 0.140640 Jun 16 18:46:18.089686 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1740/3560] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 18:46:17 2022] GET /compute/v2.1/os-snapshots/69f91b31-d1fc-41b6-9578-c94301ab157b => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:18.091841 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-53e44d1b-4f9e-4c4a-94b7-dcca0aed7c11 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 1.329460 Jun 16 18:46:18.092516 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1821/3561] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:16 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:18.105385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:18.106565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:18.129199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:18.129966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:18.130855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9687f41c-b854-4354-9b5c-777a561d6857 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866eba7e50>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:18.132343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:18.135427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:18.297050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:18.301718 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9687f41c-b854-4354-9b5c-777a561d6857 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 202 len: 0 microversion: 2.1 time: 0.193787 Jun 16 18:46:18.302335 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1822/3562] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:46:18 2022] DELETE /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:46:18.310235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6fe21180-7bb2-4167-b938-9b775d18f2e0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866de6c820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:18.311644 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3e4c882c-2bd6-4e65-a676-1a79911b119a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1271 microversion: 2.1 time: 0.220662 Jun 16 18:46:18.318766 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1741/3563] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:18 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:18.421339 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6fe21180-7bb2-4167-b938-9b775d18f2e0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 200 len: 344 microversion: 2.1 time: 0.114670 Jun 16 18:46:18.422826 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1823/3564] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:18 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:46:18.587705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-31d2025d-1cb9-47e9-a5d1-925520a0e025 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdbb560f-358c-4972-b923-22ba4712a262"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:18.589177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-31d2025d-1cb9-47e9-a5d1-925520a0e025 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:18.627512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31d2025d-1cb9-47e9-a5d1-925520a0e025 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:18.634746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31d2025d-1cb9-47e9-a5d1-925520a0e025 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:18.639774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31d2025d-1cb9-47e9-a5d1-925520a0e025 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:18.646900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31d2025d-1cb9-47e9-a5d1-925520a0e025 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:18.964357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:18.965561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:18.999057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:19.006894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:19.008317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:19.009012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:19.287010 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-31d2025d-1cb9-47e9-a5d1-925520a0e025 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "POST /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703123 Jun 16 18:46:19.287887 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1742/3565] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:46:18 2022] POST /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:19.317080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:19.318611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:19.383944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:19.390488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:19.397338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:19.399788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:19.414015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:19.431138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:19.445844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:19.447704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6b07d57-ee1c-4d71-ac53-a2c40cd356f4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.487209 Jun 16 18:46:19.451784 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1824/3566] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:18 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:46:19.462714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:19.476491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:19.508785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:19.509541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:19.511775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:19.512541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:20.222550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:20.247823 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e9c3c84e-a37a-4076-81d5-d6c27635b61a tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 0.958201 Jun 16 18:46:20.251878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:20.252671 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1743/3567] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:19 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:20.260780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-18f9da71-e422-44be-8ea0-b547d90093ab tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1313 microversion: 2.1 time: 0.807000 Jun 16 18:46:20.270207 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1825/3568] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:19 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:20.270207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-73ee50f5-5564-442e-9c27-75eb39d31602 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'create', calling method: .version_select at 0x7f866eba7040>, body: {"keypair": {"name": "tempest-keypair-971878849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP8NHYA2H/ypXa7F8Yz2v6pP2SCuvYyYwLP0A1II5fh8mdUKnY8NvN1VIGELkieBUYTzA9oQtOrpXxoOvbLnyoV4no7Yuqm/HOVNx8u/sXIcFnw6XBw+m8jDnM2njfKWw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:20.287158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-846d49a6-7f01-4b26-a294-babe5d27814f tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866deabf70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:20.308709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-73ee50f5-5564-442e-9c27-75eb39d31602 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for project bce48b6c6c6d441db054c828687ad6a3. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:20.323477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-73ee50f5-5564-442e-9c27-75eb39d31602 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for user ea59542886884867a7db703105cd495e and project bce48b6c6c6d441db054c828687ad6a3. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:20.422481 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-73ee50f5-5564-442e-9c27-75eb39d31602 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156070 Jun 16 18:46:20.424267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1826/3569] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:46:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:20.471292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:20.472161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:20.514882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:20.515424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:20.516803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:20.517262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:20.559373 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-846d49a6-7f01-4b26-a294-babe5d27814f tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 200 len: 344 microversion: 2.1 time: 0.304982 Jun 16 18:46:20.560454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1744/3570] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:20 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 344 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:21.212331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ebdee150-ff1d-472f-9a7e-f611a3165621 req-b2ceb323-b285-4450-a7f0-81dd5b901c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60fe531-bb99-4b2f-9d97-e7d46455fd6c", "name": "network-vif-plugged", "status": "completed", "tag": "26bcc148-51d6-41e8-a63e-78386bc5b193"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:21.257077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ebdee150-ff1d-472f-9a7e-f611a3165621 req-b2ceb323-b285-4450-a7f0-81dd5b901c86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:21.267522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ebdee150-ff1d-472f-9a7e-f611a3165621 req-b2ceb323-b285-4450-a7f0-81dd5b901c86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:21.307888 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ebdee150-ff1d-472f-9a7e-f611a3165621 req-b2ceb323-b285-4450-a7f0-81dd5b901c86 service nova] Creating event network-vif-plugged:26bcc148-51d6-41e8-a63e-78386bc5b193 for instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c on n-h2-846209-2 Jun 16 18:46:21.320966 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ebdee150-ff1d-472f-9a7e-f611a3165621 req-b2ceb323-b285-4450-a7f0-81dd5b901c86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118450 Jun 16 18:46:21.324986 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1745/3571] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:21.340976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:21.357610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:21.383395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:21.384386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:21.385436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:21.387596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:21.439873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:21.449400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:21.451001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:21.468552 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9837cb11-cb54-47fc-9ab7-7c41473e57e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.986046 Jun 16 18:46:21.483721 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1827/3572] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:20 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:46:21.506222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:21.510442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:21.549853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:21.552712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:21.554498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:21.559263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:22.269598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:22.288741 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ece4fd57-fe8f-429c-91a3-c9833ae55929 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 0.952765 Jun 16 18:46:22.291465 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1746/3573] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:21 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:22.324351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-534342e5-0316-4b2a-ba28-fb51b21cbd69 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866dd2e040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:22.333958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:22.351916 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-744cae34-e294-4e14-91b9-b18f121282f6 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1313 microversion: 2.1 time: 0.864527 Jun 16 18:46:22.365105 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1828/3574] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:21 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:22.417459 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-534342e5-0316-4b2a-ba28-fb51b21cbd69 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 200 len: 344 microversion: 2.1 time: 0.112595 Jun 16 18:46:22.418516 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1747/3575] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:22 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 344 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:22.493259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:22.494640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:22.527867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:22.531896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:22.535150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:22.538120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:22.602789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-18c04efc-385c-4c73-b203-2b0e69a776d5 req-eb69ad3c-4496-42eb-842d-b8ddb6aee891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2", "tag": "ef142460-44f6-44a7-a1b3-68f538debf8d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:22.681656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-18c04efc-385c-4c73-b203-2b0e69a776d5 req-eb69ad3c-4496-42eb-842d-b8ddb6aee891 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:22.682686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-18c04efc-385c-4c73-b203-2b0e69a776d5 req-eb69ad3c-4496-42eb-842d-b8ddb6aee891 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:22.721361 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-18c04efc-385c-4c73-b203-2b0e69a776d5 req-eb69ad3c-4496-42eb-842d-b8ddb6aee891 service nova] Creating event network-changed:ef142460-44f6-44a7-a1b3-68f538debf8d for instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 on n-h1-846209-2 Jun 16 18:46:22.735125 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-18c04efc-385c-4c73-b203-2b0e69a776d5 req-eb69ad3c-4496-42eb-842d-b8ddb6aee891 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137602 Jun 16 18:46:22.736168 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1748/3576] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:23.012442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:23.029278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:23.031412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:23.032660 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d9a7b041-62d3-4ba0-921a-b57cb0064275 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.547002 Jun 16 18:46:23.071855 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1829/3577] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:22 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:23.310240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:23.312073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:23.341050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:23.345252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:23.347144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:23.351253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:23.371239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:23.372190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:23.378121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:23.396070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:23.398065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:23.401624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:23.404285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:24.011466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:24.503913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:24.521051 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3faef287-f7e0-4339-933d-adf95d6d2f86 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1313 microversion: 2.1 time: 1.154814 Jun 16 18:46:24.525753 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1830/3578] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:23 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1313 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:46:24.531406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-711b6419-bec5-4676-a123-e0eb44d1a2c0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866dea9670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:24.596064 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-711b6419-bec5-4676-a123-e0eb44d1a2c0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] HTTP exception thrown: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-711b6419-bec5-4676-a123-e0eb44d1a2c0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Request method failure captured: Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 HTTP/1.1 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3porAMD99ueYu7Nt_u5Ax2GdfihKSZeTWgXNOTRQ1WAtBCnt47hdEeljeKBsI6YHYJUKV2Meqptfg0TyfEtsq2cT6y9HDM1ELResP-aJyrS75Q3736EfbjPT-NWcumT2fERfRrnS59BJratNf3wNVYM5bu-oJwfzXkMW9dJf8iyUCE Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3cd9caf178374ff3944677858c1ebd3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: aa6fd2652bae447d8339dd84f1e85ca4 Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: exception: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '264c1f80-02e7-40fe-baac-162a19aa62d3'} Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. (HTTP 404) (Request-ID: req-d8f0e8b6-349a-47cb-abfb-70e481b96074) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:46:24.601460 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.607580 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.618755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-711b6419-bec5-4676-a123-e0eb44d1a2c0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Returning 404 to user: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:24.618755 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-711b6419-bec5-4676-a123-e0eb44d1a2c0 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 404 len: 109 microversion: 2.1 time: 0.086114 Jun 16 18:46:24.618755 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1831/3579] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:24 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:24.630892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:24.633058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:24.644137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:24.645185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:24.646353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:24.648420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:24.684320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:24.695223 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c5ef082-1a0d-4feb-9241-077d68b1e795 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1318 microversion: 2.1 time: 1.389599 Jun 16 18:46:24.698004 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1749/3580] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:23 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1318 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:24.712835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2aa11182-ed7f-41ae-bee2-8c6c544ebcf9 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866dd2e4c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:24.860350 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-2aa11182-ed7f-41ae-bee2-8c6c544ebcf9 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] HTTP exception thrown: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2aa11182-ed7f-41ae-bee2-8c6c544ebcf9 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Request method failure captured: Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 HTTP/1.1 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3porAMD99ueYu7Nt_u5Ax2GdfihKSZeTWgXNOTRQ1WAtBCnt47hdEeljeKBsI6YHYJUKV2Meqptfg0TyfEtsq2cT6y9HDM1ELResP-aJyrS75Q3736EfbjPT-NWcumT2fERfRrnS59BJratNf3wNVYM5bu-oJwfzXkMW9dJf8iyUCE Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3cd9caf178374ff3944677858c1ebd3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: aa6fd2652bae447d8339dd84f1e85ca4 Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: exception: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '264c1f80-02e7-40fe-baac-162a19aa62d3'} Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. (HTTP 404) (Request-ID: req-2388e245-5190-48b8-b884-2a8e9c11c59e) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:46:24.865420 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.871495 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.885159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2aa11182-ed7f-41ae-bee2-8c6c544ebcf9 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Returning 404 to user: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:24.891335 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2aa11182-ed7f-41ae-bee2-8c6c544ebcf9 tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 404 len: 109 microversion: 2.1 time: 0.191767 Jun 16 18:46:24.898351 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1750/3581] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:46:24 2022] DELETE /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 109 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:24.923999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fca44be9-650b-44b2-9489-e3da726997bf tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Calling method '.version_select at 0x7f866dd481f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:24.994451 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-fca44be9-650b-44b2-9489-e3da726997bf tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] HTTP exception thrown: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fca44be9-650b-44b2-9489-e3da726997bf tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Request method failure captured: Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 HTTP/1.1 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3porAMD99ueYu7Nt_u5Ax2GdfihKSZeTWgXNOTRQ1WAtBCnt47hdEeljeKBsI6YHYJUKV2Meqptfg0TyfEtsq2cT6y9HDM1ELResP-aJyrS75Q3736EfbjPT-NWcumT2fERfRrnS59BJratNf3wNVYM5bu-oJwfzXkMW9dJf8iyUCE Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3cd9caf178374ff3944677858c1ebd3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3cd9caf178374ff3944677858c1ebd3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 3cd9caf178374ff3944677858c1ebd3e Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305388515 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: aa6fd2652bae447d8339dd84f1e85ca4 Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305388515-project Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: exception: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '264c1f80-02e7-40fe-baac-162a19aa62d3'} Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. (HTTP 404) (Request-ID: req-9c870654-00f1-443e-bcde-11c7d20ee695) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:46:24.996438 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fca44be9-650b-44b2-9489-e3da726997bf tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] Returning 404 to user: Volume 264c1f80-02e7-40fe-baac-162a19aa62d3 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fca44be9-650b-44b2-9489-e3da726997bf tempest-VolumesSnapshotsTestJSON-305388515 tempest-VolumesSnapshotsTestJSON-305388515-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3" status: 404 len: 109 microversion: 2.1 time: 0.097898 Jun 16 18:46:25.004384 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1751/3582] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:46:24 2022] GET /compute/v2.1/os-volumes/264c1f80-02e7-40fe-baac-162a19aa62d3 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:25.111967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:25.128052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:25.130435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:25.133156 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fa8668aa-1ccf-4b05-8774-ea7c20cf6e53 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.512686 Jun 16 18:46:25.134430 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1832/3583] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:24 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:25.542663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:25.543136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:25.564400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:25.565022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:25.566509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:25.569432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:25.714970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:25.716357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:25.741818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:25.746303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:25.754315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:25.755129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:26.779073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:26.788072 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-563d911f-90ee-4e57-8ecb-d66f8b1122de tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1313 microversion: 2.1 time: 1.249432 Jun 16 18:46:26.788692 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1752/3584] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:25 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1313 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:26.805008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:26.805868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:26.841620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:26.845923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:26.846408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:26.847259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:26.847706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:26.860800 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e673ae1f-eb83-48cf-809b-0f2107379d93 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 200 len: 1505 microversion: 2.1 time: 1.151664 Jun 16 18:46:26.861676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1833/3585] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:25 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 1505 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:46:26.893664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1913277840", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5bae4cd-c89e-4d76-ac0b-eedd098439e4"}], "security_groups": [{"name": "tempest-securitygroup--1348020115"}], "key_name": "tempest-keypair-971878849", "user_data": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:27.492456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] validate_networks() for [('b5bae4cd-c89e-4d76-ac0b-eedd098439e4', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:46:28.072323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:28.081893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:28.082934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:28.085280 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b15fe5fd-5962-4462-9518-dec5ad787702 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 1.294565 Jun 16 18:46:28.099506 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1753/3586] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:26 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:28.111745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:28.118029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:28.128012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:28.133953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:28.135074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:28.135794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:28.858557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:28.872017 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26f601ee-bd7d-4378-ace5-6e2f50af294f tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64" status: 200 len: 1506 microversion: 2.1 time: 0.768436 Jun 16 18:46:28.878736 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1754/3587] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:28 2022] GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:28.888516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:28.892151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:28.904667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:28.907074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:28.910838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:28.911541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.193976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:29.211221 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f358b82b-3044-40a9-b28a-5be3d2e492b1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1313 microversion: 2.1 time: 0.330942 Jun 16 18:46:29.212267 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1755/3588] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:28 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:29.212744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:46:29.213465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:46:29.213994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:46:29.214422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:46:29.214844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:46:29.225275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:29.228261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:29.235589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.236229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.237525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.238689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.242192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=59 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:29.271034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.271508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.272349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.273237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.303367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:46:29.350170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for project bce48b6c6c6d441db054c828687ad6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:29.379231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Getting quotas for user ea59542886884867a7db703105cd495e and project bce48b6c6c6d441db054c828687ad6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:29.425697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:46:29.429800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:46:29.521764 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-549fd457-9a5f-42ae-9369-50ddd03e7754 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64" status: 204 len: 0 microversion: 2.1 time: 0.304723 Jun 16 18:46:29.527287 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1756/3589] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:46:29 2022] DELETE /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:29.542397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:29.544863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:29.559679 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c688c0d-d3a7-4259-8c2c-9498615af2a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.688203 Jun 16 18:46:29.561104 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1834/3590] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:46:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 2690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:46:29.561455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.567689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:29.567918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.569854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.570345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.573005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:29.594778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.595514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.600231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:29.600919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:29.680238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:46:29.914402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-012899cf-b0eb-45a3-810a-9b9f50c5d674 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 204 len: 0 microversion: 2.1 time: 0.351311 Jun 16 18:46:29.921872 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1835/3591] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:46:29 2022] DELETE /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:29.931659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2fb06f7-839e-4c2c-848b-0460e57c2d29 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:29.932969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2fb06f7-839e-4c2c-848b-0460e57c2d29 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:30.026805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:30.041730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:30.049281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:30.050667 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a63278da-ddad-4480-abe5-e564138a81b5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.521112 Jun 16 18:46:30.055725 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1757/3592] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:29 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:30.070158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:30.071058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:30.085623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2fb06f7-839e-4c2c-848b-0460e57c2d29 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:30.113705 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2fb06f7-839e-4c2c-848b-0460e57c2d29 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1245 microversion: 2.1 time: 0.190063 Jun 16 18:46:30.114279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:30.115045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:30.117289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:30.117723 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1836/3593] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:29 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1245 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:30.119633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:30.123674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:30.128814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5ef0f519-bcab-4d0b-b609-5bc9ece781d9 req-86d5762a-b5b5-4b52-a076-263622f7de7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2", "name": "network-vif-plugged", "status": "completed", "tag": "ef142460-44f6-44a7-a1b3-68f538debf8d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:30.151857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5ef0f519-bcab-4d0b-b609-5bc9ece781d9 req-86d5762a-b5b5-4b52-a076-263622f7de7f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:30.156159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5ef0f519-bcab-4d0b-b609-5bc9ece781d9 req-86d5762a-b5b5-4b52-a076-263622f7de7f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:30.179516 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5ef0f519-bcab-4d0b-b609-5bc9ece781d9 req-86d5762a-b5b5-4b52-a076-263622f7de7f service nova] Creating event network-vif-plugged:ef142460-44f6-44a7-a1b3-68f538debf8d for instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 on n-h1-846209-2 Jun 16 18:46:30.189184 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5ef0f519-bcab-4d0b-b609-5bc9ece781d9 req-86d5762a-b5b5-4b52-a076-263622f7de7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070005 Jun 16 18:46:30.193204 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1837/3594] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:30.231436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:30.232221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:30.257396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:30.262862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:30.264796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:30.269315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:31.033313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:31.043126 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eefe17b8-0b1b-4f81-9d0a-ba1494bff25b tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1313 microversion: 2.1 time: 0.816594 Jun 16 18:46:31.043721 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1838/3595] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:30 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1313 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:31.071068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:31.080826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:31.086068 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2a8cb8c1-df11-44af-991f-40fd5148add8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64" status: 200 len: 1512 microversion: 2.1 time: 1.026895 Jun 16 18:46:31.086886 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1758/3596] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:30 2022] GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 => generated 1512 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:31.094603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:31.133816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:31.134687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:31.145011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:31.150156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:31.161309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:31.162215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:31.170516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:31.172351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:31.173943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:31.174574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:31.327831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:31.336356 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-651508e8-eaa6-4fc4-80e9-2804b27de32f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1297 microversion: 2.1 time: 0.207555 Jun 16 18:46:31.353312 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1759/3597] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:31 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1297 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:46:31.822939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:31.841686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:31.849028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:31.850732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ac2c062-5e1d-4f20-ba5d-002ae399486d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.774536 Jun 16 18:46:31.855020 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1839/3598] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:31 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:32.061189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:32.062625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:32.079018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:32.080531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:32.082148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:32.082887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:32.103910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:32.104657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:32.126145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:32.126609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:32.129799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:32.131365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:32.882286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:32.910179 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e90436ca-9bfe-44ea-8604-e3b79322b554 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64" status: 200 len: 1512 microversion: 2.1 time: 0.805806 Jun 16 18:46:32.912484 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1840/3599] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:32 2022] GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 => generated 1512 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:32.931418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:32.936130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:32.971299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:32.976232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:32.977468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:32.980556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:32.995660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:33.027949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:33.070338 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f9b92d0b-8b46-425f-b783-744e944f3f69 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1313 microversion: 2.1 time: 1.007445 Jun 16 18:46:33.075207 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1760/3600] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:32 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1313 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:33.096096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:33.100909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:33.141145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:33.142312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:33.149474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:33.151753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:33.424124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:33.440841 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4248300-ab05-403d-b01c-412eec654e0c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1303 microversion: 2.1 time: 0.519787 Jun 16 18:46:33.444329 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1841/3601] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:32 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1303 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:33.630899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:33.648496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:33.650736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:33.652361 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-49edc2f7-af3b-4692-ab7f-c67c8d551725 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.575717 Jun 16 18:46:33.657076 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1761/3602] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:33 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:33.931346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:33.932074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:33.947446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:33.947919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:33.956493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:33.956946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:34.095503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:34.100880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:34.129081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:34.134543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:34.136371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:34.137881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:34.660925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:34.677493 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4572b459-dd40-4ae9-940e-2a1d537a9d13 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1496 microversion: 2.1 time: 0.585093 Jun 16 18:46:34.691636 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1762/3603] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:34 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1496 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:34.704481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:34.706686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:34.719396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:34.720385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:34.722418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:34.723260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:34.732599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:34.743437 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be5e9dea-a34f-4eed-a2b9-b297659107c8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64" status: 200 len: 1512 microversion: 2.1 time: 0.818493 Jun 16 18:46:34.748109 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1842/3604] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:33 2022] GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 => generated 1512 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:34.766907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:34.772376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:34.788129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:34.789043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:34.791230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:34.791939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.255099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:35.266357 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-14107614-869f-4712-b949-36b8f1fa139a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 0.572051 Jun 16 18:46:35.282018 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1763/3605] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:34 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:35.287971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf93d0ea-0dc8-4aff-8416-046dc97843a0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:35.328595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.server_groups [None req-cf93d0ea-0dc8-4aff-8416-046dc97843a0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Querying cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) for 1 instances {{(pid=119207) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 16 18:46:35.329489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ea-0dc8-4aff-8416-046dc97843a0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.329969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf93d0ea-0dc8-4aff-8416-046dc97843a0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.369354 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf93d0ea-0dc8-4aff-8416-046dc97843a0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/64704c54-d31c-454d-889f-f67d3db7647d" status: 200 len: 221 microversion: 2.1 time: 0.085767 Jun 16 18:46:35.370315 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1764/3606] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:46:35 2022] GET /compute/v2.1/os-server-groups/64704c54-d31c-454d-889f-f67d3db7647d => generated 221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:35.376342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:35.387413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:35.394975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:35.396726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:35.397553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:35.403342 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f12d6c80-3a59-4ac8-b128-02af3f95b90e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1740 microversion: 2.20 time: 0.646164 Jun 16 18:46:35.406720 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1843/3607] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:34 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1740 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:35.428856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.429660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.431477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.432145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.436128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1fb7c06f-1bf3-4713-91fa-32e4fa0c44d0 req-21ee0159-c45f-4134-b611-4aa04d5e6019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60fe531-bb99-4b2f-9d97-e7d46455fd6c", "name": "network-vif-deleted", "tag": "26bcc148-51d6-41e8-a63e-78386bc5b193"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:35.467152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1fb7c06f-1bf3-4713-91fa-32e4fa0c44d0 req-21ee0159-c45f-4134-b611-4aa04d5e6019 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.468915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1fb7c06f-1bf3-4713-91fa-32e4fa0c44d0 req-21ee0159-c45f-4134-b611-4aa04d5e6019 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.489860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:46:35.537526 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1fb7c06f-1bf3-4713-91fa-32e4fa0c44d0 req-21ee0159-c45f-4134-b611-4aa04d5e6019 service nova] Creating event network-vif-deleted:26bcc148-51d6-41e8-a63e-78386bc5b193 for instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c on n-h2-846209-2 Jun 16 18:46:35.553319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1fb7c06f-1bf3-4713-91fa-32e4fa0c44d0 req-21ee0159-c45f-4134-b611-4aa04d5e6019 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124661 Jun 16 18:46:35.557890 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1844/3608] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:35.691191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92b506d6-e74a-4565-8b73-046bf0bea744 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 204 len: 0 microversion: 2.1 time: 0.309936 Jun 16 18:46:35.694764 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1765/3609] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:46:35 2022] DELETE /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:35.703464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:35.704808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:35.714277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.717127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.720228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.723268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.768963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:35.770212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:35.796223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.797310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:35.798428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:35.799128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:36.016895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771965bf0ff449829821757417b58fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d9dbb0e09427486fc555e684ce26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:36.033525 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5b8734f-8c10-42a2-80bb-4e97e4204b85 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64" status: 200 len: 1470 microversion: 2.1 time: 0.270978 Jun 16 18:46:36.045150 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1766/3610] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:35 2022] GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:46:36.158594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:36.180240 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7f6e97c0-43ec-488b-ad31-97fa204ee9c1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1502 microversion: 2.1 time: 0.479870 Jun 16 18:46:36.181937 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1845/3611] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:35 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1502 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:36.285888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:36.287852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:36.304136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:36.306684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:36.313112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:36.313786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:36.427189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:36.428492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:36.454431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:36.454922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:36.456256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:36.456256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:36.795136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:36.827685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:36.832708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:36.838268 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6e59e132-9db5-4e3a-b6c6-2f5bf1b8355c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1722 microversion: 2.20 time: 0.415531 Jun 16 18:46:36.849870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:36.854726 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1846/3612] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:36 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:36.865672 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-08aea917-8c80-4dfb-b417-589b29c6d29e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 0.585593 Jun 16 18:46:36.868144 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1767/3613] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:36 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:36.969975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f1f57887-2086-4e23-9871-fccb17578312 req-1a6539ec-e4f9-48e2-bd3c-aa4aea0ea1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c93d90-ad38-4326-9bb6-4c38b39891ac", "tag": "eb1ba32b-d248-475f-874f-fd6a54c3990d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:36.992419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f1f57887-2086-4e23-9871-fccb17578312 req-1a6539ec-e4f9-48e2-bd3c-aa4aea0ea1c7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.010890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f1f57887-2086-4e23-9871-fccb17578312 req-1a6539ec-e4f9-48e2-bd3c-aa4aea0ea1c7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.048549 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f1f57887-2086-4e23-9871-fccb17578312 req-1a6539ec-e4f9-48e2-bd3c-aa4aea0ea1c7 service nova] Creating event network-changed:eb1ba32b-d248-475f-874f-fd6a54c3990d for instance d0c93d90-ad38-4326-9bb6-4c38b39891ac on n-h1-846209-2 Jun 16 18:46:37.051677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:37.052309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: a20f110f-2d96-4548-a622-84b1c4ceda64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:37.057966 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f1f57887-2086-4e23-9871-fccb17578312 req-1a6539ec-e4f9-48e2-bd3c-aa4aea0ea1c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096171 Jun 16 18:46:37.059376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.059603 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1847/3614] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:37.069187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.070601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.071591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.104596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] HTTP exception thrown: Instance a20f110f-2d96-4548-a622-84b1c4ceda64 could not be found. Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Request method failure captured: Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 HTTP/1.1 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3pF-_0726s9YHU-J1ZjDbsfTLvZzGFlLEn-bnysl-V1bf7GEhh3N1FDCwQc-4nWk8QGaJUEG-TsVMR94mYOgMt3RQlNidrXlAy5XqnTaP46Med4aoDIjgsdCoxbhwuqDQ_vQcyKf5QKhz9Mq8KK_Ru0SYZE-d0cMHI_HKeRQdJsMqU Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 845d9dbb0e09427486fc555e684ce26e Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-MultipleCreateTestJSON-863651203 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/845d9dbb0e09427486fc555e684ce26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/845d9dbb0e09427486fc555e684ce26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_845d9dbb0e09427486fc555e684ce26e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/845d9dbb0e09427486fc555e684ce26e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-MultipleCreateTestJSON-863651203 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 845d9dbb0e09427486fc555e684ce26e Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-MultipleCreateTestJSON-863651203 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-MultipleCreateTestJSON-863651203-project Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 771965bf0ff449829821757417b58fc1 Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-MultipleCreateTestJSON-863651203-project Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a20f110f-2d96-4548-a622-84b1c4ceda64 could not be found. Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a20f110f-2d96-4548-a622-84b1c4ceda64'} Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a20f110f-2d96-4548-a622-84b1c4ceda64 could not be found. Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20f110f-2d96-4548-a622-84b1c4ceda64 could not be found. Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:37.106950 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.112364 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:37.112364 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:37.112364 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:37.112364 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:37.112364 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:37.112364 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20f110f-2d96-4548-a622-84b1c4ceda64 could not be found. Jun 16 18:46:37.112364 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.115913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Returning 404 to user: Instance a20f110f-2d96-4548-a622-84b1c4ceda64 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:37.122161 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-830ceb8b-41a9-4262-bbb9-38342fe16b8b tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64" status: 404 len: 111 microversion: 2.1 time: 0.074488 Jun 16 18:46:37.124612 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1768/3615] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:37 2022] GET /compute/v2.1/servers/a20f110f-2d96-4548-a622-84b1c4ceda64 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:37.134703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:37.135427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] [instance: d60fe531-bb99-4b2f-9d97-e7d46455fd6c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:37.145043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.145608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.146451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.147330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.179717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] HTTP exception thrown: Instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c could not be found. Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Request method failure captured: Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c HTTP/1.1 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pF-_0726s9YHU-J1ZjDbsfTLvZzGFlLEn-bnysl-V1bf7GEhh3N1FDCwQc-4nWk8QGaJUEG-TsVMR94mYOgMt3RQlNidrXlAy5XqnTaP46Med4aoDIjgsdCoxbhwuqDQ_vQcyKf5QKhz9Mq8KK_Ru0SYZE-d0cMHI_HKeRQdJsMqU Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 845d9dbb0e09427486fc555e684ce26e Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-MultipleCreateTestJSON-863651203 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/845d9dbb0e09427486fc555e684ce26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/845d9dbb0e09427486fc555e684ce26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_845d9dbb0e09427486fc555e684ce26e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/845d9dbb0e09427486fc555e684ce26e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-MultipleCreateTestJSON-863651203 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 845d9dbb0e09427486fc555e684ce26e Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-MultipleCreateTestJSON-863651203 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-MultipleCreateTestJSON-863651203-project Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 771965bf0ff449829821757417b58fc1 Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-MultipleCreateTestJSON-863651203-project Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c could not be found. Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'd60fe531-bb99-4b2f-9d97-e7d46455fd6c'} Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c could not be found. Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c could not be found. Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:37.181476 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c could not be found. Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] Returning 404 to user: Instance d60fe531-bb99-4b2f-9d97-e7d46455fd6c could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:37.188210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a8b140f-5a07-44fc-b471-f092bb78c3b8 tempest-MultipleCreateTestJSON-863651203 tempest-MultipleCreateTestJSON-863651203-project] 10.222.0.27 "GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c" status: 404 len: 111 microversion: 2.1 time: 0.056363 Jun 16 18:46:37.193438 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1848/3616] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:37 2022] GET /compute/v2.1/servers/d60fe531-bb99-4b2f-9d97-e7d46455fd6c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:37.198956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:37.199628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:37.212192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.215866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.217043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.217508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.616269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-19aee60d-69e5-4093-b0a0-20dbafc0337a req-2fb324a6-02b6-4f88-8dc4-4eaaa21f0c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20f110f-2d96-4548-a622-84b1c4ceda64", "name": "network-vif-deleted", "tag": "cc05cc16-6566-4443-9482-9d93e9371137"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:37.643382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-19aee60d-69e5-4093-b0a0-20dbafc0337a req-2fb324a6-02b6-4f88-8dc4-4eaaa21f0c26 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.644941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-19aee60d-69e5-4093-b0a0-20dbafc0337a req-2fb324a6-02b6-4f88-8dc4-4eaaa21f0c26 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.696911 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-19aee60d-69e5-4093-b0a0-20dbafc0337a req-2fb324a6-02b6-4f88-8dc4-4eaaa21f0c26 service nova] Creating event network-vif-deleted:cc05cc16-6566-4443-9482-9d93e9371137 for instance a20f110f-2d96-4548-a622-84b1c4ceda64 on n-h2-846209-2 Jun 16 18:46:37.710886 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-19aee60d-69e5-4093-b0a0-20dbafc0337a req-2fb324a6-02b6-4f88-8dc4-4eaaa21f0c26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101951 Jun 16 18:46:37.713259 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1849/3617] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:46:37.802680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:37.817920 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9fd4f416-eea4-45e5-b4de-1f29e07d07e1 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1502 microversion: 2.1 time: 0.620773 Jun 16 18:46:37.821228 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1769/3618] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:37 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1502 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:37.861875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:37.862871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:37.884847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:37.885470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:37.892868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.893319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.894141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.894578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.902529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.903045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:37.903826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:37.910977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.317541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:39.397823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:39.419695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:39.421898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:39.424285 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b018480-bc71-4b27-8910-5342b1659181 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1722 microversion: 2.20 time: 1.567774 Jun 16 18:46:39.425618 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1850/3619] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:37 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1722 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:39.525483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:39.565621 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c08b04f2-af70-4dfd-a77d-a45d471ff6c1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 1.684510 Jun 16 18:46:39.566265 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1770/3620] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:37 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:39.591853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:39.593839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:39.602261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:39.609398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.610822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:39.611448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.683473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:39.684362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.685071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lazy-loading 'fault' on Instance uuid c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:46:39.748632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:39.767171 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae726e98-7ee6-43f5-8026-d7a588b3dd90 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1303 microversion: 2.1 time: 0.173092 Jun 16 18:46:39.767775 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1771/3621] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:39 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:39.792420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-635e2d26-3b9b-4bb7-8d25-6786576aa6a4 req-5d783e86-778e-4536-9a00-7f7fec1875bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b6c0e5-0374-409e-928e-fef329282b9d", "name": "network-vif-unplugged", "status": "completed", "tag": "1d6556a3-3abe-405b-9851-474f0b6ab80f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:39.813739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-635e2d26-3b9b-4bb7-8d25-6786576aa6a4 req-5d783e86-778e-4536-9a00-7f7fec1875bb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:39.814665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-635e2d26-3b9b-4bb7-8d25-6786576aa6a4 req-5d783e86-778e-4536-9a00-7f7fec1875bb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.841376 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-635e2d26-3b9b-4bb7-8d25-6786576aa6a4 req-5d783e86-778e-4536-9a00-7f7fec1875bb service nova] Creating event network-vif-unplugged:1d6556a3-3abe-405b-9851-474f0b6ab80f for instance 31b6c0e5-0374-409e-928e-fef329282b9d on n-h2-846209-2 Jun 16 18:46:39.856662 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-635e2d26-3b9b-4bb7-8d25-6786576aa6a4 req-5d783e86-778e-4536-9a00-7f7fec1875bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071702 Jun 16 18:46:39.877324 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1772/3622] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:39.895202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-bc413102-cffc-4da6-8b1d-e30844eb1db3 req-098c0fd8-5279-42a3-9cca-2d2063b67a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2", "name": "network-vif-deleted", "tag": "ef142460-44f6-44a7-a1b3-68f538debf8d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:39.924563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bc413102-cffc-4da6-8b1d-e30844eb1db3 req-098c0fd8-5279-42a3-9cca-2d2063b67a12 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:39.925261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bc413102-cffc-4da6-8b1d-e30844eb1db3 req-098c0fd8-5279-42a3-9cca-2d2063b67a12 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.932259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c035bff5-5973-47af-9e98-c0578e368861"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:39.933637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:39.948487 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-bc413102-cffc-4da6-8b1d-e30844eb1db3 req-098c0fd8-5279-42a3-9cca-2d2063b67a12 service nova] Creating event network-vif-deleted:ef142460-44f6-44a7-a1b3-68f538debf8d for instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 on n-h1-846209-2 Jun 16 18:46:39.948832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:39.950067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.953803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:39.954503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:39.961514 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-bc413102-cffc-4da6-8b1d-e30844eb1db3 req-098c0fd8-5279-42a3-9cca-2d2063b67a12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081624 Jun 16 18:46:39.973006 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1773/3623] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:40.111820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:40.178501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] HTTP exception thrown: Volume c035bff5-5973-47af-9e98-c0578e368861 could not be found. Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Request method failure captured: Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments/cdbb560f-358c-4972-b923-22ba4712a262 HTTP/1.1 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 74 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ovbpSZxA2810R9zrQHryc-1XV3OTQugU7lc6t9DmikCrc7oqavdV3Eds-fcHCuVkYXBhDwB6dKEmgTJOdScSOkt8dKXqAzefMm3oMHYfXl_RUH7LkSCQep7H5v7p3koLz0ZSwuITIZsiO6hqaN6OAls6jTaItK-jkd-cP84iQQt3c Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5881fc50718d4b3abfcc9151355212f6 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesAdminNegativeTest-1634604682 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5881fc50718d4b3abfcc9151355212f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5881fc50718d4b3abfcc9151355212f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5881fc50718d4b3abfcc9151355212f6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5881fc50718d4b3abfcc9151355212f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesAdminNegativeTest-1634604682 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5881fc50718d4b3abfcc9151355212f6 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1634604682 Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesAdminNegativeTest-1634604682-project-admin Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 2f656c5d905c443a97efadb7678944da Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesAdminNegativeTest-1634604682-project-admin Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: {"volumeAttachment": {"volumeId": "c035bff5-5973-47af-9e98-c0578e368861"}} Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: exception: Volume c035bff5-5973-47af-9e98-c0578e368861 could not be found. Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'server_id': '11cc723a-7d61-4241-bc08-1309b6674872', 'id': 'cdbb560f-358c-4972-b923-22ba4712a262', 'body': {'volumeAttachment': {'volumeId': 'c035bff5-5973-47af-9e98-c0578e368861'}}} Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c035bff5-5973-47af-9e98-c0578e368861 could not be found. (HTTP 404) (Request-ID: req-e264b6d9-3724-44e5-8676-112422f9b4b7) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:46:40.181445 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c035bff5-5973-47af-9e98-c0578e368861 could not be found. Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume c035bff5-5973-47af-9e98-c0578e368861 could not be found. Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c035bff5-5973-47af-9e98-c0578e368861 could not be found. Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:40.189378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Returning 400 to user: Volume c035bff5-5973-47af-9e98-c0578e368861 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:40.195525 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97d8baf3-7c7e-4c03-8669-913f79c2aa3a tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments/cdbb560f-358c-4972-b923-22ba4712a262" status: 400 len: 107 microversion: 2.1 time: 0.756951 Jun 16 18:46:40.195785 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1851/3624] 10.222.0.27 () {60 vars in 1432 bytes} [Thu Jun 16 18:46:39 2022] PUT /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments/cdbb560f-358c-4972-b923-22ba4712a262 => generated 107 bytes in 769 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:46:40.291942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:40.292656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:40.303047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.303823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.305090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.305687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.447375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:40.448214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:40.456370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lazy-loading 'services' on Instance uuid 11cc723a-7d61-4241-bc08-1309b6674872 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:46:40.462591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:40.464882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.465648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.469679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.470347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.618877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-971a3e00-c604-47a3-a7ba-9bca33b49ea9 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments/cdbb560f-358c-4972-b923-22ba4712a262" status: 202 len: 0 microversion: 2.1 time: 0.332654 Jun 16 18:46:40.622107 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1774/3625] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:46:40 2022] DELETE /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments/cdbb560f-358c-4972-b923-22ba4712a262 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:46:40.642398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:40.657922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:40.663962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:40.676366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.677116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.679938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.680975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.741373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:40.765979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:40.783559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:40.788214 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-83ffcf80-8f84-428c-90f1-2a68d51e723b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1665 microversion: 2.20 time: 0.346633 Jun 16 18:46:40.800393 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1852/3626] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:40 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1665 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:40.829755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-026b9121-aa00-44e9-998f-24cba50e1722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:40.833316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-026b9121-aa00-44e9-998f-24cba50e1722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:40.849302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:40.867693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-026b9121-aa00-44e9-998f-24cba50e1722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.873591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-026b9121-aa00-44e9-998f-24cba50e1722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.879656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-026b9121-aa00-44e9-998f-24cba50e1722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:40.880637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-026b9121-aa00-44e9-998f-24cba50e1722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:40.984572 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-026b9121-aa00-44e9-998f-24cba50e1722 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168931 Jun 16 18:46:40.993674 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1853/3627] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:40 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:41.006248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:41.007221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:41.026629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:41.028368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:41.032450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:41.035327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:41.120237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:41.120740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:41.121228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lazy-loading 'fault' on Instance uuid c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:46:41.203514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:41.214610 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4cfef022-f82f-49cf-a0f7-6022e9c9bf6e tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 0.590347 Jun 16 18:46:41.218199 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1775/3628] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:40 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:41.235619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5f39375-06cc-47cc-a777-ea509d2b40ed tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41c1c8f4-1db7-4603-ac8e-7bbc45caf8c4"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:41.237359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5f39375-06cc-47cc-a777-ea509d2b40ed tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:41.258737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5f39375-06cc-47cc-a777-ea509d2b40ed tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:41.261047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5f39375-06cc-47cc-a777-ea509d2b40ed tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:41.263549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5f39375-06cc-47cc-a777-ea509d2b40ed tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:41.267129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5f39375-06cc-47cc-a777-ea509d2b40ed tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:41.285832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ff206b8a2c4e3ea6fd96f4dcd4478c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc0d0ecb5e4f12b8be9a1c0c18e682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:41.299402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36dd21bf-738d-49ce-a5de-741b12bd2038 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 200 len: 1303 microversion: 2.1 time: 0.300489 Jun 16 18:46:41.300514 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1854/3629] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:40 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 1303 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:41.447245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ce1e1db-ced9-46f1-9254-2e25fde031aa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'create', calling method: .version_select at 0x7f866deacc10>, body: {"keypair": {"name": "tempest-keypair-657024561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ4eqM4YVqU61Nf2nMhkL7pGEg6WmXqbwe7beva9gOR1F1FGId+/VW0X2OvPbq+hPy4VFO6sa/mmIu7expPnG9tPbezhm8AYFxID/AmYfmZdx+GaGYmBYgRQ0e+KYJ60w=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:41.492640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6ce1e1db-ced9-46f1-9254-2e25fde031aa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:41.509699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6ce1e1db-ced9-46f1-9254-2e25fde031aa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for user 0bad5f4aa84e4b978a5a92478b6772bf and project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:41.567388 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ce1e1db-ced9-46f1-9254-2e25fde031aa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264148 Jun 16 18:46:41.567997 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1855/3630] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:46:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:41.963905 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5f39375-06cc-47cc-a777-ea509d2b40ed tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.741709 Jun 16 18:46:41.966065 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1776/3631] 10.222.0.27 () {62 vars in 1363 bytes} [Thu Jun 16 18:46:41 2022] POST /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 188 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:46:42.010101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77a9c629-dac7-4a9f-a67c-5ea1d85bb1f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:42.016937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77a9c629-dac7-4a9f-a67c-5ea1d85bb1f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:42.032381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77a9c629-dac7-4a9f-a67c-5ea1d85bb1f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.033133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77a9c629-dac7-4a9f-a67c-5ea1d85bb1f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.034157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77a9c629-dac7-4a9f-a67c-5ea1d85bb1f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.035608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77a9c629-dac7-4a9f-a67c-5ea1d85bb1f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.073430 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77a9c629-dac7-4a9f-a67c-5ea1d85bb1f2 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077162 Jun 16 18:46:42.078392 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1856/3632] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:41 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:42.197946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-636565d8-5f78-4fcb-9109-0561df3007fc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:42.198588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-636565d8-5f78-4fcb-9109-0561df3007fc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:42.212739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-636565d8-5f78-4fcb-9109-0561df3007fc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.213198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-636565d8-5f78-4fcb-9109-0561df3007fc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.214041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-636565d8-5f78-4fcb-9109-0561df3007fc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.219653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-636565d8-5f78-4fcb-9109-0561df3007fc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.236465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:42.237386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:42.256727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.257597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.258603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.269997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.450551 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-636565d8-5f78-4fcb-9109-0561df3007fc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/action" status: 202 len: 0 microversion: 2.20 time: 0.254401 Jun 16 18:46:42.455092 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1777/3633] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:46:42 2022] POST /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:42.497185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:42.499473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:42.525856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.526612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.527647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.528409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.570535 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] HTTP exception thrown: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Request method failure captured: Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 HTTP/1.1 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3pqjPmZA2JCPKEl4T9S2kB0V6Ahxq0sIg2tEBO3-VnKu07VSAifBrXefdKogWrUIsUkhgrbnsxzciSt4E-Bh7hGXymJ7uOCsnk0o-PdBFYVriCEz_Zv3IgHXRc3vNnp1kAJh4pnBcuaiGlOH3TPC7UL9Ujh5PWsy0VSE2byZpVMCj8 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3abc0d0ecb5e4f12b8be9a1c0c18e682", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c5ff206b8a2c4e3ea6fd96f4dcd4478c Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2'} Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:42.572583 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:42.579055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Returning 404 to user: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:42.580421 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-47856cd4-9854-4c51-b4f4-2b1de6598489 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 404 len: 111 microversion: 2.1 time: 0.111150 Jun 16 18:46:42.581201 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1778/3634] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:42 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:42.593986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:42.594786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:42.602494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.603112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:42.604081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:42.605404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.053538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:43.076168 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2bdaab52-f05d-47af-8840-d70a05b4a254 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 0.840699 Jun 16 18:46:43.082564 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1857/3635] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:42 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:43.101408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55610fd7-f308-447f-abe4-dcbb0a82ece4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.194998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:43.206295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_groups [None req-55610fd7-f308-447f-abe4-dcbb0a82ece4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Querying cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) for 1 instances {{(pid=119206) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 16 18:46:43.207644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55610fd7-f308-447f-abe4-dcbb0a82ece4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.226129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55610fd7-f308-447f-abe4-dcbb0a82ece4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.242218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:43.249934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:43.268755 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98a65e75-d95e-49dd-939e-00e0ee07cf5d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1751 microversion: 2.20 time: 0.679740 Jun 16 18:46:43.271909 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1779/3636] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:42 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1751 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:43.298057 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55610fd7-f308-447f-abe4-dcbb0a82ece4 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.207917 Jun 16 18:46:43.304508 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1858/3637] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 18:46:43 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:43.308045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cc93708-eb4e-41d3-b358-527c46fa6034 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.312010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7fe2db90-ee80-42b2-b416-8224a975a4a9 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.314653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7cc93708-eb4e-41d3-b358-527c46fa6034 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:43.356225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_groups [None req-7fe2db90-ee80-42b2-b416-8224a975a4a9 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Querying cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) for 1 instances {{(pid=119206) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 16 18:46:43.357294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fe2db90-ee80-42b2-b416-8224a975a4a9 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.358314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fe2db90-ee80-42b2-b416-8224a975a4a9 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.380216 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7fe2db90-ee80-42b2-b416-8224a975a4a9 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/64704c54-d31c-454d-889f-f67d3db7647d" status: 200 len: 183 microversion: 2.1 time: 0.074386 Jun 16 18:46:43.380865 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1859/3638] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:46:43 2022] GET /compute/v2.1/os-server-groups/64704c54-d31c-454d-889f-f67d3db7647d => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:43.392512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.393013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:43.396724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cc93708-eb4e-41d3-b358-527c46fa6034 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.406863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cc93708-eb4e-41d3-b358-527c46fa6034 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.411534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cc93708-eb4e-41d3-b358-527c46fa6034 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.415359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.418156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cc93708-eb4e-41d3-b358-527c46fa6034 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.419060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.420106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.421449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.454961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] HTTP exception thrown: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Request method failure captured: Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 HTTP/1.1 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pqjPmZA2JCPKEl4T9S2kB0V6Ahxq0sIg2tEBO3-VnKu07VSAifBrXefdKogWrUIsUkhgrbnsxzciSt4E-Bh7hGXymJ7uOCsnk0o-PdBFYVriCEz_Zv3IgHXRc3vNnp1kAJh4pnBcuaiGlOH3TPC7UL9Ujh5PWsy0VSE2byZpVMCj8 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3abc0d0ecb5e4f12b8be9a1c0c18e682", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c5ff206b8a2c4e3ea6fd96f4dcd4478c Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2'} Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:43.456872 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.462023 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.466810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Returning 404 to user: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:43.468556 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c6f36e1-39d2-49bf-be7e-bee4303e8076 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 404 len: 111 microversion: 2.1 time: 0.080271 Jun 16 18:46:43.477895 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1860/3639] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:46:43 2022] DELETE /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:43.483397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.487807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] [instance: c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:43.508034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.508802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.509758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:43.510406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:43.539237 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] HTTP exception thrown: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Request method failure captured: Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 HTTP/1.1 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pqjPmZA2JCPKEl4T9S2kB0V6Ahxq0sIg2tEBO3-VnKu07VSAifBrXefdKogWrUIsUkhgrbnsxzciSt4E-Bh7hGXymJ7uOCsnk0o-PdBFYVriCEz_Zv3IgHXRc3vNnp1kAJh4pnBcuaiGlOH3TPC7UL9Ujh5PWsy0VSE2byZpVMCj8 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3abc0d0ecb5e4f12b8be9a1c0c18e682", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c5ff206b8a2c4e3ea6fd96f4dcd4478c Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2'} Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.542261 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.547270 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.547270 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.547270 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.547270 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:43.547270 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:43.547270 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. Jun 16 18:46:43.547270 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.551322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Returning 404 to user: Instance c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:43.554593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8655339c-9e97-4b7a-b952-6b647c816461 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2" status: 404 len: 111 microversion: 2.1 time: 0.074695 Jun 16 18:46:43.565886 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1861/3640] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:43 2022] GET /compute/v2.1/servers/c8f5eede-1652-4797-a9e9-ce0a5dd4c2d2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:43.578585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-910053e8-7af0-4289-aa63-571d156bfd1a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.604599 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-910053e8-7af0-4289-aa63-571d156bfd1a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] HTTP exception thrown: Instance group b9be92e5-04ab-43b9-b295-d63cfc8858bb could not be found. Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-910053e8-7af0-4289-aa63-571d156bfd1a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Request method failure captured: Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-server-groups/b9be92e5-04ab-43b9-b295-d63cfc8858bb HTTP/1.1 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pqjPmZA2JCPKEl4T9S2kB0V6Ahxq0sIg2tEBO3-VnKu07VSAifBrXefdKogWrUIsUkhgrbnsxzciSt4E-Bh7hGXymJ7uOCsnk0o-PdBFYVriCEz_Zv3IgHXRc3vNnp1kAJh4pnBcuaiGlOH3TPC7UL9Ujh5PWsy0VSE2byZpVMCj8 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3abc0d0ecb5e4f12b8be9a1c0c18e682", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c5ff206b8a2c4e3ea6fd96f4dcd4478c Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance group b9be92e5-04ab-43b9-b295-d63cfc8858bb could not be found. Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b9be92e5-04ab-43b9-b295-d63cfc8858bb'} Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b9be92e5-04ab-43b9-b295-d63cfc8858bb could not be found. Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b9be92e5-04ab-43b9-b295-d63cfc8858bb could not be found. Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.618855 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.623602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.623602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.623602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:43.623602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:43.623602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b9be92e5-04ab-43b9-b295-d63cfc8858bb could not be found. Jun 16 18:46:43.623602 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.627454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-910053e8-7af0-4289-aa63-571d156bfd1a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Returning 404 to user: Instance group b9be92e5-04ab-43b9-b295-d63cfc8858bb could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:43.628736 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-910053e8-7af0-4289-aa63-571d156bfd1a tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b9be92e5-04ab-43b9-b295-d63cfc8858bb" status: 404 len: 117 microversion: 2.1 time: 0.060162 Jun 16 18:46:43.633337 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7cc93708-eb4e-41d3-b358-527c46fa6034 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.341064 Jun 16 18:46:43.637015 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1862/3641] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:43 2022] DELETE /compute/v2.1/os-server-groups/b9be92e5-04ab-43b9-b295-d63cfc8858bb => generated 117 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:43.637970 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1780/3642] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:43 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 197 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:43.647866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-611c788b-5a80-4cb1-b6c4-d2209eb4afe0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.662914 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-611c788b-5a80-4cb1-b6c4-d2209eb4afe0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] HTTP exception thrown: Instance group dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec could not be found. Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-611c788b-5a80-4cb1-b6c4-d2209eb4afe0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Request method failure captured: Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-server-groups/dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec HTTP/1.1 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pqjPmZA2JCPKEl4T9S2kB0V6Ahxq0sIg2tEBO3-VnKu07VSAifBrXefdKogWrUIsUkhgrbnsxzciSt4E-Bh7hGXymJ7uOCsnk0o-PdBFYVriCEz_Zv3IgHXRc3vNnp1kAJh4pnBcuaiGlOH3TPC7UL9Ujh5PWsy0VSE2byZpVMCj8 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3abc0d0ecb5e4f12b8be9a1c0c18e682", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c5ff206b8a2c4e3ea6fd96f4dcd4478c Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance group dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec could not be found. Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec'} Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec could not be found. Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec could not be found. Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.673796 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.678427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.678427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.678427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:43.678427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:43.678427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec could not be found. Jun 16 18:46:43.678427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.680447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-611c788b-5a80-4cb1-b6c4-d2209eb4afe0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Returning 404 to user: Instance group dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:43.681550 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-611c788b-5a80-4cb1-b6c4-d2209eb4afe0 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec" status: 404 len: 117 microversion: 2.1 time: 0.043527 Jun 16 18:46:43.685875 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1863/3643] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:43 2022] DELETE /compute/v2.1/os-server-groups/dfb1e0b0-53fb-4adb-beab-4046f8e9a1ec => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:43.696621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e92d27c2-39c8-4db6-afa7-3eba7a821aeb tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.721803 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e92d27c2-39c8-4db6-afa7-3eba7a821aeb tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] HTTP exception thrown: Instance group ea9a500b-63a0-4137-849a-66eebeb5a189 could not be found. Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e92d27c2-39c8-4db6-afa7-3eba7a821aeb tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Request method failure captured: Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-server-groups/ea9a500b-63a0-4137-849a-66eebeb5a189 HTTP/1.1 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3pqjPmZA2JCPKEl4T9S2kB0V6Ahxq0sIg2tEBO3-VnKu07VSAifBrXefdKogWrUIsUkhgrbnsxzciSt4E-Bh7hGXymJ7uOCsnk0o-PdBFYVriCEz_Zv3IgHXRc3vNnp1kAJh4pnBcuaiGlOH3TPC7UL9Ujh5PWsy0VSE2byZpVMCj8 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3abc0d0ecb5e4f12b8be9a1c0c18e682", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c5ff206b8a2c4e3ea6fd96f4dcd4478c Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance group ea9a500b-63a0-4137-849a-66eebeb5a189 could not be found. Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ea9a500b-63a0-4137-849a-66eebeb5a189'} Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ea9a500b-63a0-4137-849a-66eebeb5a189 could not be found. Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ea9a500b-63a0-4137-849a-66eebeb5a189 could not be found. Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.729945 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.743443 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.743443 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.743443 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:43.743443 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:43.743443 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ea9a500b-63a0-4137-849a-66eebeb5a189 could not be found. Jun 16 18:46:43.743443 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.743443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e92d27c2-39c8-4db6-afa7-3eba7a821aeb tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Returning 404 to user: Instance group ea9a500b-63a0-4137-849a-66eebeb5a189 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:43.747392 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e92d27c2-39c8-4db6-afa7-3eba7a821aeb tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ea9a500b-63a0-4137-849a-66eebeb5a189" status: 404 len: 117 microversion: 2.1 time: 0.059330 Jun 16 18:46:43.749896 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1781/3644] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:43 2022] DELETE /compute/v2.1/os-server-groups/ea9a500b-63a0-4137-849a-66eebeb5a189 => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:43.767451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87647c9d-e18a-436b-a717-711aa888977f tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.784783 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-87647c9d-e18a-436b-a717-711aa888977f tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] HTTP exception thrown: Instance group 11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 could not be found. Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87647c9d-e18a-436b-a717-711aa888977f tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Request method failure captured: Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-server-groups/11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 HTTP/1.1 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3pqjPmZA2JCPKEl4T9S2kB0V6Ahxq0sIg2tEBO3-VnKu07VSAifBrXefdKogWrUIsUkhgrbnsxzciSt4E-Bh7hGXymJ7uOCsnk0o-PdBFYVriCEz_Zv3IgHXRc3vNnp1kAJh4pnBcuaiGlOH3TPC7UL9Ujh5PWsy0VSE2byZpVMCj8 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3abc0d0ecb5e4f12b8be9a1c0c18e682", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3abc0d0ecb5e4f12b8be9a1c0c18e682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3abc0d0ecb5e4f12b8be9a1c0c18e682 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerGroupTestJSON-1188825113 Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c5ff206b8a2c4e3ea6fd96f4dcd4478c Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerGroupTestJSON-1188825113-project Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance group 11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 could not be found. Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '11e30ea6-58cf-452d-9ae2-09c7ec33ebc4'} Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 could not be found. Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 could not be found. Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.791210 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 could not be found. Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87647c9d-e18a-436b-a717-711aa888977f tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Returning 404 to user: Instance group 11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:43.795916 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87647c9d-e18a-436b-a717-711aa888977f tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/11e30ea6-58cf-452d-9ae2-09c7ec33ebc4" status: 404 len: 117 microversion: 2.1 time: 0.039164 Jun 16 18:46:43.800951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1864/3645] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:43 2022] DELETE /compute/v2.1/os-server-groups/11e30ea6-58cf-452d-9ae2-09c7ec33ebc4 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:43.807932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6e791492-5e32-4ff2-8f45-e3fc26d3d153 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:43.858380 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6e791492-5e32-4ff2-8f45-e3fc26d3d153 tempest-ServerGroupTestJSON-1188825113 tempest-ServerGroupTestJSON-1188825113-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/64704c54-d31c-454d-889f-f67d3db7647d" status: 204 len: 0 microversion: 2.1 time: 0.055526 Jun 16 18:46:43.860423 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1782/3646] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 18:46:43 2022] DELETE /compute/v2.1/os-server-groups/64704c54-d31c-454d-889f-f67d3db7647d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:46:44.095495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:44.096271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:44.114501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:44.117840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:44.125889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:44.127985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:44.292343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:44.295178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:44.334353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:44.335098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:44.336268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:44.336882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:45.066658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:45.078186 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2da03093-bfa0-4374-b8c1-3c08daead8b6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 0.987522 Jun 16 18:46:45.090096 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1865/3647] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:44 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:45.101715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2627a90a-4a70-49b4-88e5-74454a64ca32 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:45.110420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2627a90a-4a70-49b4-88e5-74454a64ca32 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:45.133014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2627a90a-4a70-49b4-88e5-74454a64ca32 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:45.133558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2627a90a-4a70-49b4-88e5-74454a64ca32 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:45.134746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2627a90a-4a70-49b4-88e5-74454a64ca32 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:45.140661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2627a90a-4a70-49b4-88e5-74454a64ca32 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:45.189376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:45.205427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:45.206566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:45.220859 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a179d98-cf6f-4e1b-bd27-448222648c91 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1751 microversion: 2.20 time: 0.920873 Jun 16 18:46:45.223300 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1783/3648] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:44 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1751 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:45.256721 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2627a90a-4a70-49b4-88e5-74454a64ca32 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163939 Jun 16 18:46:45.268647 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1866/3649] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:45 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:46.098925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:46.099435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:46.114019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:46.117703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:46.128592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:46.129061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:46.242313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:46.242934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:46.277703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:46.278170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:46.284526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:46.287158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:46.296430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:46.900090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:46.912467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:46.914029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:46.925864 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cc2806e7-5bf5-4481-bab8-e28672f79285 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 0.677031 Jun 16 18:46:46.929583 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1867/3650] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:46 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:46.950004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50ad552f-ad43-45fd-8573-53c47f3915a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:46.951031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50ad552f-ad43-45fd-8573-53c47f3915a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:46.968089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ad552f-ad43-45fd-8573-53c47f3915a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:46.974549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ad552f-ad43-45fd-8573-53c47f3915a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:46.982451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ad552f-ad43-45fd-8573-53c47f3915a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:46.984137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50ad552f-ad43-45fd-8573-53c47f3915a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:46.988792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:47.011271 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-939e872e-b521-4ce4-b25f-e70e3333f73f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 0.908459 Jun 16 18:46:47.015437 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1784/3651] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:46 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:47.115689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50ad552f-ad43-45fd-8573-53c47f3915a5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184881 Jun 16 18:46:47.123715 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1868/3652] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:46 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:47.819788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d024cb92-15d8-4fdd-9d6e-e3f7bd4b96dc req-9e63e6db-3712-4d48-8fda-9fbdd4eed002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c93d90-ad38-4326-9bb6-4c38b39891ac", "name": "network-vif-plugged", "status": "completed", "tag": "eb1ba32b-d248-475f-874f-fd6a54c3990d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:47.841264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d024cb92-15d8-4fdd-9d6e-e3f7bd4b96dc req-9e63e6db-3712-4d48-8fda-9fbdd4eed002 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:47.842093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d024cb92-15d8-4fdd-9d6e-e3f7bd4b96dc req-9e63e6db-3712-4d48-8fda-9fbdd4eed002 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:47.868448 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d024cb92-15d8-4fdd-9d6e-e3f7bd4b96dc req-9e63e6db-3712-4d48-8fda-9fbdd4eed002 service nova] Creating event network-vif-plugged:eb1ba32b-d248-475f-874f-fd6a54c3990d for instance d0c93d90-ad38-4326-9bb6-4c38b39891ac on n-h1-846209-2 Jun 16 18:46:47.882778 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d024cb92-15d8-4fdd-9d6e-e3f7bd4b96dc req-9e63e6db-3712-4d48-8fda-9fbdd4eed002 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068275 Jun 16 18:46:47.884091 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1785/3653] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:47.950486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:47.952734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:47.971732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:47.972731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:47.974139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:47.974805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:48.034091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:48.035543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:48.052052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:48.053986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:48.054870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:48.055321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:48.958404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:48.974004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:48.977867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:48.983029 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9f3d5425-5a5c-48eb-a682-0a7956e06fd4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 1.041207 Jun 16 18:46:48.987829 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1869/3654] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:47 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:48.999471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be3a284b-f023-4470-8d72-2b454516c89f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:49.001370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be3a284b-f023-4470-8d72-2b454516c89f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:49.020263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3a284b-f023-4470-8d72-2b454516c89f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:49.024520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3a284b-f023-4470-8d72-2b454516c89f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:49.026304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3a284b-f023-4470-8d72-2b454516c89f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:49.031430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3a284b-f023-4470-8d72-2b454516c89f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:49.050258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:49.066939 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8dfb4f78-9513-4037-b635-23701e2ad41d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1371 microversion: 2.1 time: 1.037250 Jun 16 18:46:49.078119 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1786/3655] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:48 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1371 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:49.089102 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be3a284b-f023-4470-8d72-2b454516c89f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099498 Jun 16 18:46:49.089979 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1870/3656] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:48 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:49.098509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1154693657", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43"}], "security_groups": [{"name": "tempest-securitygroup--166535166"}], "key_name": "tempest-keypair-657024561", "user_data": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:49.307031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] validate_networks() for [('8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:46:49.855895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:46:49.857246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:46:49.858001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:46:49.859874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:46:49.860805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:46:49.875150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:49.875633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:49.876541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:49.882454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:49.919168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:49.929173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for user 0bad5f4aa84e4b978a5a92478b6772bf and project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:49.951396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:46:49.956238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:46:50.004075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:50.004851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:50.034439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:50.037633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:50.038773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:50.040924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:50.070996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f53aa4ed-4a87-4529-8842-8de7080d7bc0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.991640 Jun 16 18:46:50.072306 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1787/3657] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:46:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:46:50.085634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ac2c9f1-3a92-444c-b452-e86d10d7648c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:50.087624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2ac2c9f1-3a92-444c-b452-e86d10d7648c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:50.338869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2ac2c9f1-3a92-444c-b452-e86d10d7648c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:50.352486 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2ac2c9f1-3a92-444c-b452-e86d10d7648c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1238 microversion: 2.1 time: 0.272834 Jun 16 18:46:50.356924 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1788/3658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:50 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1238 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:50.384810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:50.391532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:50.417399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:50.418365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:50.424669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:50.425352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:50.482143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:50.515897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:50.525576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:50.531705 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7db1a8d1-be02-450c-bd6e-31806886c3eb tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 0.532816 Jun 16 18:46:50.545733 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1871/3659] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:49 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:46:50.559275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4273879e-fa60-4e6e-b61e-373b4f12b35c tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:50.565652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4273879e-fa60-4e6e-b61e-373b4f12b35c tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:50.588667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4273879e-fa60-4e6e-b61e-373b4f12b35c tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:50.590883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4273879e-fa60-4e6e-b61e-373b4f12b35c tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:50.594039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4273879e-fa60-4e6e-b61e-373b4f12b35c tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:50.595237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4273879e-fa60-4e6e-b61e-373b4f12b35c tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:50.680875 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4273879e-fa60-4e6e-b61e-373b4f12b35c tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128728 Jun 16 18:46:50.682319 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1872/3660] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:50 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:51.145826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:51.158702 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ed11e8ae-df14-43a7-b638-08513e533ea6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1565 microversion: 2.1 time: 0.800478 Jun 16 18:46:51.163436 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1789/3661] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:50 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1565 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:51.180234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19fd5971-19f1-4239-81bb-02553301aa93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:51.181106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19fd5971-19f1-4239-81bb-02553301aa93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:51.195820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19fd5971-19f1-4239-81bb-02553301aa93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.198042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19fd5971-19f1-4239-81bb-02553301aa93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.203650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19fd5971-19f1-4239-81bb-02553301aa93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.206713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19fd5971-19f1-4239-81bb-02553301aa93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.371607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:51.372534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:51.381564 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19fd5971-19f1-4239-81bb-02553301aa93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206056 Jun 16 18:46:51.382204 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1873/3662] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:46:51 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:51.403718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.416985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.420063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.425101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.556319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:51.556961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:51.560125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:51.610074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.610586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.611422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.611871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.654206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:51.665404 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a8d86ae-9319-46aa-9904-13e0709b440d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1234 microversion: 2.1 time: 0.297517 Jun 16 18:46:51.674936 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1790/3663] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:51 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1234 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:51.694112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-817e61a9-0a22-4293-875d-0de3f6240740 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:51.695510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-817e61a9-0a22-4293-875d-0de3f6240740 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:51.717372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817e61a9-0a22-4293-875d-0de3f6240740 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.722683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817e61a9-0a22-4293-875d-0de3f6240740 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.733983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817e61a9-0a22-4293-875d-0de3f6240740 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:51.737608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817e61a9-0a22-4293-875d-0de3f6240740 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:51.823160 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-817e61a9-0a22-4293-875d-0de3f6240740 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133443 Jun 16 18:46:51.847342 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1791/3664] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:46:51 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:46:52.153364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:52.162197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-559880532", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "d2ce3f71-08e8-4dc0-9036-15309e3e1841"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:52.177420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:52.185439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:52.194117 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-43f2985b-be97-40e4-8d50-0eaa8e24cc37 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 0.642657 Jun 16 18:46:52.194748 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1874/3665] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:51 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:46:52.279586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] validate_networks() for [('d2ce3f71-08e8-4dc0-9036-15309e3e1841', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:46:52.693852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:52.694296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:52.708453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:52.709732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:52.710580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:52.712359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:52.901812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:52.920175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-adb3e08a-841f-494b-836b-d878631707ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1296 microversion: 2.1 time: 0.229736 Jun 16 18:46:52.921864 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1875/3666] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:52 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1296 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:53.213119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:53.213805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:53.226011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:53.226398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:53.229729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:53.231900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:53.368363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:46:53.369427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:46:53.370534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:46:53.371127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:46:53.371785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:46:53.396416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:53.396874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:53.397685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:53.398149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:53.452345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Getting quotas for project ad9838adc91d4481b89c898b0fedf24c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:53.463939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Getting quotas for user 4b2ef3108bed4dbd9911a6e681799d57 and project ad9838adc91d4481b89c898b0fedf24c. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:53.500835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:46:53.508434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:46:53.616045 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b354fb60-33a8-4b22-8fac-6a47e1d313fe tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459919 Jun 16 18:46:53.618365 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1792/3667] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:46:53.628627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-95ea00a3-d283-4d29-9441-facc495b4a72 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:53.638089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-95ea00a3-d283-4d29-9441-facc495b4a72 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:53.792848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-95ea00a3-d283-4d29-9441-facc495b4a72 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:53.805280 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-95ea00a3-d283-4d29-9441-facc495b4a72 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1217 microversion: 2.1 time: 0.179470 Jun 16 18:46:53.808245 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1793/3668] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:53 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:46:53.884223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:53.894548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:53.896266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:53.897594 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f17b4224-2025-478c-b22e-f192afd480b2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 0.688716 Jun 16 18:46:53.899462 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1876/3669] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:53 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:46:53.943354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:53.944647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:53.970653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:53.971320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:53.973198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:53.975649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:53.987900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:54.203889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:54.225750 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d4c3c57-3d22-46f6-a3eb-fa2da28be104 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1296 microversion: 2.1 time: 0.289637 Jun 16 18:46:54.229946 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1794/3670] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:53 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1296 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:54.510688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-124b7471-d419-4d86-8d6c-740ab216689c req-236cc005-7052-4f60-9665-a6723e135d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c93d90-ad38-4326-9bb6-4c38b39891ac", "tag": "eb1ba32b-d248-475f-874f-fd6a54c3990d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:54.531895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-124b7471-d419-4d86-8d6c-740ab216689c req-236cc005-7052-4f60-9665-a6723e135d4a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:54.535111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-124b7471-d419-4d86-8d6c-740ab216689c req-236cc005-7052-4f60-9665-a6723e135d4a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:54.568027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-124b7471-d419-4d86-8d6c-740ab216689c req-236cc005-7052-4f60-9665-a6723e135d4a service nova] Creating event network-changed:eb1ba32b-d248-475f-874f-fd6a54c3990d for instance d0c93d90-ad38-4326-9bb6-4c38b39891ac on n-h1-846209-2 Jun 16 18:46:54.581647 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-124b7471-d419-4d86-8d6c-740ab216689c req-236cc005-7052-4f60-9665-a6723e135d4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074858 Jun 16 18:46:54.585065 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1877/3671] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:54.832248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:54.834748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:54.866045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:54.870448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:54.875382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:54.877954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:54.933566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:54.935153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:54.973164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:54.974574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:54.977963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:54.980382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:55.158461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:55.171073 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-000f7836-cd5d-41b0-8571-6ea4a37af074 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1213 microversion: 2.1 time: 0.348411 Jun 16 18:46:55.182428 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1795/3672] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:54 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1213 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:55.247894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:55.249010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:55.261432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:55.266597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:55.267816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:55.268445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:55.493462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:55.513695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:55.523088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:55.525316 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d1d09ad-449e-47af-afb3-7e30e52c79d9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 0.598393 Jun 16 18:46:55.543392 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1878/3673] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:54 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:55.834839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:55.849320 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0b8a7cc8-0f9b-4579-a7c3-b1f385a61993 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1363 microversion: 2.1 time: 0.607075 Jun 16 18:46:55.850544 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1796/3674] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:55 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1363 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:46:56.203722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:56.204409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:56.222163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:56.222976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:56.226718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:56.227394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:56.364729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3f2f1819-0e8f-4142-b031-ee0281d66f54 req-81f23f86-14a6-477a-8159-67ccd93563c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:56.394100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3f2f1819-0e8f-4142-b031-ee0281d66f54 req-81f23f86-14a6-477a-8159-67ccd93563c4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:56.396695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3f2f1819-0e8f-4142-b031-ee0281d66f54 req-81f23f86-14a6-477a-8159-67ccd93563c4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:56.449077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3f2f1819-0e8f-4142-b031-ee0281d66f54 req-81f23f86-14a6-477a-8159-67ccd93563c4 service nova] Creating event network-changed:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:46:56.468585 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3f2f1819-0e8f-4142-b031-ee0281d66f54 req-81f23f86-14a6-477a-8159-67ccd93563c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107880 Jun 16 18:46:56.473398 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1797/3675] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:56.548356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:56.549411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:56.550225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:56.562670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:56.563297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7d59a38a-d02c-4efa-b86c-dc9f9780b4c5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1275 microversion: 2.1 time: 0.362227 Jun 16 18:46:56.563940 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1879/3676] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:56 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:56.567246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:56.568337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:56.570637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:56.974289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2134771823", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": "none"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:57.091615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:46:57.094471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:46:57.095344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:46:57.096005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:46:57.096743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:46:57.131660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:57.134600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:57.135757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:57.136431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:57.161087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Getting quotas for project 149b009bc3ef425e9546387781bb626e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:57.169818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Getting quotas for user f3c449f289ff43ca9737612cd2a389c6 and project 149b009bc3ef425e9546387781bb626e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:57.188129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:46:57.191136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:46:57.255352 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19c62115-b178-49e2-a1f9-50509dca79cf tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.545458 Jun 16 18:46:57.256526 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1880/3677] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:46:57.267154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:57.268318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:57.285842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:57.294669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:57.297109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:57.301172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:57.628606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:57.645174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:57.646758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:57.648166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7211d6dc-22f3-424a-8019-45536eed1201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 1.103134 Jun 16 18:46:57.669246 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1798/3678] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:56 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:46:57.688004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ace5b38-dc30-42c6-a252-3981d3bca329 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:57.700084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ace5b38-dc30-42c6-a252-3981d3bca329 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:58.139247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ace5b38-dc30-42c6-a252-3981d3bca329 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:58.149725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ace5b38-dc30-42c6-a252-3981d3bca329 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:58.159589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ace5b38-dc30-42c6-a252-3981d3bca329 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:58.161106 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ace5b38-dc30-42c6-a252-3981d3bca329 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 200 len: 1278 microversion: 2.47 time: 0.490791 Jun 16 18:46:58.161820 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1799/3679] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:57 2022] GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 1278 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:58.206735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:58.207375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:58.235949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:58.236426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:58.237237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:58.237681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:58.246302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:58.265213 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c5554d9-c799-49e8-9415-2ef12aa88bdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1363 microversion: 2.1 time: 1.004180 Jun 16 18:46:58.267753 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1881/3680] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:57 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1363 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:58.456895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1737214607", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": "none"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:58.570508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:46:58.571346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:46:58.572014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:46:58.572602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:46:58.573211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:46:58.593290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:58.595741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:58.599754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:58.601417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:58.640599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Getting quotas for project 149b009bc3ef425e9546387781bb626e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:46:58.647012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Getting quotas for user f3c449f289ff43ca9737612cd2a389c6 and project 149b009bc3ef425e9546387781bb626e. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:46:58.665820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:46:58.669063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:46:58.683806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:58.742495 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6b3a661e-4d63-4c46-90ed-403e4a7e8290 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.289359 Jun 16 18:46:58.743556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1882/3681] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 18:46:58.754004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:58.756669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:58.773396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:58.773895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:58.774688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:58.775166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:59.926904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:59.945042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:59.946603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:59.948035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-35d0489f-e64f-400e-9b92-4d4497fb3592 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 1.203217 Jun 16 18:46:59.949126 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1883/3682] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:46:58 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:46:59.956459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b3222fe6-c17d-4ce4-ba4b-4a9e0cd266b9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:59.964641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b3222fe6-c17d-4ce4-ba4b-4a9e0cd266b9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:59.993868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3222fe6-c17d-4ce4-ba4b-4a9e0cd266b9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:59.994518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3222fe6-c17d-4ce4-ba4b-4a9e0cd266b9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:59.995608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3222fe6-c17d-4ce4-ba4b-4a9e0cd266b9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:59.996609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:59.999621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3222fe6-c17d-4ce4-ba4b-4a9e0cd266b9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:00.012179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-315a6e14-2cd1-416c-ac15-88b46d17c457 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 1.816627 Jun 16 18:47:00.014227 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1800/3683] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:58 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:00.030264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:00.031447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:00.038654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:00.039513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:00.040512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:00.041334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:00.086613 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b3222fe6-c17d-4ce4-ba4b-4a9e0cd266b9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "PUT /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1048 microversion: 2.47 time: 0.133177 Jun 16 18:47:00.098010 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1884/3684] 10.222.0.27 () {62 vars in 1296 bytes} [Thu Jun 16 18:46:59 2022] PUT /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1048 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:00.112407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:00.113333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:00.126942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:00.127681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:00.128651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:00.129263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:00.332982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:00.343609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:00.345183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:00.350199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0b169c77-539d-4dee-b4df-35e73b3356d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1330 microversion: 2.47 time: 0.241635 Jun 16 18:47:00.366775 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1885/3685] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:00 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1330 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:47:00.515965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:00.526287 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00951a95-f440-45f3-957b-1d7008871861 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1363 microversion: 2.1 time: 0.509989 Jun 16 18:47:00.527916 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1801/3686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:00 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:00.972143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:00.972757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:00.986855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:00.988489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:00.989849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:00.990846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:01.032212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:01.032934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:01.039415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:01.040253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:01.040783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:01.041946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:01.042642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:01.465018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.486397 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b038162c-7f9f-4df1-892d-291bc2bb4e9e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 0.459439 Jun 16 18:47:01.495348 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1802/3687] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:01 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:01.512611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.532855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:01.533498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:01.534523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.536245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.542836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:01.545951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c516884e-4c5d-403a-8db1-473440cf5e11 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1753 microversion: 2.20 time: 0.570547 Jun 16 18:47:01.547787 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1886/3688] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:00 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1753 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:01.568740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:01.569538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:01.570551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:01.571204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:01.572893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:01.575548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:01.599978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:01.600481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:01.601292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:01.604015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:01.697296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.709748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.714529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.715747 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7bfef52-57a1-47b6-8813-58845b5ccb80 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1336 microversion: 2.47 time: 0.218210 Jun 16 18:47:01.718987 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1803/3689] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:01 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1336 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:01.926062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:01.954645 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-795ed29e-6dd4-4ab2-8bc8-0bf5379515a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1363 microversion: 2.1 time: 0.405523 Jun 16 18:47:01.956138 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1887/3690] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:01 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:01.974032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5571669a-96b8-4aa0-8744-3f1df72cff0b req-dba37ab8-70ce-4081-81f9-c5beb8154e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14159429-d942-4e87-8426-d571ff7a2825", "tag": "b7d2fe38-e299-4efa-8ece-089608fbc478"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:02.022755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5571669a-96b8-4aa0-8744-3f1df72cff0b req-dba37ab8-70ce-4081-81f9-c5beb8154e8e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:02.035962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5571669a-96b8-4aa0-8744-3f1df72cff0b req-dba37ab8-70ce-4081-81f9-c5beb8154e8e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:02.082684 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5571669a-96b8-4aa0-8744-3f1df72cff0b req-dba37ab8-70ce-4081-81f9-c5beb8154e8e service nova] Creating event network-changed:b7d2fe38-e299-4efa-8ece-089608fbc478 for instance 14159429-d942-4e87-8426-d571ff7a2825 on n-h1-846209-2 Jun 16 18:47:02.100082 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5571669a-96b8-4aa0-8744-3f1df72cff0b req-dba37ab8-70ce-4081-81f9-c5beb8154e8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132735 Jun 16 18:47:02.101824 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1804/3691] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:02.511989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:02.512666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:02.550313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:02.550779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:02.551736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:02.552187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:02.565356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:02.566839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:02.579965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:02.583826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:02.586954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:02.587414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.184228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.195069 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-20ee41d9-ec15-4402-8240-c024744b219e tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 0.687256 Jun 16 18:47:03.199291 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1888/3692] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:02 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:03.212279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:03.219680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:03.230377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.230990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.231375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.242586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.243100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.244128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.255776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.262075 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-392201ec-0db1-4add-964d-d9ca5c89c041 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.701727 Jun 16 18:47:03.263250 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1805/3693] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:02 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:03.277693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:03.280005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:03.291119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.294189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.295326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.298316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.384572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.396820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.400793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.403058 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55f4e041-56ed-4ea3-b96c-485307db53ed tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1357 microversion: 2.47 time: 0.202123 Jun 16 18:47:03.403804 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1889/3694] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:03 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:03.421155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:03.427462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:03.429040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:03.454825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.455569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.456519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.465880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.630077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:47:03.633575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:47:03.634752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:47:03.635818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:47:03.636847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:47:03.736919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:03.753585 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-07084b68-0a6e-4bb1-b65b-2cf7854a8396 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1363 microversion: 2.1 time: 0.488206 Jun 16 18:47:03.758626 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1806/3695] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:03 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:03.816173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:03.849094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.858318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.863842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:03.870110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:03.928690 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3db8db2-ecc4-4e7f-b3f7-79d1ae9f972f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "POST /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48/action" status: 202 len: 1079 microversion: 2.47 time: 0.508878 Jun 16 18:47:03.938140 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1890/3696] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:47:03 2022] POST /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48/action => generated 1079 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 16 18:47:03.972229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:03.973746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:04.033426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.047681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.057991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.058723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.170798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:04.182933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:04.185464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:04.187371 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-645e0591-9f5f-4f1f-b9ec-b2f8b185a54e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.240657 Jun 16 18:47:04.195960 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1807/3697] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:03 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:04.216007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:04.216631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:04.225006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.225288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.230992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.232339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.281277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:04.281894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:04.293504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.296872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.298038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.300929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.512223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:04.548610 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-260a12a0-e9f0-45c4-8856-dbf2e7f67739 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 0.331623 Jun 16 18:47:04.557956 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1891/3698] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:04 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:04.627915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:04.642975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:04.647586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:04.649124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2723cb03-f58f-4d36-a77a-dddac1f72164 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.372130 Jun 16 18:47:04.650986 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1808/3699] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:04 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:04.776706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:04.778043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:04.793431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.794030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.795686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:04.796434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:04.997724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:05.010012 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0cfc5c49-5338-436e-93bc-4bf781fefafa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1363 microversion: 2.1 time: 0.237445 Jun 16 18:47:05.011385 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1892/3700] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:04 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:05.185228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bbd1b8a4-63c1-43e9-bf2e-c0e03286820d req-4f7343db-65be-49da-a48a-9a155b13604e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-plugged", "status": "completed", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:05.223104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bbd1b8a4-63c1-43e9-bf2e-c0e03286820d req-4f7343db-65be-49da-a48a-9a155b13604e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:05.224958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bbd1b8a4-63c1-43e9-bf2e-c0e03286820d req-4f7343db-65be-49da-a48a-9a155b13604e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:05.240924 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bbd1b8a4-63c1-43e9-bf2e-c0e03286820d req-4f7343db-65be-49da-a48a-9a155b13604e service nova] Creating event network-vif-plugged:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:47:05.250045 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bbd1b8a4-63c1-43e9-bf2e-c0e03286820d req-4f7343db-65be-49da-a48a-9a155b13604e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067494 Jun 16 18:47:05.251306 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1893/3701] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:05.259272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:05.260400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:05.272219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:05.273540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:05.274615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:05.275978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:05.419641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1420401590", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:05.480905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:05.494141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:05.507903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:05.512841 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88039923-c48f-4cad-a92e-70c524552fd9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.260206 Jun 16 18:47:05.516041 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1894/3702] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:05 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:05.543059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] validate_networks() for [('bd502f9e-6186-4173-bbab-b814030e03fd', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:47:05.568921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:05.569942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:05.585978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:05.586983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:05.589685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:05.593313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:06.419443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:47:06.419871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:47:06.420697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:47:06.421020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:47:06.421562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:47:06.435196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:06.447178 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bfc30cb2-c5f9-4bb7-a27e-8d5a9f999507 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 0.884557 Jun 16 18:47:06.472296 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1895/3703] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:05 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:06.478503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:06.479281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:06.480385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:06.481304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:06.497496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:06.499525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:06.505390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Getting quotas for project 2417e0463f644ca086ae3f2db4a58a84. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:47:06.512619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Getting quotas for user 71c134f43ffe4b57a10c03105a3fcf0c and project 2417e0463f644ca086ae3f2db4a58a84. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:47:06.526387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:06.529105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:47:06.531752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:06.533338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:47:06.534279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:06.534744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:06.619883 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0defc5b0-9593-4720-8f5d-7b073b2c7d63 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.515082 Jun 16 18:47:06.625559 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1809/3704] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:47:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:47:06.632050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:06.652980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:06.673478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:06.674747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:06.675176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:06.675631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:07.105685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.134606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.155114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7ed0dd81-8ec3-49cb-ba25-177d5d1e1f9a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1363 microversion: 2.1 time: 0.523727 Jun 16 18:47:07.157024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.168768 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1810/3705] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:06 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:07.172906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.176028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:07.176824 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9acf4e5-aeb6-4add-8da8-4f8a9980f710 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.702200 Jun 16 18:47:07.177394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:07.178385 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1896/3706] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:06 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:07.196994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:07.197781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:07.201176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12fb76fb-45d6-4cde-a9c2-4e389d2bc831 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:07.202250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12fb76fb-45d6-4cde-a9c2-4e389d2bc831 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:07.205418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:07.206108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:07.336138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12fb76fb-45d6-4cde-a9c2-4e389d2bc831 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.348149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12fb76fb-45d6-4cde-a9c2-4e389d2bc831 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1224 microversion: 2.1 time: 0.166358 Jun 16 18:47:07.362630 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1897/3707] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:07 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:07.423147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.446516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.448604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.453791 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91051cb1-fda5-457b-aa94-43683370649e tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.284559 Jun 16 18:47:07.455306 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1811/3708] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:07 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:07.466701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:07.468161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:07.475479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:07.476381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:07.477979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:07.479426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:07.743892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:07.760575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ce5d06e9-109f-4d37-b66c-38ccb7c29772 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 0.297615 Jun 16 18:47:07.762132 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1898/3709] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:07 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:47:08.175474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:08.176323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:08.193787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:08.199803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:08.200253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:08.204345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:08.205749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:08.211421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:08.235175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:08.235671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:08.239789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:08.241799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:08.625648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:08.921666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:08.935044 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83f10f96-2ada-4b0a-9b11-a1f1233cadb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1550 microversion: 2.1 time: 0.764251 Jun 16 18:47:08.939625 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1812/3710] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:08 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1550 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:08.950504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:08.959990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:08.984571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:08.998293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:08.999834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.004061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:09.004990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.008556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:09.012130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:09.014940 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3256c004-3dac-486d-953b-76379396689d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.822485 Jun 16 18:47:09.028862 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1899/3711] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:08 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:09.041567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:09.044012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:09.079085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:09.080558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.084092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:09.086427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.150824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:09.154167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:09.177351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b2766e6d-1720-4caa-819c-6c5711c6f299 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1220 microversion: 2.1 time: 0.233831 Jun 16 18:47:09.182176 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1813/3712] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:08 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1220 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:09.197010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:09.197955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:09.210470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:09.224894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.231705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:09.235650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.290139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:09.304200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:09.307117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:09.312383 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88868b64-a43f-4c32-be15-2783ed6b1ad9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.278023 Jun 16 18:47:09.313763 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1900/3713] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:09 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:09.320347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-09d5334d-db91-4271-8a13-79f13901056b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:09.321082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-09d5334d-db91-4271-8a13-79f13901056b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:09.363426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09d5334d-db91-4271-8a13-79f13901056b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:09.371667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09d5334d-db91-4271-8a13-79f13901056b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.372768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09d5334d-db91-4271-8a13-79f13901056b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:09.374486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09d5334d-db91-4271-8a13-79f13901056b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:09.612131 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-09d5334d-db91-4271-8a13-79f13901056b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.296737 Jun 16 18:47:09.613159 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1901/3714] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:47:09 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:09.709018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:09.726028 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ea392f84-b5ff-4dbb-bf4d-330ea4692447 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 0.541078 Jun 16 18:47:09.726554 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1814/3715] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:09 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:10.035616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:10.041812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:10.069456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:10.070318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:10.073075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:10.074822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:10.116639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-52a5e7e9-0a85-4354-97b3-ab29d84c8505 req-bf8018cd-a38c-4e03-b8b4-64044c878da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14159429-d942-4e87-8426-d571ff7a2825", "name": "network-vif-plugged", "status": "completed", "tag": "b7d2fe38-e299-4efa-8ece-089608fbc478"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:10.146467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-52a5e7e9-0a85-4354-97b3-ab29d84c8505 req-bf8018cd-a38c-4e03-b8b4-64044c878da3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:10.147303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-52a5e7e9-0a85-4354-97b3-ab29d84c8505 req-bf8018cd-a38c-4e03-b8b4-64044c878da3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:10.199337 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-52a5e7e9-0a85-4354-97b3-ab29d84c8505 req-bf8018cd-a38c-4e03-b8b4-64044c878da3 service nova] Creating event network-vif-plugged:b7d2fe38-e299-4efa-8ece-089608fbc478 for instance 14159429-d942-4e87-8426-d571ff7a2825 on n-h1-846209-2 Jun 16 18:47:10.209405 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-52a5e7e9-0a85-4354-97b3-ab29d84c8505 req-bf8018cd-a38c-4e03-b8b4-64044c878da3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097018 Jun 16 18:47:10.210699 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1815/3716] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:10.217820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:10.218979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:10.241635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:10.242516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:10.243521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:10.244213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:11.233040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.243376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.252647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.258008 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59381951-6f63-4440-84c3-63f6951aacf1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 1.227633 Jun 16 18:47:11.259744 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1902/3717] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:10 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:11.276166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:11.277162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:11.286525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:11.287577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:11.288653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:11.289503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:11.296708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:11.414572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.431478 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd31db5b-7dcc-43a6-82bf-b7e863fc704f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1294 microversion: 2.1 time: 1.219073 Jun 16 18:47:11.436512 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1816/3718] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:10 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1294 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:11.450525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:11.451725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:11.472149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:11.474442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:11.476313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:11.477680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:11.510726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.538001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.540530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.548145 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ebd821cf-fb91-42ca-b0af-b4012cfd9091 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.273948 Jun 16 18:47:11.556817 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1903/3719] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:11 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:11.962298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:11.980816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f8661534-6302-480e-8468-3c09e4cd383a tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1317 microversion: 2.1 time: 0.542849 Jun 16 18:47:11.987001 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1817/3720] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:11 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:12.279823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:12.282676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:12.304949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:12.308245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:12.309826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:12.310576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:12.453591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:12.455662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:12.467469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:12.467938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:12.468942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:12.469161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:12.657294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:12.669565 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3bbd130-31d5-4203-be8c-3e0c8c017fad tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1282 microversion: 2.1 time: 0.220423 Jun 16 18:47:12.678646 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1818/3721] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:12 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1282 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:12.685754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:12.693609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:12.718388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:12.719341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:12.720501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:12.726346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:12.962325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:12.974725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:12.976213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:12.977606 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-68013c34-7791-4ddd-9fa9-ef7ce60e4f21 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.297581 Jun 16 18:47:12.995995 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1819/3722] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:12 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:13.015303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:13.016931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:13.036713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:13.038253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:13.039155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:13.042401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:13.049083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:13.060117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:13.067755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:13.073373 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab36e029-3e3a-4605-bf8b-0920a88c9696 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.798511 Jun 16 18:47:13.092567 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1904/3723] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:12 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:13.333492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f19b5752-e7b6-4888-89ae-7c61c78ed969 req-7cc0da7b-f6ce-426b-8822-a5840e02e822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:13.354955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f19b5752-e7b6-4888-89ae-7c61c78ed969 req-7cc0da7b-f6ce-426b-8822-a5840e02e822 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:13.360681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f19b5752-e7b6-4888-89ae-7c61c78ed969 req-7cc0da7b-f6ce-426b-8822-a5840e02e822 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:13.399183 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f19b5752-e7b6-4888-89ae-7c61c78ed969 req-7cc0da7b-f6ce-426b-8822-a5840e02e822 service nova] Creating event network-changed:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:47:13.426131 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f19b5752-e7b6-4888-89ae-7c61c78ed969 req-7cc0da7b-f6ce-426b-8822-a5840e02e822 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094305 Jun 16 18:47:13.429462 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1905/3724] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:13.697865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:13.698984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:13.716387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:13.718765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:13.719232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:13.725162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:13.725662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:13.731249 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dfe2ae67-c921-480b-a0e0-02150ae18587 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1506 microversion: 2.1 time: 0.728636 Jun 16 18:47:13.733487 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1820/3725] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:13 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:13.997435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:13.998458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:14.013165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:14.017404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:14.018526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:14.021121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:14.120090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:14.134189 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aed04d7b-7b59-430f-bd60-943b9ea4d991 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1282 microversion: 2.1 time: 0.439828 Jun 16 18:47:14.146161 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1906/3726] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:13 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1282 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:47:14.154230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:14.155404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:14.163681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:14.164558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:14.172564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:14.173667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:14.821243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:14.844030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:14.845763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:14.858273 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bd9dfd7c-3f0d-4a65-8c4e-7c6e179c45bd tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.863664 Jun 16 18:47:14.859982 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1821/3727] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:13 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:15.153346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:15.154013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:15.169782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:15.178531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:15.179749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:15.181393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:15.271248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:15.285714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:15.292481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:15.299198 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b2e585ee-361d-4129-bf06-6eec5a1618c8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 1.150775 Jun 16 18:47:15.300081 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1907/3728] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:14 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:15.878462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:15.891064 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35351b38-0282-4da7-a14d-4d208fefdea3 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.742188 Jun 16 18:47:15.895779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:15.896463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:15.910402 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1822/3729] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:15 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:15.939286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:15.950139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:15.953813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:15.962934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.195141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:16.208730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:16.212670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:16.223158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d64c946a-ac85-4a86-8cf6-99769b74585a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.333444 Jun 16 18:47:16.225739 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1908/3730] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:15 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:16.327809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:16.330330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:16.357083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.358472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.361429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.362833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.496209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:16.511344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "994566b7-6e03-4ad4-8721-96930ac1650c"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:16.513404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:16.523960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=24 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:16.533245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.535987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.539997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.540544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.626671 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] HTTP exception thrown: Volume de5e201c-55ac-4c6a-8666-11c1b6a90256 could not be found. Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Request method failure captured: Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: request: PUT /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825/os-volume_attachments/de5e201c-55ac-4c6a-8666-11c1b6a90256 HTTP/1.1 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 74 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3ovbpSZxA2810R9zrQHryc-1XV3OTQugU7lc6t9DmikCrc7oqavdV3Eds-fcHCuVkYXBhDwB6dKEmgTJOdScSOkt8dKXqAzefMm3oMHYfXl_RUH7LkSCQep7H5v7p3koLz0ZSwuITIZsiO6hqaN6OAls6jTaItK-jkd-cP84iQQt3c Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5881fc50718d4b3abfcc9151355212f6 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesAdminNegativeTest-1634604682 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5881fc50718d4b3abfcc9151355212f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5881fc50718d4b3abfcc9151355212f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5881fc50718d4b3abfcc9151355212f6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5881fc50718d4b3abfcc9151355212f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesAdminNegativeTest-1634604682 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5881fc50718d4b3abfcc9151355212f6 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1634604682 Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesAdminNegativeTest-1634604682-project-admin Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 2f656c5d905c443a97efadb7678944da Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesAdminNegativeTest-1634604682-project-admin Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: {"volumeAttachment": {"volumeId": "994566b7-6e03-4ad4-8721-96930ac1650c"}} Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: exception: Volume de5e201c-55ac-4c6a-8666-11c1b6a90256 could not be found. Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'server_id': '14159429-d942-4e87-8426-d571ff7a2825', 'id': 'de5e201c-55ac-4c6a-8666-11c1b6a90256', 'body': {'volumeAttachment': {'volumeId': '994566b7-6e03-4ad4-8721-96930ac1650c'}}} Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de5e201c-55ac-4c6a-8666-11c1b6a90256 could not be found. (HTTP 404) (Request-ID: req-f2c1c678-4f43-4552-bcfb-0d3463afb65f) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:47:16.629036 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de5e201c-55ac-4c6a-8666-11c1b6a90256 could not be found. Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de5e201c-55ac-4c6a-8666-11c1b6a90256 could not be found. Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de5e201c-55ac-4c6a-8666-11c1b6a90256 could not be found. Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] Returning 404 to user: Volume de5e201c-55ac-4c6a-8666-11c1b6a90256 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f83c39a9-0c37-4bf9-8db5-c983a80ad89b tempest-VolumesAdminNegativeTest-1634604682 tempest-VolumesAdminNegativeTest-1634604682-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825/os-volume_attachments/de5e201c-55ac-4c6a-8666-11c1b6a90256" status: 404 len: 109 microversion: 2.1 time: 0.136375 Jun 16 18:47:16.633766 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1909/3731] 10.222.0.27 () {60 vars in 1432 bytes} [Thu Jun 16 18:47:16 2022] PUT /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825/os-volume_attachments/de5e201c-55ac-4c6a-8666-11c1b6a90256 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:47:16.658961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:16.674931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:16.680132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:16.682139 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94676f11-a617-429a-a4eb-9aee20937657 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.367912 Jun 16 18:47:16.682722 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1823/3732] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:16 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:16.909828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:16.911795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:16.931907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.939274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.943801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.945441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:17.258478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:17.262688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:17.283925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:17.287286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:17.290498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:17.291260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:17.342151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=14 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:17.404759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:17.417887 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-afa22c67-b158-425e-9afe-3f5589945653 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.512437 Jun 16 18:47:17.420541 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1910/3733] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:16 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:17.525341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:17.548369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:17.553112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:17.564591 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a3da8ce-a7ab-4f18-b7c6-b593a3b3c6b2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.324963 Jun 16 18:47:17.569794 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1824/3734] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:17 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:17.703785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:17.704493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:17.725212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:17.726996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:17.728544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:17.729240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:17.988078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ffa1f66d-77bf-44ba-a0ef-221218c41663 req-0f6abafa-6f3d-4d69-be32-175893b6bf77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63a67b3-23b6-41db-84d6-3b562059cb64", "tag": "7da62769-bea3-4a58-ab55-2567e9e2687d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:18.002790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ffa1f66d-77bf-44ba-a0ef-221218c41663 req-0f6abafa-6f3d-4d69-be32-175893b6bf77 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:18.011703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ffa1f66d-77bf-44ba-a0ef-221218c41663 req-0f6abafa-6f3d-4d69-be32-175893b6bf77 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:18.071102 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ffa1f66d-77bf-44ba-a0ef-221218c41663 req-0f6abafa-6f3d-4d69-be32-175893b6bf77 service nova] Creating event network-changed:7da62769-bea3-4a58-ab55-2567e9e2687d for instance f63a67b3-23b6-41db-84d6-3b562059cb64 on n-h2-846209-2 Jun 16 18:47:18.096439 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ffa1f66d-77bf-44ba-a0ef-221218c41663 req-0f6abafa-6f3d-4d69-be32-175893b6bf77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119592 Jun 16 18:47:18.106441 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1825/3735] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:18.200088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:18.210918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:18.214237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:18.215679 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e5e710d-26c4-486c-83dd-cc28704924da tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.516543 Jun 16 18:47:18.216825 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1911/3736] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:17 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:18.439951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:18.441764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:18.451924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:18.453069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:18.454674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:18.455135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:18.594022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:18.594840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:18.601526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:18.602287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:18.603334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:18.603937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:18.632114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:18.641633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c6b2d332-ca02-4f51-b4bb-488516d5a529 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.207675 Jun 16 18:47:18.643483 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1826/3737] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:18 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:18.688832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:18.699539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:18.701601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:18.702894 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-91454562-d800-44f8-a963-aedb3c21604a tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.115462 Jun 16 18:47:18.707791 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1912/3738] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:18 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:19.236220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:19.236843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:19.244345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:19.244952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:19.246583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:19.247544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:19.440313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:19.451039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:19.454419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:19.455960 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4903514e-cd4a-46e2-8e07-acbe3a86ad30 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.223815 Jun 16 18:47:19.457137 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1827/3739] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:19 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:19.660388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:19.661036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:19.667814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:19.668342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:19.669177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:19.669687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:19.724219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:19.725237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:19.733467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:19.734175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:19.735300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:19.735914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:19.831471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:19.843097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:19.844680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:19.845949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-adb4d966-6513-4351-a220-fe2fc6053dc8 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.125768 Jun 16 18:47:19.848191 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1828/3740] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:19 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:47:19.853158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:19.865049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-632b1b6b-89ce-4b82-b714-6cd8291aac04 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.208694 Jun 16 18:47:19.866366 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1913/3741] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:19 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:20.134950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:20.135462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:20.146150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.146150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.147227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.147527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.182130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:47:20.305089 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c625ecf7-fb56-4828-9061-be1e5b5f9d08 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "DELETE /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 204 len: 0 microversion: 2.1 time: 0.174651 Jun 16 18:47:20.306103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1829/3742] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:47:20 2022] DELETE /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:47:20.314451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:20.315770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:20.322460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.323216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.324109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.324622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.478957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:20.479293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:20.480159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:20.489044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.489779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.490266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4dc9ae6c-4295-4c1b-9e05-b8955f449580 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1512 microversion: 2.1 time: 0.179788 Jun 16 18:47:20.491038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.491244 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1914/3743] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:20 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:20.492052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.516720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:20.689268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:20.698568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:20.700624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:20.702155 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ccc261e-d58e-4df7-abf1-00692d901d96 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.230046 Jun 16 18:47:20.712782 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1830/3744] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:20 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:20.865406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:20.866065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:20.879403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.879870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.880933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.881196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.890268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:20.891732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:20.902616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.903477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.905399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:20.906996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:20.979563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:20.991112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:20.996977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:21.001160 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-072a1807-e69b-4630-a7f8-c32b8f8524a2 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.138867 Jun 16 18:47:21.004815 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1915/3745] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:20 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:21.127110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:21.134949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad04dd10-e47f-44f7-a31a-85f93a28f610 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.255785 Jun 16 18:47:21.136083 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1831/3746] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:20 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:47:21.509472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:21.510394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:21.518048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:21.518634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:21.519637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:21.520341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:21.672067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:21.679968 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc35a5fa-930a-4f50-a89f-d30a6c123e46 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1512 microversion: 2.1 time: 0.175220 Jun 16 18:47:21.680554 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1916/3747] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:21 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:21.721263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:21.721824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:21.728006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:21.728471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:21.729245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:21.729875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:21.941001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:21.955719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:21.962214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:21.964110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-af60de44-33bf-43de-8d76-6b1893e0ee97 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.247361 Jun 16 18:47:21.974236 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1832/3748] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:21 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:22.024256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:22.024878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:22.032497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.033200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.034106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.034746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.120357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:22.127948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:22.129892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:22.131503 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f99da7d-cfae-4d7a-b681-d2e455a397e0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.111246 Jun 16 18:47:22.134039 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1917/3749] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:22 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:22.151405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:22.152029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:22.158832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.159348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.160138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.160587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.359352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:22.374714 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-db6fd5eb-daa3-4e97-bc34-88beaca2d697 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.226572 Jun 16 18:47:22.375143 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1833/3750] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:22 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:22.491772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-37c81e30-7979-409b-9fbf-4585bf1899aa req-5d4cdbe3-45b6-4b10-a398-7573f2b9f99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14159429-d942-4e87-8426-d571ff7a2825", "name": "network-vif-deleted", "tag": "b7d2fe38-e299-4efa-8ece-089608fbc478"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:22.504622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-37c81e30-7979-409b-9fbf-4585bf1899aa req-5d4cdbe3-45b6-4b10-a398-7573f2b9f99e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.505878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-37c81e30-7979-409b-9fbf-4585bf1899aa req-5d4cdbe3-45b6-4b10-a398-7573f2b9f99e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.545841 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-37c81e30-7979-409b-9fbf-4585bf1899aa req-5d4cdbe3-45b6-4b10-a398-7573f2b9f99e service nova] Creating event network-vif-deleted:b7d2fe38-e299-4efa-8ece-089608fbc478 for instance 14159429-d942-4e87-8426-d571ff7a2825 on n-h1-846209-2 Jun 16 18:47:22.556078 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-37c81e30-7979-409b-9fbf-4585bf1899aa req-5d4cdbe3-45b6-4b10-a398-7573f2b9f99e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068293 Jun 16 18:47:22.557522 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1918/3751] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:22.696678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:22.697292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:22.704254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.704641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.705432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.705866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.743389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.744207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:22.744380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lazy-loading 'fault' on Instance uuid 14159429-d942-4e87-8426-d571ff7a2825 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:47:22.793725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:22.801203 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16dfc90d-886d-476e-811d-a5aae5a95cc5 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 200 len: 1307 microversion: 2.1 time: 0.108334 Jun 16 18:47:22.801791 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1834/3752] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:22 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:22.985638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:22.986786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:22.997322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:22.999575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.000726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.001564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.007324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-aa1a28cb-e964-4dcc-b8c6-c00eb24ae81e req-2476b3b5-4282-4050-ac05-963970c4d1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63a67b3-23b6-41db-84d6-3b562059cb64", "name": "network-vif-plugged", "status": "completed", "tag": "7da62769-bea3-4a58-ab55-2567e9e2687d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:23.028994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-aa1a28cb-e964-4dcc-b8c6-c00eb24ae81e req-2476b3b5-4282-4050-ac05-963970c4d1fa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.030757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-aa1a28cb-e964-4dcc-b8c6-c00eb24ae81e req-2476b3b5-4282-4050-ac05-963970c4d1fa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.047978 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-aa1a28cb-e964-4dcc-b8c6-c00eb24ae81e req-2476b3b5-4282-4050-ac05-963970c4d1fa service nova] Creating event network-vif-plugged:7da62769-bea3-4a58-ab55-2567e9e2687d for instance f63a67b3-23b6-41db-84d6-3b562059cb64 on n-h2-846209-2 Jun 16 18:47:23.055527 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-aa1a28cb-e964-4dcc-b8c6-c00eb24ae81e req-2476b3b5-4282-4050-ac05-963970c4d1fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052632 Jun 16 18:47:23.056539 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1835/3753] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:23.153492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:23.154798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:23.163708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.164464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.166403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.172019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.188602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:23.207440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:23.214817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:23.216064 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88b17cff-ae3b-4c46-8147-764c23934857 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.236018 Jun 16 18:47:23.218527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1919/3754] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:22 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:23.265834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:23.275344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:23.277071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:23.278414 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-34185de1-3710-47e7-870e-9be53f488fc1 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.129995 Jun 16 18:47:23.279162 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1836/3755] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:23 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:23.391845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:23.392469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:23.398750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.399213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.400030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.400478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.542242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:23.550801 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4d24bab2-70d6-4f35-b4b8-d170817f0a0c tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.163287 Jun 16 18:47:23.551376 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1920/3756] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:23 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:23.818758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:23.819477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 14159429-d942-4e87-8426-d571ff7a2825] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:23.827367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.828241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.829074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:23.829599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:23.844988 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] HTTP exception thrown: Instance 14159429-d942-4e87-8426-d571ff7a2825 could not be found. Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Request method failure captured: Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 HTTP/1.1 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3okBXDzRPiMNfdAGNuOJAz1dGbPHtumcr7Vx2kYw_ZY5pkysd5_vFsyJ2aqRUDlYyYwb1CwnleYnBmqyiPELAs4KaxCAGX0XB_zkxqIzxabzghwv5ICrBdVhkvumwWEovLEFuF852VYtWbeZuI78Uhvots1gDYm1dwemZ2R3TiS9s4 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ad9838adc91d4481b89c898b0fedf24c Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesAdminNegativeTest-746891065 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9838adc91d4481b89c898b0fedf24c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad9838adc91d4481b89c898b0fedf24c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad9838adc91d4481b89c898b0fedf24c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9838adc91d4481b89c898b0fedf24c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesAdminNegativeTest-746891065 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ad9838adc91d4481b89c898b0fedf24c Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-746891065 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesAdminNegativeTest-746891065-project Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 4b2ef3108bed4dbd9911a6e681799d57 Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesAdminNegativeTest-746891065-project Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 14159429-d942-4e87-8426-d571ff7a2825 could not be found. Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '14159429-d942-4e87-8426-d571ff7a2825'} Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14159429-d942-4e87-8426-d571ff7a2825 could not be found. Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14159429-d942-4e87-8426-d571ff7a2825 could not be found. Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:23.846965 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14159429-d942-4e87-8426-d571ff7a2825 could not be found. Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Returning 404 to user: Instance 14159429-d942-4e87-8426-d571ff7a2825 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-24a1e7ee-1031-41da-bc44-219e05d38103 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825" status: 404 len: 111 microversion: 2.1 time: 0.033591 Jun 16 18:47:23.853776 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1837/3757] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:23 2022] GET /compute/v2.1/servers/14159429-d942-4e87-8426-d571ff7a2825 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:47:24.240073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:24.240693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:24.248399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:24.249337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:24.250663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:24.251104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:24.272553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:24.298348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:24.299133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:24.307566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:24.308087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:24.308982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:24.309535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:24.421306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:24.436149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:24.439292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:24.441142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c49d2ac2-285c-4850-b532-f2265283525d tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.147176 Jun 16 18:47:24.442318 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1838/3758] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:24 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:47:24.467603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:24.477427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:24.479144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:24.480402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51ad7f8e-2f55-40dd-8592-542bcce2bb51 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.244470 Jun 16 18:47:24.480997 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1921/3759] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:24 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:24.574466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:24.575314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:24.584544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:24.585499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:24.586557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:24.587773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:24.746580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:24.755396 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a9af4f6-6de9-4125-b07f-b651f665591f tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1324 microversion: 2.1 time: 0.189946 Jun 16 18:47:24.756197 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1839/3760] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:24 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1324 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:25.462741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:25.463356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:25.471372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:25.471841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:25.472631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:25.473073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:25.499864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:25.500485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:25.507840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:25.508317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:25.509214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:25.509543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:25.554565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:25.568449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:25.570031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:25.577634 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b0f6a21-22d0-4d6d-9624-593614997b4f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.118921 Jun 16 18:47:25.588724 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1922/3761] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:25 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:25.679584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:25.691641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:25.693603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:25.694851 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8854eced-3b9f-445c-9d54-b0560e201037 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.199277 Jun 16 18:47:25.695603 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1840/3762] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:25 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:25.774923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:25.775454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:25.783414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:25.783878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:25.784669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:25.785116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:25.974528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:25.984340 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3eafddd-7a73-4175-9ba3-44bdf6d22d82 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1520 microversion: 2.1 time: 0.213376 Jun 16 18:47:25.985109 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1923/3763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:25 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:26.132167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b766afb-78aa-421b-8a1c-64ccf52aa90d tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-112429724", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b766afb-78aa-421b-8a1c-64ccf52aa90d tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 242 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-112429724", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-112429724', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'bd502f9e-6186-4173-bbab-b814030e03fd'}]}}} Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:26.135072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.141133 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.146362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b766afb-78aa-421b-8a1c-64ccf52aa90d tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:26.146362 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7b766afb-78aa-421b-8a1c-64ccf52aa90d tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016707 Jun 16 18:47:26.146362 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1841/3764] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:47:26 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:47:26.157391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e32896ee-8a2d-4c36-972a-fe404743e852 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:26.157997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e32896ee-8a2d-4c36-972a-fe404743e852 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: 409b30c8-8c24-40ad-9d31-ba2634e867c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:26.163902 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e32896ee-8a2d-4c36-972a-fe404743e852 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] HTTP exception thrown: Instance 409b30c8-8c24-40ad-9d31-ba2634e867c8 could not be found. Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e32896ee-8a2d-4c36-972a-fe404743e852 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/409b30c8-8c24-40ad-9d31-ba2634e867c8/metadata HTTP/1.1 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 409b30c8-8c24-40ad-9d31-ba2634e867c8 could not be found. Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'server_id': '409b30c8-8c24-40ad-9d31-ba2634e867c8'} Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409b30c8-8c24-40ad-9d31-ba2634e867c8 could not be found. Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409b30c8-8c24-40ad-9d31-ba2634e867c8 could not be found. Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.168004 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409b30c8-8c24-40ad-9d31-ba2634e867c8 could not be found. Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e32896ee-8a2d-4c36-972a-fe404743e852 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 404 to user: Instance 409b30c8-8c24-40ad-9d31-ba2634e867c8 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e32896ee-8a2d-4c36-972a-fe404743e852 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/409b30c8-8c24-40ad-9d31-ba2634e867c8/metadata" status: 404 len: 111 microversion: 2.1 time: 0.016936 Jun 16 18:47:26.172534 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1924/3765] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:47:26 2022] GET /compute/v2.1/servers/409b30c8-8c24-40ad-9d31-ba2634e867c8/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:47:26.290801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ab28a23-6fc2-48b8-8763-ced9673ea1cb tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-457255146", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ab28a23-6fc2-48b8-8763-ced9673ea1cb tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 498 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-457255146", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-457255146', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd502f9e-6186-4173-bbab-b814030e03fd'}]}}} Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:47:26.293876 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ab28a23-6fc2-48b8-8763-ced9673ea1cb tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:26.298614 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0ab28a23-6fc2-48b8-8763-ced9673ea1cb tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.008508 Jun 16 18:47:26.304397 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1842/3766] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:47:26 2022] POST /compute/v2.1/servers => generated 687 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:47:26.345162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-951f1802-91fe-4d40-91ac-8f55240bcf70 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1945906080", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-951f1802-91fe-4d40-91ac-8f55240bcf70 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 500 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1945906080", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1945906080', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd502f9e-6186-4173-bbab-b814030e03fd'}]}}} Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:47:26.348869 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.352878 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.357636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-951f1802-91fe-4d40-91ac-8f55240bcf70 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:26.358777 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-951f1802-91fe-4d40-91ac-8f55240bcf70 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.018553 Jun 16 18:47:26.368007 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1925/3767] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:47:26 2022] POST /compute/v2.1/servers => generated 689 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:47:26.412783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11fc82b6-5424-4c70-a11f-b2f14f2cd6b0 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1192899654", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11fc82b6-5424-4c70-a11f-b2f14f2cd6b0 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 754 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1192899654", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1192899654', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd502f9e-6186-4173-bbab-b814030e03fd'}]}}} Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.417982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:47:26.421719 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:47:26.428024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.428024 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.428367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11fc82b6-5424-4c70-a11f-b2f14f2cd6b0 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:26.429635 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-11fc82b6-5424-4c70-a11f-b2f14f2cd6b0 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021615 Jun 16 18:47:26.438755 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1843/3768] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:47:26 2022] POST /compute/v2.1/servers => generated 1197 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 16 18:47:26.547918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17bf67c4-1829-4225-bf45-38cd4ab00374 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1931609150", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17bf67c4-1829-4225-bf45-38cd4ab00374 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 1266 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1931609150", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd502f9e-6186-4173-bbab-b814030e03fd"}]}} Jun 16 18:47:26.551972 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1931609150', 'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd502f9e-6186-4173-bbab-b814030e03fd'}]}}} Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.556363 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:47:26.558512 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:47:26.561810 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 18:47:26.561810 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.561810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17bf67c4-1829-4225-bf45-38cd4ab00374 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:26.561810 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-17bf67c4-1829-4225-bf45-38cd4ab00374 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013451 Jun 16 18:47:26.561810 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1926/3769] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Jun 16 18:47:26 2022] POST /compute/v2.1/servers => generated 2221 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 16 18:47:26.566710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a7bd4fab-a87a-4363-80cb-b9b5698b1d99 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:26.567362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a7bd4fab-a87a-4363-80cb-b9b5698b1d99 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: 8306b0f3-2776-4752-8b32-910f2ac2efcd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:26.572768 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a7bd4fab-a87a-4363-80cb-b9b5698b1d99 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] HTTP exception thrown: Instance 8306b0f3-2776-4752-8b32-910f2ac2efcd could not be found. Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a7bd4fab-a87a-4363-80cb-b9b5698b1d99 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/8306b0f3-2776-4752-8b32-910f2ac2efcd/metadata/test2 HTTP/1.1 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 8306b0f3-2776-4752-8b32-910f2ac2efcd could not be found. Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': '8306b0f3-2776-4752-8b32-910f2ac2efcd', 'id': 'test2'} Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8306b0f3-2776-4752-8b32-910f2ac2efcd could not be found. Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8306b0f3-2776-4752-8b32-910f2ac2efcd could not be found. Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.574516 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8306b0f3-2776-4752-8b32-910f2ac2efcd could not be found. Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a7bd4fab-a87a-4363-80cb-b9b5698b1d99 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 404 to user: Instance 8306b0f3-2776-4752-8b32-910f2ac2efcd could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:26.580659 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a7bd4fab-a87a-4363-80cb-b9b5698b1d99 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/8306b0f3-2776-4752-8b32-910f2ac2efcd/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014176 Jun 16 18:47:26.586669 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1844/3770] 10.222.0.27 () {58 vars in 1280 bytes} [Thu Jun 16 18:47:26 2022] GET /compute/v2.1/servers/8306b0f3-2776-4752-8b32-910f2ac2efcd/metadata/test2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:47:26.601390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:26.602094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:26.609237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:26.610677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.611115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:26.611297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.611888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.612316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.622186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:26.624996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.625653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.626520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.627306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.663346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:47:26.723561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:26.737518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:26.739045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:26.740419 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50b4f8a3-ccc2-4768-b167-dddd754d4948 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.142735 Jun 16 18:47:26.741049 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1927/3771] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:26 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:26.749302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:26.750566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:26.757538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.758428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.759559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.760268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.791927 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e10e019-965b-4ead-a56a-730f40cb6a57 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 204 len: 0 microversion: 2.1 time: 0.192495 Jun 16 18:47:26.793070 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1845/3772] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:47:26 2022] DELETE /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:47:26.823815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:26.824865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:26.852350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.852801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.853572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:26.854131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:26.995526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.015532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.025383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.027065 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33d142ba-0468-4a77-ae0b-ccfadca3e187 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.284762 Jun 16 18:47:27.037075 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1928/3773] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:26 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:27.132939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.140489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ccbf3fed-a5b4-4975-a525-b371ac184999 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2efeabd6-0e6b-4ed9-8c60-fcf13250a9f7"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:27.142979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ccbf3fed-a5b4-4975-a525-b371ac184999 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:27.155492 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-210f21c6-3d76-4604-9e0d-1bd80a9f0ccc tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1526 microversion: 2.1 time: 0.351172 Jun 16 18:47:27.157506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbf3fed-a5b4-4975-a525-b371ac184999 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.158369 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1846/3774] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:26 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1526 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:27.162523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbf3fed-a5b4-4975-a525-b371ac184999 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.163662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbf3fed-a5b4-4975-a525-b371ac184999 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.164034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbf3fed-a5b4-4975-a525-b371ac184999 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.170767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:27.171534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:27.178838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.179563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.180538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.181138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.213433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:47:27.321805 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f258fcdb-fb22-46c9-a2fb-22ae47f45ebb tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 204 len: 0 microversion: 2.1 time: 0.161644 Jun 16 18:47:27.322506 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1847/3775] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:47:27 2022] DELETE /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:47:27.332330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:27.333075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:27.340851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.341592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.342606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.343101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.362753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:27.549663 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ccbf3fed-a5b4-4975-a525-b371ac184999 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422974 Jun 16 18:47:27.556803 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1929/3776] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:47:27 2022] POST /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:27.602974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.612461 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8c4ea8e1-7dac-429f-b78b-7d75b6e67cdc tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1681 microversion: 2.1 time: 0.284485 Jun 16 18:47:27.613470 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1848/3777] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:27 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:27.761440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:27.762243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:27.765936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:27.789120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.789587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.790405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:27.790849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:27.872902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.884866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.886431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:27.887739 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-701a36cb-b07d-4129-bcc5-4c11e8b547d0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.131065 Jun 16 18:47:27.888834 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1930/3778] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:27 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:28.056006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:28.056615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:28.064522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.064977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:28.065978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.066589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:28.177505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:28.178233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:28.192944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.193612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:28.195079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.195590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:28.237414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:28.248518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:28.251059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:28.252554 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7b99b7db-4e80-4e79-8aa7-3afd7603a42f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.200456 Jun 16 18:47:28.253514 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1849/3779] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:28 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:47:28.418913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:28.431957 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c0aeeacc-ee54-46ab-98d2-981808ba0033 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1526 microversion: 2.1 time: 0.259384 Jun 16 18:47:28.432911 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1931/3780] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:28 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1526 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:47:28.630553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:28.631149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:28.638212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.638969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:28.640372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.640824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:28.801966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:28.813922 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a901249d-26aa-45e2-b525-aa70f947ed77 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1681 microversion: 2.1 time: 0.187140 Jun 16 18:47:28.814556 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1850/3781] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:28 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:28.906957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:28.908567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:28.916941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.918352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:28.919997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:28.920967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:29.014655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:29.026277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:29.028274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:29.030365 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89801e59-1842-4e09-a3ab-c46348159b45 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.127765 Jun 16 18:47:29.032142 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1932/3782] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:28 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:29.059065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-91b52c4f-8c74-4c44-9947-bd6590df648c req-7a8e5192-fea0-4659-886b-72f21122be48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b6c0e5-0374-409e-928e-fef329282b9d", "name": "network-vif-plugged", "status": "completed", "tag": "1d6556a3-3abe-405b-9851-474f0b6ab80f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:29.072315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-91b52c4f-8c74-4c44-9947-bd6590df648c req-7a8e5192-fea0-4659-886b-72f21122be48 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:29.073259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-91b52c4f-8c74-4c44-9947-bd6590df648c req-7a8e5192-fea0-4659-886b-72f21122be48 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:29.088071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-91b52c4f-8c74-4c44-9947-bd6590df648c req-7a8e5192-fea0-4659-886b-72f21122be48 service nova] Creating event network-vif-plugged:1d6556a3-3abe-405b-9851-474f0b6ab80f for instance 31b6c0e5-0374-409e-928e-fef329282b9d on n-h2-846209-2 Jun 16 18:47:29.095857 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-91b52c4f-8c74-4c44-9947-bd6590df648c req-7a8e5192-fea0-4659-886b-72f21122be48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041669 Jun 16 18:47:29.097134 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1851/3783] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:29.271307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:29.271924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:29.278055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:29.278514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:29.280353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:29.280941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:29.454461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:29.461791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:29.463491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:29.471235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:29.472177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:29.472323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:29.473305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:29.474012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:29.474185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:29.475613 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e8149fc0-1366-4b65-9e30-95246c92ec56 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.208181 Jun 16 18:47:29.476707 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1933/3784] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:29 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:29.680743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:29.692642 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d2334ce-7990-48fb-bb9a-56179b3be1e1 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1526 microversion: 2.1 time: 0.245298 Jun 16 18:47:29.693901 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1852/3785] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:29 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1526 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:29.831612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:29.832234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:29.840655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:29.841395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:29.843123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:29.844273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:30.033935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:30.051077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:30.051875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:30.056123 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-959bb88d-ba5d-425c-8d16-cb9618a80228 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1681 microversion: 2.1 time: 0.228164 Jun 16 18:47:30.059745 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1934/3786] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:29 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:30.063862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:30.064463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:30.065463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:30.066136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:30.140466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:30.150611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:30.152546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:30.154494 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-132acf87-2ee3-4f32-9bc8-2cad94336799 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.107937 Jun 16 18:47:30.155310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1853/3787] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:30 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:30.495028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:30.495839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:30.526196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:30.532957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:30.534066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:30.537386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:30.881729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:30.898056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:30.900370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:30.906664 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ffed64ae-2ec6-4194-9846-0f79d7b61631 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.415927 Jun 16 18:47:30.917800 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1935/3788] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:30 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:30.928272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:30.931854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:30.954550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:30.955378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:30.956739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:30.957398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:31.115676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c134f43ffe4b57a10c03105a3fcf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417e0463f644ca086ae3f2db4a58a84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:31.132006 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6494bf38-9d32-4f62-b725-249c95619310 tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 200 len: 1309 microversion: 2.1 time: 0.208152 Jun 16 18:47:31.133993 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1936/3789] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:30 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:31.147941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:31.151508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:31.164520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:31.166498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:31.169244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:31.169753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:31.245154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-63a2920d-ffe8-4dff-a44c-c1d7b63ac9d8 req-9d7b6081-b156-43ec-b885-a22ad1bc3c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63a67b3-23b6-41db-84d6-3b562059cb64", "name": "network-vif-deleted", "tag": "7da62769-bea3-4a58-ab55-2567e9e2687d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:31.256430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:31.257113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-63a2920d-ffe8-4dff-a44c-c1d7b63ac9d8 req-9d7b6081-b156-43ec-b885-a22ad1bc3c35 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:31.257743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-63a2920d-ffe8-4dff-a44c-c1d7b63ac9d8 req-9d7b6081-b156-43ec-b885-a22ad1bc3c35 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:31.266989 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8511da66-cd1d-4a1f-be83-841555c707e8 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1614 microversion: 2.1 time: 0.131741 Jun 16 18:47:31.277956 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1937/3790] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:31 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1614 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:31.281500 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-63a2920d-ffe8-4dff-a44c-c1d7b63ac9d8 req-9d7b6081-b156-43ec-b885-a22ad1bc3c35 service nova] Creating event network-vif-deleted:7da62769-bea3-4a58-ab55-2567e9e2687d for instance f63a67b3-23b6-41db-84d6-3b562059cb64 on n-h2-846209-2 Jun 16 18:47:31.284400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:31.285256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:31.286774 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-63a2920d-ffe8-4dff-a44c-c1d7b63ac9d8 req-9d7b6081-b156-43ec-b885-a22ad1bc3c35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.629357 Jun 16 18:47:31.289218 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1854/3791] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:31.292979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:31.293440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:31.294257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:31.295432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:31.394257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:31.405600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:31.415333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:31.418456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28806e38-67e5-41aa-bb8b-53b560f2296f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.137637 Jun 16 18:47:31.423671 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1938/3792] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:31 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:31.939954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:31.941146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:31.956640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:31.957144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:31.958159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:31.959063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.153994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:32.157396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] [instance: f63a67b3-23b6-41db-84d6-3b562059cb64] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:32.164413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:32.164960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.166019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:32.166847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.186740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] HTTP exception thrown: Instance f63a67b3-23b6-41db-84d6-3b562059cb64 could not be found. Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Request method failure captured: Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 HTTP/1.1 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qo_c6Qx1VAi1YbDHDEFQOZEak_WZIsP5EDT3cECd8pCwT3j-EEVFVLlNY8IJNzuCxJAOg4KsI6s6bxhWVrPAqBNIpQ4JQuYJHEzg-kFtQuiNQrN4Y4Kxtq8y0ZutP5GeEYOyeoeV3kPIl6n6K0Rj_fCEtvZIGHqJVYDDbFgdyEFSU Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "tempest-type-1928130410", "name": "tempest-service-410148653", "endpoints": [{"region": "tempest-region-1899248217", "publicURL": "https://url-2098844531.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2417e0463f644ca086ae3f2db4a58a84", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2417e0463f644ca086ae3f2db4a58a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2417e0463f644ca086ae3f2db4a58a84 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-813075475 Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 71c134f43ffe4b57a10c03105a3fcf0c Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-813075475-project Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f63a67b3-23b6-41db-84d6-3b562059cb64 could not be found. Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f63a67b3-23b6-41db-84d6-3b562059cb64'} Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f63a67b3-23b6-41db-84d6-3b562059cb64 could not be found. Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:32.188313 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f63a67b3-23b6-41db-84d6-3b562059cb64 could not be found. Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f63a67b3-23b6-41db-84d6-3b562059cb64 could not be found. Jun 16 18:47:32.193592 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:32.196294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] Returning 404 to user: Instance f63a67b3-23b6-41db-84d6-3b562059cb64 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:32.197499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-58c28c6c-bb94-43d1-b6d8-2ae8aad2160b tempest-ServerMetadataNegativeTestJSON-813075475 tempest-ServerMetadataNegativeTestJSON-813075475-project] 10.222.0.27 "GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64" status: 404 len: 111 microversion: 2.1 time: 0.050081 Jun 16 18:47:32.198572 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1939/3793] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:32 2022] GET /compute/v2.1/servers/f63a67b3-23b6-41db-84d6-3b562059cb64 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:47:32.265443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:32.274340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:32.275880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:32.277087 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2b873e8b-e8c3-48b7-9a6e-eeb439db81a4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1809 microversion: 2.20 time: 0.344310 Jun 16 18:47:32.277664 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1855/3794] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:31 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1809 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:32.297685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:32.298472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:32.309974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:32.310225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.311492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:32.311952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.418395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:32.439761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:32.440394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:32.454040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:32.454505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.455295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:32.455897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.494590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:32.498567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:32.499358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lazy-loading 'fault' on Instance uuid 11cc723a-7d61-4241-bc08-1309b6674872 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:47:32.582566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:32.591321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:32.598829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:32.606501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b2ef3108bed4dbd9911a6e681799d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9838adc91d4481b89c898b0fedf24c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:32.609250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62a8dd4f-e656-468b-aa59-67f759481da4 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.174275 Jun 16 18:47:32.620084 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9438f97a-d227-4a51-9ac8-58161d9a492d tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 200 len: 1332 microversion: 2.1 time: 0.327959 Jun 16 18:47:32.622074 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1940/3795] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:32 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 1332 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:32.637341 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1856/3796] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:32 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:33.301482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:33.303536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:33.314852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:33.315517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:33.316345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:33.316666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b31f97b9-def3-412d-99a2-ce6e57e65ddf req-7e5b8527-35d4-46c8-9efc-acec6390ac64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cc723a-7d61-4241-bc08-1309b6674872", "name": "network-vif-deleted", "tag": "d2307271-c4cf-4845-a3fb-ea0cc26b2a43"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:33.317178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:33.332768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b31f97b9-def3-412d-99a2-ce6e57e65ddf req-7e5b8527-35d4-46c8-9efc-acec6390ac64 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:33.333331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b31f97b9-def3-412d-99a2-ce6e57e65ddf req-7e5b8527-35d4-46c8-9efc-acec6390ac64 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:33.364428 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b31f97b9-def3-412d-99a2-ce6e57e65ddf req-7e5b8527-35d4-46c8-9efc-acec6390ac64 service nova] Creating event network-vif-deleted:d2307271-c4cf-4845-a3fb-ea0cc26b2a43 for instance 11cc723a-7d61-4241-bc08-1309b6674872 on n-h2-846209-2 Jun 16 18:47:33.374780 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b31f97b9-def3-412d-99a2-ce6e57e65ddf req-7e5b8527-35d4-46c8-9efc-acec6390ac64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058206 Jun 16 18:47:33.375974 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1857/3797] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:33.521156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:33.533537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:33.535581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:33.537160 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4fe7116b-d7de-44e5-95d4-0a26d452f407 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1796 microversion: 2.20 time: 0.242451 Jun 16 18:47:33.538326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1941/3798] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:33 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1796 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:33.637088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:33.637799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:33.639695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:33.640385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] [instance: 11cc723a-7d61-4241-bc08-1309b6674872] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:33.652309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:33.653242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:33.655370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:33.657738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:33.658271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:33.659278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:33.660808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:33.662660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:33.695761 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] HTTP exception thrown: Instance 11cc723a-7d61-4241-bc08-1309b6674872 could not be found. Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Request method failure captured: Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 HTTP/1.1 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3okBXDzRPiMNfdAGNuOJAz1dGbPHtumcr7Vx2kYw_ZY5pkysd5_vFsyJ2aqRUDlYyYwb1CwnleYnBmqyiPELAs4KaxCAGX0XB_zkxqIzxabzghwv5ICrBdVhkvumwWEovLEFuF852VYtWbeZuI78Uhvots1gDYm1dwemZ2R3TiS9s4 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: ad9838adc91d4481b89c898b0fedf24c Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesAdminNegativeTest-746891065 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9838adc91d4481b89c898b0fedf24c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad9838adc91d4481b89c898b0fedf24c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad9838adc91d4481b89c898b0fedf24c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9838adc91d4481b89c898b0fedf24c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesAdminNegativeTest-746891065 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: ad9838adc91d4481b89c898b0fedf24c Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-746891065 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesAdminNegativeTest-746891065-project Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 4b2ef3108bed4dbd9911a6e681799d57 Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesAdminNegativeTest-746891065-project Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 11cc723a-7d61-4241-bc08-1309b6674872 could not be found. Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '11cc723a-7d61-4241-bc08-1309b6674872'} Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11cc723a-7d61-4241-bc08-1309b6674872 could not be found. Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11cc723a-7d61-4241-bc08-1309b6674872 could not be found. Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:33.702203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11cc723a-7d61-4241-bc08-1309b6674872 could not be found. Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:33.707609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Returning 404 to user: Instance 11cc723a-7d61-4241-bc08-1309b6674872 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:33.708341 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-379be31a-76fb-4813-a3ed-1c42f264ab9f tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872" status: 404 len: 111 microversion: 2.1 time: 0.072199 Jun 16 18:47:33.709151 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1942/3799] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:33 2022] GET /compute/v2.1/servers/11cc723a-7d61-4241-bc08-1309b6674872 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:47:33.721134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5de0c5cc-420d-4808-9e4c-51f74934cf73 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] Calling method '.version_select at 0x7f866dd5ab80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:33.765296 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5de0c5cc-420d-4808-9e4c-51f74934cf73 tempest-VolumesAdminNegativeTest-746891065 tempest-VolumesAdminNegativeTest-746891065-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006190216" status: 202 len: 0 microversion: 2.1 time: 0.050918 Jun 16 18:47:33.766407 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1943/3800] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:47:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006190216 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:47:33.774412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:33.788726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:33.791417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:33.792848 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a3aae38-dda8-45a0-97c5-8c39697f51ca tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.161410 Jun 16 18:47:33.794765 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1858/3801] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:33 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:34.816663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:34.817343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:34.835941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:34.842358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:34.843784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:34.846683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:35.003519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:35.016799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:35.023013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:35.027060 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b400fe1b-ad30-465c-88f5-8ca3bd7c715f tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.217969 Jun 16 18:47:35.027877 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1944/3802] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:34 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:47:36.049405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:36.050724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:36.069232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:36.069694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:36.070502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:36.076402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:36.191128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:36.208838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:36.216359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:36.218876 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c4f77eb-47f6-476c-8a73-8032be1971c9 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1366 microversion: 2.47 time: 0.175203 Jun 16 18:47:36.220080 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1859/3803] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:36 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:37.239032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:37.239643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:37.247709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:37.248154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:37.248940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:37.249378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:37.363558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:37.383924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:37.385772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:37.390087 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e189971-0eaf-4024-9bfa-42a759178203 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1372 microversion: 2.47 time: 0.152542 Jun 16 18:47:37.390087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1945/3804] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:37 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:38.412904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:38.413626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:38.427835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:38.430630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:38.431711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:38.432990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:38.889428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:38.897816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:38.899738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:38.901114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bcecd0b8-dd65-4ed2-bfa0-57fdba567349 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1372 microversion: 2.47 time: 0.498915 Jun 16 18:47:38.901861 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1860/3805] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:38 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1372 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:39.926315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:39.928279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:39.940988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:39.941768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:39.942809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:39.943681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.038923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:40.053048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:40.054984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:40.056214 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8d845bb-9a31-42f3-b939-7a0492085c51 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1357 microversion: 2.47 time: 0.135579 Jun 16 18:47:40.075901 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1861/3806] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:39 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:40.091015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:40.099795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:40.100798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Searching by: {'deleted': False, 'project_id': '149b009bc3ef425e9546387781bb626e'} {{(pid=119207) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:47:40.111322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:40.111891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.112812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:40.113689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.168752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22351627-5d72-4802-8435-43f3b72d9e82 tempest-ExtensionsTest-329132392 tempest-ExtensionsTest-329132392-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:40.171815 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-22351627-5d72-4802-8435-43f3b72d9e82 tempest-ExtensionsTest-329132392 tempest-ExtensionsTest-329132392-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.472246 Jun 16 18:47:40.172357 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1946/3807] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jun 16 18:47:39 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:40.181263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88813120-ca82-4738-9fcb-50fb56ce4e2b tempest-ExtensionsTest-329132392 tempest-ExtensionsTest-329132392-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:40.189846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88813120-ca82-4738-9fcb-50fb56ce4e2b tempest-ExtensionsTest-329132392 tempest-ExtensionsTest-329132392-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012506 Jun 16 18:47:40.206512 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1947/3808] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jun 16 18:47:40 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:47:40.316467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.multi_cell_list [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119207) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:47:40.421530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:40.435787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:40.437156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.454747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:40.458349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:40.593187 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e9adf333-e2c7-40cd-8f71-0c9a6b8cb093 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.515813 Jun 16 18:47:40.593707 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1862/3809] 10.222.0.27 () {60 vars in 1186 bytes} [Thu Jun 16 18:47:40 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:40.615823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:40.616322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:40.624907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:40.625583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.626581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:40.627184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.661319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:47:40.803104 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af96ec6d-055e-4b79-b4c9-1ec60e97d296 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 204 len: 0 microversion: 2.47 time: 0.191297 Jun 16 18:47:40.805216 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1948/3810] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:47:40 2022] DELETE /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:47:40.820593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:40.822659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:40.843257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:40.846748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.847585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:40.848028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:40.986493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:40.987904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:40.999516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:41.000259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:41.002267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:41.006443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:41.034033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:41.046630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:41.048696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:41.051179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ef5e2873-fe78-4a79-937e-0a2bbcddabfa tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1363 microversion: 2.47 time: 0.240795 Jun 16 18:47:41.052649 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1863/3811] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:40 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:41.063856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lazy-loading 'flavor' on Instance uuid d0c93d90-ad38-4326-9bb6-4c38b39891ac {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:47:41.307799 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-16af48df-7cea-4476-9319-c540f6168e3c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/action" status: 200 len: 32 microversion: 2.1 time: 0.325541 Jun 16 18:47:41.313047 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1949/3812] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:47:40 2022] POST /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/action => generated 32 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:47:41.325379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:41.327422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:41.338470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:41.339687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:41.342539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:41.344110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:42.005313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:42.025157 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d5077d09-5046-4f10-b9a7-da26a2811c18 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.707054 Jun 16 18:47:42.026329 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1864/3813] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:41 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:42.073398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:42.078374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:42.097067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:42.105260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:42.106571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:42.107090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:42.219882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:42.236416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:42.238234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:42.239445 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59354d94-914f-48d7-960d-fcff4ec461f0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 200 len: 1363 microversion: 2.47 time: 0.170528 Jun 16 18:47:42.243138 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1950/3814] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:42 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:43.069971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:43.073409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:43.093269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.093269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.093269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.093269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.340964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:43.341538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:43.358161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.358737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.359503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.365387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.375323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:43.395519 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-02fc2183-fb63-43ab-9b59-cdd0ca49d8a8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.342243 Jun 16 18:47:43.396430 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1865/3815] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:43 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:43.401379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:43.402221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: 3e5afd86-10ab-4736-b4bf-fbd655e3bc48] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:43.408113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:47:43.417425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.417884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.418697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.419144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.450441 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] HTTP exception thrown: Instance 3e5afd86-10ab-4736-b4bf-fbd655e3bc48 could not be found. Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Request method failure captured: Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 HTTP/1.1 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3qg7C3cYySA80dvtKEK53_U1r-zJ_FzSMCHgIvKPJqIHkjzqQm0LxDKjQMbzNrMSSt2B2ZzOz1IiFr6cPCGRqjNvNGoYY5UWVikRs7LGYz3gI9-J0-yjPfRGJXLDGJwdGj0vXCiAvM1iGuqiruosxsxK4o3vAfYcp5n2f9Q7AY_JKs Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.47 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 149b009bc3ef425e9546387781bb626e Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerShowV247Test-961815841 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/149b009bc3ef425e9546387781bb626e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/149b009bc3ef425e9546387781bb626e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_149b009bc3ef425e9546387781bb626e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/149b009bc3ef425e9546387781bb626e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerShowV247Test-961815841 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 149b009bc3ef425e9546387781bb626e Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerShowV247Test-961815841 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerShowV247Test-961815841-project Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: f3c449f289ff43ca9737612cd2a389c6 Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerShowV247Test-961815841-project Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 3e5afd86-10ab-4736-b4bf-fbd655e3bc48 could not be found. Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '3e5afd86-10ab-4736-b4bf-fbd655e3bc48'} Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5afd86-10ab-4736-b4bf-fbd655e3bc48 could not be found. Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5afd86-10ab-4736-b4bf-fbd655e3bc48 could not be found. Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:43.453380 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5afd86-10ab-4736-b4bf-fbd655e3bc48 could not be found. Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Returning 404 to user: Instance 3e5afd86-10ab-4736-b4bf-fbd655e3bc48 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:43.457199 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b8ac61c1-aaaf-43d4-899e-1679ba43b610 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48" status: 404 len: 111 microversion: 2.47 time: 0.057345 Jun 16 18:47:43.458459 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1866/3816] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:43 2022] GET /compute/v2.1/servers/3e5afd86-10ab-4736-b4bf-fbd655e3bc48 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:47:43.475245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:43.476287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:43.496241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.496992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.498226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.499238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.504842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:43.557519 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4d32bbc0-f100-4446-bbab-bbf3f7850064 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 204 len: 0 microversion: 2.42 time: 0.497776 Jun 16 18:47:43.557864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:47:43.565133 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1951/3817] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:47:43 2022] DELETE /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:47:43.588003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:43.590261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:43.598533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.598880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.600187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.600760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.721845 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-33b163f9-11c1-46d1-9c02-120510b71df3 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 204 len: 0 microversion: 2.47 time: 0.250000 Jun 16 18:47:43.723622 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1867/3818] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:47:43 2022] DELETE /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:47:43.733855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:43.734685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:43.741814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.742386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.743234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:43.743737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:43.940923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:43.967117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:43.971836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:43.975933 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6dee0987-aaf9-4240-9d30-32f6aae1a227 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 200 len: 1363 microversion: 2.47 time: 0.246405 Jun 16 18:47:43.977616 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1868/3819] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:43 2022] GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:44.030281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:44.040939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:44.047446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:44.049185 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a411c8ac-61e9-446f-be3a-05395b31686e tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2960 microversion: 2.42 time: 0.479586 Jun 16 18:47:44.049855 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1952/3820] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:43 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2960 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:44.414326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:44.415765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:44.438182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:44.438965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:44.440519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:44.441129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:44.760030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:44.769637 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a1641302-70b0-4f9a-b516-b0a9ca005ad3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.359409 Jun 16 18:47:44.779781 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1869/3821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:44 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:44.997041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:44.999391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:45.019884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:45.020356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:45.021162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:45.023684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:45.070750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:45.071487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:45.081606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:45.090028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:45.091023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:45.094143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:45.247210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:45.264093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:45.271603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:45.273455 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-deee782d-131d-4ac4-a222-bc9bdc6f5f67 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 200 len: 1363 microversion: 2.47 time: 0.281658 Jun 16 18:47:45.274069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1953/3822] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:44 2022] GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:45.486992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:45.502017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:45.504580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:45.509895 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d89d7cce-d625-4564-927d-0125dc88d812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2960 microversion: 2.42 time: 0.440312 Jun 16 18:47:45.511495 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1870/3823] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:45 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2960 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:45.787046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:45.788302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:45.797702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:45.799492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:45.802313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:45.803110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:46.196612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:46.207727 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1c15716-8d70-4f46-9ab0-7670ebdb6ce6 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.425225 Jun 16 18:47:46.208696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1954/3824] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:45 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:46.300059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:46.301158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:46.311555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:46.312242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:46.313085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:46.313685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:46.470666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:46.484238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:46.485863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:46.491243 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a5aaa47-be6a-4ca7-a5bd-5a1ad8b47f5c tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 200 len: 1363 microversion: 2.47 time: 0.195370 Jun 16 18:47:46.496596 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1871/3825] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:46 2022] GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:46.532066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:46.532696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:46.543162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:46.544930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:46.546762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:46.550139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:46.604430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:46.916044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:46.927278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:46.928992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:46.930377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-52539374-2d77-486e-8aff-ca391ddeb2ef tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2960 microversion: 2.42 time: 0.403512 Jun 16 18:47:46.931556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1955/3826] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:46 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2960 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:47.227829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:47.228743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:47.238638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:47.239785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:47.240751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:47.241405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:47.501544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:47.521357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:47.522022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:47.547778 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8027f284-a7db-4e3a-88f3-6a5569ab94bd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.320154 Jun 16 18:47:47.550854 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1872/3827] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:47 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:47.552200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:47.553507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:47.554517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:47.557685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:47.661027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:47.674154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:47.678188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:47.681062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fc6f3121-2ae8-4c2a-87ce-bed85fa408a0 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 200 len: 1363 microversion: 2.47 time: 0.171414 Jun 16 18:47:47.688494 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1956/3828] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:47 2022] GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:47.953663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:47.954319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:47.978070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:47.978542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:47.979355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:47.986613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:48.460337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:48.486006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:48.488002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:48.489871 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97d13ee1-d2ee-46be-a10a-09c7177fb812 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2960 microversion: 2.42 time: 0.542276 Jun 16 18:47:48.490856 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1873/3829] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:47 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2960 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:48.568241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:48.569405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:48.581344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:48.584532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:48.586929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:48.587535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:48.703317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:48.703954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:48.731604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:48.732749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:48.733813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:48.734290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:48.880102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:48.881467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:48.882558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lazy-loading 'fault' on Instance uuid d9d1f1a8-3960-4956-822b-15bebe0347d0 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:47:49.329825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:49.345838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:49.347989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c449f289ff43ca9737612cd2a389c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149b009bc3ef425e9546387781bb626e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:49.349377 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-18bf73bd-4c31-43b1-b32d-fc96e62a7d83 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 200 len: 1368 microversion: 2.47 time: 0.651212 Jun 16 18:47:49.361950 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1874/3830] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:48 2022] GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 1368 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:49.374693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:49.375479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:49.397127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:49.397762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:49.401132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:49.402582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:49.679827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:49.702464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c5b5b50-e152-4d52-a248-261c41becd4c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 1.138627 Jun 16 18:47:49.705923 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1957/3831] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:48 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:49.725243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:49.728292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:49.742882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:49.744910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:49.747177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:49.750015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:49.928340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:49.947712 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d71cce4f-416c-46d5-8963-b1c35f6bf136 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.584415 Jun 16 18:47:49.949195 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1875/3832] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:49 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:50.201683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:50.415159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:50.434724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d160ca3a-dbe9-46d4-8a15-258844813519 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:50.448622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:50.464545 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d160ca3a-dbe9-46d4-8a15-258844813519 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.509593 Jun 16 18:47:50.465211 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1876/3833] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:50.470284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:50.471970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:50.473492 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97de1b3a-b32a-45f7-aff9-62d6e4822963 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2939 microversion: 2.42 time: 0.766328 Jun 16 18:47:50.493672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:50.495515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1958/3834] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:49 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2939 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:50.503295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:50.523719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:50.526264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:50.543263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:50.544245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:50.767819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8630c944-9735-420c-ab6b-550ceb296dde req-0a993461-8a42-4bc9-b275-7fd907f9cb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-unplugged", "status": "completed", "tag": "9d1b468a-2120-4f05-94a5-e5db40e872bf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:50.796556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8630c944-9735-420c-ab6b-550ceb296dde req-0a993461-8a42-4bc9-b275-7fd907f9cb65 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:50.797733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8630c944-9735-420c-ab6b-550ceb296dde req-0a993461-8a42-4bc9-b275-7fd907f9cb65 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:50.828510 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8630c944-9735-420c-ab6b-550ceb296dde req-0a993461-8a42-4bc9-b275-7fd907f9cb65 service nova] Creating event network-vif-unplugged:9d1b468a-2120-4f05-94a5-e5db40e872bf for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:50.844911 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8630c944-9735-420c-ab6b-550ceb296dde req-0a993461-8a42-4bc9-b275-7fd907f9cb65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.347378 Jun 16 18:47:50.845852 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1959/3835] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:50.867739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:50.870683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] [instance: d9d1f1a8-3960-4956-822b-15bebe0347d0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:50.896880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:50.897490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:50.898444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:50.899048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:50.921716 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] HTTP exception thrown: Instance d9d1f1a8-3960-4956-822b-15bebe0347d0 could not be found. Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Request method failure captured: Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 HTTP/1.1 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qg7C3cYySA80dvtKEK53_U1r-zJ_FzSMCHgIvKPJqIHkjzqQm0LxDKjQMbzNrMSSt2B2ZzOz1IiFr6cPCGRqjNvNGoYY5UWVikRs7LGYz3gI9-J0-yjPfRGJXLDGJwdGj0vXCiAvM1iGuqiruosxsxK4o3vAfYcp5n2f9Q7AY_JKs Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.47 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 149b009bc3ef425e9546387781bb626e Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerShowV247Test-961815841 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/149b009bc3ef425e9546387781bb626e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/149b009bc3ef425e9546387781bb626e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_149b009bc3ef425e9546387781bb626e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/149b009bc3ef425e9546387781bb626e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerShowV247Test-961815841 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 149b009bc3ef425e9546387781bb626e Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerShowV247Test-961815841 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerShowV247Test-961815841-project Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: f3c449f289ff43ca9737612cd2a389c6 Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerShowV247Test-961815841-project Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance d9d1f1a8-3960-4956-822b-15bebe0347d0 could not be found. Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'd9d1f1a8-3960-4956-822b-15bebe0347d0'} Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d1f1a8-3960-4956-822b-15bebe0347d0 could not be found. Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d1f1a8-3960-4956-822b-15bebe0347d0 could not be found. Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:47:50.926239 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:50.929727 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:47:50.929727 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:47:50.929727 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:47:50.929727 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:47:50.929727 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:47:50.929727 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d1f1a8-3960-4956-822b-15bebe0347d0 could not be found. Jun 16 18:47:50.929727 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:47:50.932508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] Returning 404 to user: Instance d9d1f1a8-3960-4956-822b-15bebe0347d0 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:47:50.933592 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3b59ac2f-0cdb-4727-a125-1fdaa43a1457 tempest-ServerShowV247Test-961815841 tempest-ServerShowV247Test-961815841-project] 10.222.0.27 "GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0" status: 404 len: 111 microversion: 2.47 time: 0.086370 Jun 16 18:47:50.938815 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1960/3836] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:50 2022] GET /compute/v2.1/servers/d9d1f1a8-3960-4956-822b-15bebe0347d0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:47:50.947395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d673caa0-626a-4e6b-9a08-e61628cf6b96 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:50.988205 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d673caa0-626a-4e6b-9a08-e61628cf6b96 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.047403 Jun 16 18:47:50.989186 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1961/3837] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:47:50 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:51.002819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:51.003655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:51.022816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:51.023572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:51.024699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:51.026370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:51.079263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:51.097730 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca9d104e-789b-4bce-b5cc-6b1e64965b72 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.626046 Jun 16 18:47:51.098930 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1877/3838] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:50 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:51.111176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-372da966-b677-430b-8bb3-7f2bc0f85f5c tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:51.133293 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-372da966-b677-430b-8bb3-7f2bc0f85f5c tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027542 Jun 16 18:47:51.135398 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1878/3839] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:51.152440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:51.153368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:51.172647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:51.173221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:51.175019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:51.178924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:52.108398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:52.133087 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-299f974b-811c-41d2-991e-512ca353dcb5 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 1.142436 Jun 16 18:47:52.133683 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1962/3840] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:50 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:52.148395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:52.148920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b7ca925-cae1-44cd-8795-6c98f29c94e4 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:52.158092 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b7ca925-cae1-44cd-8795-6c98f29c94e4 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013406 Jun 16 18:47:52.164696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1963/3841] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:52.167986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-11138cd7-9c42-467b-848e-055c5bdf3867 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 1.029999 Jun 16 18:47:52.172238 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1879/3842] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:51 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:52.193314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:52.194017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f75daf44-ab86-448d-a425-0c6d541c9e82 req-1d63528c-9a22-40e1-8c1e-2d9bc7cbc496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-deleted", "tag": "b3893116-c573-4d2e-b1ad-049449293671"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:52.194874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:52.211093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:52.212272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:52.216608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:52.217283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:52.217593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f75daf44-ab86-448d-a425-0c6d541c9e82 req-1d63528c-9a22-40e1-8c1e-2d9bc7cbc496 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:52.218193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f75daf44-ab86-448d-a425-0c6d541c9e82 req-1d63528c-9a22-40e1-8c1e-2d9bc7cbc496 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:52.284014 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f75daf44-ab86-448d-a425-0c6d541c9e82 req-1d63528c-9a22-40e1-8c1e-2d9bc7cbc496 service nova] Creating event network-vif-deleted:b3893116-c573-4d2e-b1ad-049449293671 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:52.321858 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f75daf44-ab86-448d-a425-0c6d541c9e82 req-1d63528c-9a22-40e1-8c1e-2d9bc7cbc496 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141859 Jun 16 18:47:52.325377 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1880/3843] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:52.382604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e531992f-000b-488e-8ce8-7fa3ecf7305e tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:52.470069 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e531992f-000b-488e-8ce8-7fa3ecf7305e tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.125430 Jun 16 18:47:52.471283 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1881/3844] 10.222.0.27 () {58 vars in 1164 bytes} [Thu Jun 16 18:47:52 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:52.488270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e980ab56-df49-4a74-86a4-b6df24d34720 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1689473874"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:52.490094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e980ab56-df49-4a74-86a4-b6df24d34720 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:52.502538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e980ab56-df49-4a74-86a4-b6df24d34720 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:52.503689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e980ab56-df49-4a74-86a4-b6df24d34720 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:52.506820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e980ab56-df49-4a74-86a4-b6df24d34720 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:52.507545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e980ab56-df49-4a74-86a4-b6df24d34720 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:53.073040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:53.083693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:53.085434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:53.095226 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3699b45f-07fc-484c-adc2-67b64fa86ab4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2824 microversion: 2.42 time: 0.910882 Jun 16 18:47:53.110451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1964/3845] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:52 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2824 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:53.163912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae53b47b-605b-416a-a837-b19177cb80c7 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.174689 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e980ab56-df49-4a74-86a4-b6df24d34720 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.700502 Jun 16 18:47:53.178179 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1882/3846] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:47:52 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 16 18:47:53.192940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d83b4c0c-9aad-4e06-bd1d-65cd6047f71c req-c77530d1-b6d6-458e-af84-b41f65ed87b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-unplugged", "status": "completed", "tag": "007a7fdc-42d7-466b-a1f0-28a9c6ab1600"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-unplugged", "status": "completed", "tag": "241f1fc5-16df-4f88-83bb-da75d25e2755"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-unplugged", "status": "completed", "tag": "ba2ae7ab-69a0-4f82-8d6a-7c53590e8739"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:53.220464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d83b4c0c-9aad-4e06-bd1d-65cd6047f71c req-c77530d1-b6d6-458e-af84-b41f65ed87b5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:53.222008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d83b4c0c-9aad-4e06-bd1d-65cd6047f71c req-c77530d1-b6d6-458e-af84-b41f65ed87b5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:53.237472 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae53b47b-605b-416a-a837-b19177cb80c7 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.122256 Jun 16 18:47:53.238353 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1965/3847] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:53.248915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.251530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:53.255060 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d83b4c0c-9aad-4e06-bd1d-65cd6047f71c req-c77530d1-b6d6-458e-af84-b41f65ed87b5 service nova] Creating event network-vif-unplugged:007a7fdc-42d7-466b-a1f0-28a9c6ab1600 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:53.255629 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d83b4c0c-9aad-4e06-bd1d-65cd6047f71c req-c77530d1-b6d6-458e-af84-b41f65ed87b5 service nova] Creating event network-vif-unplugged:241f1fc5-16df-4f88-83bb-da75d25e2755 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:53.257276 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d83b4c0c-9aad-4e06-bd1d-65cd6047f71c req-c77530d1-b6d6-458e-af84-b41f65ed87b5 service nova] Creating event network-vif-unplugged:ba2ae7ab-69a0-4f82-8d6a-7c53590e8739 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:53.274652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:53.277011 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d83b4c0c-9aad-4e06-bd1d-65cd6047f71c req-c77530d1-b6d6-458e-af84-b41f65ed87b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.097193 Jun 16 18:47:53.277251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:53.280575 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1883/3848] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:53.281512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:53.282063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:53.301122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-128ba14d-b7ca-42cf-b8d3-10b2ee33b244 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.322488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:53.395475 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-128ba14d-b7ca-42cf-b8d3-10b2ee33b244 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.110184 Jun 16 18:47:53.400190 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1884/3849] 10.222.0.27 () {58 vars in 1168 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:53.417661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6955b032-9c71-473d-83dc-ad95ff47dd91 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.445286 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6955b032-9c71-473d-83dc-ad95ff47dd91 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.034174 Jun 16 18:47:53.451877 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1885/3850] 10.222.0.27 () {58 vars in 1160 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:53.474796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57ffa62c-d631-4505-b964-0add37ec9d87 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.503697 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-57ffa62c-d631-4505-b964-0add37ec9d87 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042205 Jun 16 18:47:53.504521 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1886/3851] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:53.524831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a041a0e0-3282-46fc-9cf2-1415fb10f2c4 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.601418 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a041a0e0-3282-46fc-9cf2-1415fb10f2c4 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.087226 Jun 16 18:47:53.606506 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1887/3852] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:53.625501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-665c8a07-47ce-49e0-9ad1-70ab3dd21883 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.644833 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-665c8a07-47ce-49e0-9ad1-70ab3dd21883 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027995 Jun 16 18:47:53.648141 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1888/3853] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:53.658901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1f0dd89-d8fb-4cda-ac08-02183e5e9e79 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.693293 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f1f0dd89-d8fb-4cda-ac08-02183e5e9e79 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038331 Jun 16 18:47:53.708713 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1889/3854] 10.222.0.27 () {58 vars in 1143 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:53.721820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eb1a5eb-759b-4a61-b9f6-2e912ca1511b tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.752346 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0eb1a5eb-759b-4a61-b9f6-2e912ca1511b tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033850 Jun 16 18:47:53.759446 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1890/3855] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:53.776131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-841e3e9d-063b-4b05-81db-c39e0dea52f4 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.826581 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-841e3e9d-063b-4b05-81db-c39e0dea52f4 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.062883 Jun 16 18:47:53.827492 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1891/3856] 10.222.0.27 () {58 vars in 1147 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:53.851446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-76294a14-e3ae-4c7f-b5e4-182384f09918 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.865339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-76294a14-e3ae-4c7f-b5e4-182384f09918 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026460 Jun 16 18:47:53.873440 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1892/3857] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:53.879749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f36b9f7e-e2bd-448b-b86c-2f19b78668e9 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.892658 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f36b9f7e-e2bd-448b-b86c-2f19b78668e9 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017477 Jun 16 18:47:53.893515 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1893/3858] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:53.899271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:53.907659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6df6e2f2-3c5e-4e4f-8fae-2a9c777a2049 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:53.912122 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-70e4c1e8-1feb-4257-bc9b-8ed64be19677 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.671160 Jun 16 18:47:53.917092 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1966/3859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:53.954956 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6df6e2f2-3c5e-4e4f-8fae-2a9c777a2049 tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.053759 Jun 16 18:47:53.955706 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1894/3860] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:53.969489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9779d6a-2729-4ae3-ad66-a129a57b834f tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:54.007319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9779d6a-2729-4ae3-ad66-a129a57b834f tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042897 Jun 16 18:47:54.008219 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1967/3861] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:47:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:54.022544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be0843c1-aa31-451a-9c0b-ea7c6770d41d tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:54.079919 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-be0843c1-aa31-451a-9c0b-ea7c6770d41d tempest-FlavorsV2TestJSON-654734963 tempest-FlavorsV2TestJSON-654734963-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061116 Jun 16 18:47:54.080509 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1895/3862] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:47:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:54.119735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:54.120533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:54.133281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:54.134129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:54.135957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:54.138397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:54.443425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:54.460255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:54.461842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:54.464275 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2660180f-cf56-413d-9ec1-099511cb7344 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2663 microversion: 2.42 time: 0.349215 Jun 16 18:47:54.480515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1968/3863] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:54 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2663 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:54.491492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e0c7be7a-1c0d-479b-8585-08c604412048 req-1f293bbf-b3b7-4e27-9614-79fc1678dcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-deleted", "tag": "007a7fdc-42d7-466b-a1f0-28a9c6ab1600"}, {"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-deleted", "tag": "ba2ae7ab-69a0-4f82-8d6a-7c53590e8739"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:54.493034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e482892-6b3b-490a-89fc-86cd966e78f4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: .version_select at 0x7f866dd2ea60>, body: {"keypair": {"name": "tempest-keypair-896110164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4VF4IeAqvKpZO/93UiVE5NxPoKGaQhNWjfKIAHJcqopJnMGMwKVyq4Ib2XXhOIa7C7tWBAaQmuYVvwMABnypReJmS3haaM5NOA1SOr+JCS9Bt9TZ0RUrNe2d+HFKKc4w=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:54.513740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e0c7be7a-1c0d-479b-8585-08c604412048 req-1f293bbf-b3b7-4e27-9614-79fc1678dcbb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:54.514156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e0c7be7a-1c0d-479b-8585-08c604412048 req-1f293bbf-b3b7-4e27-9614-79fc1678dcbb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:54.540400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0e482892-6b3b-490a-89fc-86cd966e78f4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:47:54.558543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0e482892-6b3b-490a-89fc-86cd966e78f4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:47:54.576447 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e0c7be7a-1c0d-479b-8585-08c604412048 req-1f293bbf-b3b7-4e27-9614-79fc1678dcbb service nova] Creating event network-vif-deleted:007a7fdc-42d7-466b-a1f0-28a9c6ab1600 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:54.577279 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e0c7be7a-1c0d-479b-8585-08c604412048 req-1f293bbf-b3b7-4e27-9614-79fc1678dcbb service nova] Creating event network-vif-deleted:ba2ae7ab-69a0-4f82-8d6a-7c53590e8739 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:54.598896 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e0c7be7a-1c0d-479b-8585-08c604412048 req-1f293bbf-b3b7-4e27-9614-79fc1678dcbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116955 Jun 16 18:47:54.599516 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1969/3864] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:54.672243 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e482892-6b3b-490a-89fc-86cd966e78f4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.463845 Jun 16 18:47:54.677595 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1896/3865] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:47:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:54.937274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:54.938296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:54.961377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:54.966649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:54.969637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:54.971078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:55.191655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:55.207739 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b18c30ca-8c33-49e3-b37d-bf570ca7586b tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.278126 Jun 16 18:47:55.224541 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1970/3866] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:54 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:55.484801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:55.485558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:55.493779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:55.494440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:55.495091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:55.502914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:55.787320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:55.791657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:55.801770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:55.803463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:55.804791 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0eb857aa-07cc-4bc0-806c-2c82ee2e11a5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2388 microversion: 2.42 time: 0.324045 Jun 16 18:47:55.807626 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1897/3867] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:55 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2388 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:55.895654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-426588025", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": "none"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:56.023706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:47:56.024302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:47:56.024941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:47:56.025537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:47:56.026139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:47:56.049171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:56.049644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:56.052204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:56.052703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:56.083905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Getting quotas for project be29111e305a4e95a082a21866947a56. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:47:56.090595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:47:56.092897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Getting quotas for user 84739b3622dd4f989f74d85863940328 and project be29111e305a4e95a082a21866947a56. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:47:56.117859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:47:56.120898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:47:56.211433 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8e898e51-dd5f-4bd0-bdff-ccdf5a4f5620 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.550297 Jun 16 18:47:56.212980 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1971/3868] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 18:47:56.235721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-21255bf9-b03d-4d42-895d-7367933303aa tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:56.236382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-21255bf9-b03d-4d42-895d-7367933303aa tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:56.244555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:56.247482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:56.276939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:56.277469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:56.278976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:56.279778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:56.620928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-21255bf9-b03d-4d42-895d-7367933303aa tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:56.642773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-21255bf9-b03d-4d42-895d-7367933303aa tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:56.647390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-21255bf9-b03d-4d42-895d-7367933303aa tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:56.660201 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-21255bf9-b03d-4d42-895d-7367933303aa tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1277 microversion: 2.57 time: 0.436835 Jun 16 18:47:56.683430 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1898/3869] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:56 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:56.693259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-af84f341-c3ef-4610-8afd-7be49a3dfb73 req-98da9266-2303-4c63-9d3f-2cd0b630cffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-deleted", "tag": "241f1fc5-16df-4f88-83bb-da75d25e2755"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:56.712606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-af84f341-c3ef-4610-8afd-7be49a3dfb73 req-98da9266-2303-4c63-9d3f-2cd0b630cffb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:56.716756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-af84f341-c3ef-4610-8afd-7be49a3dfb73 req-98da9266-2303-4c63-9d3f-2cd0b630cffb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:56.749716 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-af84f341-c3ef-4610-8afd-7be49a3dfb73 req-98da9266-2303-4c63-9d3f-2cd0b630cffb service nova] Creating event network-vif-deleted:241f1fc5-16df-4f88-83bb-da75d25e2755 for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:56.767773 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-af84f341-c3ef-4610-8afd-7be49a3dfb73 req-98da9266-2303-4c63-9d3f-2cd0b630cffb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082672 Jun 16 18:47:56.771465 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1899/3870] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:56.828464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:56.829703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:56.846476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:56.849305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:56.853994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:56.854303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:57.147481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:57.160916 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25ed5cbc-4b3e-47df-a686-94ff13fc20cc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.937566 Jun 16 18:47:57.171087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1972/3871] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:56 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:57.226662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:57.240268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:57.246066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:57.248665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-876acf5c-41e8-4d20-a30f-edf2098a1159 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 2162 microversion: 2.42 time: 0.427443 Jun 16 18:47:57.254212 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1900/3872] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:56 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 2162 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:57.682858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ab55f34-a3c9-450a-bf56-83314563c5ed tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:57.685508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ab55f34-a3c9-450a-bf56-83314563c5ed tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:57.978122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c2f19af6-c43a-4797-a880-91db4f98935f req-1aca57cd-1b07-46db-b95b-79d66f266562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-plugged", "status": "completed", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:58.000130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2f19af6-c43a-4797-a880-91db4f98935f req-1aca57cd-1b07-46db-b95b-79d66f266562 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:58.003083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c2f19af6-c43a-4797-a880-91db4f98935f req-1aca57cd-1b07-46db-b95b-79d66f266562 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:58.040986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c2f19af6-c43a-4797-a880-91db4f98935f req-1aca57cd-1b07-46db-b95b-79d66f266562 service nova] Creating event network-vif-plugged:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:47:58.052200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ab55f34-a3c9-450a-bf56-83314563c5ed tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:58.061440 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c2f19af6-c43a-4797-a880-91db4f98935f req-1aca57cd-1b07-46db-b95b-79d66f266562 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091876 Jun 16 18:47:58.069553 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1901/3873] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:58.081273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ab55f34-a3c9-450a-bf56-83314563c5ed tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:58.092970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ab55f34-a3c9-450a-bf56-83314563c5ed tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:58.094280 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ab55f34-a3c9-450a-bf56-83314563c5ed tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1277 microversion: 2.57 time: 0.417372 Jun 16 18:47:58.095062 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1973/3874] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:57 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1277 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:58.181565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:58.182393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:58.205115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:58.205627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:58.206702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:58.207147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:58.281059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:58.282412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:58.293190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:58.295936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:58.298617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:58.299230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:58.738204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:58.754668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:58.769017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:58.770831 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ceed1a40-1b3f-48f7-8d07-4cc148acee00 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.495444 Jun 16 18:47:58.771790 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1974/3875] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:58 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:58.795982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-17eace99-fac7-437e-bf42-79a460506567 req-cfab1e95-6b70-4d2a-91ed-00949542a0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24180ce8-cbfa-45a1-b91c-651f81a7f556", "name": "network-vif-deleted", "tag": "9d1b468a-2120-4f05-94a5-e5db40e872bf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:58.835460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-17eace99-fac7-437e-bf42-79a460506567 req-cfab1e95-6b70-4d2a-91ed-00949542a0fe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:58.843668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-17eace99-fac7-437e-bf42-79a460506567 req-cfab1e95-6b70-4d2a-91ed-00949542a0fe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:58.889025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-17eace99-fac7-437e-bf42-79a460506567 req-cfab1e95-6b70-4d2a-91ed-00949542a0fe service nova] Creating event network-vif-deleted:9d1b468a-2120-4f05-94a5-e5db40e872bf for instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 on n-h2-846209-2 Jun 16 18:47:58.912744 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-17eace99-fac7-437e-bf42-79a460506567 req-cfab1e95-6b70-4d2a-91ed-00949542a0fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118601 Jun 16 18:47:58.916453 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1975/3876] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:47:59.117465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:59.118379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:59.135825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:59.152296 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a837b4ed-64bf-427e-8d1f-55bd72c9db10 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.971492 Jun 16 18:47:59.154729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:59.157010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:59.157500 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1902/3877] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:47:58 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:47:59.159076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:59.163457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:59.338338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:59.350597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:59.362410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:47:59.364157 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c886f96-f359-4d2c-9523-5c775525065a tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1329 microversion: 2.57 time: 0.253886 Jun 16 18:47:59.377834 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1976/3878] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:59 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1329 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:47:59.524761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885060554", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "342ef20c-b425-4c3e-85a8-70079b12ec49"}], "security_groups": [{"name": "tempest-securitygroup--685241604"}], "key_name": "tempest-keypair-896110164", "user_data": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:47:59.805854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:59.813610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:47:59.835561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:59.837554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:59.838484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:59.840396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:00.015369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:00.030078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:00.032184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:00.033850 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4d4b782b-40ab-4300-89be-9439a16c3c02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.247573 Jun 16 18:48:00.047120 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1977/3879] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:47:59 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:00.191514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:00.192089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:00.211607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:00.212070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:00.214716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:00.217627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:00.226299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] validate_networks() for [('342ef20c-b425-4c3e-85a8-70079b12ec49', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:48:00.894933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:00.907294 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81ea9763-1fed-4b1c-a6e8-cecffac6298d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.720924 Jun 16 18:48:00.907860 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1978/3880] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:00 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:48:00.921826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:00.922385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:00.960936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:00.962397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:00.962397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:00.962619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:01.580627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:01.615903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:01.620197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:01.624668 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-00cc1291-075b-4f17-a41b-91faf4226b4c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1335 microversion: 2.57 time: 0.715804 Jun 16 18:48:01.628973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1979/3881] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:00 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1335 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:01.673693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:01.677049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:01.697268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:01.698173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:01.703762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:01.707045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:01.758836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:01.954161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.001337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.017438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.022082 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90cc4429-0c15-421b-be68-351ad524d5f2 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.385967 Jun 16 18:48:02.022082 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1980/3882] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:01 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:02.053335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:02.054578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:02.136032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:02.136501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:02.137321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:02.142894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:02.449312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:48:02.452768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:48:02.463742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:48:02.469047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:48:02.469803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:48:02.511936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:02.512387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:02.520804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:02.522900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:02.555983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.566147 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-673d10d1-1cd6-4968-9f24-9916a4cbf437 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.544153 Jun 16 18:48:02.570774 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1981/3883] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:02 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:02.587144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:48:02.601073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:48:02.639271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:48:02.644647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:48:02.651482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:02.652323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:02.667397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:02.668690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:02.671256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:02.673514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:02.789544 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e2471590-a31d-4f20-ad23-0fbf8b7ef72f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.269408 Jun 16 18:48:02.791517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.795107 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1903/3884] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:47:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 3276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:48:02.807559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.810497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.812070 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5349c405-5f4b-4d4d-8f83-547741c57bf5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1335 microversion: 2.57 time: 0.164687 Jun 16 18:48:02.817156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1b80043-ac70-4d39-b2ce-430f8ddfd9fb tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:02.818861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1b80043-ac70-4d39-b2ce-430f8ddfd9fb tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:02.824706 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1982/3885] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:02 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:02.922683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1b80043-ac70-4d39-b2ce-430f8ddfd9fb tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:02.932192 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1b80043-ac70-4d39-b2ce-430f8ddfd9fb tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1241 microversion: 2.1 time: 0.130564 Jun 16 18:48:02.937763 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1904/3886] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:02 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:03.047451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:03.048672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:03.062307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:03.064395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:03.065466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:03.068036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:03.399836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:03.447454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:03.457494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:03.487948 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e57febe-fe9a-4fff-8536-99f12f089a19 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.447507 Jun 16 18:48:03.491029 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1983/3887] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:03 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:03.588011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:03.589005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:03.610824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:03.623321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:03.627901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:03.633191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:03.833263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:03.834414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:03.845136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:03.845986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:03.847129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:03.847721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.086876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.103611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.110804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.112727 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5645dd76-dc31-4e64-ae63-393b2867216e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1356 microversion: 2.57 time: 0.284266 Jun 16 18:48:04.125704 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1984/3888] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:03 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1356 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:04.143131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-49d89b0b-a05d-4315-b519-a174bd0e69de tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:04.160683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-49d89b0b-a05d-4315-b519-a174bd0e69de tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:04.189517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.205728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-56cae4c5-c429-406b-9646-f2f721c15d79 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1735 microversion: 2.1 time: 0.619742 Jun 16 18:48:04.208731 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1905/3889] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:03 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1735 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:04.220358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:04.222487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:04.231181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.239035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.241339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.242224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.355571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-49d89b0b-a05d-4315-b519-a174bd0e69de tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.362819 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-49d89b0b-a05d-4315-b519-a174bd0e69de tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1241 microversion: 2.1 time: 0.235272 Jun 16 18:48:04.381123 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1985/3890] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:04 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1241 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:04.518429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:04.519472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:04.531175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:48:04.534689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:48:04.549259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:48:04.557699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:48:04.559049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:48:04.565031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.565498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.566347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.576945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.851065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:04.863103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.869617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.870142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.872094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.872717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.884016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.885597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:04.886923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c1085a3-9ebe-486c-a50e-7c728cf44a81 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.372656 Jun 16 18:48:04.912752 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1986/3891] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:04 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:04.931266 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-138d86e1-f096-408e-874e-e08d944e06e0 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "POST /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef/action" status: 202 len: 1137 microversion: 2.57 time: 0.721096 Jun 16 18:48:04.944256 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1906/3892] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Jun 16 18:48:04 2022] POST /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef/action => generated 1137 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 16 18:48:04.950192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:04.951526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:04.958554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.959242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:04.960226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:04.960825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:05.183736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:05.193697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:05.203337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:05.207890 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f51fe70-62d9-4705-aa81-0ec47e46c520 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.263287 Jun 16 18:48:05.214251 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1987/3893] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:04 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:05.247954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:05.251096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:05.270943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:05.274810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:05.277777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:05.277777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:05.388906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:05.389829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:05.414957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:05.415715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:05.417266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:05.420690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:05.744015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:05.776066 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-86cca665-aa7c-48e6-9f22-d1ca432fe9dc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1301 microversion: 2.1 time: 0.391832 Jun 16 18:48:05.786470 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1988/3894] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:05 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1301 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:05.850743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:05.863051 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fe00f5c6-bafe-4742-aed0-2667e833f696 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1715 microversion: 2.1 time: 0.636766 Jun 16 18:48:05.863857 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1907/3895] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:05 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1715 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:05.917018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:05.918649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:05.930542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:05.931588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:05.933407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:05.934009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.070084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:06.180900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:06.192126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:06.192736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:06.203837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:06.206244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.210092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.211164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.212545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.230434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:06.234604 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a515ca6-2f2d-4a77-b3d5-5881b4c146cb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.329625 Jun 16 18:48:06.235231 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1989/3896] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:05 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:06.245802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:06.249417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:06.271777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.272481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.275806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.277385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.415526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:06.431295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:06.433010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:06.434306 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-00a8cd6f-3a49-4ef1-a28f-40e87c5b8633 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.198075 Jun 16 18:48:06.446389 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1990/3897] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:06 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:06.460700 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Cannot 'detach_volume' instance d0c93d90-ad38-4326-9bb6-4c38b39891ac while it is in vm_state rescued Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments/2efeabd6-0e6b-4ed9-8c60-fcf13250a9f7 HTTP/1.1 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: exception: Cannot 'detach_volume' instance d0c93d90-ad38-4326-9bb6-4c38b39891ac while it is in vm_state rescued Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': 'd0c93d90-ad38-4326-9bb6-4c38b39891ac', 'id': '2efeabd6-0e6b-4ed9-8c60-fcf13250a9f7'} Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d0c93d90-ad38-4326-9bb6-4c38b39891ac in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d0c93d90-ad38-4326-9bb6-4c38b39891ac while it is in vm_state rescued Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:06.462850 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:06.466825 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:06.466825 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:06.466825 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:06.466825 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:06.466825 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d0c93d90-ad38-4326-9bb6-4c38b39891ac while it is in vm_state rescued Jun 16 18:48:06.466825 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:06.466825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 409 to user: Cannot 'detach_volume' instance d0c93d90-ad38-4326-9bb6-4c38b39891ac while it is in vm_state rescued {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:06.468941 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-762797ca-75ed-4250-acfa-3c4129735955 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments/2efeabd6-0e6b-4ed9-8c60-fcf13250a9f7" status: 409 len: 152 microversion: 2.1 time: 0.278225 Jun 16 18:48:06.488500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b767fc3e-5f75-4dbf-b61e-b2544fea4d2a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:06.489098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b767fc3e-5f75-4dbf-b61e-b2544fea4d2a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:06.500357 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1908/3898] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:48:06 2022] DELETE /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments/2efeabd6-0e6b-4ed9-8c60-fcf13250a9f7 => generated 152 bytes in 313 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:48:06.508155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b767fc3e-5f75-4dbf-b61e-b2544fea4d2a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.508373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b767fc3e-5f75-4dbf-b61e-b2544fea4d2a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.509155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b767fc3e-5f75-4dbf-b61e-b2544fea4d2a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.509612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b767fc3e-5f75-4dbf-b61e-b2544fea4d2a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.646896 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b767fc3e-5f75-4dbf-b61e-b2544fea4d2a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/action" status: 202 len: 0 microversion: 2.1 time: 0.172223 Jun 16 18:48:06.659432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:06.660073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:06.664017 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1991/3899] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:48:06 2022] POST /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:48:06.676023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.676536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.679363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.679863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.795270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:06.796016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:06.810285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.811215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:06.811553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:06.812005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:07.132932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.153930 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7fd73a64-92f7-4a8f-944e-3bc778811d05 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1299 microversion: 2.1 time: 0.359337 Jun 16 18:48:07.155569 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1992/3900] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:06 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1299 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:48:07.255844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:07.257266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:07.267779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:07.270068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:07.273129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:07.274185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:07.468234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.518891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.526401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.528146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.532863 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e7ca27e-3f07-42ba-9201-eca598c117bd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.283011 Jun 16 18:48:07.537150 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1993/3901] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:07 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:07.539280 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-675f1df6-e09d-425e-9f03-02f592da87a9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1723 microversion: 2.1 time: 0.884063 Jun 16 18:48:07.540512 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1909/3902] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:06 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1723 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:07.553286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:07.554163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:07.564838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:07.565573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:07.566236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:07.566741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:07.758944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.793557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.795715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:07.801421 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-393020b9-976e-411c-b3e1-e691b73d28b8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.260628 Jun 16 18:48:07.802305 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1994/3903] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:07 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:08.177172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:08.178181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:08.195303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:08.195859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:08.196868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:08.202142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:08.570967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:08.574292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:08.631241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:08.637577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:08.641786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:08.645476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:08.715131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:08.735095 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dba61445-3760-4a4d-a211-e6893e63eec5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1366 microversion: 2.1 time: 0.566164 Jun 16 18:48:08.739746 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1910/3904] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:08 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1366 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:48:08.764351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:08.767318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:08.787120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:08.793149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:08.797215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:08.798298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:08.895806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:08.937683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:08.944259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:08.946468 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3acae7e0-132c-4791-9cb3-f1dbcf2e8a1c tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.393757 Jun 16 18:48:08.958340 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1995/3905] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:08 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:08.972827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:08.973691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:08.996015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:08.996721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:08.999406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:09.000196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:09.154950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:09.159880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:09.177851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:09.188705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:09.190577 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2ee3ec07-3d2b-47b9-b0e2-037ef407b101 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.230388 Jun 16 18:48:09.191417 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1996/3906] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:08 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:09.570448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:09.580917 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ec74f175-4585-4fdf-b016-3ffe572c9dcb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1723 microversion: 2.1 time: 0.835500 Jun 16 18:48:09.581524 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1911/3907] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:08 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1723 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:09.756519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:09.757152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:09.801776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:09.802737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:09.811070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:09.816630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:09.973650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:09.974935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:09.993476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:10.003844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:10.006515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:10.010939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:10.294036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:10.305866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:10.307370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:10.312104 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3186d89d-8965-4dd3-ad06-762dec00bd61 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.342994 Jun 16 18:48:10.320533 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1912/3908] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:09 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:10.362262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-451be289-6921-4c6b-84c9-d0decd0419b8 req-c1b3518c-bce4-4120-a90d-792b433b2a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5", "tag": "1f59f32f-8cd9-4223-aa08-52dd71b45dc6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:10.407668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-451be289-6921-4c6b-84c9-d0decd0419b8 req-c1b3518c-bce4-4120-a90d-792b433b2a48 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:10.408131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-451be289-6921-4c6b-84c9-d0decd0419b8 req-c1b3518c-bce4-4120-a90d-792b433b2a48 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:10.487335 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-451be289-6921-4c6b-84c9-d0decd0419b8 req-c1b3518c-bce4-4120-a90d-792b433b2a48 service nova] Creating event network-changed:1f59f32f-8cd9-4223-aa08-52dd71b45dc6 for instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 on n-h2-846209-2 Jun 16 18:48:10.505033 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-451be289-6921-4c6b-84c9-d0decd0419b8 req-c1b3518c-bce4-4120-a90d-792b433b2a48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181094 Jun 16 18:48:10.509421 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1913/3909] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:10.525853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:10.526700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:10.536903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:10.537427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:10.538252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:10.540621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:10.698397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:10.713266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:10.715412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:10.717651 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1e0dbe4-3a67-4f22-8133-9d8c581cbed5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.205988 Jun 16 18:48:10.717811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:10.718578 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1914/3910] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:10 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:10.732223 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c03d9a63-aade-4eec-916e-df43b8451501 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1366 microversion: 2.1 time: 0.978877 Jun 16 18:48:10.735454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:10.736237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:10.740955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1997/3911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:09 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1366 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:10.743990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:10.744653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:10.745593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:10.746360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.091171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:11.103653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-75e25f97-874d-4c48-accd-ee66c253e2fc tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1729 microversion: 2.1 time: 0.372757 Jun 16 18:48:11.107106 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1915/3912] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:10 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1729 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:11.129565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-30705aef-a61d-4d04-b98a-c31f62a208a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:11.131342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-30705aef-a61d-4d04-b98a-c31f62a208a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:11.161669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30705aef-a61d-4d04-b98a-c31f62a208a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.163119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30705aef-a61d-4d04-b98a-c31f62a208a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.164320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30705aef-a61d-4d04-b98a-c31f62a208a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.164933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30705aef-a61d-4d04-b98a-c31f62a208a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.341582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:11.342658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:11.356820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:11.403606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.405826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.410822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.415275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.640056 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-30705aef-a61d-4d04-b98a-c31f62a208a4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.518856 Jun 16 18:48:11.640961 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1998/3913] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:48:11 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-interface => generated 285 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:11.712314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e9d8838d-c599-4221-ac0d-2c40f6b1cecd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:11.712820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e9d8838d-c599-4221-ac0d-2c40f6b1cecd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:11.718411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:11.749251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9d8838d-c599-4221-ac0d-2c40f6b1cecd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.750089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9d8838d-c599-4221-ac0d-2c40f6b1cecd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.758237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:11.759035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9d8838d-c599-4221-ac0d-2c40f6b1cecd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.759850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e9d8838d-c599-4221-ac0d-2c40f6b1cecd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.769855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:11.771504 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7d7948a-1662-46f9-8275-57cf342c28b1 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.435283 Jun 16 18:48:11.773200 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1916/3914] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:11 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:11.793625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:11.801879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:11.823802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.824269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.825686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.826170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.860361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:11.881797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e9d8838d-c599-4221-ac0d-2c40f6b1cecd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments/41c1c8f4-1db7-4603-ac8e-7bbc45caf8c4" status: 200 len: 194 microversion: 2.20 time: 0.173488 Jun 16 18:48:11.894003 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 1999/3915] 10.222.0.27 () {60 vars in 1453 bytes} [Thu Jun 16 18:48:11 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments/41c1c8f4-1db7-4603-ac8e-7bbc45caf8c4 => generated 194 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:11.903857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:11.904487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:11.932325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.932793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:11.938743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:11.939302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:12.310110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:12.322900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:12.324728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:12.327607 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90991565-68a4-4e77-ae82-90401157712e tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.552187 Jun 16 18:48:12.328386 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1917/3916] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:11 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:12.385194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:12.387784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:12.418695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:12.424627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:12.425880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:12.426528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:12.561031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:12.633184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:12.680094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lazy-loading 'services' on Instance uuid 31b6c0e5-0374-409e-928e-fef329282b9d {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:48:12.684939 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-98390d7f-51bd-43c7-b470-435b691920c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1366 microversion: 2.1 time: 0.789673 Jun 16 18:48:12.685561 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2000/3917] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:11 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1366 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:12.794378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:12.796862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:12.806913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:12.807770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:12.808855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:12.810465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:12.915262 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a0111737-c9f3-40de-970d-3fabe44e727e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments/41c1c8f4-1db7-4603-ac8e-7bbc45caf8c4" status: 202 len: 0 microversion: 2.20 time: 0.585310 Jun 16 18:48:12.915917 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1918/3918] 10.222.0.27 () {60 vars in 1456 bytes} [Thu Jun 16 18:48:12 2022] DELETE /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments/41c1c8f4-1db7-4603-ac8e-7bbc45caf8c4 => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:48:12.954671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5920fadb-9a43-4cf1-887f-4ae651245517 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:12.967763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5920fadb-9a43-4cf1-887f-4ae651245517 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:12.969822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:12.999585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5920fadb-9a43-4cf1-887f-4ae651245517 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:13.000042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5920fadb-9a43-4cf1-887f-4ae651245517 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:13.009048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5920fadb-9a43-4cf1-887f-4ae651245517 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:13.009520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5920fadb-9a43-4cf1-887f-4ae651245517 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:13.055310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:13.066392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:13.077096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:13.080767 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4107cf1e-5f38-4f1d-b430-6df2ea66bce4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.292844 Jun 16 18:48:13.083572 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2001/3919] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:12 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:13.132618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5920fadb-9a43-4cf1-887f-4ae651245517 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189241 Jun 16 18:48:13.133224 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1919/3920] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:12 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:13.349234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:13.350411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:13.368108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:13.368805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:13.369761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:13.373485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:13.703267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:13.704478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:13.716458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:13.721746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:13.722976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:13.723469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:13.768798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:13.791105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:13.797105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:13.806839 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e44b7edf-abd0-4992-ab87-e207a0c65ba2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.463387 Jun 16 18:48:13.819998 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2002/3921] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:13 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:14.103843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:14.104413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:14.117031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:14.117507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:14.118369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:14.118836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:14.359028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:14.772057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:14.784702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:14.786717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:14.788376 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-922df7a4-943a-4330-908d-a48e1b1b5476 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.689000 Jun 16 18:48:14.800969 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2003/3922] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:14 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:14.812446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d46e021c-ec8c-4975-92b6-08abcc221663 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:14.816788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d46e021c-ec8c-4975-92b6-08abcc221663 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:14.828456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d46e021c-ec8c-4975-92b6-08abcc221663 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:14.829149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d46e021c-ec8c-4975-92b6-08abcc221663 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:14.832215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d46e021c-ec8c-4975-92b6-08abcc221663 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:14.832822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d46e021c-ec8c-4975-92b6-08abcc221663 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:14.923478 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d46e021c-ec8c-4975-92b6-08abcc221663 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121019 Jun 16 18:48:14.924336 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2004/3923] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:14 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:14.937509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:14.938445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:14.949719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:14.954217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:14.955316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:14.955925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:15.276268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:15.293225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:15.295374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:15.296632 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f107191-1873-4133-91eb-77260dee3964 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.371104 Jun 16 18:48:15.302342 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2005/3924] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:14 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:15.373247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e45f4402-c833-4f83-b366-c9d13199b0b2 req-59691dfc-2fc5-4fca-87eb-14e467d87f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5", "name": "network-vif-plugged", "status": "completed", "tag": "1f59f32f-8cd9-4223-aa08-52dd71b45dc6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:15.390087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e45f4402-c833-4f83-b366-c9d13199b0b2 req-59691dfc-2fc5-4fca-87eb-14e467d87f7a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:15.390547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e45f4402-c833-4f83-b366-c9d13199b0b2 req-59691dfc-2fc5-4fca-87eb-14e467d87f7a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:15.420196 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e45f4402-c833-4f83-b366-c9d13199b0b2 req-59691dfc-2fc5-4fca-87eb-14e467d87f7a service nova] Creating event network-vif-plugged:1f59f32f-8cd9-4223-aa08-52dd71b45dc6 for instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 on n-h2-846209-2 Jun 16 18:48:15.429423 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e45f4402-c833-4f83-b366-c9d13199b0b2 req-59691dfc-2fc5-4fca-87eb-14e467d87f7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060882 Jun 16 18:48:15.433711 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2006/3925] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:48:15.462886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:15.474259 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa16101d-2ff6-42f7-8d16-c368430cb54b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1366 microversion: 2.1 time: 1.775798 Jun 16 18:48:15.494117 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1920/3926] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:13 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1366 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:48:15.508758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e3a822e0-5a0a-4ab8-b915-f0e952789391 req-5ac1285c-9c0b-44ea-bfbd-bbf46796bfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c93d90-ad38-4326-9bb6-4c38b39891ac", "tag": "eb1ba32b-d248-475f-874f-fd6a54c3990d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:15.533287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e3a822e0-5a0a-4ab8-b915-f0e952789391 req-5ac1285c-9c0b-44ea-bfbd-bbf46796bfec service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:15.534099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e3a822e0-5a0a-4ab8-b915-f0e952789391 req-5ac1285c-9c0b-44ea-bfbd-bbf46796bfec service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:15.553232 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e3a822e0-5a0a-4ab8-b915-f0e952789391 req-5ac1285c-9c0b-44ea-bfbd-bbf46796bfec service nova] Creating event network-changed:eb1ba32b-d248-475f-874f-fd6a54c3990d for instance d0c93d90-ad38-4326-9bb6-4c38b39891ac on n-h1-846209-2 Jun 16 18:48:15.575638 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e3a822e0-5a0a-4ab8-b915-f0e952789391 req-5ac1285c-9c0b-44ea-bfbd-bbf46796bfec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069065 Jun 16 18:48:15.576775 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2007/3927] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:15.807421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:15.808061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:15.821146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:15.821854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:15.822879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:15.826445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:15.938024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ff41d0f-b905-4d6f-a37e-3faa58a3db36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:15.941718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ff41d0f-b905-4d6f-a37e-3faa58a3db36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:15.976437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff41d0f-b905-4d6f-a37e-3faa58a3db36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:15.978489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff41d0f-b905-4d6f-a37e-3faa58a3db36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:15.979400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff41d0f-b905-4d6f-a37e-3faa58a3db36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:15.984805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff41d0f-b905-4d6f-a37e-3faa58a3db36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:16.097113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:16.110711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:16.113607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:16.118759 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-20d65532-ea71-4179-b37a-5372d2e05418 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.315371 Jun 16 18:48:16.120605 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1921/3928] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:15 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:16.173046 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ff41d0f-b905-4d6f-a37e-3faa58a3db36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.237005 Jun 16 18:48:16.175002 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2008/3929] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:15 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:48:16.317092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:16.317726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:16.324323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:16.340011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:16.341119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:16.341653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:16.498760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:16.499780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:16.514473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:16.514941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:16.515766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:16.516222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:16.589207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:16.602405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:16.604014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:16.616971 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19313439-a332-40dc-b432-c30f5a7bec3c tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.303906 Jun 16 18:48:16.619334 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1922/3930] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:16 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:17.037708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:17.047099 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14c64da0-8ae4-4941-95b1-d7adb992fbe9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1366 microversion: 2.1 time: 0.552681 Jun 16 18:48:17.062771 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2009/3931] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:16 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1366 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:17.140026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:17.140946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:17.161473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:17.162393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:17.164074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:17.165876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:17.185526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5fea32a1-d087-4a3f-b57d-6d9700a182e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:17.186684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5fea32a1-d087-4a3f-b57d-6d9700a182e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:17.204682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fea32a1-d087-4a3f-b57d-6d9700a182e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:17.206745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fea32a1-d087-4a3f-b57d-6d9700a182e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:17.210367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fea32a1-d087-4a3f-b57d-6d9700a182e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:17.214663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fea32a1-d087-4a3f-b57d-6d9700a182e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:17.288554 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5fea32a1-d087-4a3f-b57d-6d9700a182e1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107502 Jun 16 18:48:17.289757 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2010/3932] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:17 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:48:17.375369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:17.423351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:17.428839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:17.437085 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-96bfe4ee-92fb-4692-b016-8cf2b488c45d tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.302375 Jun 16 18:48:17.443139 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1923/3933] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:17 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:17.640216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:17.641567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:17.671482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:17.675564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:17.691491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:17.692013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:17.789023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88cb84dd-27c8-47aa-8d86-ac2667962a96 tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Calling method '.version_select at 0x7f866ddef0d0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:18.076917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:18.116385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:18.127539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:18.132678 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd2dac2c-21c2-4790-a100-0a0fd182ccc4 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.499511 Jun 16 18:48:18.139021 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1924/3934] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:17 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:18.150988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8b88bf31-b1fc-4ab4-bd39-314aa1b47d96 req-239ef820-456a-4781-ace5-ca6b8d213f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c93d90-ad38-4326-9bb6-4c38b39891ac", "tag": "eb1ba32b-d248-475f-874f-fd6a54c3990d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:18.175462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8b88bf31-b1fc-4ab4-bd39-314aa1b47d96 req-239ef820-456a-4781-ace5-ca6b8d213f3c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:18.176365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8b88bf31-b1fc-4ab4-bd39-314aa1b47d96 req-239ef820-456a-4781-ace5-ca6b8d213f3c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:18.209822 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8b88bf31-b1fc-4ab4-bd39-314aa1b47d96 req-239ef820-456a-4781-ace5-ca6b8d213f3c service nova] Creating event network-changed:eb1ba32b-d248-475f-874f-fd6a54c3990d for instance d0c93d90-ad38-4326-9bb6-4c38b39891ac on n-h1-846209-2 Jun 16 18:48:18.241044 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8b88bf31-b1fc-4ab4-bd39-314aa1b47d96 req-239ef820-456a-4781-ace5-ca6b8d213f3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085068 Jun 16 18:48:18.246276 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1925/3935] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:18.256776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:18.269562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:18.286718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:18.287824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:18.288945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:18.289795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:18.292890 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88cb84dd-27c8-47aa-8d86-ac2667962a96 tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.001627 Jun 16 18:48:18.295247 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2011/3936] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:48:17 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:48:18.303145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7f93e9b1-f46c-430a-b7de-68ade419f81c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:18.303632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7f93e9b1-f46c-430a-b7de-68ade419f81c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:18.340399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f93e9b1-f46c-430a-b7de-68ade419f81c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:18.357298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f93e9b1-f46c-430a-b7de-68ade419f81c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:18.362133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f93e9b1-f46c-430a-b7de-68ade419f81c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:18.362978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f93e9b1-f46c-430a-b7de-68ade419f81c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:18.430821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7f93e9b1-f46c-430a-b7de-68ade419f81c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134469 Jun 16 18:48:18.436246 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2012/3937] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:18 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:48:18.442207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e7ca222-b4d7-48b1-b35a-cec436c1764a tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Action: 'create', calling method: .version_select at 0x7f866eba7820>, body: {"pool": "non_exist_pool"} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:18.567339 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-6e7ca222-b4d7-48b1-b35a-cec436c1764a tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] HTTP exception thrown: Floating IP pool not found. Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e7ca222-b4d7-48b1-b35a-cec436c1764a tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Request method failure captured: Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 26 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3rxOcU25Ji4beZrljhlWb3kJFFoc0DTOby2ssDYeIItzNR6mWM3zXakDOImu6xWlajXLhJ2xeV8itpnO7q2yIhk1g3n8RrmGexgVTw_Zyh91hR5S-htIqhphd-PA9rBmH2vS2EEgX09NzID2k3rmfsh3BhJfSQO-FhzRnW4P3fkhVY Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6e7cc9d4e933408d914918d219b2cd5c Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-612643381 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6e7cc9d4e933408d914918d219b2cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6e7cc9d4e933408d914918d219b2cd5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6e7cc9d4e933408d914918d219b2cd5c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6e7cc9d4e933408d914918d219b2cd5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-612643381 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6e7cc9d4e933408d914918d219b2cd5c Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-612643381 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FloatingIPsNegativeTestJSON-612643381-project Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: cee0ace5e1f94443acfae6ee1f15eff2 Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-612643381-project Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: {"pool": "non_exist_pool"} Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: exception: Floating IP pool not found. Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:18.569021 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:18.573532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 16 18:48:18.573532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:18.573532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e7ca222-b4d7-48b1-b35a-cec436c1764a tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Returning 404 to user: Floating IP pool not found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:18.573532 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6e7ca222-b4d7-48b1-b35a-cec436c1764a tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.132978 Jun 16 18:48:18.573532 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2013/3938] 10.222.0.27 () {60 vars in 1169 bytes} [Thu Jun 16 18:48:18 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:48:18.577664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:18.578309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:18.595851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:18.596314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:18.597109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:18.602953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:18.910420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:18.936897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:18.940475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:18.946494 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9c8c92a1-a2f7-4939-b883-b81a0a400beb tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.373124 Jun 16 18:48:18.966494 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2014/3939] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:18 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:18.980815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef83bb1e-b2ed-4ebc-a52d-d30133c5877f tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Calling method '.version_select at 0x7f866dd38f70>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:19.382554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-ef83bb1e-b2ed-4ebc-a52d-d30133c5877f tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e8eb9847-a463-442e-a505-551736a080bc could not be found", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:48:19.383913 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ef83bb1e-b2ed-4ebc-a52d-d30133c5877f tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] HTTP exception thrown: Floating IP not found for ID e8eb9847-a463-442e-a505-551736a080bc Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef83bb1e-b2ed-4ebc-a52d-d30133c5877f tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Request method failure captured: Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-floating-ips/e8eb9847-a463-442e-a505-551736a080bc HTTP/1.1 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3rxOcU25Ji4beZrljhlWb3kJFFoc0DTOby2ssDYeIItzNR6mWM3zXakDOImu6xWlajXLhJ2xeV8itpnO7q2yIhk1g3n8RrmGexgVTw_Zyh91hR5S-htIqhphd-PA9rBmH2vS2EEgX09NzID2k3rmfsh3BhJfSQO-FhzRnW4P3fkhVY Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 6e7cc9d4e933408d914918d219b2cd5c Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-612643381 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6e7cc9d4e933408d914918d219b2cd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6e7cc9d4e933408d914918d219b2cd5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6e7cc9d4e933408d914918d219b2cd5c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6e7cc9d4e933408d914918d219b2cd5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-612643381 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 6e7cc9d4e933408d914918d219b2cd5c Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-612643381 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-FloatingIPsNegativeTestJSON-612643381-project Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: cee0ace5e1f94443acfae6ee1f15eff2 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-612643381-project Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: exception: Floating IP not found for ID e8eb9847-a463-442e-a505-551736a080bc Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'e8eb9847-a463-442e-a505-551736a080bc'} Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e8eb9847-a463-442e-a505-551736a080bc could not be found Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bff26fad-fa69-442c-b720-bd141376d6e8'] Jun 16 18:48:19.386297 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e8eb9847-a463-442e-a505-551736a080bc. Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e8eb9847-a463-442e-a505-551736a080bc Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e8eb9847-a463-442e-a505-551736a080bc Jun 16 18:48:19.390252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:19.392167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:19.393954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef83bb1e-b2ed-4ebc-a52d-d30133c5877f tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] Returning 404 to user: Floating IP not found for ID e8eb9847-a463-442e-a505-551736a080bc {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:19.395207 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef83bb1e-b2ed-4ebc-a52d-d30133c5877f tempest-FloatingIPsNegativeTestJSON-612643381 tempest-FloatingIPsNegativeTestJSON-612643381-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e8eb9847-a463-442e-a505-551736a080bc" status: 404 len: 111 microversion: 2.1 time: 0.427633 Jun 16 18:48:19.396124 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2015/3940] 10.222.0.27 () {58 vars in 1262 bytes} [Thu Jun 16 18:48:18 2022] DELETE /compute/v2.1/os-floating-ips/e8eb9847-a463-442e-a505-551736a080bc => generated 111 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:48:19.405994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:19.415631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:19.430628 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4df83fc-2d97-4bad-9e1f-357272f8485d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1555 microversion: 2.1 time: 1.180984 Jun 16 18:48:19.431244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1926/3941] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:18 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1555 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:19.440298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:19.445963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:19.447056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:19.448833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0172f149-ddc5-4ac3-b49c-648310c0c44b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:19.449523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:19.450335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0172f149-ddc5-4ac3-b49c-648310c0c44b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:19.478993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0172f149-ddc5-4ac3-b49c-648310c0c44b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:19.479460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0172f149-ddc5-4ac3-b49c-648310c0c44b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:19.480278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0172f149-ddc5-4ac3-b49c-648310c0c44b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:19.480729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0172f149-ddc5-4ac3-b49c-648310c0c44b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:19.608763 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0172f149-ddc5-4ac3-b49c-648310c0c44b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168352 Jun 16 18:48:19.615433 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1927/3942] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:19 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:19.624948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26c82abd-f7fe-4370-a41f-c9734a4c543e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:19.639802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26c82abd-f7fe-4370-a41f-c9734a4c543e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:19.695761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c82abd-f7fe-4370-a41f-c9734a4c543e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:19.701643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c82abd-f7fe-4370-a41f-c9734a4c543e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:19.708140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c82abd-f7fe-4370-a41f-c9734a4c543e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:19.710371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c82abd-f7fe-4370-a41f-c9734a4c543e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:20.140809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:20.159559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:20.173575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:20.177388 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fcad06da-aa25-4f03-bdcc-3bd192886320 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.778614 Jun 16 18:48:20.183388 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2016/3943] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:19 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:20.210351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:20.211247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:20.228770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:20.229478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:20.230448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:20.233544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:20.426168 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26c82abd-f7fe-4370-a41f-c9734a4c543e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.809455 Jun 16 18:48:20.427862 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1928/3944] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:48:19 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-interface => generated 284 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:20.626496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0b430e4e-7d73-4168-a8b1-6f5ded6e65c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:20.629358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0b430e4e-7d73-4168-a8b1-6f5ded6e65c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:20.652118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b430e4e-7d73-4168-a8b1-6f5ded6e65c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:20.664626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b430e4e-7d73-4168-a8b1-6f5ded6e65c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:20.669820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b430e4e-7d73-4168-a8b1-6f5ded6e65c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:20.671072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b430e4e-7d73-4168-a8b1-6f5ded6e65c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:20.765990 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0b430e4e-7d73-4168-a8b1-6f5ded6e65c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143397 Jun 16 18:48:20.769899 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1929/3945] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:20 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:20.795651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:20.823303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:20.836102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:20.837957 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5724a45c-3ed5-4ead-b115-82f8808dda26 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.639383 Jun 16 18:48:20.839087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2017/3946] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:20 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:21.203900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:21.204484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:21.212320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:21.218952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:21.219870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:21.220519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:21.542230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:21.579115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:21.581018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:21.582565 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f06e522f-b083-4558-a1ec-5d5a262a637f tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.384061 Jun 16 18:48:21.583870 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1930/3947] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:21 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:21.781623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2aa6a670-60b0-4f63-ae1a-cffbc32b4760 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:21.785248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2aa6a670-60b0-4f63-ae1a-cffbc32b4760 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:21.796573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:21.804886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa6a670-60b0-4f63-ae1a-cffbc32b4760 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:21.806162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa6a670-60b0-4f63-ae1a-cffbc32b4760 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:21.806708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa6a670-60b0-4f63-ae1a-cffbc32b4760 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:21.813605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aa6a670-60b0-4f63-ae1a-cffbc32b4760 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:21.821080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:21.860442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:21.861574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:21.868935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:21.881248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:21.882816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:21.884830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:21.893894 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2aa6a670-60b0-4f63-ae1a-cffbc32b4760 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117283 Jun 16 18:48:21.895866 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2018/3948] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:21 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:22.150013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:22.163127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:22.172778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:22.177505 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f364283a-b363-4c59-af80-c125c079e5f5 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.324677 Jun 16 18:48:22.179410 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1931/3949] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:21 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:22.609519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:22.610484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:22.625764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:22.626433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:22.627227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:22.627667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:22.812252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:22.829790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:22.831568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:22.833978 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f7a2fc43-1ba4-433b-ad4f-0d1cf26c7a04 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.234010 Jun 16 18:48:22.835986 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2019/3950] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:22 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:22.907697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7b1b6dd1-a43d-458b-8438-194be6df06ea tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:22.909639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7b1b6dd1-a43d-458b-8438-194be6df06ea tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:22.922183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b1b6dd1-a43d-458b-8438-194be6df06ea tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:22.926346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b1b6dd1-a43d-458b-8438-194be6df06ea tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:22.927646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b1b6dd1-a43d-458b-8438-194be6df06ea tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:22.933015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7b1b6dd1-a43d-458b-8438-194be6df06ea tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:23.016079 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7b1b6dd1-a43d-458b-8438-194be6df06ea tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113954 Jun 16 18:48:23.017138 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1932/3951] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:22 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:23.195713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:23.198996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:23.213085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:23.213539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:23.222698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:23.223165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:23.401059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:23.417132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:23.424196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:23.425983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-20a2a454-0299-4ca9-b64b-2a7b4af06e37 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.234179 Jun 16 18:48:23.427092 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2020/3952] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:23 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:23.856947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:23.858418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:23.867972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:23.874824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:23.876115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:23.877345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:23.929946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-419c0433-bbcf-469a-91cd-7685e0447cef req-ac78299e-3df1-41cf-98cd-219bcfdfba9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5", "tag": "1f59f32f-8cd9-4223-aa08-52dd71b45dc6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:23.949368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-419c0433-bbcf-469a-91cd-7685e0447cef req-ac78299e-3df1-41cf-98cd-219bcfdfba9d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:23.953626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-419c0433-bbcf-469a-91cd-7685e0447cef req-ac78299e-3df1-41cf-98cd-219bcfdfba9d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:23.993128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-419c0433-bbcf-469a-91cd-7685e0447cef req-ac78299e-3df1-41cf-98cd-219bcfdfba9d service nova] Creating event network-changed:1f59f32f-8cd9-4223-aa08-52dd71b45dc6 for instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 on n-h2-846209-2 Jun 16 18:48:24.004051 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-419c0433-bbcf-469a-91cd-7685e0447cef req-ac78299e-3df1-41cf-98cd-219bcfdfba9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078799 Jun 16 18:48:24.005385 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2021/3953] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:48:24.029584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-941542fb-0139-4bc4-95c3-288eea77f60d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:24.031080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-941542fb-0139-4bc4-95c3-288eea77f60d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:24.047318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-941542fb-0139-4bc4-95c3-288eea77f60d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:24.049617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-941542fb-0139-4bc4-95c3-288eea77f60d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:24.052922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-941542fb-0139-4bc4-95c3-288eea77f60d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:24.053655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-941542fb-0139-4bc4-95c3-288eea77f60d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:24.115174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:24.131503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:24.134142 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-941542fb-0139-4bc4-95c3-288eea77f60d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109843 Jun 16 18:48:24.138859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:24.139385 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2022/3954] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:24 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:24.144013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d0b233d-424c-4a1b-9f48-219dc9129ae5 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.291584 Jun 16 18:48:24.150440 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1933/3955] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:23 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:24.446496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:24.447437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:24.461306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:24.468062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:24.476155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:24.477758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:24.899954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:24.914256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:24.930343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:24.940796 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae9773b3-8b66-4f40-9f09-374a1529b5ee tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.497154 Jun 16 18:48:24.944216 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2023/3956] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:24 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:25.155834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6393940-7e65-4741-8322-d3173c4bccbe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:25.158565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f6393940-7e65-4741-8322-d3173c4bccbe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:25.170155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:25.171900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:25.179910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6393940-7e65-4741-8322-d3173c4bccbe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:25.183526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6393940-7e65-4741-8322-d3173c4bccbe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:25.188052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6393940-7e65-4741-8322-d3173c4bccbe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:25.188562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6393940-7e65-4741-8322-d3173c4bccbe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:25.197283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:25.203396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:25.206948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:25.208981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:25.210341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:25.316769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f6393940-7e65-4741-8322-d3173c4bccbe tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.169249 Jun 16 18:48:25.317386 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1934/3957] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:25 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:25.624020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:25.640648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:25.642237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:25.643461 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1f075a90-9275-4779-91f6-36fcb155c8f1 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.478141 Jun 16 18:48:25.649014 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2024/3958] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:25 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:25.961802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:25.962594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:25.978843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:25.987390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:25.988600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:25.989222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:26.109636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:26.122560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:26.132143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:26.134545 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1545b22a-9be5-4f45-8b16-4c51fd43c766 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.176958 Jun 16 18:48:26.146831 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1935/3959] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:25 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:26.329028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1893b7fa-c1ff-4fb3-bdfa-4531907b4528 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:26.329875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1893b7fa-c1ff-4fb3-bdfa-4531907b4528 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:26.358627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1893b7fa-c1ff-4fb3-bdfa-4531907b4528 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:26.362212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1893b7fa-c1ff-4fb3-bdfa-4531907b4528 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:26.374616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1893b7fa-c1ff-4fb3-bdfa-4531907b4528 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:26.375093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1893b7fa-c1ff-4fb3-bdfa-4531907b4528 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:26.436618 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1893b7fa-c1ff-4fb3-bdfa-4531907b4528 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111764 Jun 16 18:48:26.445432 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2025/3960] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:26 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:26.674320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:26.675763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:26.694012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:26.695155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:26.696537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:26.697295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:26.841663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:26.854353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:26.858301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:26.862372 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b86e5997-e7d7-4110-bae4-231b6f7254b2 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.194834 Jun 16 18:48:26.864109 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1936/3961] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:26 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:27.165436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:27.166286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:27.178239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.178884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.183074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.183745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.318054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:27.332978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:27.335024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:27.341799 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e0428cee-9391-4c9e-99f4-fcab0aa18013 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.180241 Jun 16 18:48:27.373347 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2026/3962] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:27 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:27.457276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ade27e4-a5fc-4548-aedb-5a518cf7c47e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:27.462591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5ade27e4-a5fc-4548-aedb-5a518cf7c47e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:27.483150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ade27e4-a5fc-4548-aedb-5a518cf7c47e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.483749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ade27e4-a5fc-4548-aedb-5a518cf7c47e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.487797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ade27e4-a5fc-4548-aedb-5a518cf7c47e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.489541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ade27e4-a5fc-4548-aedb-5a518cf7c47e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.597510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ade27e4-a5fc-4548-aedb-5a518cf7c47e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.150827 Jun 16 18:48:27.601326 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1937/3963] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:48:27 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:27.710768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:27.711521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:27.726704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.727418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.728948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.729634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.767372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:48:27.883892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:27.885262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:27.904093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.904592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.907690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:27.908400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:27.956815 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f6ffd30-88c0-41bc-8464-b761beafcdda tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 204 len: 0 microversion: 2.20 time: 0.248533 Jun 16 18:48:27.958097 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2027/3964] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:48:27 2022] DELETE /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:48:27.967614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:27.986921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:28.001732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:28.002315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:28.003177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:28.003705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:28.063716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.088100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.089638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.116549 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ac0dd669-c843-4d07-996c-7cb03da6ebd3 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.211635 Jun 16 18:48:28.117241 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1938/3965] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:27 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:28.270306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.287341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.289286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.303271 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15898ec8-b9be-4d93-9f7f-bda93045811b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.340753 Jun 16 18:48:28.310116 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2028/3966] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:27 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:28.362561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:28.370921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:28.385991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:28.386700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:28.390287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:28.393065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:28.562552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.576563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.583156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:28.584652 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-550c8b64-3ef5-4bb6-933c-8e1e8e8f45e7 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.226838 Jun 16 18:48:28.585366 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1939/3967] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:28 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:29.136321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:29.136985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:29.144707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.145207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.146053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.146685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.243899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.254898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.256479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.257727 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2da509b-23b2-43fc-9436-8396039f0261 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.125706 Jun 16 18:48:29.258349 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2029/3968] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:29 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:29.326848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:29.327489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:29.335002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.335756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.336571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.337023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.502264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:29.503068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:29.519120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.520910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.521884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.524130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.589170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.608233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.611018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.612436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d30b36dd-3615-4d89-8869-8a9b0f8d3201 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.290232 Jun 16 18:48:29.635448 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1940/3969] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:29 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:29.655224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:29.656319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:29.663432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.666723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.667556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.668035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.883909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.894934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.901746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.908955 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67d8f04a-96f8-4dff-bd43-efcfcc69fa18 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.272111 Jun 16 18:48:29.910013 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1941/3970] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:29 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:29.942832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:29.953067 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-948a5141-46e1-4153-b501-deb6c3e1047d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.455405 Jun 16 18:48:29.954550 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2030/3971] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:48:29 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:29.972972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90b7d952-f713-43fa-9f2f-2602a57c3bcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-517399611"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:29.974749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90b7d952-f713-43fa-9f2f-2602a57c3bcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:29.983402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b7d952-f713-43fa-9f2f-2602a57c3bcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.984344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b7d952-f713-43fa-9f2f-2602a57c3bcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:29.985424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b7d952-f713-43fa-9f2f-2602a57c3bcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:29.986269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90b7d952-f713-43fa-9f2f-2602a57c3bcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:30.276207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:30.276981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:30.290529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:30.292815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:30.295635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:30.296249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:30.460362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:30.482350 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90b7d952-f713-43fa-9f2f-2602a57c3bcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.511597 Jun 16 18:48:30.483532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:30.492121 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1942/3972] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:48:29 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 16 18:48:30.495051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:30.499099 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7bb39f8c-9a65-4cda-a94d-dc0c22133beb tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.224421 Jun 16 18:48:30.500677 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2031/3973] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:30 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:30.632478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:30.633247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:30.648129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:30.657469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:30.658805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:30.666534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:30.929704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:30.930419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:30.939149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:30.940007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:30.941135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:30.942152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:31.068901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.092693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.094882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.098187 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd65820f-4561-4338-b0fc-aac467705fe4 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.172569 Jun 16 18:48:31.100224 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2032/3974] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:30 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:31.194614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.203708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.205241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.212165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17929809-249c-4807-abcb-0c57ca3c5619 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 200 len: 1724 microversion: 2.20 time: 0.584360 Jun 16 18:48:31.225136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-34b0c5b3-292f-423e-8d83-8dece2537046 req-dd55e7d5-ab79-4677-bb9d-70efed63aced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b6c0e5-0374-409e-928e-fef329282b9d", "name": "network-vif-deleted", "tag": "1d6556a3-3abe-405b-9851-474f0b6ab80f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:31.233737 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1943/3975] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:30 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 1724 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:31.249035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-34b0c5b3-292f-423e-8d83-8dece2537046 req-dd55e7d5-ab79-4677-bb9d-70efed63aced service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:31.250333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-34b0c5b3-292f-423e-8d83-8dece2537046 req-dd55e7d5-ab79-4677-bb9d-70efed63aced service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:31.272204 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-34b0c5b3-292f-423e-8d83-8dece2537046 req-dd55e7d5-ab79-4677-bb9d-70efed63aced service nova] Creating event network-vif-deleted:1d6556a3-3abe-405b-9851-474f0b6ab80f for instance 31b6c0e5-0374-409e-928e-fef329282b9d on n-h2-846209-2 Jun 16 18:48:31.283637 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-34b0c5b3-292f-423e-8d83-8dece2537046 req-dd55e7d5-ab79-4677-bb9d-70efed63aced service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069501 Jun 16 18:48:31.286518 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2033/3976] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:31.523262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:31.523844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:31.545140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:31.546865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:31.546865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:31.547463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:31.707310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.730139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.735112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:31.739775 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35346c63-bffa-4bc6-bfa2-d64b316b76d6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1365 microversion: 2.57 time: 0.218292 Jun 16 18:48:31.742436 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1944/3977] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:31 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:32.140661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:32.153748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:32.189956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:32.192944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:32.194640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:32.195263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:32.244336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:32.244974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:32.253022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:32.254119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:32.255065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:32.255666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:32.288686 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] HTTP exception thrown: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Request method failure captured: Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d HTTP/1.1 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3oQSNUCbqEVo9tjqy9aJyTjXEUEdu_tJdwht-p0ilsRPcmWBErwDJuORwvV7OGrlPuDgkeV6au6pByR1FmdQ2FYDug0xJDixW-sEisfkbk6D1zEFPbiaj9OjObSkVibhfb1c9sBW2DLQ57f6qK5ykCzTD7GrCm6wGMYCWrKqol7Pe0 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8493b9facda24bb6849d297a47afd81b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1e1faf1cce864fa4b65a67074b879065 Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '31b6c0e5-0374-409e-928e-fef329282b9d'} Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:32.296125 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:48:32.302151 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:32.303381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:32.304001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Returning 404 to user: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:32.308580 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8210aa95-149e-408f-ac4f-0a10e6843be5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 404 len: 111 microversion: 2.20 time: 0.069196 Jun 16 18:48:32.310270 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1945/3978] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:32 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:32.319768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f934273c-63d7-48a5-8e5c-347375c182e9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '.version_select at 0x7f866e1ab670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:32.367053 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f934273c-63d7-48a5-8e5c-347375c182e9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063212738" status: 204 len: 0 microversion: 2.20 time: 0.051882 Jun 16 18:48:32.371454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1946/3979] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:48:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063212738 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:48:32.415224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:32.430470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:32.432414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:32.434632 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a26c419b-93b6-4a1b-8ad1-3aaf91c3a3cd tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1602 microversion: 2.42 time: 0.318523 Jun 16 18:48:32.446574 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2034/3980] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:32 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1602 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:32.764645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:32.766402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:32.782549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:32.783570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:32.784589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:32.785426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:32.876262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:32.892358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:32.894199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:32.895535 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d79593d5-909c-4898-a0a9-11578d145cd6 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1371 microversion: 2.57 time: 0.139014 Jun 16 18:48:32.909037 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1947/3981] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:32 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:33.454704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:33.455449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:33.473028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:33.473641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:33.474852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:33.475335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:33.500679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b86f93ff-aea1-4d6c-b9c8-bf790b5d65b1 req-cd23d0fa-f3cf-4707-85c8-4cdf3d37468c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-unplugged", "status": "completed", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:33.522240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b86f93ff-aea1-4d6c-b9c8-bf790b5d65b1 req-cd23d0fa-f3cf-4707-85c8-4cdf3d37468c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:33.527274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b86f93ff-aea1-4d6c-b9c8-bf790b5d65b1 req-cd23d0fa-f3cf-4707-85c8-4cdf3d37468c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:33.552217 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b86f93ff-aea1-4d6c-b9c8-bf790b5d65b1 req-cd23d0fa-f3cf-4707-85c8-4cdf3d37468c service nova] Creating event network-vif-unplugged:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:48:33.567637 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b86f93ff-aea1-4d6c-b9c8-bf790b5d65b1 req-cd23d0fa-f3cf-4707-85c8-4cdf3d37468c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070955 Jun 16 18:48:33.570962 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1948/3982] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:33.578125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:33.578864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:33.579632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lazy-loading 'fault' on Instance uuid 24180ce8-cbfa-45a1-b91c-651f81a7f556 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:48:33.664637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:33.679607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:33.681896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bded9f5ba0a41b38e7bf0a13604bed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60605ca65e2e4016993b3f649c5bea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:33.686505 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4081db05-4439-4b40-b1b3-deca5e4768f6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 200 len: 1607 microversion: 2.42 time: 0.235825 Jun 16 18:48:33.694162 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2035/3983] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:33 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 1607 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:33.919333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:33.920104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:33.931446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:33.932211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:33.933128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:33.933970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:34.038420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:34.053234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:34.056110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:34.061793 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9713bef6-35bf-49de-af07-4547b9bcdf9d tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1371 microversion: 2.57 time: 0.148254 Jun 16 18:48:34.062685 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1949/3984] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:33 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:34.462004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-154da3f8-8079-465e-bf93-867901de72d7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'create', calling method: .version_select at 0x7f866eae8550>, body: {"keypair": {"name": "tempest-keypair-1966056705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDw6gA9r8fSbI7urjo4RUQLDdZ1bkLFYnx+Su5tjNefTQA1L01QPn0B5yWoKrpe67lbLTrJdlDkPdIobM7SWy2PkCa/l5XyLVLzoOkSATDn35rlwEgJiuA4sFtEtWsnQ7g=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:34.479978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-154da3f8-8079-465e-bf93-867901de72d7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for project 8493b9facda24bb6849d297a47afd81b. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:48:34.488823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-154da3f8-8079-465e-bf93-867901de72d7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for user 1e1faf1cce864fa4b65a67074b879065 and project 8493b9facda24bb6849d297a47afd81b. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:48:34.532767 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-154da3f8-8079-465e-bf93-867901de72d7 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.081611 Jun 16 18:48:34.539584 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2036/3985] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:48:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:48:34.711171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:34.711958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:34.728100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:34.728718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:34.729797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:34.730386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:34.750708 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] HTTP exception thrown: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Request method failure captured: Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 HTTP/1.1 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3l5mDWJeY35QkbmixJ8z7ZRVLgm4cjey-0u-dI7jpOkaVUwSOOh6Zb1y2A36UxjIU9eRH0Ki0ZhoKofwJbhxI4sMZ2dt_avhcaac56yuGvnOyfIeRcOJX72sh9N0Yf-pDIwU0bxw3Tt_pER9qiNkPwLbM7d35Mxa0LL6nVd_xtB71U Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.42 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 60605ca65e2e4016993b3f649c5bea44 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60605ca65e2e4016993b3f649c5bea44", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 60605ca65e2e4016993b3f649c5bea44 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TaggedBootDevicesTest_v242-704741004-project Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1bded9f5ba0a41b38e7bf0a13604bed5 Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TaggedBootDevicesTest_v242-704741004-project Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '24180ce8-cbfa-45a1-b91c-651f81a7f556'} Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:34.752561 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:34.756927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:34.757721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Returning 404 to user: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:34.767704 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8070f1d1-763c-40b3-a55c-424196ef6856 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 404 len: 111 microversion: 2.42 time: 0.053926 Jun 16 18:48:34.770432 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1950/3986] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:34 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:34.777210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3834cb14-6a37-48ad-a39a-16c19827e0a6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '.version_select at 0x7f86781784c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:34.836180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3834cb14-6a37-48ad-a39a-16c19827e0a6 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-827571068" status: 204 len: 0 microversion: 2.42 time: 0.062758 Jun 16 18:48:34.850570 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2037/3987] 10.222.0.27 () {60 vars in 1258 bytes} [Thu Jun 16 18:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-827571068 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:48:35.084592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:35.086343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:35.097114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:35.100940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:35.103045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:35.103738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:35.601532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-92bcd9bd-ef18-4702-a259-a0eb7fbc1028 req-fde8dbc1-2b38-4849-9b02-8b8c3e9107ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-plugged", "status": "completed", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:35.626012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-92bcd9bd-ef18-4702-a259-a0eb7fbc1028 req-fde8dbc1-2b38-4849-9b02-8b8c3e9107ae service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:35.628090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-92bcd9bd-ef18-4702-a259-a0eb7fbc1028 req-fde8dbc1-2b38-4849-9b02-8b8c3e9107ae service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:35.656385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:35.657778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-92bcd9bd-ef18-4702-a259-a0eb7fbc1028 req-fde8dbc1-2b38-4849-9b02-8b8c3e9107ae service nova] Creating event network-vif-plugged:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:48:35.667103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:35.677990 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-92bcd9bd-ef18-4702-a259-a0eb7fbc1028 req-fde8dbc1-2b38-4849-9b02-8b8c3e9107ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077713 Jun 16 18:48:35.682488 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2038/3988] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:48:35.687446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:35.697615 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1154b6f4-15c6-4700-85de-51de4d034d32 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1356 microversion: 2.57 time: 0.613137 Jun 16 18:48:35.699597 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1951/3989] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:35 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1356 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:35.735316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:35.736176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:35.746135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:35.748119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:35.749123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:35.749730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:35.795753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:48:35.971570 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-023a8d37-e616-4b99-9b33-76f6c30f2129 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 204 len: 0 microversion: 2.57 time: 0.241135 Jun 16 18:48:35.972823 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2039/3990] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:48:35 2022] DELETE /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:48:35.982965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:35.983822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:36.005286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:36.005759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:36.006719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:36.007337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:36.047501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:36.186591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:36.203686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:36.205134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:36.206355 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bdf4b21-b9bd-444d-99e6-1808ef322ab8 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1362 microversion: 2.57 time: 0.229263 Jun 16 18:48:36.224913 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1952/3991] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:35 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:37.231985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:37.233650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:37.251153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:37.251802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:37.252729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:37.257789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:37.575745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:37.593260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:37.596072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:37.601754 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c254323b-e434-42c9-83a6-c50ca8781165 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1362 microversion: 2.57 time: 0.373730 Jun 16 18:48:37.607292 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2040/3992] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:37 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:38.625088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:38.626366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:38.635864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:38.636323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:38.637148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:38.637594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:38.754970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:38.755431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:38.771662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lazy-loading 'fault' on Instance uuid 21280e40-619f-4716-9cf6-00536b9091ef {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:48:38.882629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:38.892099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:38.894099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84739b3622dd4f989f74d85863940328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be29111e305a4e95a082a21866947a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:38.894883 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2a5e96d1-190b-454e-93d8-f6b2db227c3b tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 200 len: 1367 microversion: 2.57 time: 0.274056 Jun 16 18:48:38.922489 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1953/3993] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:38 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:39.743238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2013336224", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "448a9d16-1568-4616-82e9-7c0185274295"}], "security_groups": [{"name": "tempest-securitygroup--289847257"}], "key_name": "tempest-keypair-1966056705", "user_data": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:39.919278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:39.919917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] [instance: 21280e40-619f-4716-9cf6-00536b9091ef] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:39.956633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:39.958669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:39.965641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:39.967045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:40.053538 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] HTTP exception thrown: Instance 21280e40-619f-4716-9cf6-00536b9091ef could not be found. Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Request method failure captured: Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef HTTP/1.1 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3rbSqV0_12Z4RZU5SB_sfccjZTDO-noMZkHT85LligWOFZuMumcR7vnENTHHRj2nX92fVFuKqo_vB_F5Xo51uXCt-BOLoSnzi1CymYFT6Hzjeb4GY-yH0clT04Svg61JDRUSdCz5PIY7TkaOgmy3CEHHDMVaYFZZ0JCPIMeyMeXsX0 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.57 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: be29111e305a4e95a082a21866947a56 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerShowV257Test-1867872993 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be29111e305a4e95a082a21866947a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be29111e305a4e95a082a21866947a56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be29111e305a4e95a082a21866947a56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be29111e305a4e95a082a21866947a56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerShowV257Test-1867872993 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: be29111e305a4e95a082a21866947a56 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerShowV257Test-1867872993 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerShowV257Test-1867872993-project Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 84739b3622dd4f989f74d85863940328 Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerShowV257Test-1867872993-project Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 21280e40-619f-4716-9cf6-00536b9091ef could not be found. Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '21280e40-619f-4716-9cf6-00536b9091ef'} Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21280e40-619f-4716-9cf6-00536b9091ef could not be found. Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21280e40-619f-4716-9cf6-00536b9091ef could not be found. Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:40.055865 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:40.062646 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:40.062646 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:40.062646 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:40.062646 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:40.062646 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:40.062646 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21280e40-619f-4716-9cf6-00536b9091ef could not be found. Jun 16 18:48:40.062646 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:40.066948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] Returning 404 to user: Instance 21280e40-619f-4716-9cf6-00536b9091ef could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:40.078077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a65d49ab-6db2-437d-815d-2ac53a3d8647 tempest-ServerShowV257Test-1867872993 tempest-ServerShowV257Test-1867872993-project] 10.222.0.27 "GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef" status: 404 len: 111 microversion: 2.57 time: 0.166590 Jun 16 18:48:40.085726 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1954/3994] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:39 2022] GET /compute/v2.1/servers/21280e40-619f-4716-9cf6-00536b9091ef => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:40.479958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] validate_networks() for [('448a9d16-1568-4616-82e9-7c0185274295', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:48:42.390250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:48:42.391453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:48:42.392197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:48:42.393639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:48:42.400758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:48:42.422045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:42.423104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:42.424600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:42.425402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:42.462862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for project 8493b9facda24bb6849d297a47afd81b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:48:42.491776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Getting quotas for user 1e1faf1cce864fa4b65a67074b879065 and project 8493b9facda24bb6849d297a47afd81b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:48:42.530187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-793ebbc0-bd05-48db-8672-08d8749b0349 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866f1bc0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1411743170", "description": "tempest-description-2044582643"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:42.539350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:48:42.550827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:48:42.726231 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7057a78e-1f81-40e1-8378-53425a0bbb6f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.979473 Jun 16 18:48:42.732774 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2041/3995] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:48:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 2995 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:48:42.737794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9084f18-6dfe-4d50-ad3c-8e17bfeee4d5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:42.738568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b9084f18-6dfe-4d50-ad3c-8e17bfeee4d5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:43.023312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9084f18-6dfe-4d50-ad3c-8e17bfeee4d5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:43.033256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9084f18-6dfe-4d50-ad3c-8e17bfeee4d5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:43.042108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9084f18-6dfe-4d50-ad3c-8e17bfeee4d5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:43.043765 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9084f18-6dfe-4d50-ad3c-8e17bfeee4d5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1282 microversion: 2.20 time: 0.309923 Jun 16 18:48:43.044527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2042/3996] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:42 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1282 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:43.983935 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-793ebbc0-bd05-48db-8672-08d8749b0349 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.618978 Jun 16 18:48:43.984504 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1955/3997] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:48:42 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:43.995590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04135a38-7dd4-4a83-9339-26de3e51f11b tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f8677fef1f0>, body: {"security_group_rule": {"parent_group_id": "c9636c85-47ec-4241-99f2-a3d47679282c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:44.062535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:44.063178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:44.065160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:44.087909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:44.088372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:44.089171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:44.089613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:44.244456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:44.266424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:44.269324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:44.270921 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6b39cec0-34dc-4a4b-89ff-216913b34acf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1334 microversion: 2.20 time: 0.212993 Jun 16 18:48:44.272048 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1956/3998] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:44 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1334 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:45.291778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:45.292436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:45.308315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:45.310901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:45.311953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:45.312401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:45.659497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:45.676901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:45.686059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:45.693256 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bdaa96ef-2405-45b9-945e-83703cf54ffa tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1340 microversion: 2.20 time: 0.406433 Jun 16 18:48:45.695390 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1957/3999] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:45 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1340 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:45.845783 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04135a38-7dd4-4a83-9339-26de3e51f11b tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.853981 Jun 16 18:48:45.862373 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2043/4000] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:45.864578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8045f7e-e01e-49ae-a414-1fd52bd9175c tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866de63ee0>, body: {"security_group_rule": {"parent_group_id": "c9636c85-47ec-4241-99f2-a3d47679282c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:46.029519 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e8045f7e-e01e-49ae-a414-1fd52bd9175c tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: This rule already exists in group c9636c85-47ec-4241-99f2-a3d47679282c Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8045f7e-e01e-49ae-a414-1fd52bd9175c tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 138 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: {"security_group_rule": {"parent_group_id": "c9636c85-47ec-4241-99f2-a3d47679282c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: exception: This rule already exists in group c9636c85-47ec-4241-99f2-a3d47679282c Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c9636c85-47ec-4241-99f2-a3d47679282c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c9636c85-47ec-4241-99f2-a3d47679282c Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c9636c85-47ec-4241-99f2-a3d47679282c Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:46.032319 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:46.036758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:46.036758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:46.036758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c9636c85-47ec-4241-99f2-a3d47679282c Jun 16 18:48:46.036758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:46.036758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8045f7e-e01e-49ae-a414-1fd52bd9175c tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 400 to user: This rule already exists in group c9636c85-47ec-4241-99f2-a3d47679282c {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:46.036758 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8045f7e-e01e-49ae-a414-1fd52bd9175c tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.175251 Jun 16 18:48:46.047567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-771f9e73-0bc7-4a28-a3ad-f60a35fe17c7 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Calling method '.version_select at 0x7f866eae83a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:46.049228 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1958/4001] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:45 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:46.435778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:46.437068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:46.456543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:46.458536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:46.464569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:46.466097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:46.687493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lazy-loading 'services' on Instance uuid d0c93d90-ad38-4326-9bb6-4c38b39891ac {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:48:46.988099 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61d74258-2cf6-476c-aa77-a7ea781822d3 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments/2efeabd6-0e6b-4ed9-8c60-fcf13250a9f7" status: 202 len: 0 microversion: 2.1 time: 0.560477 Jun 16 18:48:46.989241 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1959/4002] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:48:46 2022] DELETE /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments/2efeabd6-0e6b-4ed9-8c60-fcf13250a9f7 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:48:47.004661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:47.006450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:47.033698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:47.034597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:47.036052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:47.037684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:47.077548 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] HTTP exception thrown: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Request method failure captured: Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 HTTP/1.1 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3l5mDWJeY35QkbmixJ8z7ZRVLgm4cjey-0u-dI7jpOkaVUwSOOh6Zb1y2A36UxjIU9eRH0Ki0ZhoKofwJbhxI4sMZ2dt_avhcaac56yuGvnOyfIeRcOJX72sh9N0Yf-pDIwU0bxw3Tt_pER9qiNkPwLbM7d35Mxa0LL6nVd_xtB71U Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.42 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 60605ca65e2e4016993b3f649c5bea44 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60605ca65e2e4016993b3f649c5bea44", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 60605ca65e2e4016993b3f649c5bea44 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TaggedBootDevicesTest_v242-704741004-project Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1bded9f5ba0a41b38e7bf0a13604bed5 Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TaggedBootDevicesTest_v242-704741004-project Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '24180ce8-cbfa-45a1-b91c-651f81a7f556'} Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:48:47.088442 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:47.092410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:47.096213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Returning 404 to user: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:47.100007 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4561e3dd-94fb-418d-a6f4-10a4dbc5db02 tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 404 len: 111 microversion: 2.42 time: 0.108875 Jun 16 18:48:47.104791 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1960/4003] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:48:46 2022] DELETE /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:47.137706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:47.141319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:47.168379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:47.175247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:47.177027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:47.178362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:48.141927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-771f9e73-0bc7-4a28-a3ad-f60a35fe17c7 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/2e5423ca-c2e1-42cc-819f-fe7ae44f076a" status: 202 len: 0 microversion: 2.1 time: 2.100672 Jun 16 18:48:48.142863 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2044/4004] 10.222.0.27 () {58 vars in 1286 bytes} [Thu Jun 16 18:48:46 2022] DELETE /compute/v2.1/os-security-group-rules/2e5423ca-c2e1-42cc-819f-fe7ae44f076a => generated 0 bytes in 2104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:48:48.149260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f1ec2a3b-166f-47c7-85cf-a180c29e39c0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:48.150494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f1ec2a3b-166f-47c7-85cf-a180c29e39c0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:48.190981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1ec2a3b-166f-47c7-85cf-a180c29e39c0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:48.195209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1ec2a3b-166f-47c7-85cf-a180c29e39c0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:48.202410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1ec2a3b-166f-47c7-85cf-a180c29e39c0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:48.202895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1ec2a3b-166f-47c7-85cf-a180c29e39c0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:48.377538 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f1ec2a3b-166f-47c7-85cf-a180c29e39c0 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233410 Jun 16 18:48:48.380522 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2045/4005] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:48:48 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:48.414337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:48.414972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] [instance: 24180ce8-cbfa-45a1-b91c-651f81a7f556] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:48.436701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:48.437444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:48.438739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:48.439562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:48.503989 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] HTTP exception thrown: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Request method failure captured: Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 HTTP/1.1 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3l5mDWJeY35QkbmixJ8z7ZRVLgm4cjey-0u-dI7jpOkaVUwSOOh6Zb1y2A36UxjIU9eRH0Ki0ZhoKofwJbhxI4sMZ2dt_avhcaac56yuGvnOyfIeRcOJX72sh9N0Yf-pDIwU0bxw3Tt_pER9qiNkPwLbM7d35Mxa0LL6nVd_xtB71U Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.42 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 60605ca65e2e4016993b3f649c5bea44 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60605ca65e2e4016993b3f649c5bea44", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60605ca65e2e4016993b3f649c5bea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 60605ca65e2e4016993b3f649c5bea44 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-704741004 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TaggedBootDevicesTest_v242-704741004-project Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 1bded9f5ba0a41b38e7bf0a13604bed5 Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TaggedBootDevicesTest_v242-704741004-project Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '24180ce8-cbfa-45a1-b91c-651f81a7f556'} Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:48.518334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] Returning 404 to user: Instance 24180ce8-cbfa-45a1-b91c-651f81a7f556 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:48.522714 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fafbae69-c219-4431-8750-a461977dc54a tempest-TaggedBootDevicesTest_v242-704741004 tempest-TaggedBootDevicesTest_v242-704741004-project] 10.222.0.27 "GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556" status: 404 len: 111 microversion: 2.42 time: 0.129287 Jun 16 18:48:48.530743 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2046/4006] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:48 2022] GET /compute/v2.1/servers/24180ce8-cbfa-45a1-b91c-651f81a7f556 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:48.542576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-edbb86ec-4ab1-4609-8e5d-24d437590b35 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866de6f310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-57704660", "description": "tempest-description-793816939"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:49.372537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:49.391585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:49.409758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:49.416065 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f61ce589-62fd-4d4c-9b3a-7c52be05550b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 2.305365 Jun 16 18:48:49.416737 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1961/4007] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:47 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:49.442011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f0d2d2d-82ac-466a-8e07-987c22f71fdd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:49.444388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f0d2d2d-82ac-466a-8e07-987c22f71fdd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:49.489204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f0d2d2d-82ac-466a-8e07-987c22f71fdd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:49.489824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f0d2d2d-82ac-466a-8e07-987c22f71fdd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:49.493147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f0d2d2d-82ac-466a-8e07-987c22f71fdd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:49.494242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f0d2d2d-82ac-466a-8e07-987c22f71fdd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:49.632388 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f0d2d2d-82ac-466a-8e07-987c22f71fdd tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210995 Jun 16 18:48:49.632982 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1962/4008] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:48:49 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:49.866875 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-edbb86ec-4ab1-4609-8e5d-24d437590b35 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.333482 Jun 16 18:48:49.868665 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2047/4009] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:48:48 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:49.883130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e5f2e23-c914-44ec-aa0d-1142d4586b05 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866e23fc10>, body: {"security_group_rule": {"parent_group_id": "2ff40e53-4edf-471a-8c78-763f3ddddd5b", "ip_protocol": "tcp", "from_port": 890031248, "to_port": 22}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:50.163690 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8e5f2e23-c914-44ec-aa0d-1142d4586b05 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: Invalid port range 890031248:22. Former value cannot be greater than the later Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e5f2e23-c914-44ec-aa0d-1142d4586b05 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 145 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: {"security_group_rule": {"parent_group_id": "2ff40e53-4edf-471a-8c78-763f3ddddd5b", "ip_protocol": "tcp", "from_port": 890031248, "to_port": 22}} Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid port range 890031248:22. Former value cannot be greater than the later Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2ff40e53-4edf-471a-8c78-763f3ddddd5b', 'ip_protocol': 'tcp', 'from_port': 890031248, 'to_port': 22}}} Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 890031248:22. Former value cannot be greater than the later Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 890031248:22. Former value cannot be greater than the later Jun 16 18:48:50.165677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 890031248:22. Former value cannot be greater than the later Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e5f2e23-c914-44ec-aa0d-1142d4586b05 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 400 to user: Invalid port range 890031248:22. Former value cannot be greater than the later {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e5f2e23-c914-44ec-aa0d-1142d4586b05 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.290086 Jun 16 18:48:50.173791 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1963/4010] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:49 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:50.180835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa66aa46-45c7-4722-90eb-cab400aa0d3d tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866e535e50>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-195640780", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:50.185489 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-fa66aa46-45c7-4722-90eb-cab400aa0d3d tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: Security group id should be uuid Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa66aa46-45c7-4722-90eb-cab400aa0d3d tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 130 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-195640780", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group id should be uuid Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-195640780', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:50.194334 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:50.198666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 16 18:48:50.198666 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:50.198666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa66aa46-45c7-4722-90eb-cab400aa0d3d tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 400 to user: Security group id should be uuid {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:50.198666 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fa66aa46-45c7-4722-90eb-cab400aa0d3d tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.022217 Jun 16 18:48:50.233693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5c9afa05-71dc-406a-9deb-42c32750a03d tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866de638b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-180833375", "description": "tempest-description-1707829179"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:50.235882 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2048/4011] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:50 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:50.444804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:50.445441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:50.471651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:50.477088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:50.479784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:50.484941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:51.898261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:51.936435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:51.954784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:51.962703 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-73f68c81-0589-497f-825a-161100be00a1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 1.522871 Jun 16 18:48:51.980217 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2049/4012] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:50 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:51.995526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-436d84a4-ab57-4944-9bd0-5289069048f4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:52.002065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-436d84a4-ab57-4944-9bd0-5289069048f4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:52.013197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:52.031288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-436d84a4-ab57-4944-9bd0-5289069048f4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:52.034342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-436d84a4-ab57-4944-9bd0-5289069048f4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:52.035381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-436d84a4-ab57-4944-9bd0-5289069048f4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:52.035991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-436d84a4-ab57-4944-9bd0-5289069048f4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:52.138571 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-436d84a4-ab57-4944-9bd0-5289069048f4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151733 Jun 16 18:48:52.141896 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2050/4013] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:48:51 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:52.295035 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5c9afa05-71dc-406a-9deb-42c32750a03d tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.087590 Jun 16 18:48:52.295682 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1964/4014] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:48:50 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:52.306963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1c303e8-7919-4127-b4b6-9e75f85994b3 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866eba7280>, body: {"security_group_rule": {"parent_group_id": "6c75baef-93ce-477b-a680-8d6b28b66d0e", "ip_protocol": "tempest-999-1471038774", "from_port": 22, "to_port": 22}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:52.446550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:52.449720 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e1c303e8-7919-4127-b4b6-9e75f85994b3 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: Invalid IP protocol tempest-999-1471038774. Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1c303e8-7919-4127-b4b6-9e75f85994b3 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 157 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: {"security_group_rule": {"parent_group_id": "6c75baef-93ce-477b-a680-8d6b28b66d0e", "ip_protocol": "tempest-999-1471038774", "from_port": 22, "to_port": 22}} Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid IP protocol tempest-999-1471038774. Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6c75baef-93ce-477b-a680-8d6b28b66d0e', 'ip_protocol': 'tempest-999-1471038774', 'from_port': 22, 'to_port': 22}}} Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1471038774. Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1471038774. Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:52.451650 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1471038774. Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1c303e8-7919-4127-b4b6-9e75f85994b3 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 400 to user: Invalid IP protocol tempest-999-1471038774. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:52.455358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1c303e8-7919-4127-b4b6-9e75f85994b3 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.150151 Jun 16 18:48:52.458297 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2051/4015] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:52 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:52.469559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bd6fef1e-613d-4c76-9373-dcf7bccbf8b6 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866e23ff70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-181240978", "description": "tempest-description-2038230573"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:52.986081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:52.986704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:53.007910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:53.015823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:53.019713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:53.023186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:53.030594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:53.897923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bd6fef1e-613d-4c76-9373-dcf7bccbf8b6 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.437050 Jun 16 18:48:53.899614 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1965/4016] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:48:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:53.937108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:53.955900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:53.959403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:53.963624 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14265d98-baea-4aba-b2fb-0a969a72d159 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 0.983136 Jun 16 18:48:53.967634 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2052/4017] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:52 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:53.978622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88087ca5-4b80-487a-90fc-b48c41c41c22 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:53.983141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88087ca5-4b80-487a-90fc-b48c41c41c22 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:54.005330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88087ca5-4b80-487a-90fc-b48c41c41c22 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:54.006886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88087ca5-4b80-487a-90fc-b48c41c41c22 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:54.012753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88087ca5-4b80-487a-90fc-b48c41c41c22 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:54.014764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88087ca5-4b80-487a-90fc-b48c41c41c22 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:54.097575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88087ca5-4b80-487a-90fc-b48c41c41c22 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125935 Jun 16 18:48:54.101685 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2053/4018] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:48:53 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:54.113295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aef36c7e-0f66-49bc-9ab2-28b918766e68 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f8678179c10>, body: {"security_group_rule": {"parent_group_id": "8ca1b753-d0c6-4a6a-8415-40e830bfd692", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:54.241470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6476c98d-1962-43ef-ace4-6826d63e8d73 req-cd38ac4e-63e1-4704-b664-64e037ae7744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53ee4be-2727-4f03-9f09-0e87c82f5694", "tag": "7e418d2c-584e-4d39-9444-c18f66d62054"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:54.257098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6476c98d-1962-43ef-ace4-6826d63e8d73 req-cd38ac4e-63e1-4704-b664-64e037ae7744 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:54.262067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6476c98d-1962-43ef-ace4-6826d63e8d73 req-cd38ac4e-63e1-4704-b664-64e037ae7744 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:54.279396 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6476c98d-1962-43ef-ace4-6826d63e8d73 req-cd38ac4e-63e1-4704-b664-64e037ae7744 service nova] Creating event network-changed:7e418d2c-584e-4d39-9444-c18f66d62054 for instance a53ee4be-2727-4f03-9f09-0e87c82f5694 on n-h1-846209-2 Jun 16 18:48:54.287176 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6476c98d-1962-43ef-ace4-6826d63e8d73 req-cd38ac4e-63e1-4704-b664-64e037ae7744 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386009 Jun 16 18:48:54.288646 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1966/4019] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:54.863036 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-aef36c7e-0f66-49bc-9ab2-28b918766e68 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aef36c7e-0f66-49bc-9ab2-28b918766e68 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 138 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: {"security_group_rule": {"parent_group_id": "8ca1b753-d0c6-4a6a-8415-40e830bfd692", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8ca1b753-d0c6-4a6a-8415-40e830bfd692', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 18:48:54.864598 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aef36c7e-0f66-49bc-9ab2-28b918766e68 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aef36c7e-0f66-49bc-9ab2-28b918766e68 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.763274 Jun 16 18:48:54.868746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2054/4020] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:54 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 764 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:54.881414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c66724fe-bf29-4fc0-b56a-edf4ae7b53cb tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866dea0790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1925391538", "description": "tempest-description-929111998"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:54.985191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:54.986271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:55.031915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:55.038720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:55.039865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:55.041091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:55.396610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:55.415368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:55.424502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:55.428004 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-423099da-37c3-4d77-9bed-1c03bc299941 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 0.448128 Jun 16 18:48:55.438939 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2055/4021] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:54 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:55.465523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a820c29a-3471-434b-95cd-c0c3f8c17e96 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:55.467152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a820c29a-3471-434b-95cd-c0c3f8c17e96 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:55.485144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a820c29a-3471-434b-95cd-c0c3f8c17e96 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:55.487447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a820c29a-3471-434b-95cd-c0c3f8c17e96 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:55.490373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a820c29a-3471-434b-95cd-c0c3f8c17e96 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:55.491105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a820c29a-3471-434b-95cd-c0c3f8c17e96 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:55.583591 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c66724fe-bf29-4fc0-b56a-edf4ae7b53cb tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.706208 Jun 16 18:48:55.584210 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1967/4022] 10.222.0.27 () {60 vars in 1179 bytes} [Thu Jun 16 18:48:54 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:55.588319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a820c29a-3471-434b-95cd-c0c3f8c17e96 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147214 Jun 16 18:48:55.595156 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2056/4023] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:48:55 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:55.598865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5644e2a-affc-4c90-8b75-d3c822ddcd9f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:55.599636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5644e2a-affc-4c90-8b75-d3c822ddcd9f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:55.601888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f46ca63b-3e19-46d8-869b-d9ab2b1487fb tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866de6f4c0>, body: {"security_group_rule": {"parent_group_id": "87e413f1-b787-4059-9dbd-104b1797d6d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 354580790}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:55.623221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5644e2a-affc-4c90-8b75-d3c822ddcd9f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:55.623974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5644e2a-affc-4c90-8b75-d3c822ddcd9f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:55.625349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5644e2a-affc-4c90-8b75-d3c822ddcd9f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:55.626064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5644e2a-affc-4c90-8b75-d3c822ddcd9f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:55.703909 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5644e2a-affc-4c90-8b75-d3c822ddcd9f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/ips" status: 200 len: 149 microversion: 2.1 time: 0.118419 Jun 16 18:48:55.715580 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1968/4024] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:48:55 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/ips => generated 149 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:56.467594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:56.468412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:56.484797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:56.485541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:56.486631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:56.487249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:57.044983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f46ca63b-3e19-46d8-869b-d9ab2b1487fb tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: Invalid port range 22:354580790. Valid TCP ports should be between 1-65535 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f46ca63b-3e19-46d8-869b-d9ab2b1487fb tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 145 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: {"security_group_rule": {"parent_group_id": "87e413f1-b787-4059-9dbd-104b1797d6d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 354580790}} Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid port range 22:354580790. Valid TCP ports should be between 1-65535 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'security_group_rule': {'parent_group_id': '87e413f1-b787-4059-9dbd-104b1797d6d5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 354580790}}} Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:354580790. Valid TCP ports should be between 1-65535 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:354580790. Valid TCP ports should be between 1-65535 Jun 16 18:48:57.048828 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:354580790. Valid TCP ports should be between 1-65535 Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f46ca63b-3e19-46d8-869b-d9ab2b1487fb tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 400 to user: Invalid port range 22:354580790. Valid TCP ports should be between 1-65535 {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:57.053180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f46ca63b-3e19-46d8-869b-d9ab2b1487fb tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 1.453758 Jun 16 18:48:57.057283 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2057/4025] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:55 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 1461 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:48:57.071387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bcc9ce4b-6fb6-4408-b19b-d0cde837b618 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:57.073596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bcc9ce4b-6fb6-4408-b19b-d0cde837b618 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:57.164148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcc9ce4b-6fb6-4408-b19b-d0cde837b618 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:57.164627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcc9ce4b-6fb6-4408-b19b-d0cde837b618 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:57.179135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcc9ce4b-6fb6-4408-b19b-d0cde837b618 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:57.179532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcc9ce4b-6fb6-4408-b19b-d0cde837b618 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:57.359279 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bcc9ce4b-6fb6-4408-b19b-d0cde837b618 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.296739 Jun 16 18:48:57.360267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2058/4026] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:48:57 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 197 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:57.534492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e40e9007-5090-436b-a36d-faa57af786e6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'create', calling method: .version_select at 0x7f866de6f1f0>, body: {"keypair": {"name": "tempest-keypair-838189399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyh1xiyO3qkeBrvdq7GWb0aczle3Ocea2S+ZU5VXxzN7wmIBJm6/YFhToC6HIAZEQA9EUBxrmNAUU6pRnBfFm9tw8+qmH7nfV7pQFuFUpLEnKIxu+DVAANXcMrdPGT8Bg=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:57.579878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e40e9007-5090-436b-a36d-faa57af786e6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for project a625bc4b5480485189cb007113356b39. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:48:57.594226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e40e9007-5090-436b-a36d-faa57af786e6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for user fe2a00a0282a4a0f80d6ab03cd8cf21a and project a625bc4b5480485189cb007113356b39. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:48:57.602805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:57.616942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:57.628000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:57.630512 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91d747f1-0f1a-4477-8cd8-0abaf00ccbd9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 1.177511 Jun 16 18:48:57.631933 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1969/4027] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:56 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:57.642980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-289087da-7392-4ce9-ae00-d4da74279158 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Action: 'create', calling method: .version_select at 0x7f866de7f310>, body: {"security_group_rule": {"parent_group_id": "6c3f3b5e-7755-4872-96e9-0109dcd70bd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:57.665899 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e40e9007-5090-436b-a36d-faa57af786e6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.298175 Jun 16 18:48:57.666717 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2059/4028] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:48:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:57.734145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG neutronclient.v2_0.client [None req-289087da-7392-4ce9-ae00-d4da74279158 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist", "detail": ""}} {{(pid=119207) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:48:57.735145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.security_group_api [None req-289087da-7392-4ce9-ae00-d4da74279158 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Neutron security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 not found {{(pid=119207) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 18:48:57.735826 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-289087da-7392-4ce9-ae00-d4da74279158 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist Jun 16 18:48:57.735826 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-52c01cd3-b9fd-4bf8-8e32-039cdaae2051'] Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-289087da-7392-4ce9-ae00-d4da74279158 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 138 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: {"security_group_rule": {"parent_group_id": "6c3f3b5e-7755-4872-96e9-0109dcd70bd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: exception: Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-52c01cd3-b9fd-4bf8-8e32-039cdaae2051'] Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6c3f3b5e-7755-4872-96e9-0109dcd70bd4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:48:57.744400 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52c01cd3-b9fd-4bf8-8e32-039cdaae2051'] Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52c01cd3-b9fd-4bf8-8e32-039cdaae2051'] Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52c01cd3-b9fd-4bf8-8e32-039cdaae2051'] Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52c01cd3-b9fd-4bf8-8e32-039cdaae2051'] Jun 16 18:48:57.749548 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.760370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-289087da-7392-4ce9-ae00-d4da74279158 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 404 to user: Security group 6c3f3b5e-7755-4872-96e9-0109dcd70bd4 does not exist Jun 16 18:48:57.760370 n-d-846209-2 devstack@n-api.service[119207]: Neutron server returns request_ids: ['req-52c01cd3-b9fd-4bf8-8e32-039cdaae2051'] {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:57.762904 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-289087da-7392-4ce9-ae00-d4da74279158 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.129414 Jun 16 18:48:57.764523 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1970/4029] 10.222.0.27 () {60 vars in 1194 bytes} [Thu Jun 16 18:48:57 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:48:57.773794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce346c2b-5694-4793-b696-fa7df7b6e2ff tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Calling method '.version_select at 0x7f866e4c9d30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:57.815143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG neutronclient.v2_0.client [None req-ce346c2b-5694-4793-b696-fa7df7b6e2ff tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist", "detail": ""}} {{(pid=119206) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 18:48:57.815919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.security_group_api [None req-ce346c2b-5694-4793-b696-fa7df7b6e2ff tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Neutron security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c not found {{(pid=119206) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 16 18:48:57.817580 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ce346c2b-5694-4793-b696-fa7df7b6e2ff tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] HTTP exception thrown: Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist Jun 16 18:48:57.817580 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-16ed6ffe-1ef0-4df4-b2f9-a850a17a278e'] Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce346c2b-5694-4793-b696-fa7df7b6e2ff tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Request method failure captured: Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-security-group-rules/822bed4f-1b62-4f3d-83eb-1eea7806829c HTTP/1.1 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sKEF-wd-kHe4_cfGIqJV_5-s6zsGuYdGlbLVbxFDV7iyCaCmPKEWDaxzxjY-dhudGjkkn3rlNcI_gbM8gjZP5XnC1sGYYk4nk07eL_AILa_WxTBwhv3vkGExmTilf_cv87ygyJ4r315u9R3TT5Tel-kvhjuLW_L8xbBtR-tUI_Qs4 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3cd17c7d74b62b72546d06c5f40fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3cd17c7d74b62b72546d06c5f40fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 16f3cd17c7d74b62b72546d06c5f40fe Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6ac580fb24784162a944f48c433fa3a7 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: exception: Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-16ed6ffe-1ef0-4df4-b2f9-a850a17a278e'] Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '822bed4f-1b62-4f3d-83eb-1eea7806829c'} Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 18:48:57.820016 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16ed6ffe-1ef0-4df4-b2f9-a850a17a278e'] Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16ed6ffe-1ef0-4df4-b2f9-a850a17a278e'] Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16ed6ffe-1ef0-4df4-b2f9-a850a17a278e'] Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16ed6ffe-1ef0-4df4-b2f9-a850a17a278e'] Jun 16 18:48:57.823613 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:48:57.834762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce346c2b-5694-4793-b696-fa7df7b6e2ff tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Returning 404 to user: Security group rule 822bed4f-1b62-4f3d-83eb-1eea7806829c does not exist Jun 16 18:48:57.834762 n-d-846209-2 devstack@n-api.service[119206]: Neutron server returns request_ids: ['req-16ed6ffe-1ef0-4df4-b2f9-a850a17a278e'] {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:48:57.837159 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ce346c2b-5694-4793-b696-fa7df7b6e2ff tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/822bed4f-1b62-4f3d-83eb-1eea7806829c" status: 404 len: 199 microversion: 2.1 time: 0.066598 Jun 16 18:48:57.838558 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2060/4030] 10.222.0.27 () {58 vars in 1286 bytes} [Thu Jun 16 18:48:57 2022] DELETE /compute/v2.1/os-security-group-rules/822bed4f-1b62-4f3d-83eb-1eea7806829c => generated 199 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:48:57.848870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e5a04061-b6c2-4458-8b78-95a571cc904a tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Calling method '.version_select at 0x7f866f26a550>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:58.378518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3269e990-539b-4e7a-a8bb-af43d3682ad1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:58.379977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3269e990-539b-4e7a-a8bb-af43d3682ad1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:58.440863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3269e990-539b-4e7a-a8bb-af43d3682ad1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:58.446936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3269e990-539b-4e7a-a8bb-af43d3682ad1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:58.448091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3269e990-539b-4e7a-a8bb-af43d3682ad1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:58.449391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3269e990-539b-4e7a-a8bb-af43d3682ad1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:58.565104 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3269e990-539b-4e7a-a8bb-af43d3682ad1 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196137 Jun 16 18:48:58.567976 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2061/4031] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:48:58 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac/os-volume_attachments => generated 25 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:48:58.651095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:58.651727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:58.680655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:58.681198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:58.699638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:58.699638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:59.784039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e5a04061-b6c2-4458-8b78-95a571cc904a tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/87e413f1-b787-4059-9dbd-104b1797d6d5" status: 202 len: 0 microversion: 2.1 time: 1.939578 Jun 16 18:48:59.786297 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1971/4032] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:48:57 2022] DELETE /compute/v2.1/os-security-groups/87e413f1-b787-4059-9dbd-104b1797d6d5 => generated 0 bytes in 1942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:48:59.792573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2824e413-a5eb-40fd-8a58-ef70d200dbbd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "867f65a1-f411-4ca2-8096-75daa3024367"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:59.794220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2824e413-a5eb-40fd-8a58-ef70d200dbbd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:59.815084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2824e413-a5eb-40fd-8a58-ef70d200dbbd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:59.816674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2824e413-a5eb-40fd-8a58-ef70d200dbbd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:59.817497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2824e413-a5eb-40fd-8a58-ef70d200dbbd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:59.817977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2824e413-a5eb-40fd-8a58-ef70d200dbbd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:59.872480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:59.885815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:59.893245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:48:59.898964 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-392a2543-a3e0-4a96-b119-89d96eafb31a tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 1.252728 Jun 16 18:48:59.902907 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2062/4033] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:48:58 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:48:59.942623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:59.945271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:48:59.965968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:59.973432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:59.975578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:48:59.977647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:48:59.987884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:00.094658 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Cannot 'reboot' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action HTTP/1.1 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 28 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: {"reboot": {"type": "HARD"}} Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: exception: Cannot 'reboot' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '75991cfb-7591-4816-8042-289915225a1f', 'body': {'reboot': {'type': 'HARD'}}} Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75991cfb-7591-4816-8042-289915225a1f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:49:00.098574 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.102203 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.109440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 409 to user: Cannot 'reboot' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:00.113780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf0ecc23-4a4f-43a3-97f6-2d320cfe837c tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action" status: 409 len: 145 microversion: 2.1 time: 0.208069 Jun 16 18:49:00.115469 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2063/4034] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:48:59 2022] POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action => generated 145 bytes in 212 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:49:00.138644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-30d37725-8f4e-40ed-b32b-714e40610b02 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Calling method '.version_select at 0x7f866e51cd30>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:00.456830 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2824e413-a5eb-40fd-8a58-ef70d200dbbd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668402 Jun 16 18:49:00.457507 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1972/4035] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:48:59 2022] POST /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:00.474120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:00.486427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:00.523452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:00.526723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:00.538066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:00.540986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:00.660922 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Cannot 'rebuild' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action HTTP/1.1 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 65 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: exception: Cannot 'rebuild' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '75991cfb-7591-4816-8042-289915225a1f', 'body': {'rebuild': {'imageRef': 'd20d7330-9f4e-454d-b9ff-f7d2dd6e5e72'}}} Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75991cfb-7591-4816-8042-289915225a1f in vm_state rescued. Cannot rebuild while the instance is in this state. Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:49:00.672943 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued Jun 16 18:49:00.677079 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:00.679112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 409 to user: Cannot 'rebuild' instance 75991cfb-7591-4816-8042-289915225a1f while it is in vm_state rescued {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:00.680244 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53fc8815-85c8-4c81-b82e-1bb12e0e8668 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action" status: 409 len: 146 microversion: 2.1 time: 0.221088 Jun 16 18:49:00.696652 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1973/4036] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:49:00 2022] POST /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f/action => generated 146 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:49:00.704266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:00.705195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:00.715811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:00.716490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:00.717450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:00.718132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:00.750216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:49:00.950633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0c603d85-51c8-4472-b469-1b0581236e45 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 204 len: 0 microversion: 2.1 time: 0.251977 Jun 16 18:49:00.959974 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1974/4037] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:49:00 2022] DELETE /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:49:00.971175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:00.979635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:01.003249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:01.006598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:01.011006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:01.012342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:01.251511 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-30d37725-8f4e-40ed-b32b-714e40610b02 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8ca1b753-d0c6-4a6a-8415-40e830bfd692" status: 202 len: 0 microversion: 2.1 time: 1.129805 Jun 16 18:49:01.253192 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2064/4038] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:49:00 2022] DELETE /compute/v2.1/os-security-groups/8ca1b753-d0c6-4a6a-8415-40e830bfd692 => generated 0 bytes in 1132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:49:01.260753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:01.266301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:01.284219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:01.287378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:01.288705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:01.291716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:02.017842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:02.023591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:02.054822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:02.061052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:02.064145 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-adf0fb0d-329e-4b62-ac2a-5568ba6cd361 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 1.102595 Jun 16 18:49:02.071804 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1975/4039] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:00 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:02.077268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-008035bf-0dc6-44cf-aff3-e610a2af7597 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Calling method '.version_select at 0x7f866e9064c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:02.181833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:02.205825 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d4b4e040-99a2-4916-862e-d43674ed813f tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1689 microversion: 2.1 time: 0.951328 Jun 16 18:49:02.206451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2065/4040] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:01 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1689 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:02.865237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-431332132", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14b492a6-fcde-467e-acd6-c6be898b2ffe"}], "security_groups": [{"name": "tempest-securitygroup--1491239445"}], "key_name": "tempest-keypair-838189399", "user_data": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:03.067802 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-008035bf-0dc6-44cf-aff3-e610a2af7597 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6c75baef-93ce-477b-a680-8d6b28b66d0e" status: 202 len: 0 microversion: 2.1 time: 0.994742 Jun 16 18:49:03.069583 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1976/4041] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:49:02 2022] DELETE /compute/v2.1/os-security-groups/6c75baef-93ce-477b-a680-8d6b28b66d0e => generated 0 bytes in 997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:49:03.078320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e79e01da-6b75-442a-8e55-a5a772a5036e tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Calling method '.version_select at 0x7f866e906f70>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:03.181795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] validate_networks() for [('14b492a6-fcde-467e-acd6-c6be898b2ffe', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:49:04.338844 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e79e01da-6b75-442a-8e55-a5a772a5036e tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2ff40e53-4edf-471a-8c78-763f3ddddd5b" status: 202 len: 0 microversion: 2.1 time: 1.265155 Jun 16 18:49:04.340196 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1977/4042] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:49:03 2022] DELETE /compute/v2.1/os-security-groups/2ff40e53-4edf-471a-8c78-763f3ddddd5b => generated 0 bytes in 1267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:49:04.347728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:04.349390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:04.405604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:04.406396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:04.410026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:04.410747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:04.538094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:49:04.538684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:49:04.539007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:49:04.539428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:49:04.539852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:49:04.604995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:04.605548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:04.606582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:04.607344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:04.661080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for project a625bc4b5480485189cb007113356b39. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:49:04.673135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for user fe2a00a0282a4a0f80d6ab03cd8cf21a and project a625bc4b5480485189cb007113356b39. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:49:04.701487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:49:04.703766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:49:04.804726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bb9dea2d-93c6-4140-892a-c21d899b67ea tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.944092 Jun 16 18:49:04.805539 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2066/4043] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:49:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:49:04.810870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:04.814916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:04.835116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:04.835870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:04.836838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:04.837443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:05.157838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:05.175108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:05.177800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:05.179988 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b97aa580-6174-48c3-b536-f7e8d72c93e2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1407 microversion: 2.20 time: 0.838782 Jun 16 18:49:05.180850 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1978/4044] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:04 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1407 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:05.195482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4a6c97e1-913a-49e1-8a62-347b15797bb5 req-400aab06-1b81-4ccb-b7e5-48450371456d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ee4be-2727-4f03-9f09-0e87c82f5694", "name": "network-vif-plugged", "status": "completed", "tag": "7e418d2c-584e-4d39-9444-c18f66d62054"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:05.251285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4a6c97e1-913a-49e1-8a62-347b15797bb5 req-400aab06-1b81-4ccb-b7e5-48450371456d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:05.252371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4a6c97e1-913a-49e1-8a62-347b15797bb5 req-400aab06-1b81-4ccb-b7e5-48450371456d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:05.316535 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4a6c97e1-913a-49e1-8a62-347b15797bb5 req-400aab06-1b81-4ccb-b7e5-48450371456d service nova] Creating event network-vif-plugged:7e418d2c-584e-4d39-9444-c18f66d62054 for instance a53ee4be-2727-4f03-9f09-0e87c82f5694 on n-h1-846209-2 Jun 16 18:49:05.369195 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4a6c97e1-913a-49e1-8a62-347b15797bb5 req-400aab06-1b81-4ccb-b7e5-48450371456d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186232 Jun 16 18:49:05.377812 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1979/4045] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:05.385679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d2efee5-c5ec-4379-b2dd-b5cfc6296ce9 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] Calling method '.version_select at 0x7f8677fc2b80>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:05.789802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:05.805698 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fec691ce-570d-4a4e-9f2b-9c33bd449f20 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1689 microversion: 2.1 time: 0.998858 Jun 16 18:49:05.810494 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2067/4046] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:04 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1689 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:05.818606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:05.829843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:05.854514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:05.858156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:05.859070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:05.863724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:06.054987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:06.071965 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6022774d-4fc0-4d09-997f-5db53cbd4403 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1240 microversion: 2.1 time: 0.259912 Jun 16 18:49:06.072573 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2068/4047] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:05 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1240 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:06.078594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:06.086565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:06.104714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:06.106208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:06.107239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:06.107871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:07.754558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:07.765286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-702e7356-f554-4b93-9b47-83020bf654d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 1.691375 Jun 16 18:49:07.767223 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2069/4048] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:06 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:07.775843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:07.777070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:07.786015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:07.786817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:07.787986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:07.788885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:07.899137 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d2efee5-c5ec-4379-b2dd-b5cfc6296ce9 tempest-SecurityGroupRulesNegativeTestJSON-1907003031 tempest-SecurityGroupRulesNegativeTestJSON-1907003031-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c9636c85-47ec-4241-99f2-a3d47679282c" status: 202 len: 0 microversion: 2.1 time: 2.519817 Jun 16 18:49:07.904110 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1980/4049] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 18:49:05 2022] DELETE /compute/v2.1/os-security-groups/c9636c85-47ec-4241-99f2-a3d47679282c => generated 0 bytes in 2522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:49:07.909773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:07.910568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:07.928292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:07.930668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:07.932408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:07.937097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.158169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:08.171981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:08.174652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:08.177217 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8315bb93-ed5b-4801-8e16-fb893bf0e4dd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1600 microversion: 2.20 time: 0.408691 Jun 16 18:49:08.178462 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2070/4050] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:07 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1600 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:08.186215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:08.187254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:08.197147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.198094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.200016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.200738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.346976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:08.375377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ef8bfd5-e91b-4496-b057-f0ce16cfd213 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1294 microversion: 2.1 time: 0.194037 Jun 16 18:49:08.376794 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2071/4051] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:08 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1294 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:08.396171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-76f41f66-2a08-47c6-bc45-964b808b22b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-796372169"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:08.408331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-76f41f66-2a08-47c6-bc45-964b808b22b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:08.427564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76f41f66-2a08-47c6-bc45-964b808b22b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.429884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76f41f66-2a08-47c6-bc45-964b808b22b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.434082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76f41f66-2a08-47c6-bc45-964b808b22b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.436465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76f41f66-2a08-47c6-bc45-964b808b22b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.447913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:08.457615 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8478379d-44f1-41cb-a43d-7064aec8ee93 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1689 microversion: 2.1 time: 0.555780 Jun 16 18:49:08.463981 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1981/4052] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:07 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1689 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:08.471727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-887a131c-0756-4076-bd33-16217b2d0b5b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:08.487579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-887a131c-0756-4076-bd33-16217b2d0b5b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:08.513053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-887a131c-0756-4076-bd33-16217b2d0b5b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.515840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-887a131c-0756-4076-bd33-16217b2d0b5b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.518950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-887a131c-0756-4076-bd33-16217b2d0b5b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.520412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-887a131c-0756-4076-bd33-16217b2d0b5b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.709063 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-887a131c-0756-4076-bd33-16217b2d0b5b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.242703 Jun 16 18:49:08.710443 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1982/4053] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:49:08 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:08.940950 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-76f41f66-2a08-47c6-bc45-964b808b22b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.551729 Jun 16 18:49:08.942738 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2072/4054] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:49:08 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 16 18:49:08.957757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:08.959725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:08.979089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.979715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:08.980974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:08.982156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:09.394638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:09.395508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:09.409780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:09.414506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:09.417254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:09.421324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:09.625538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:09.651811 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-05e57b31-d9b2-44c7-95e8-4ab5b9759a98 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1294 microversion: 2.1 time: 0.261564 Jun 16 18:49:09.654447 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2073/4055] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:09 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:09.668292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:09.670378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:09.686771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:09.687238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:09.691173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:09.691651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:10.001378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:10.012091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:10.022717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9693120b-ac39-41f0-8187-a41023b57f82 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 200 len: 1621 microversion: 2.1 time: 0.367115 Jun 16 18:49:10.023314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2074/4056] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:09 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 1621 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:10.029098 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bcd35f90-e718-462d-82a1-4460e0f2f7ef tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 1.077837 Jun 16 18:49:10.029694 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1983/4057] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:08 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:10.047451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2f33e9c9-b5e8-4bcd-a527-2a2209b29b4a req-d645dc99-be5b-410f-8412-b5b097629e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-unplugged", "status": "completed", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:10.074840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2f33e9c9-b5e8-4bcd-a527-2a2209b29b4a req-d645dc99-be5b-410f-8412-b5b097629e3d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:10.075453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2f33e9c9-b5e8-4bcd-a527-2a2209b29b4a req-d645dc99-be5b-410f-8412-b5b097629e3d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:10.110827 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2f33e9c9-b5e8-4bcd-a527-2a2209b29b4a req-d645dc99-be5b-410f-8412-b5b097629e3d service nova] Creating event network-vif-unplugged:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:49:10.122351 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2f33e9c9-b5e8-4bcd-a527-2a2209b29b4a req-d645dc99-be5b-410f-8412-b5b097629e3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095936 Jun 16 18:49:10.126255 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2075/4058] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:10.612805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-fb59004e-0588-43d2-9386-08d4e9e03af5 req-a370258d-dff5-457a-a0d8-b0ccd5482db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c93d90-ad38-4326-9bb6-4c38b39891ac", "name": "network-vif-deleted", "tag": "eb1ba32b-d248-475f-874f-fd6a54c3990d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:10.637130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fb59004e-0588-43d2-9386-08d4e9e03af5 req-a370258d-dff5-457a-a0d8-b0ccd5482db1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:10.646605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fb59004e-0588-43d2-9386-08d4e9e03af5 req-a370258d-dff5-457a-a0d8-b0ccd5482db1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:10.674767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:10.675705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:10.678815 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-fb59004e-0588-43d2-9386-08d4e9e03af5 req-a370258d-dff5-457a-a0d8-b0ccd5482db1 service nova] Creating event network-vif-deleted:eb1ba32b-d248-475f-874f-fd6a54c3990d for instance d0c93d90-ad38-4326-9bb6-4c38b39891ac on n-h1-846209-2 Jun 16 18:49:10.692367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:10.694290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:10.696754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:10.697499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:10.703892 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-fb59004e-0588-43d2-9386-08d4e9e03af5 req-a370258d-dff5-457a-a0d8-b0ccd5482db1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095469 Jun 16 18:49:10.708028 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1984/4059] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:11.043178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:11.044951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: d0c93d90-ad38-4326-9bb6-4c38b39891ac] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:11.060031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:11.061844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:11.063237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:11.064915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:11.107608 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Instance d0c93d90-ad38-4326-9bb6-4c38b39891ac could not be found. Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac HTTP/1.1 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance d0c93d90-ad38-4326-9bb6-4c38b39891ac could not be found. Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'd0c93d90-ad38-4326-9bb6-4c38b39891ac'} Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c93d90-ad38-4326-9bb6-4c38b39891ac could not be found. Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c93d90-ad38-4326-9bb6-4c38b39891ac could not be found. Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:11.109578 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c93d90-ad38-4326-9bb6-4c38b39891ac could not be found. Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 404 to user: Instance d0c93d90-ad38-4326-9bb6-4c38b39891ac could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98d0cbd6-3909-492c-98b8-510d43862beb tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac" status: 404 len: 111 microversion: 2.1 time: 0.075859 Jun 16 18:49:11.116198 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1985/4060] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:11 2022] GET /compute/v2.1/servers/d0c93d90-ad38-4326-9bb6-4c38b39891ac => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:49:11.126216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:11.127750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:11.143169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:11.150804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:11.152617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:11.153324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:12.373103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:12.384115 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7dcd2f86-4893-43d5-91e9-c4cf15f03504 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 1.711606 Jun 16 18:49:12.384781 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2076/4061] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:10 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:12.401033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-650f6665-8249-4a96-8e02-33a8f19a3c24 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '.version_select at 0x7f866de9e8b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:12.445273 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-650f6665-8249-4a96-8e02-33a8f19a3c24 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971878849" status: 202 len: 0 microversion: 2.1 time: 0.055880 Jun 16 18:49:12.446316 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2077/4062] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:49:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971878849 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:49:12.661213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:12.672951 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fcefa1b9-0236-4858-9cbd-c9c9b1152913 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1687 microversion: 2.1 time: 1.554851 Jun 16 18:49:12.699276 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1986/4063] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:11 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1687 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:13.176990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2d5237ec-2d91-4c8e-8971-c339144566c6 req-70cdef5a-a65f-46d7-babc-3d8c5c4d7938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53ee4be-2727-4f03-9f09-0e87c82f5694", "tag": "7e418d2c-584e-4d39-9444-c18f66d62054"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:13.209633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2d5237ec-2d91-4c8e-8971-c339144566c6 req-70cdef5a-a65f-46d7-babc-3d8c5c4d7938 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:13.210696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2d5237ec-2d91-4c8e-8971-c339144566c6 req-70cdef5a-a65f-46d7-babc-3d8c5c4d7938 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:13.228881 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2d5237ec-2d91-4c8e-8971-c339144566c6 req-70cdef5a-a65f-46d7-babc-3d8c5c4d7938 service nova] Creating event network-changed:7e418d2c-584e-4d39-9444-c18f66d62054 for instance a53ee4be-2727-4f03-9f09-0e87c82f5694 on n-h1-846209-2 Jun 16 18:49:13.246073 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2d5237ec-2d91-4c8e-8971-c339144566c6 req-70cdef5a-a65f-46d7-babc-3d8c5c4d7938 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069489 Jun 16 18:49:13.258580 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2078/4064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:13.402887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:13.404227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:13.425628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:13.426744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:13.427819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:13.428500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:13.707383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:13.708193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:13.727492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:13.727957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:13.728764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:13.733392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:14.623574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:14.693095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:15.442414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:15.456027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9515c94-c5a8-43a4-b92b-68924d201e32 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.753182 Jun 16 18:49:15.456652 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2079/4065] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:13 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:15.482728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e33d86d6-5cde-4e0d-85df-0fc4d638f02c req-2d846bc5-e0e4-4765-8d9c-92699ddd5a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-plugged", "status": "completed", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:15.520147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e33d86d6-5cde-4e0d-85df-0fc4d638f02c req-2d846bc5-e0e4-4765-8d9c-92699ddd5a44 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:15.520653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e33d86d6-5cde-4e0d-85df-0fc4d638f02c req-2d846bc5-e0e4-4765-8d9c-92699ddd5a44 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:15.528761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:15.548488 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9af6ac05-5bf1-4dd9-a4ed-5f114571fb29 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 2.150357 Jun 16 18:49:15.549109 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1987/4066] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:13 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:15.573020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e33d86d6-5cde-4e0d-85df-0fc4d638f02c req-2d846bc5-e0e4-4765-8d9c-92699ddd5a44 service nova] Creating event network-vif-plugged:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:49:15.596192 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e33d86d6-5cde-4e0d-85df-0fc4d638f02c req-2d846bc5-e0e4-4765-8d9c-92699ddd5a44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122518 Jun 16 18:49:15.598648 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2080/4067] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:16.474458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:16.475379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:16.489098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:16.505936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:16.514010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:16.516107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:16.516774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:16.568331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:16.569643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:16.585373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:16.585840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:16.595855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:16.596328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:17.355785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:17.378681 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46995c4c-86b6-4d57-aeab-ec7ef7213bb4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 0.815601 Jun 16 18:49:17.382956 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2081/4068] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:16 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:17.723703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-947a9729-9e98-4176-94c9-b9eb1daf1d96 req-fd93f924-0949-4fc7-b4ed-034aadc71611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e7cff4-9488-49aa-b529-00d7ad69b2c7", "tag": "e16c32e7-5eed-4ad5-aef8-724c589780ac"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:17.764938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-947a9729-9e98-4176-94c9-b9eb1daf1d96 req-fd93f924-0949-4fc7-b4ed-034aadc71611 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:17.765549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-947a9729-9e98-4176-94c9-b9eb1daf1d96 req-fd93f924-0949-4fc7-b4ed-034aadc71611 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:17.834592 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-947a9729-9e98-4176-94c9-b9eb1daf1d96 req-fd93f924-0949-4fc7-b4ed-034aadc71611 service nova] Creating event network-changed:e16c32e7-5eed-4ad5-aef8-724c589780ac for instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 on n-h1-846209-2 Jun 16 18:49:17.852345 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-947a9729-9e98-4176-94c9-b9eb1daf1d96 req-fd93f924-0949-4fc7-b4ed-034aadc71611 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132726 Jun 16 18:49:17.855796 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2082/4069] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:17.946590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:17.960831 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-77d66f07-ab90-4c35-85cb-42170e826621 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.490849 Jun 16 18:49:17.972964 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1988/4070] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:16 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:18.399912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:18.400757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:18.412641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:18.414137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:18.415238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:18.417648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:18.980953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:18.981780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:18.993718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:18.994776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:18.996335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:18.996955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:19.835501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:19.853691 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3b49fcf5-0ee3-4f4d-bf63-390cd912d064 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 1.458152 Jun 16 18:49:19.856194 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2083/4071] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:18 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:19.873298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19f1ee65-cbad-4ba8-b327-f19e6e2ad026 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: .version_select at 0x7f866e51c1f0>, body: {"keypair": {"name": "tempest-keypair-1884088199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9hLN+QFMsHAoUW9JpxRf+2DXGLYCYg19MOC9J2Qn6TQMxsACrqzEipD1i+sbbiEEXXRJcKFIfwmpnLCyK6ogPqi2LnsJJkUWjRj292MqO6c6lKgPjswN2CpSKFf+S+2Q=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:19.930703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-19f1ee65-cbad-4ba8-b327-f19e6e2ad026 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:49:19.960112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-19f1ee65-cbad-4ba8-b327-f19e6e2ad026 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:49:20.047836 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19f1ee65-cbad-4ba8-b327-f19e6e2ad026 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190175 Jun 16 18:49:20.049221 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2084/4072] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:49:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:20.092654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:20.119186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-20ca9477-4b30-4750-b29a-15da73c74c3a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.143439 Jun 16 18:49:20.135169 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1989/4073] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:18 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:20.874974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:20.875598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:20.887335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:20.898820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:20.900016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:20.900735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:20.907205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:21.141270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:21.142675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:21.150184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:21.158707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:21.159931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:21.160604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:21.722050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:21.730569 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f66c138-ecbc-4322-a881-297a87a0204a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 0.861196 Jun 16 18:49:21.735370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:21.738296 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2085/4074] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:20 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:21.746992 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-897cb98e-6cb9-4b67-ab62-7c83770c2f39 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 0.605783 Jun 16 18:49:21.748198 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1990/4075] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:21 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:22.750067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:22.750756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:22.756752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:22.766573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:22.767806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:22.790322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:22.794951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:22.796698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:22.798091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:22.799206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:22.804831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:22.805066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:22.805423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:23.412129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:23.422513 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6e25ba01-7075-464a-9662-20a376acd2da tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 0.678379 Jun 16 18:49:23.425717 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2086/4076] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:22 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:23.461235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:23.470278 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61606151-a366-42b4-8f4a-ce1382c41e36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 0.709350 Jun 16 18:49:23.481497 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1991/4077] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:22 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:24.459857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:24.466502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:24.504155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:24.505327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:24.524666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:24.528477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:24.532490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:24.539322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:24.563531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:24.567347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:24.571155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:24.571998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:25.868503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:25.888507 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e001dd84-5cf7-493f-97e1-bd41d9ffe550 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 1.444185 Jun 16 18:49:25.891798 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2087/4078] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:24 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:25.959185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:25.975009 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f287532-771a-4731-b14e-6004e6ef0dab tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.486646 Jun 16 18:49:25.976251 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1992/4079] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:24 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:26.907267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:26.908925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:26.929599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:26.935008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:26.936223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:26.939897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:26.997714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:26.998316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:27.014376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:27.014853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:27.015637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:27.016086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:27.963604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:27.976035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c48bd349-7f52-4eeb-94ff-3c1e12b588bb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 1.073670 Jun 16 18:49:27.978700 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2088/4080] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:26 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:27.997414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377507045", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "342ef20c-b425-4c3e-85a8-70079b12ec49"}], "security_groups": [{"name": "tempest-securitygroup--162145053"}], "key_name": "tempest-keypair-1884088199", "user_data": "}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:28.110241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:28.118873 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8bf7c773-ed73-48f8-be27-22ddeb75261a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.126070 Jun 16 18:49:28.124318 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1993/4081] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:26 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:28.137776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-690a293d-8fdd-4e72-bac3-fd0925a139b1 req-33844d55-e379-4fb7-8c3f-dc94ddfa10bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e7cff4-9488-49aa-b529-00d7ad69b2c7", "name": "network-vif-plugged", "status": "completed", "tag": "e16c32e7-5eed-4ad5-aef8-724c589780ac"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:28.166212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-690a293d-8fdd-4e72-bac3-fd0925a139b1 req-33844d55-e379-4fb7-8c3f-dc94ddfa10bf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:28.166689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-690a293d-8fdd-4e72-bac3-fd0925a139b1 req-33844d55-e379-4fb7-8c3f-dc94ddfa10bf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:28.185608 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-690a293d-8fdd-4e72-bac3-fd0925a139b1 req-33844d55-e379-4fb7-8c3f-dc94ddfa10bf service nova] Creating event network-vif-plugged:e16c32e7-5eed-4ad5-aef8-724c589780ac for instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 on n-h1-846209-2 Jun 16 18:49:28.192394 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-690a293d-8fdd-4e72-bac3-fd0925a139b1 req-33844d55-e379-4fb7-8c3f-dc94ddfa10bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066556 Jun 16 18:49:28.196236 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1994/4082] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:28.570947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] validate_networks() for [('342ef20c-b425-4c3e-85a8-70079b12ec49', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:49:28.800347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:28.800945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:28.812138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:28.812816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:28.821973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:28.822912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:28.901802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:49:29.049254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afc260f1-6d8e-4469-99ff-c4596414bbe8 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 204 len: 0 microversion: 2.1 time: 0.252882 Jun 16 18:49:29.050184 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1995/4083] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:49:28 2022] DELETE /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:49:29.063774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:29.067361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:29.083149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:29.087260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:29.089145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:29.090721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:29.451122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:29.458392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:29.467259 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7face830-675d-4894-bfb1-4d306ae8518a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 0.414137 Jun 16 18:49:29.467880 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1996/4084] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:29 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:29.513757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:29.518779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:29.545102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:29.545827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:29.546415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:29.546883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:29.993192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:30.633677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:49:30.634633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:49:30.635132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:49:30.635663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:49:30.637436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:49:30.657510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:30.658141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:30.659174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:30.661640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:30.669048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:30.681082 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b5190e40-5829-4463-92fb-29ed23043d6a tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1505 microversion: 2.1 time: 1.196144 Jun 16 18:49:30.685820 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1997/4085] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:29 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1505 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:30.711299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:49:30.715354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:30.716061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:30.726473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:49:30.752054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:30.757297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:49:30.760228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:30.762070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:30.762535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:30.765349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:49:30.884159 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d660d706-f687-4766-a39d-6c7584274a3f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.902230 Jun 16 18:49:30.884828 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2089/4086] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:49:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:49:30.902407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:30.903109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:30.928970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:30.929433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:30.930273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:30.930725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:31.865510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:31.878409 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cc6f8a6a-fca1-4271-8076-9f4b6eb22e58 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1362 microversion: 2.1 time: 0.992458 Jun 16 18:49:31.906755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:31.916107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-49bf64a5-7221-4089-a064-65b231b1f1be tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.228751 Jun 16 18:49:31.918455 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2090/4087] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:30 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1362 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:31.929972 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1998/4088] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:30 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:31.938325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:31.939380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:31.952094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:31.952762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:31.967078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:31.968049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:31.975609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:31.976348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:31.977087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:31.977778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:31.977901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:31.978355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:32.301758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:32.325359 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8004d2a0-45b3-49ec-8564-f78c92470aa5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1237 microversion: 2.1 time: 0.405317 Jun 16 18:49:32.326644 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2091/4089] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:31 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1237 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:32.505523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:32.524496 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c55a2227-0bd9-48f7-a2cd-dced00262d2d tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1505 microversion: 2.1 time: 0.593445 Jun 16 18:49:32.525590 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 1999/4090] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:31 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:32.910624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:32.911207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:32.927081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:32.929983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:32.933748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:32.937062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:32.948396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:32.958365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:32.972150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:32.974492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:32.975926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:32.977596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:33.429358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:33.452978 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c8dc689d-c5a2-4143-bf4e-5a72c2c16d7b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 0.497055 Jun 16 18:49:33.456726 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2000/4091] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:32 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:33.461554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:33.462221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:33.507923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:33.512085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:33.515970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:33.518646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:33.565443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:33.607202 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ccbda0e5-d43e-4989-b7e8-e86fa3d2da88 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1548 microversion: 2.1 time: 0.700180 Jun 16 18:49:33.609535 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2092/4092] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:32 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1548 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:33.626313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:33.632336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:33.650849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:33.652985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:33.658929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:33.659603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:33.747310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:33.757806 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc0825b1-5379-4beb-8d16-81483caf2be7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1299 microversion: 2.1 time: 0.299924 Jun 16 18:49:33.778814 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2001/4093] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:33 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1299 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:33.784464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-02e2a726-62bc-48a4-92a4-f6d295fad910 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:33.785206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-02e2a726-62bc-48a4-92a4-f6d295fad910 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:33.792144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02e2a726-62bc-48a4-92a4-f6d295fad910 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:33.792892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02e2a726-62bc-48a4-92a4-f6d295fad910 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:33.793863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02e2a726-62bc-48a4-92a4-f6d295fad910 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:33.794510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02e2a726-62bc-48a4-92a4-f6d295fad910 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:33.852363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:33.875570 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d12acdf-c6f8-48fb-9edb-f5b86c002c59 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 200 len: 1463 microversion: 2.1 time: 0.257997 Jun 16 18:49:33.876233 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2093/4094] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:33 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:33.928992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1d1144cb-3742-4d2a-b85b-33351d38745d req-c7abb954-091a-423d-9808-65fab03bb73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75991cfb-7591-4816-8042-289915225a1f", "name": "network-vif-deleted", "tag": "3338b564-46d1-472b-8a31-e0b31bc011ae"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:33.929644 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-02e2a726-62bc-48a4-92a4-f6d295fad910 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148905 Jun 16 18:49:33.930237 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2002/4095] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:49:33 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:34.024148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1d1144cb-3742-4d2a-b85b-33351d38745d req-c7abb954-091a-423d-9808-65fab03bb73e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:34.024603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1d1144cb-3742-4d2a-b85b-33351d38745d req-c7abb954-091a-423d-9808-65fab03bb73e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:34.121087 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1d1144cb-3742-4d2a-b85b-33351d38745d req-c7abb954-091a-423d-9808-65fab03bb73e service nova] Creating event network-vif-deleted:3338b564-46d1-472b-8a31-e0b31bc011ae for instance 75991cfb-7591-4816-8042-289915225a1f on n-h1-846209-2 Jun 16 18:49:34.148613 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1d1144cb-3742-4d2a-b85b-33351d38745d req-c7abb954-091a-423d-9808-65fab03bb73e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262285 Jun 16 18:49:34.158020 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2094/4096] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:34.481620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:34.483160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:34.507777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:34.508558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:34.509721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:34.511589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:34.787028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:34.788693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:34.802604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:34.803362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:34.804408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:34.809076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:35.061197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:35.076887 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-32966127-d560-4ecb-84d9-bb0f3f662b06 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1299 microversion: 2.1 time: 0.293974 Jun 16 18:49:35.079096 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2095/4097] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:34 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:35.084930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:35.085844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 75991cfb-7591-4816-8042-289915225a1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:35.093411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:35.094539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:35.095573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:35.096264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:35.146919 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Instance 75991cfb-7591-4816-8042-289915225a1f could not be found. Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f HTTP/1.1 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 75991cfb-7591-4816-8042-289915225a1f could not be found. Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '75991cfb-7591-4816-8042-289915225a1f'} Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75991cfb-7591-4816-8042-289915225a1f could not be found. Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75991cfb-7591-4816-8042-289915225a1f could not be found. Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:35.150683 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75991cfb-7591-4816-8042-289915225a1f could not be found. Jun 16 18:49:35.155158 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:35.159771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 404 to user: Instance 75991cfb-7591-4816-8042-289915225a1f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:35.161676 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9e33fffe-f46a-49fc-9063-f9392a1dcdf2 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f" status: 404 len: 111 microversion: 2.1 time: 0.080804 Jun 16 18:49:35.163993 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2096/4098] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:35 2022] GET /compute/v2.1/servers/75991cfb-7591-4816-8042-289915225a1f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:49:35.177434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:35.179023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:35.192266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:35.193107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:35.194171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:35.194862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:35.236524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:49:35.398201 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f76f92a-f7b1-4f70-aa77-69f62c7d17c7 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "DELETE /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 204 len: 0 microversion: 2.1 time: 0.228753 Jun 16 18:49:35.402166 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2097/4099] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:49:35 2022] DELETE /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:49:35.429104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:35.430027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:35.450292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:35.451019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:35.452929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:35.453719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:35.593647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:35.606043 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2db3e829-cf6a-4c92-b4fe-f85b2c36421c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.135163 Jun 16 18:49:35.607057 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2003/4100] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:34 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:35.919310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:35.936166 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97d35715-0ece-4c2b-acec-3d07899f90b9 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.528429 Jun 16 18:49:35.937072 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2098/4101] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:35 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:36.096558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:36.097197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:36.106772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:36.107232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:36.108025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:36.108475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:36.606694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:36.616272 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-71f1f675-fcb3-4753-a116-5fbfa77c3ae0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1299 microversion: 2.1 time: 0.523525 Jun 16 18:49:36.617567 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2004/4102] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:36 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1299 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:36.632416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:36.633035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:36.656071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:36.657180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:36.658171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:36.659187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:36.961485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:36.962774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:36.985135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:36.989291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:37.000125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:37.002948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:38.052121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:38.062828 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c7375c9-450f-41af-8bb0-6d017cf41b7f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.434251 Jun 16 18:49:38.070057 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2099/4103] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:36 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:38.094674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:38.095308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:38.107809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:38.108479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:38.109503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:38.110130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:38.350203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:38.374866 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f877403b-a7d7-45f9-ade3-b95dc5df7907 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 1.415451 Jun 16 18:49:38.376490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2005/4104] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:36 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:38.839812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:38.853718 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-128fa2f3-0f59-441c-9aee-fae63cb39346 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1366 microversion: 2.1 time: 0.781769 Jun 16 18:49:38.866592 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2100/4105] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:38 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1366 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:39.085896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:39.088186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:39.103685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:39.106528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:39.110162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:39.110838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:39.392880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:39.394308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:39.406744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:39.407714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:39.408673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:39.409265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:40.091756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:40.108836 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-45c5ec58-2a88-404e-a463-eed79f74befe tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1682 microversion: 2.1 time: 1.026205 Jun 16 18:49:40.110204 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2006/4106] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:39 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1682 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:40.135651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:40.138257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:40.156754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:40.157954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:40.159882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:40.160580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:40.232358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:40.257529 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e13d3d7-0707-4957-848e-9f3cf8a63b72 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1520 microversion: 2.1 time: 0.866838 Jun 16 18:49:40.270094 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2101/4107] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:39 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1520 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:40.668481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:40.709327 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2526b370-6e09-4612-8bab-36c6b422f92f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1366 microversion: 2.1 time: 0.597299 Jun 16 18:49:40.724653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-10f199e9-f681-4bbf-a713-6673d1201d95 req-9102ef31-abac-405e-8efc-f3d53f2aaac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710e4c0f-a958-4070-92db-6df4658db530", "tag": "3959dbbd-8f75-465d-93b6-3f866f316353"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:40.730062 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2007/4108] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:40 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1366 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:40.739704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:40.747290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-10f199e9-f681-4bbf-a713-6673d1201d95 req-9102ef31-abac-405e-8efc-f3d53f2aaac5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:40.747901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-10f199e9-f681-4bbf-a713-6673d1201d95 req-9102ef31-abac-405e-8efc-f3d53f2aaac5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:40.767711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-46ca46a4-28c5-4892-91bb-a0c6a2e1fdb5 req-a483a22b-edf2-4e34-a554-e26d3a856bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e7cff4-9488-49aa-b529-00d7ad69b2c7", "tag": "e16c32e7-5eed-4ad5-aef8-724c589780ac"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:40.773412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:40.774581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:40.777722 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-10f199e9-f681-4bbf-a713-6673d1201d95 req-9102ef31-abac-405e-8efc-f3d53f2aaac5 service nova] Creating event network-changed:3959dbbd-8f75-465d-93b6-3f866f316353 for instance 710e4c0f-a958-4070-92db-6df4658db530 on n-h2-846209-2 Jun 16 18:49:40.784702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-46ca46a4-28c5-4892-91bb-a0c6a2e1fdb5 req-a483a22b-edf2-4e34-a554-e26d3a856bc6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:40.788539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-46ca46a4-28c5-4892-91bb-a0c6a2e1fdb5 req-a483a22b-edf2-4e34-a554-e26d3a856bc6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:40.790241 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-10f199e9-f681-4bbf-a713-6673d1201d95 req-9102ef31-abac-405e-8efc-f3d53f2aaac5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098586 Jun 16 18:49:40.791417 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2102/4109] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:40.819824 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-46ca46a4-28c5-4892-91bb-a0c6a2e1fdb5 req-a483a22b-edf2-4e34-a554-e26d3a856bc6 service nova] Creating event network-changed:e16c32e7-5eed-4ad5-aef8-724c589780ac for instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 on n-h1-846209-2 Jun 16 18:49:40.834150 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-46ca46a4-28c5-4892-91bb-a0c6a2e1fdb5 req-a483a22b-edf2-4e34-a554-e26d3a856bc6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067400 Jun 16 18:49:40.836891 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2008/4110] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:41.130488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:41.131680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:41.162273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:41.162884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:41.164205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:41.164754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:41.280858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:41.281666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:41.297040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:41.298719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:41.299629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:41.300081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:41.402260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:41.402720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:41.403188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lazy-loading 'fault' on Instance uuid 253e4a8a-f499-447c-a0ec-2cf88b67abad {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:49:41.608129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59542886884867a7db703105cd495e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce48b6c6c6d441db054c828687ad6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:41.634213 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d6d438c4-8567-4efc-bbc2-41ad5f46eec4 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 200 len: 1311 microversion: 2.1 time: 0.363033 Jun 16 18:49:41.642074 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2009/4111] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:41 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:41.732536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:41.733178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:41.748328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:41.748797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:41.749602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:41.750126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:42.040157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:42.055187 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7d1c591-fc96-4a57-9fc4-514b0ba6da1c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.930534 Jun 16 18:49:42.072592 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2103/4112] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:41 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:42.628482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:42.654533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:42.655454 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-56fada7d-17bd-4ebd-a249-6959e1c2f0d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1366 microversion: 2.1 time: 0.920276 Jun 16 18:49:42.655805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] [instance: 253e4a8a-f499-447c-a0ec-2cf88b67abad] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:42.656686 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2010/4113] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:41 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1366 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:42.670399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:42.671103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:42.672860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:42.673892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:42.707929 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] HTTP exception thrown: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad could not be found. Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Request method failure captured: Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad HTTP/1.1 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oMPGpY8h9JhVpN7P1hFNx7dFXF4Zg63xhHbC_BuMIbMWTxTE_yiHx2H9aLP_vE3xY0c-Sqm91ZeRVxVwqkQ6dQMYuQKv4vXjg8edvF3bYGYPk2q8lBF-1QwS3F5iplmlVhWrbZgSNjf7_t5w3OHJ8of4T0-h7ReDeZfnZgip17RV4 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bce48b6c6c6d441db054c828687ad6a3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bce48b6c6c6d441db054c828687ad6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bce48b6c6c6d441db054c828687ad6a3 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735561651 Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: ea59542886884867a7db703105cd495e Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735561651-project Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad could not be found. Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '253e4a8a-f499-447c-a0ec-2cf88b67abad'} Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad could not be found. Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad could not be found. Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:42.710234 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad could not be found. Jun 16 18:49:42.714492 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:49:42.716719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] Returning 404 to user: Instance 253e4a8a-f499-447c-a0ec-2cf88b67abad could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:42.718151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9d439d7a-a73f-4b8b-b2cf-4ca1543e1b26 tempest-ServerRescueNegativeTestJSON-1735561651 tempest-ServerRescueNegativeTestJSON-1735561651-project] 10.222.0.27 "GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad" status: 404 len: 111 microversion: 2.1 time: 0.069258 Jun 16 18:49:42.722824 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2104/4114] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:42 2022] GET /compute/v2.1/servers/253e4a8a-f499-447c-a0ec-2cf88b67abad => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:49:43.220460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:43.221227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:43.228826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:43.230827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:43.231793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:43.232396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:43.486437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9562375d-8633-450f-a6be-bcb9122a6370 req-2e9aec68-c4c2-459d-9354-4a6152770dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253e4a8a-f499-447c-a0ec-2cf88b67abad", "name": "network-vif-deleted", "tag": "40ce37ea-67c1-48ca-ae0e-e6c814830c0a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:43.512524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9562375d-8633-450f-a6be-bcb9122a6370 req-2e9aec68-c4c2-459d-9354-4a6152770dfe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:43.512979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9562375d-8633-450f-a6be-bcb9122a6370 req-2e9aec68-c4c2-459d-9354-4a6152770dfe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:43.538207 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9562375d-8633-450f-a6be-bcb9122a6370 req-2e9aec68-c4c2-459d-9354-4a6152770dfe service nova] Creating event network-vif-deleted:40ce37ea-67c1-48ca-ae0e-e6c814830c0a for instance 253e4a8a-f499-447c-a0ec-2cf88b67abad on n-h2-846209-2 Jun 16 18:49:43.548320 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9562375d-8633-450f-a6be-bcb9122a6370 req-2e9aec68-c4c2-459d-9354-4a6152770dfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066661 Jun 16 18:49:43.549004 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2105/4115] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:43.579775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-55cc757d-f37f-44a3-892f-8abd9b332224 req-10619a6d-9f07-478d-b6b1-2dcc5f6b8b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-unplugged", "status": "completed", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:43.595993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-55cc757d-f37f-44a3-892f-8abd9b332224 req-10619a6d-9f07-478d-b6b1-2dcc5f6b8b19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:43.596439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-55cc757d-f37f-44a3-892f-8abd9b332224 req-10619a6d-9f07-478d-b6b1-2dcc5f6b8b19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:43.623057 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-55cc757d-f37f-44a3-892f-8abd9b332224 req-10619a6d-9f07-478d-b6b1-2dcc5f6b8b19 service nova] Creating event network-vif-unplugged:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:49:43.634169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-55cc757d-f37f-44a3-892f-8abd9b332224 req-10619a6d-9f07-478d-b6b1-2dcc5f6b8b19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058307 Jun 16 18:49:43.635987 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2106/4116] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:49:43.676577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:43.678437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:43.700648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:43.702065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:43.703075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:43.703751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:43.730011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:43.743077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aab40924-03b5-4f55-938a-3f2d5b5c480d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.526440 Jun 16 18:49:43.755339 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2011/4117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:43 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:44.317356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:44.328579 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d04e636-66c8-4107-91d0-0cd908221cc0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1366 microversion: 2.1 time: 0.658226 Jun 16 18:49:44.334263 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2107/4118] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:43 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1366 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:45.099275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:45.099885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:45.118634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:45.120267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:45.128991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:45.130617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:45.399995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:45.414585 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94221760-cda7-4b70-890b-8b2cbd4e9310 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.320645 Jun 16 18:49:45.417681 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2012/4119] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:45 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:45.430663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:45.433726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:45.452709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:45.453625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:45.457156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:45.459786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:45.537868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1771128208", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6b5d8611-2f93-4d68-b741-180fc0d2bfa6"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:45.621839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] validate_networks() for [('6b5d8611-2f93-4d68-b741-180fc0d2bfa6', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:49:45.794904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:45.809825 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-611e21d7-1121-4c09-896b-5a5617c27f89 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1366 microversion: 2.1 time: 0.389360 Jun 16 18:49:45.810692 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2013/4120] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:45 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:45.818750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:45.820116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:45.842243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:45.842721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:45.846412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:45.846882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:45.854439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:46.284683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:46.297521 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e44b2ff1-075c-41fa-9960-f674bf040f98 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.481582 Jun 16 18:49:46.299272 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2014/4121] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:45 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:46.315511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:46.316532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:46.333032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:46.334585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:46.346514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:46.347216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:46.617530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:49:46.618273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:49:46.618765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:49:46.619614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:49:46.621242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:49:46.641011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:46.641942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:46.643293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:46.643910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:46.677361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:49:46.701145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for user c60f8f3909974479836ac8b0363b9a08 and project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:49:46.707794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:46.718298 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5b1bbfb-3cb4-4c74-9672-219e969c9e8d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.406828 Jun 16 18:49:46.718909 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2015/4122] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:46 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:46.723051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:49:46.726035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:49:46.808128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2caa24d-3cdd-4d92-8818-112478b06983 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679691 Jun 16 18:49:46.809449 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2108/4123] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:49:46.820538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cc2ff01d-1627-4883-97c5-16b5e432fba9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:46.822474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cc2ff01d-1627-4883-97c5-16b5e432fba9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:46.841867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2ff01d-1627-4883-97c5-16b5e432fba9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:46.843373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2ff01d-1627-4883-97c5-16b5e432fba9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:46.844364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2ff01d-1627-4883-97c5-16b5e432fba9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:46.844997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc2ff01d-1627-4883-97c5-16b5e432fba9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:46.977631 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cc2ff01d-1627-4883-97c5-16b5e432fba9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.156573 Jun 16 18:49:46.982268 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2109/4124] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:49:46 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:49:46.993835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d10f4ad-e16a-4efe-b5f8-1382db1f1894 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:46.996532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d10f4ad-e16a-4efe-b5f8-1382db1f1894 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:47.092567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94cedc03-5147-472b-8e4c-40ab7639a3b3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:47.093525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94cedc03-5147-472b-8e4c-40ab7639a3b3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:47.096667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:47.104576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8d10f4ad-e16a-4efe-b5f8-1382db1f1894 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:47.111868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94cedc03-5147-472b-8e4c-40ab7639a3b3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:47.114869 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d10f4ad-e16a-4efe-b5f8-1382db1f1894 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1215 microversion: 2.1 time: 0.129548 Jun 16 18:49:47.115027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94cedc03-5147-472b-8e4c-40ab7639a3b3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:47.125146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94cedc03-5147-472b-8e4c-40ab7639a3b3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:47.125350 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2110/4125] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:46 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:47.125450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94cedc03-5147-472b-8e4c-40ab7639a3b3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:47.135795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:47.136692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:47.176898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:47.177364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:47.178183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:47.178630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:47.183371 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94cedc03-5147-472b-8e4c-40ab7639a3b3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/ips" status: 200 len: 153 microversion: 2.20 time: 0.451605 Jun 16 18:49:47.190023 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2016/4126] 10.222.0.27 () {60 vars in 1288 bytes} [Thu Jun 16 18:49:46 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/ips => generated 153 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:47.196187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:47.197280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:47.209449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:47.210793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:47.211834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:47.212495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:47.803152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:47.813650 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6bea6f75-3419-4bd8-97f6-b461d2906d33 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1366 microversion: 2.1 time: 0.696467 Jun 16 18:49:47.826950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:47.829888 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2111/4127] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:47 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1366 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:47.846565 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6702ba5b-bcc3-44ce-afab-82017cb0ab62 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1671 microversion: 2.1 time: 0.654077 Jun 16 18:49:47.849356 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2017/4128] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:47 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1671 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:48.133622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:48.134560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:48.146125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:48.146580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:48.147379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:48.147820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:48.297324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:48.311771 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87ac63c7-7ae6-476f-b300-c4801a2fdd93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1211 microversion: 2.1 time: 0.180885 Jun 16 18:49:48.327153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2112/4129] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:48 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:48.840310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:48.841007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:48.862217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:48.865880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:48.867079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:48.867798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:48.868166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:48.871043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:48.886649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:48.887197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:48.888060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:48.888610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:50.003051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:50.017819 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a5732be0-bb9e-46e7-aae3-f3aef9d21d15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1671 microversion: 2.1 time: 1.154650 Jun 16 18:49:50.020637 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2113/4130] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:48 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1671 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:50.029512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:50.034798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:50.048856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:50.052279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:50.052892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:50.053560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:50.136841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:50.172086 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67ea7241-c093-4fbc-a60d-7050bc3b4404 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1366 microversion: 2.1 time: 1.328266 Jun 16 18:49:50.174744 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2018/4131] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:48 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1366 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:50.192855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a7ccb336-9f12-47a1-baf9-4210dda66ab3 req-866892d4-419d-4cff-8e17-47a7b4209962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710e4c0f-a958-4070-92db-6df4658db530", "name": "network-vif-plugged", "status": "completed", "tag": "3959dbbd-8f75-465d-93b6-3f866f316353"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:50.226870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a7ccb336-9f12-47a1-baf9-4210dda66ab3 req-866892d4-419d-4cff-8e17-47a7b4209962 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:50.227681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a7ccb336-9f12-47a1-baf9-4210dda66ab3 req-866892d4-419d-4cff-8e17-47a7b4209962 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:50.268520 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a7ccb336-9f12-47a1-baf9-4210dda66ab3 req-866892d4-419d-4cff-8e17-47a7b4209962 service nova] Creating event network-vif-plugged:3959dbbd-8f75-465d-93b6-3f866f316353 for instance 710e4c0f-a958-4070-92db-6df4658db530 on n-h2-846209-2 Jun 16 18:49:50.281419 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a7ccb336-9f12-47a1-baf9-4210dda66ab3 req-866892d4-419d-4cff-8e17-47a7b4209962 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103720 Jun 16 18:49:50.283881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2019/4132] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:50.289438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:50.303713 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-45f7c90f-47ee-4a3b-b4ee-daef02b37cea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1273 microversion: 2.1 time: 0.278723 Jun 16 18:49:50.326004 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2114/4133] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:50 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:50.582023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:50.583077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:50.593294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:50.594287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:50.595393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:50.596139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:50.631746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lazy-loading 'flavor' on Instance uuid a53ee4be-2727-4f03-9f09-0e87c82f5694 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:49:51.020495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61b6dfe5-2a3a-4637-a43a-935954f3b7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/action" status: 202 len: 0 microversion: 2.20 time: 0.443322 Jun 16 18:49:51.024301 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2020/4134] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:49:50 2022] POST /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:49:51.034269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:51.036287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:51.038740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:51.039687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:51.049547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.050193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:51.050579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.051148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.051544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:51.051752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:51.053314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.054063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:51.804870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:51.824965 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6afb587b-f329-47e8-b545-42097fe504ba tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.791076 Jun 16 18:49:51.826229 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2021/4135] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:51 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:51.834249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:51.835198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:51.847434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.847641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:51.848159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:51.849280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.849831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:51.869379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:51.871168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:51.872761 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-256e0153-b0c3-4bb8-b1c1-f54b3970171d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.845346 Jun 16 18:49:51.873618 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2115/4136] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:51 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:51.913930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:51.915817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:51.926938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.927537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:51.929832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:51.930770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.404530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:52.416759 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f442a8ec-ec78-4525-943f-6e681b933305 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1556 microversion: 2.1 time: 0.588398 Jun 16 18:49:52.417730 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2022/4137] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:51 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1556 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:52.438841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9e327695-b4b4-4ace-be22-9981afd7b956 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:52.448047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9e327695-b4b4-4ace-be22-9981afd7b956 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:52.459814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e327695-b4b4-4ace-be22-9981afd7b956 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.462566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e327695-b4b4-4ace-be22-9981afd7b956 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.467388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e327695-b4b4-4ace-be22-9981afd7b956 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.467640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e327695-b4b4-4ace-be22-9981afd7b956 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.606791 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9e327695-b4b4-4ace-be22-9981afd7b956 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 200 len: 322 microversion: 2.1 time: 0.171685 Jun 16 18:49:52.608455 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2023/4138] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:49:52 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:52.617940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6753dcb4-6725-4d16-9330-652141eda8af tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:52.618959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6753dcb4-6725-4d16-9330-652141eda8af tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:52.629575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6753dcb4-6725-4d16-9330-652141eda8af tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.630569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6753dcb4-6725-4d16-9330-652141eda8af tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.631796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6753dcb4-6725-4d16-9330-652141eda8af tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.632458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6753dcb4-6725-4d16-9330-652141eda8af tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.640755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:52.654444 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5049321c-8f4e-4879-b965-79c10d028d9e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.758671 Jun 16 18:49:52.657396 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2116/4139] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:51 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:52.680295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:52.681208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:52.684374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:52.696960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.698856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.699967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.700633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.889743 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6753dcb4-6725-4d16-9330-652141eda8af tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279586 Jun 16 18:49:52.892166 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2024/4140] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:49:52 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530/os-interface => generated 285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:52.902181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:52.902181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:52.909834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.910436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:52.911298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:52.911960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:53.256132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:53.266698 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-13fedce2-e7bd-4289-a454-5539552913c1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.607456 Jun 16 18:49:53.267640 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2117/4141] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:52 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:53.287941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:53.288573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:53.307969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:53.308473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:53.312359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:53.315355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:53.534353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:53.546979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:53.550031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:53.550031 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3320671-3666-4a17-b682-c81daa3430e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.655289 Jun 16 18:49:53.574297 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2025/4142] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:52 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:53.671417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:53.672043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:53.691274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:53.691729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:53.692506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:53.693154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:54.231237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:54.248598 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9a5c547b-a4ca-4be7-9517-4c430970809d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.965027 Jun 16 18:49:54.253521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:54.268656 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7c62ec1-b6bc-43f2-bd82-8240b30bf722 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.601176 Jun 16 18:49:54.269851 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2026/4144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:53 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:54.280088 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2118/4144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:53 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:54.284109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:54.287288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:54.299239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:54.303908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:54.306029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:54.308689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:54.569083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:54.570048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:54.591012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:54.591476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:54.592275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:54.592711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:55.185305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:55.204958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:55.206676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:55.207923 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a78ba4aa-cdad-4be2-bbda-91573598a737 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.642848 Jun 16 18:49:55.208510 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2119/4145] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:54 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:49:55.262403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:55.290942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:55.292276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:55.304167 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cec56239-1f8f-4705-ba72-d58fa851c94a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 1.007578 Jun 16 18:49:55.305077 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2027/4146] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:54 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:55.325930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:55.326692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:55.327639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:55.328438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:55.329044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:55.329832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:55.347882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:55.350380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:55.351392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:55.358710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:55.841227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:55.853561 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7896c1db-9b41-402b-9946-6c21914a2b55 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.572071 Jun 16 18:49:55.865101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:55.868213 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2120/4147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:55 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:55.874787 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f931051-a7e6-4109-9ba0-4e05220ee7bf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.556901 Jun 16 18:49:55.876054 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2028/4148] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:55 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:56.007842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1384761034", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:56.084496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7e0da539-98d3-4d56-a326-20b4b5e52dd6 req-eb4add1f-63e3-4adb-930d-6fd10b6a1d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6fec83-81c5-4527-9f5e-46c894a7dc7d", "tag": "1826ccbb-dbfd-4d1a-a5ac-ed4d63dd7c66"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:56.097755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] validate_networks() for [('8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:49:56.107939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7e0da539-98d3-4d56-a326-20b4b5e52dd6 req-eb4add1f-63e3-4adb-930d-6fd10b6a1d66 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:56.110575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7e0da539-98d3-4d56-a326-20b4b5e52dd6 req-eb4add1f-63e3-4adb-930d-6fd10b6a1d66 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:56.125167 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7e0da539-98d3-4d56-a326-20b4b5e52dd6 req-eb4add1f-63e3-4adb-930d-6fd10b6a1d66 service nova] Creating event network-changed:1826ccbb-dbfd-4d1a-a5ac-ed4d63dd7c66 for instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d on n-h1-846209-2 Jun 16 18:49:56.131509 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7e0da539-98d3-4d56-a326-20b4b5e52dd6 req-eb4add1f-63e3-4adb-930d-6fd10b6a1d66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051978 Jun 16 18:49:56.132294 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2029/4149] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:49:56.228771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:56.230575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:56.250044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:56.250917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:56.251970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:56.252701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:56.654652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:56.966946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:56.982004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:56.985422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:56.987231 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10bcb79f-5e77-4895-8a02-5c77b69a8b08 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.763330 Jun 16 18:49:56.992846 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2030/4150] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:56 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:57.002943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:57.006882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:57.020651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:57.022680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:57.027208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:57.027808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:57.077349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:57.114503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:57.626764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:49:57.627643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:49:57.628136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:49:57.628557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:49:57.628986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:49:57.644334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:57.644802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:57.645627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:57.646112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:57.702147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:49:57.714564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for user 0bad5f4aa84e4b978a5a92478b6772bf and project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:49:57.780999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:57.792787 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b5aafab4-e23e-453e-acc5-e79c7de24ef0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.798494 Jun 16 18:49:57.795677 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2031/4151] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:56 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:57.809648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:49:57.819887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:49:58.014050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:58.015516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:58.030928 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ccbdb40-0760-4732-b35b-6f44c8741138 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.026592 Jun 16 18:49:58.032268 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2121/4152] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:49:58.033011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:58.034015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:58.040181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:58.040882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:58.053139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce55f966-1ef7-40da-83ac-b751e37b0b52 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:58.068091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ce55f966-1ef7-40da-83ac-b751e37b0b52 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:58.248723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ce55f966-1ef7-40da-83ac-b751e37b0b52 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:58.263476 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ce55f966-1ef7-40da-83ac-b751e37b0b52 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1215 microversion: 2.1 time: 0.215984 Jun 16 18:49:58.273388 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2122/4153] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:58 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:58.276786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-09ff66ac-4e49-4b2b-822e-b342fa76107c req-27c6c10d-b456-4e1b-80cc-22037f266adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710e4c0f-a958-4070-92db-6df4658db530", "tag": "3959dbbd-8f75-465d-93b6-3f866f316353"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:58.294952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-09ff66ac-4e49-4b2b-822e-b342fa76107c req-27c6c10d-b456-4e1b-80cc-22037f266adc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:58.295413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-09ff66ac-4e49-4b2b-822e-b342fa76107c req-27c6c10d-b456-4e1b-80cc-22037f266adc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:58.329278 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-09ff66ac-4e49-4b2b-822e-b342fa76107c req-27c6c10d-b456-4e1b-80cc-22037f266adc service nova] Creating event network-changed:3959dbbd-8f75-465d-93b6-3f866f316353 for instance 710e4c0f-a958-4070-92db-6df4658db530 on n-h2-846209-2 Jun 16 18:49:58.336820 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-09ff66ac-4e49-4b2b-822e-b342fa76107c req-27c6c10d-b456-4e1b-80cc-22037f266adc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069508 Jun 16 18:49:58.340174 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2123/4154] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:58.813129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:58.813882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:58.826938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:58.830709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:58.843761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:58.844515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:58.866432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:59.471127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:59.479342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:59.499164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:59.501155 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fe18f588-1d47-4115-813e-bc1e45ada685 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 1.492669 Jun 16 18:49:59.502288 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2032/4155] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:49:58 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:49:59.506684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:59.507335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:49:59.538327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:59.548975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:59.550127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:49:59.552227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:49:59.580175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:59.600340 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c627aea5-b6e6-44bd-bc58-1eb8cb3d0e73 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.788687 Jun 16 18:49:59.601608 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2124/4156] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:58 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:49:59.751490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:49:59.759286 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bd3a0ea7-197b-4b0d-85e2-419c7c70e300 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1267 microversion: 2.1 time: 0.256224 Jun 16 18:49:59.760521 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2033/4157] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:49:59 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:00.521631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:00.523453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:00.540533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:00.541844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:00.542846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:00.544313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:00.608635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1058336696", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "424f9cc2-5b1e-4c42-8096-43fbfff46806"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:00.692342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] validate_networks() for [('424f9cc2-5b1e-4c42-8096-43fbfff46806', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:50:01.156827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:01.183289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:01.201833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:01.207402 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00e34077-d345-421f-981a-cf88881000d1 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.688710 Jun 16 18:50:01.211064 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2034/4158] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:00 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:01.227640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:01.230245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:01.247668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:01.250334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:01.253449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:01.255015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:01.710296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:01.720154 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa19aff5-8449-40a7-b442-b5e8f491cacb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.504772 Jun 16 18:50:01.731420 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2035/4159] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:01 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:01.736543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:01.737181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:01.754319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:01.754793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:01.755605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:01.756055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:01.833631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:50:01.835131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:50:01.835958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:50:01.837057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:50:01.838823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:50:01.866248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:01.866726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:01.872521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:01.872986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:01.924050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Getting quotas for project e2f031183f564012b014510c555f8823. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:50:01.937134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Getting quotas for user 2b8f20043eab4b578d5a34cb7e0f99c4 and project e2f031183f564012b014510c555f8823. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:50:01.954514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:50:01.958309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:50:02.042864 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dd330fa0-6ed0-4f81-ac47-35fac7f9f440 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.736001 Jun 16 18:50:02.044475 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2125/4160] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:50:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:50:02.061068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a378e77b-dc21-4592-897e-b22d957eeacd tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:02.062094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a378e77b-dc21-4592-897e-b22d957eeacd tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:02.201601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a378e77b-dc21-4592-897e-b22d957eeacd tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:02.212671 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a378e77b-dc21-4592-897e-b22d957eeacd tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1217 microversion: 2.1 time: 0.161265 Jun 16 18:50:02.227051 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2126/4161] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:02 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:02.258875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:02.260230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:02.279598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:02.287028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:02.289525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:02.290824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:02.904612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:02.930730 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-363ca5f8-c4d8-4135-aa97-c05dfdd52b15 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1315 microversion: 2.1 time: 1.197832 Jun 16 18:50:02.937678 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2036/4162] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:01 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1315 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:02.956184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:02.965094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:02.995837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:02.996212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:02.997005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:02.997443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:03.571747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:03.582318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:03.584816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:03.586609 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9dde9d9a-6d8e-4fcd-82e7-dc87e2b98106 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 1.358266 Jun 16 18:50:03.589087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2127/4163] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:02 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:03.602366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:03.603005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:03.613642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:03.614399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:03.615353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:03.615961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:03.792212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:03.797330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:03.841452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6900b850-f1c4-4874-a9c2-67e3fc2ef576 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1269 microversion: 2.1 time: 0.250122 Jun 16 18:50:03.843210 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1c59dace-c67d-4e10-a48c-127437da8c67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.895514 Jun 16 18:50:03.844857 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2037/4164] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:02 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:03.846663 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2128/4165] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:03 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1269 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:03.850595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-138db188-2502-498d-ac88-42a8d82035b0 req-fb11e86f-99f6-4811-aed1-7073b1c368ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a85c52-12bf-45a7-8ab8-dbd43e9b9258", "tag": "529246b9-6b76-4044-bb7f-33d0d3d00baf"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:03.869827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-138db188-2502-498d-ac88-42a8d82035b0 req-fb11e86f-99f6-4811-aed1-7073b1c368ed service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:03.871219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-138db188-2502-498d-ac88-42a8d82035b0 req-fb11e86f-99f6-4811-aed1-7073b1c368ed service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:03.901401 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-138db188-2502-498d-ac88-42a8d82035b0 req-fb11e86f-99f6-4811-aed1-7073b1c368ed service nova] Creating event network-changed:529246b9-6b76-4044-bb7f-33d0d3d00baf for instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 on n-h2-846209-2 Jun 16 18:50:03.911208 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-138db188-2502-498d-ac88-42a8d82035b0 req-fb11e86f-99f6-4811-aed1-7073b1c368ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064788 Jun 16 18:50:03.914300 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2038/4166] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:03.954254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:03.954902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:03.964934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:03.965399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:03.966231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:03.966677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:04.486632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:04.511423 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d25aee5-635b-4490-aa6a-d3395d7323a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1315 microversion: 2.1 time: 0.559220 Jun 16 18:50:04.519862 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2129/4167] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:03 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:04.612078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:04.613233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:04.631671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:04.633007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:04.634152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:04.635162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:04.861117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:04.861744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:04.871349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:04.871812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:04.872611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:04.873057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:05.396027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:05.411300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:05.412870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:05.414105 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b67acc27-8217-4532-b99d-d6878bda29cc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.810713 Jun 16 18:50:05.414675 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2039/4168] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:04 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:05.430285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:05.431173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:05.439448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:05.446609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:05.448591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:05.449154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:05.600570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:05.610358 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b18bdae9-8141-40dc-a370-1253b67866f0 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1275 microversion: 2.1 time: 0.194389 Jun 16 18:50:05.618071 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2040/4169] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:05 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:05.620920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:05.623222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:05.623851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:05.631262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:05.631964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:05.632907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:05.633503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:05.642824 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-307571b0-e292-4a70-8b2a-040b87ff2056 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.782927 Jun 16 18:50:05.644673 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2130/4170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:04 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:06.141002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:06.152122 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e40a7bd-0b3c-49ae-a8f0-f4f9c394aa64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1315 microversion: 2.1 time: 0.532484 Jun 16 18:50:06.153579 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2041/4171] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:05 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:06.439709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:06.447357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:06.461181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:06.472580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:06.477836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:06.479213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:06.635093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:06.637067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:06.654946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:06.655775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:06.656605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:06.657305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:07.097775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:07.108734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:07.110439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:07.111736 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50143e9a-779f-48d9-b4f6-bb6742930e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.682528 Jun 16 18:50:07.112494 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2131/4172] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:06 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:07.117561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:07.118310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:07.124773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:07.125414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:07.126448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:07.127103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:07.182520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:07.191479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-12f4b1f8-70a6-405e-b8c3-4ac242adfc24 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 0.563699 Jun 16 18:50:07.192769 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2042/4173] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:06 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:07.197868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a057fa19-7b1f-4cb4-898f-bc29c418ba21 req-22629524-fba1-4c7d-bae1-4e9003399855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fec83-81c5-4527-9f5e-46c894a7dc7d", "name": "network-vif-plugged", "status": "completed", "tag": "1826ccbb-dbfd-4d1a-a5ac-ed4d63dd7c66"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:07.207226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a057fa19-7b1f-4cb4-898f-bc29c418ba21 req-22629524-fba1-4c7d-bae1-4e9003399855 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:07.208075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a057fa19-7b1f-4cb4-898f-bc29c418ba21 req-22629524-fba1-4c7d-bae1-4e9003399855 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:07.234691 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a057fa19-7b1f-4cb4-898f-bc29c418ba21 req-22629524-fba1-4c7d-bae1-4e9003399855 service nova] Creating event network-vif-plugged:1826ccbb-dbfd-4d1a-a5ac-ed4d63dd7c66 for instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d on n-h1-846209-2 Jun 16 18:50:07.243517 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a057fa19-7b1f-4cb4-898f-bc29c418ba21 req-22629524-fba1-4c7d-bae1-4e9003399855 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049275 Jun 16 18:50:07.245295 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2043/4174] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:07.266953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:07.278935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:07.292329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:07.292997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:07.294638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:07.295481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:07.551004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:07.565633 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ec8aade5-e536-477a-996b-8b25f20053ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.449135 Jun 16 18:50:07.566533 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2132/4175] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:07 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:07.765775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:07.811146 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1cf56bdf-17ce-4b90-891a-6008142cd7a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1315 microversion: 2.1 time: 0.564022 Jun 16 18:50:07.818835 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2044/4176] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:07 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:08.131665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:08.132449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:08.145270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.145990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:08.149458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.149977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:08.209828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:08.210921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:08.218475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.219174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:08.220112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.220964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:08.528551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:08.541923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:08.543862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:08.545725 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ef6aaf6-546b-4c65-b6df-20761c11083e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1746 microversion: 2.20 time: 0.418299 Jun 16 18:50:08.547396 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2133/4177] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:08 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1746 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:08.589752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:08.591145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:08.603236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.605227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:08.606192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.606841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:08.663034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:08.672635 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c86cb673-7baf-4c42-a7a5-414c9b9ccb71 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 0.466639 Jun 16 18:50:08.673495 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2045/4178] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:08 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:08.836654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:08.839926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:08.847580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.848289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:08.849635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:08.850274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:09.010748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:09.019792 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-822ba8f1-7b1c-4881-8acd-2a82979027c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1315 microversion: 2.1 time: 0.439944 Jun 16 18:50:09.021035 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2134/4179] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:08 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:09.026664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-671b797b-b3da-4f97-bd73-c3f3c35f949c req-c485943f-2552-4796-945f-967509af76b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06419f4-b16f-417d-9e00-17a939b99b4a", "tag": "3fc68a46-f0d2-4087-a4c1-e924eea2ea3c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:09.036188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-671b797b-b3da-4f97-bd73-c3f3c35f949c req-c485943f-2552-4796-945f-967509af76b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:09.036917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-671b797b-b3da-4f97-bd73-c3f3c35f949c req-c485943f-2552-4796-945f-967509af76b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:09.058036 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-671b797b-b3da-4f97-bd73-c3f3c35f949c req-c485943f-2552-4796-945f-967509af76b9 service nova] Creating event network-changed:3fc68a46-f0d2-4087-a4c1-e924eea2ea3c for instance e06419f4-b16f-417d-9e00-17a939b99b4a on n-h1-846209-2 Jun 16 18:50:09.064585 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-671b797b-b3da-4f97-bd73-c3f3c35f949c req-c485943f-2552-4796-945f-967509af76b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041984 Jun 16 18:50:09.065414 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2135/4180] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:09.225400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:09.234470 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-12489e33-f9c5-4cf7-9b31-dfebed0802d3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1315 microversion: 2.1 time: 0.405347 Jun 16 18:50:09.235196 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2046/4181] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:08 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:09.569887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:09.570957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:09.580917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:09.585665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:09.589502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:09.590601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:09.693971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:09.694754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:09.710543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:09.711059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:09.714181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:09.714657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:10.736364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:10.786046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:10.790615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:10.801617 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c38a3259-57ae-4d5d-a812-58b8d76688ba tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 1.113613 Jun 16 18:50:10.808100 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2047/4182] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:09 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:10.816579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:10.817171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:10.820463 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c832282-bdd0-429e-a4d2-3f01a8781e0c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1746 microversion: 2.20 time: 1.255142 Jun 16 18:50:10.821460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:10.834987 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2136/4183] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:09 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1746 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:10.848843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-781ba3bb-0254-4a85-b94d-e6e53fa467b9 req-a3b67244-6d86-4066-b222-d9e036b8c06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a85c52-12bf-45a7-8ab8-dbd43e9b9258", "name": "network-vif-plugged", "status": "completed", "tag": "529246b9-6b76-4044-bb7f-33d0d3d00baf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:10.852951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:10.855222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:10.856623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:10.857091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:10.878584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-781ba3bb-0254-4a85-b94d-e6e53fa467b9 req-a3b67244-6d86-4066-b222-d9e036b8c06c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:10.879302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-781ba3bb-0254-4a85-b94d-e6e53fa467b9 req-a3b67244-6d86-4066-b222-d9e036b8c06c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:10.925171 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-781ba3bb-0254-4a85-b94d-e6e53fa467b9 req-a3b67244-6d86-4066-b222-d9e036b8c06c service nova] Creating event network-vif-plugged:529246b9-6b76-4044-bb7f-33d0d3d00baf for instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 on n-h2-846209-2 Jun 16 18:50:10.938877 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-781ba3bb-0254-4a85-b94d-e6e53fa467b9 req-a3b67244-6d86-4066-b222-d9e036b8c06c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100413 Jun 16 18:50:10.947207 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2137/4184] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:10.956570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:10.958125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:10.970396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:10.971216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:10.972277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:10.973074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:11.415200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:11.432550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:11.438548 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e10880fe-5ae1-458c-9d1a-648e6e1a29b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1500 microversion: 2.1 time: 0.628942 Jun 16 18:50:11.445339 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0e860550-c9dc-4521-98c5-2da895508c5a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1315 microversion: 2.1 time: 0.494387 Jun 16 18:50:11.457936 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2138/4185] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:10 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:11.458164 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2048/4186] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:10 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1500 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:11.467870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:11.470239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:11.486602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:11.488164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:11.492597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:11.495879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:11.555283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:50:11.730354 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5896baee-10f9-4f18-aa41-74338255d78b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 204 len: 0 microversion: 2.1 time: 0.269646 Jun 16 18:50:11.731637 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2139/4187] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:50:11 2022] DELETE /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:50:11.741641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:11.742634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:11.762437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:11.765007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:11.766301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:11.766969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:11.772674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:11.830356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:11.832312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:11.862094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:11.862800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:11.867393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:11.868220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:11.930230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:12.208958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:12.332549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:12.343624 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1c1179c-46bc-45fd-85a4-9c9ef11abd05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1506 microversion: 2.1 time: 0.607849 Jun 16 18:50:12.344238 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2049/4188] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:11 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:12.382432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:12.388533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:12.414196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:12.419414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:12.421799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:12.430660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:12.569824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:12.585753 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8bc3d224-5e53-4bdf-9c52-0e3b7ebe01a5 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 0.761429 Jun 16 18:50:12.590173 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2140/4189] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:11 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:12.601449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:12.603771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:12.655496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:12.660199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:12.664192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:12.677401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:13.094938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:13.115354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:13.121228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:13.122514 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e529433c-5b36-4bd0-a3d5-890d3c3bc389 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.755331 Jun 16 18:50:13.127245 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2050/4190] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:12 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:13.147232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b8526cf8-913c-4e72-9ecc-a1d31aa7657a req-eecb3927-37d8-4759-a779-a0b909314456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ee4be-2727-4f03-9f09-0e87c82f5694", "name": "network-vif-plugged", "status": "completed", "tag": "7e418d2c-584e-4d39-9444-c18f66d62054"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:13.182731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b8526cf8-913c-4e72-9ecc-a1d31aa7657a req-eecb3927-37d8-4759-a779-a0b909314456 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:13.186854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:13.189899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b8526cf8-913c-4e72-9ecc-a1d31aa7657a req-eecb3927-37d8-4759-a779-a0b909314456 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:13.199747 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-52dc100d-1167-40b6-b7d4-51336213446d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1315 microversion: 2.1 time: 0.607985 Jun 16 18:50:13.200348 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2141/4191] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:12 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:13.255362 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b8526cf8-913c-4e72-9ecc-a1d31aa7657a req-eecb3927-37d8-4759-a779-a0b909314456 service nova] Creating event network-vif-plugged:7e418d2c-584e-4d39-9444-c18f66d62054 for instance a53ee4be-2727-4f03-9f09-0e87c82f5694 on n-h1-846209-2 Jun 16 18:50:13.280638 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b8526cf8-913c-4e72-9ecc-a1d31aa7657a req-eecb3927-37d8-4759-a779-a0b909314456 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146188 Jun 16 18:50:13.296175 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2051/4192] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:13.362717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:13.363501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:13.395383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:13.404283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:13.410984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:13.415037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:13.530737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:13.606257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:13.606976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:13.639134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:13.639590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:13.640386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:13.640870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:14.878488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:14.896953 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0eb17fd0-0ebb-4d15-85f0-38e5aff795ab tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 1.295778 Jun 16 18:50:14.906156 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2052/4193] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:13 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:14.906156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:14.906156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:14.919039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:14.928786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ea504d49-b044-4c12-9ecb-3c0bc6a1f180 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1506 microversion: 2.1 time: 1.571647 Jun 16 18:50:14.940246 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2142/4194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:13 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1506 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:14.946470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:14.946979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:14.948381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:14.948858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:14.955357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:14.956213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:14.973793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:14.974449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:14.975861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:14.976435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:15.861150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:15.882489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:15.886253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:15.888228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a98eb1fd-5e49-48f8-9f40-551fcdbd967c tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.989314 Jun 16 18:50:15.901859 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2053/4195] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:14 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:15.939137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1512f868-be13-4369-88fb-134839ea42cb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:15.941831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1512f868-be13-4369-88fb-134839ea42cb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:15.956670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1512f868-be13-4369-88fb-134839ea42cb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:15.959871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1512f868-be13-4369-88fb-134839ea42cb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:15.961225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1512f868-be13-4369-88fb-134839ea42cb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:15.965031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1512f868-be13-4369-88fb-134839ea42cb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.015658 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1512f868-be13-4369-88fb-134839ea42cb tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/ips" status: 200 len: 146 microversion: 2.1 time: 0.109664 Jun 16 18:50:16.023723 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2054/4196] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:50:15 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/ips => generated 146 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:16.032869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:16.034373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:16.043114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:16.044397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.045422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:16.046191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.078551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:16.088311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0db8dfce-a096-42ba-bfcb-283e1f93ff9d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1503 microversion: 2.1 time: 1.146243 Jun 16 18:50:16.108185 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2143/4197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:14 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1503 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:16.122855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:16.123486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:16.149404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:16.163179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.164236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:16.164701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.464595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:16.474864 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1bb6a9a9-f19b-4a7f-a0ce-190c1e116288 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1464 microversion: 2.1 time: 0.365503 Jun 16 18:50:16.482344 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2144/4198] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:16 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:16.489094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5fe98e4a-ffcd-4d29-99dc-f18c1517d3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:16.545874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fe98e4a-ffcd-4d29-99dc-f18c1517d3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:16.546944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fe98e4a-ffcd-4d29-99dc-f18c1517d3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.643172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5fe98e4a-ffcd-4d29-99dc-f18c1517d3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Going to try to stop instance {{(pid=119206) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:50:16.798691 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5fe98e4a-ffcd-4d29-99dc-f18c1517d3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258/action" status: 202 len: 0 microversion: 2.1 time: 0.314066 Jun 16 18:50:16.800375 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2145/4199] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:50:16 2022] POST /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:50:16.818334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:16.824618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:16.848154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:16.850815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.855187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:16.857690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:16.972242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:16.987255 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17d24844-17b3-4230-b128-2aadedcd5ce7 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 0.959803 Jun 16 18:50:16.990421 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2055/4200] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:16 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:17.010707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-574256ff-fe73-4147-87b8-18b25793a092 req-f7c70393-5490-4af7-b970-8733b5501e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fec83-81c5-4527-9f5e-46c894a7dc7d", "name": "network-vif-deleted", "tag": "1826ccbb-dbfd-4d1a-a5ac-ed4d63dd7c66"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:17.040070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-574256ff-fe73-4147-87b8-18b25793a092 req-f7c70393-5490-4af7-b970-8733b5501e21 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:17.040530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-574256ff-fe73-4147-87b8-18b25793a092 req-f7c70393-5490-4af7-b970-8733b5501e21 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:17.109324 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-574256ff-fe73-4147-87b8-18b25793a092 req-f7c70393-5490-4af7-b970-8733b5501e21 service nova] Creating event network-vif-deleted:1826ccbb-dbfd-4d1a-a5ac-ed4d63dd7c66 for instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d on n-h1-846209-2 Jun 16 18:50:17.126340 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-574256ff-fe73-4147-87b8-18b25793a092 req-f7c70393-5490-4af7-b970-8733b5501e21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134285 Jun 16 18:50:17.133696 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2056/4201] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:17.153864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:17.166684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:17.179702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:17.184543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:17.185629 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:17.186619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:17.284952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:17.304736 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d5284e2d-8bf6-4105-a366-7d839739a87b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.491855 Jun 16 18:50:17.309526 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2146/4202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:16 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:17.533197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:17.535274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:17.565297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:17.566552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:17.570731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:17.571604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:17.660858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:17.663299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:17.663763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:17.664232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lazy-loading 'fault' on Instance uuid 4d6fec83-81c5-4527-9f5e-46c894a7dc7d {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:50:17.750012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:17.767808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:17.769774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:17.771278 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c73a8450-6587-44f2-a567-4ecc69afd3b6 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.635315 Jun 16 18:50:17.772204 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2057/4203] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:17 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:17.793803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:17.817737 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a276f45-d4e0-41d3-aaac-6440b471b1ee tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 200 len: 1305 microversion: 2.1 time: 0.321552 Jun 16 18:50:17.822715 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2147/4204] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:17 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 1305 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:18.006635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:18.007337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:18.020268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=84 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:18.028405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.030531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:18.038192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.038969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:18.334273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:18.335129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:18.421487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.425745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:18.430184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.430697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:19.278080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:19.292813 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1cb2dd3-2ebc-41f1-b352-f26af7aafcec tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 1.290146 Jun 16 18:50:19.301269 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2058/4205] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:18 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:19.309754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b292f4b8-5178-447a-80a6-2dd2e8f44109 req-c8b93644-88b1-4abd-baee-5611ccb99661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06419f4-b16f-417d-9e00-17a939b99b4a", "name": "network-vif-plugged", "status": "completed", "tag": "3fc68a46-f0d2-4087-a4c1-e924eea2ea3c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:19.338620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b292f4b8-5178-447a-80a6-2dd2e8f44109 req-c8b93644-88b1-4abd-baee-5611ccb99661 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:19.341319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b292f4b8-5178-447a-80a6-2dd2e8f44109 req-c8b93644-88b1-4abd-baee-5611ccb99661 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:19.377037 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b292f4b8-5178-447a-80a6-2dd2e8f44109 req-c8b93644-88b1-4abd-baee-5611ccb99661 service nova] Creating event network-vif-plugged:3fc68a46-f0d2-4087-a4c1-e924eea2ea3c for instance e06419f4-b16f-417d-9e00-17a939b99b4a on n-h1-846209-2 Jun 16 18:50:19.387821 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b292f4b8-5178-447a-80a6-2dd2e8f44109 req-c8b93644-88b1-4abd-baee-5611ccb99661 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084737 Jun 16 18:50:19.390399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:19.392292 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2059/4206] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:19.411738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:19.414164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:19.420746 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-94267428-5f4d-47bb-bcdf-cbb8e1645892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 1.099056 Jun 16 18:50:19.423257 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2148/4207] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:18 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:19.429415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:19.430133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:19.444386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:19.449665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:19.450258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:19.450648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:19.451241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:19.468328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:19.469317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:19.470743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:19.512903 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d HTTP/1.1 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '4d6fec83-81c5-4527-9f5e-46c894a7dc7d'} Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:19.518630 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:19.523343 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ce9dd15-53a9-4a07-83db-b7707235e27d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 404 len: 111 microversion: 2.1 time: 0.095414 Jun 16 18:50:19.524485 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2149/4208] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:19 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:50:19.741607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-583866656", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6b5d8611-2f93-4d68-b741-180fc0d2bfa6"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:19.840274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] validate_networks() for [('6b5d8611-2f93-4d68-b741-180fc0d2bfa6', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:50:20.214589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:20.244442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:20.250455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:20.254012 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6cd03f44-9dbe-404e-a873-a3330d5a4e7f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.860130 Jun 16 18:50:20.258404 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2060/4209] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:19 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:20.319206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:20.319866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:20.343510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:20.349496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:20.350774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:20.352445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:21.244185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:21.258953 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91172c7c-b548-49fd-9087-01f490f5503d tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1317 microversion: 2.1 time: 0.943451 Jun 16 18:50:21.272184 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2061/4210] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:20 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1317 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:21.300171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:21.305363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:21.313358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:21.314716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:21.315742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:21.316348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:22.980844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:22.992903 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-945c217e-653d-45f2-bc4d-13af92bed211 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 1.719426 Jun 16 18:50:22.993424 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2062/4211] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:21 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:23.015630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d84578e-53cf-49da-a763-3bcac8f7f35a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad044d62-61a3-478e-940e-cbef31946e73"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:23.017829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d84578e-53cf-49da-a763-3bcac8f7f35a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:23.037419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d84578e-53cf-49da-a763-3bcac8f7f35a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:23.038229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d84578e-53cf-49da-a763-3bcac8f7f35a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:23.039237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d84578e-53cf-49da-a763-3bcac8f7f35a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:23.039848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d84578e-53cf-49da-a763-3bcac8f7f35a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:23.578992 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d84578e-53cf-49da-a763-3bcac8f7f35a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578779 Jun 16 18:50:23.584177 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2063/4212] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:50:22 2022] POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-volume_attachments => generated 194 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:23.591868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:23.592738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:23.605416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:23.613369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:23.617011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:23.617819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:23.840918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:50:23.842214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:50:23.842881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:50:23.843494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:50:23.844093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:50:23.894978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:23.903127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:23.911606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:23.916714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:23.969139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:50:23.999439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for user c60f8f3909974479836ac8b0363b9a08 and project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:50:24.061326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:50:24.071047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:50:24.227450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:24.246791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:24.253246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:24.262399 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8548c2a4-b451-40fa-92a9-8925427d7740 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.525686 Jun 16 18:50:24.263121 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2150/4213] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:50:24.270758 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab2e4fe4-21d3-481a-ba48-0c3912efb36b tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.689346 Jun 16 18:50:24.279381 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2064/4214] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:23 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:24.288610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:24.301132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:24.314092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:24.316788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:24.327213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:24.327678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:24.328472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:24.328921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:24.340858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:24.343410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:24.346286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:24.346968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:24.991979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:25.006994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5a2aeec4-caae-4be6-b151-2fb0e474f001 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1507 microversion: 2.1 time: 0.730392 Jun 16 18:50:25.007931 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2151/4215] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:24 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1507 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:25.023838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15fe526e-f43b-49e9-b439-f8b86e9a1a94 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:25.025267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15fe526e-f43b-49e9-b439-f8b86e9a1a94 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:25.096899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:25.110489 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53447c2c-4012-4a5a-9a33-0bafc62916e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.828167 Jun 16 18:50:25.111094 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2065/4216] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:24 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:25.255353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15fe526e-f43b-49e9-b439-f8b86e9a1a94 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:25.303587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15fe526e-f43b-49e9-b439-f8b86e9a1a94 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1214 microversion: 2.1 time: 0.294007 Jun 16 18:50:25.306909 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2152/4217] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:25 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:25.314515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-01ef2a3a-c4ad-4375-bf10-c5d85159168e tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:25.315652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-01ef2a3a-c4ad-4375-bf10-c5d85159168e tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:25.341458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01ef2a3a-c4ad-4375-bf10-c5d85159168e tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:25.342193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01ef2a3a-c4ad-4375-bf10-c5d85159168e tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:25.344538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01ef2a3a-c4ad-4375-bf10-c5d85159168e tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:25.345005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01ef2a3a-c4ad-4375-bf10-c5d85159168e tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:25.381329 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-01ef2a3a-c4ad-4375-bf10-c5d85159168e tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a/ips" status: 200 len: 110 microversion: 2.1 time: 0.072808 Jun 16 18:50:25.382688 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2153/4218] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:50:25 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a/ips => generated 110 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:25.393495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:25.396538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:25.432760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:25.437677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:25.439498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:25.441028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:25.515034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-568085189", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "47b66628-cdcc-4871-9efc-08ebc8ce689d"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:25.652998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] validate_networks() for [('47b66628-cdcc-4871-9efc-08ebc8ce689d', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:50:25.982924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:25.999162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:26.000950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:26.002260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0cf9c471-b8ad-438b-bc76-20a203da6de3 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.618338 Jun 16 18:50:26.002842 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2154/4219] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:25 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:26.028561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b3efb52-6f70-4fbd-9ddc-2d69081f7797 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.036753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3b3efb52-6f70-4fbd-9ddc-2d69081f7797 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:26.086244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b3efb52-6f70-4fbd-9ddc-2d69081f7797 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.086996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b3efb52-6f70-4fbd-9ddc-2d69081f7797 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:26.089206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b3efb52-6f70-4fbd-9ddc-2d69081f7797 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.095479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b3efb52-6f70-4fbd-9ddc-2d69081f7797 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:26.191729 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3b3efb52-6f70-4fbd-9ddc-2d69081f7797 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a/ips" status: 200 len: 110 microversion: 2.1 time: 0.178691 Jun 16 18:50:26.204641 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2155/4220] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a/ips => generated 110 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:26.215953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.225884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:26.246733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.251816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:26.252933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.253541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:26.809515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:26.818699 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-264372c7-22dc-4d21-99a1-900809372de3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.612401 Jun 16 18:50:26.824922 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2156/4221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:26.840218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4379829-24d7-4d7b-9a37-8edb6769b690 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.841826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4379829-24d7-4d7b-9a37-8edb6769b690 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:26.863091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4379829-24d7-4d7b-9a37-8edb6769b690 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.863839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4379829-24d7-4d7b-9a37-8edb6769b690 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:26.864794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4379829-24d7-4d7b-9a37-8edb6769b690 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.865397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4379829-24d7-4d7b-9a37-8edb6769b690 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:26.948577 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4379829-24d7-4d7b-9a37-8edb6769b690 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a/ips/tempest-ServerAddressesTestJSON-1765204357-network" status: 200 len: 95 microversion: 2.1 time: 0.113472 Jun 16 18:50:26.949203 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2157/4222] 10.222.0.27 () {58 vars in 1400 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a/ips/tempest-ServerAddressesTestJSON-1765204357-network => generated 95 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:50:26.963398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.964039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:26.981460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.981943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:26.982747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:26.992510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.207800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:27.226170 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5179b2f9-2d33-434b-bf2a-063c5c483aaf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1272 microversion: 2.1 time: 0.275789 Jun 16 18:50:27.236322 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2158/4223] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:27.242494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:27.250321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:27.272165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.272905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.281464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.284986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.347400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:50:27.482456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:27.486845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:50:27.487545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:50:27.488368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:50:27.488846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:50:27.489598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:50:27.554447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.555346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.569456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b775e44d-24fb-45c4-bb25-2b93a65c3b6a tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 204 len: 0 microversion: 2.1 time: 0.331297 Jun 16 18:50:27.569934 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2159/4224] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:50:27 2022] DELETE /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:50:27.570887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.572485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.586728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:27.593027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:27.611740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.612388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.613394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.614151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.651522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Getting quotas for project ad0be6d7c8e24ed8b015f3000dbb96a7. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:50:27.658587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Getting quotas for user 16f7dfa40ebd48e28fce056c13d124c8 and project ad0be6d7c8e24ed8b015f3000dbb96a7. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:50:27.698299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:50:27.700828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:50:27.795570 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfd42a29-5f15-4a5e-a2e0-8d0f9a1a7866 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.683315 Jun 16 18:50:27.797217 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2066/4225] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:50:27.802524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:27.803926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:27.812139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.812980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.814490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:27.815425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:27.849464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:28.825845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:28.839772 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7acb4a1d-0755-4bc3-abb3-be19206126e9 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1513 microversion: 2.1 time: 1.039534 Jun 16 18:50:28.842206 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2067/4226] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:27 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1513 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:28.856053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:28.856684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:28.878961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:28.879846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:28.880801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:28.881519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.277039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:29.289132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:29.295886 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a60869aa-7f27-4284-ab01-b00288d94ef1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1223 microversion: 2.1 time: 0.451925 Jun 16 18:50:29.302533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:29.309701 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2068/4227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:28 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1223 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:29.316258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:29.321258 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-578b374c-b5f2-4f0e-9b04-0f3b1a9e6042 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 1.749928 Jun 16 18:50:29.321991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:29.323708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:29.333530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.334846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.336058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.336646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.343210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2160/4228] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:27 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:29.379000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:29.385226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:29.402357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.403372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.404349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.404956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.679035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:29.691177 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a313dd73-6953-4f58-8d60-98ba4c23de2f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1272 microversion: 2.1 time: 0.319404 Jun 16 18:50:29.692084 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2161/4229] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:29 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:29.707611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf58e1ce-f237-4ae4-9740-64e9d310c1b7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:29.708124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf58e1ce-f237-4ae4-9740-64e9d310c1b7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:29.717355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf58e1ce-f237-4ae4-9740-64e9d310c1b7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.717870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf58e1ce-f237-4ae4-9740-64e9d310c1b7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.718859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf58e1ce-f237-4ae4-9740-64e9d310c1b7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.723139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf58e1ce-f237-4ae4-9740-64e9d310c1b7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.832200 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bf58e1ce-f237-4ae4-9740-64e9d310c1b7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530/ips" status: 200 len: 150 microversion: 2.1 time: 0.138825 Jun 16 18:50:29.833444 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2162/4230] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:50:29 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:29.857072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "867f65a1-f411-4ca2-8096-75daa3024367"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:29.859087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:29.873475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.874925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:29.877746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:29.879808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.115572 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Invalid volume: volume 867f65a1-f411-4ca2-8096-75daa3024367 is already attached to instances: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530/os-volume_attachments HTTP/1.1 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 74 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: {"volumeAttachment": {"volumeId": "867f65a1-f411-4ca2-8096-75daa3024367"}} Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid volume: volume 867f65a1-f411-4ca2-8096-75daa3024367 is already attached to instances: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'server_id': '710e4c0f-a958-4070-92db-6df4658db530', 'body': {'volumeAttachment': {'volumeId': '867f65a1-f411-4ca2-8096-75daa3024367'}}} Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 867f65a1-f411-4ca2-8096-75daa3024367 is already attached to instances: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:50:30.118192 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 867f65a1-f411-4ca2-8096-75daa3024367 is already attached to instances: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 867f65a1-f411-4ca2-8096-75daa3024367 is already attached to instances: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 Jun 16 18:50:30.122638 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:30.130155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 400 to user: Invalid volume: volume 867f65a1-f411-4ca2-8096-75daa3024367 is already attached to instances: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:30.133111 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24794db5-e343-4f77-86cf-36bc3f6824ca tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.290345 Jun 16 18:50:30.134825 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2163/4231] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:50:29 2022] POST /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530/os-volume_attachments => generated 174 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:50:30.155944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:30.156698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:30.174465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.175168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.176110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.178705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.222937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:30.239863 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-098ce067-0f5c-4e4d-8ec2-720f10c59f69 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.925472 Jun 16 18:50:30.242773 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2069/4232] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:29 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:30.264294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:30.264813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:30.284055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.284513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.285297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.285727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.324581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:50:30.464830 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eb67999a-797d-4b98-8652-814fea532e21 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 204 len: 0 microversion: 2.1 time: 0.217029 Jun 16 18:50:30.468714 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2070/4233] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:50:30 2022] DELETE /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:50:30.474570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:30.475551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:30.486141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.487478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.489811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.490492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.718286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:30.729720 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03bd07a0-7efa-4290-9ce8-9d2e6e702e19 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1285 microversion: 2.1 time: 0.261956 Jun 16 18:50:30.744880 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2071/4234] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:30 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:30.765054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:30.765738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:30.794864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.795327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.796645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.797147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.802362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8f20043eab4b578d5a34cb7e0f99c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f031183f564012b014510c555f8823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:30.812122 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55ed395f-d0f8-4d27-8d05-6e2d8f0ac254 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 200 len: 1513 microversion: 2.1 time: 0.675674 Jun 16 18:50:30.816446 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2164/4235] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:30 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 1513 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:30.831743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:30.836237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:30.850975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.857191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:30.858106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:30.858620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:31.380258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:31.414967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:31.422063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:31.428206 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-507421e3-9e82-4201-9948-22ae9fd6d759 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.677676 Jun 16 18:50:31.430251 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2072/4236] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:30 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:31.458919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:31.459817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:31.480679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:31.481453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:31.482457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:31.483123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:31.809175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:31.823638 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61ca81a1-aeff-482c-ad04-6e6062eb13ab tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1681 microversion: 2.1 time: 1.004391 Jun 16 18:50:31.828547 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2165/4237] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:30 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1681 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:31.834650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:31.846943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:31.856925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:31.861360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:31.862929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:31.865464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:32.469349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:32.485935 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c82c1ca-493a-45e4-aead-59ee42382e8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 1.051402 Jun 16 18:50:32.492222 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2073/4238] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:31 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:32.498652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-457eba69-6542-4e98-9d9c-07668503d83a req-122dc3d0-d170-499f-8433-f684c399a5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06419f4-b16f-417d-9e00-17a939b99b4a", "name": "network-vif-deleted", "tag": "3fc68a46-f0d2-4087-a4c1-e924eea2ea3c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:32.546294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-457eba69-6542-4e98-9d9c-07668503d83a req-122dc3d0-d170-499f-8433-f684c399a5dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:32.548688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-457eba69-6542-4e98-9d9c-07668503d83a req-122dc3d0-d170-499f-8433-f684c399a5dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:32.575098 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-457eba69-6542-4e98-9d9c-07668503d83a req-122dc3d0-d170-499f-8433-f684c399a5dc service nova] Creating event network-vif-deleted:3fc68a46-f0d2-4087-a4c1-e924eea2ea3c for instance e06419f4-b16f-417d-9e00-17a939b99b4a on n-h1-846209-2 Jun 16 18:50:32.604165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-457eba69-6542-4e98-9d9c-07668503d83a req-122dc3d0-d170-499f-8433-f684c399a5dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110110 Jun 16 18:50:32.604714 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2074/4239] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:32.610096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:32.611015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:32.620882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:32.621587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:32.622864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:32.631895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:32.866389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:32.886117 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-902e4772-9838-4547-9736-5e52b7e96388 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1285 microversion: 2.1 time: 0.279898 Jun 16 18:50:32.891796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2075/4240] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:32 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1285 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:32.903010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:32.912587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] [instance: e06419f4-b16f-417d-9e00-17a939b99b4a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:32.943756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:32.947716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:32.950612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:32.954427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:32.988376 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] HTTP exception thrown: Instance e06419f4-b16f-417d-9e00-17a939b99b4a could not be found. Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Request method failure captured: Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a HTTP/1.1 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tYMbyAjOy5t4BSiq_CsML9Ya8NlLf4ibT571eUzE_Sj6G5FnceCZRPvEgnVqZPTMN96fLt6sKxLFR9Jh8eCLgA2xGJDhwGYas0P2Gf9ov2Ezhn3yvFoitHKZPiw9o-XMDH1fZJ-f-bud9kvwsGesNSz6_vEmed2b2j37Tp2yqa3bM Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e2f031183f564012b014510c555f8823 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerAddressesTestJSON-743446590 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2f031183f564012b014510c555f8823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e2f031183f564012b014510c555f8823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e2f031183f564012b014510c555f8823", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2f031183f564012b014510c555f8823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerAddressesTestJSON-743446590 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e2f031183f564012b014510c555f8823 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerAddressesTestJSON-743446590 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerAddressesTestJSON-743446590-project Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 2b8f20043eab4b578d5a34cb7e0f99c4 Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerAddressesTestJSON-743446590-project Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance e06419f4-b16f-417d-9e00-17a939b99b4a could not be found. Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'e06419f4-b16f-417d-9e00-17a939b99b4a'} Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06419f4-b16f-417d-9e00-17a939b99b4a could not be found. Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06419f4-b16f-417d-9e00-17a939b99b4a could not be found. Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:33.001465 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06419f4-b16f-417d-9e00-17a939b99b4a could not be found. Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:33.006457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] Returning 404 to user: Instance e06419f4-b16f-417d-9e00-17a939b99b4a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:33.007619 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-30ba5684-3aa5-4658-80cd-bd2085972b17 tempest-ServerAddressesTestJSON-743446590 tempest-ServerAddressesTestJSON-743446590-project] 10.222.0.27 "GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a" status: 404 len: 111 microversion: 2.1 time: 0.114422 Jun 16 18:50:33.011837 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2076/4241] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:32 2022] GET /compute/v2.1/servers/e06419f4-b16f-417d-9e00-17a939b99b4a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:50:33.013584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:33.019299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:33.031968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:33.032886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:33.034107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:33.034742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:33.091416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:33.101225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ebc6b0b7-cea5-49eb-9bd5-27171677228f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 1.270940 Jun 16 18:50:33.105509 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2166/4242] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:31 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:33.115026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:33.116735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:33.125953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:33.127026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:33.128109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:33.128857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:33.688272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:33.699473 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-10c8d09b-3414-434d-af27-34bfdfe65301 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1681 microversion: 2.1 time: 0.592502 Jun 16 18:50:33.705427 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2167/4243] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:33 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1681 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:33.714892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:33.726680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:33.743718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:33.744651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:33.747406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:33.748122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:33.952498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:34.595824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:34.619017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:34.620710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:34.628053 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3533358d-62d4-45bb-8e0f-666f3c89504e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 1.618229 Jun 16 18:50:34.645184 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2077/4244] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:33 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:34.656012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:34.656668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:34.670766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:34.671224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:34.676855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:34.677358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.108445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:35.119389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-677f3b1c-9ebe-4260-9f17-6e5f43169b69 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1327 microversion: 2.1 time: 0.472524 Jun 16 18:50:35.121416 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2078/4245] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:34 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1327 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:35.134358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:35.135256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:35.152884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:35.158247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.159368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:35.159978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.272782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:35.283265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a84275dc-f162-4f3f-b1eb-4de85ffe789f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 1.576353 Jun 16 18:50:35.283876 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2168/4246] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:33 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:35.303352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:35.303999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:35.329463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:35.331629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:35.332092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.332958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:35.340974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.651429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:35.669286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6712cc1-53a0-4c8d-b18b-1d020e566be3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 200 len: 1614 microversion: 2.1 time: 0.370460 Jun 16 18:50:35.670173 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2169/4247] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:35 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 1614 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:35.684163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9d21f593-3645-4827-8548-b491b8eca6e7 req-aeb25375-6bbf-4f1f-8d9a-4bcfe83a055c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af0385a-bcac-4ce6-9caf-f1dd86c0d4af", "tag": "9abf7558-dc03-42b6-83ef-fb4dcd1736f0"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:35.705872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9d21f593-3645-4827-8548-b491b8eca6e7 req-aeb25375-6bbf-4f1f-8d9a-4bcfe83a055c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:35.706989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9d21f593-3645-4827-8548-b491b8eca6e7 req-aeb25375-6bbf-4f1f-8d9a-4bcfe83a055c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.740726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9d21f593-3645-4827-8548-b491b8eca6e7 req-aeb25375-6bbf-4f1f-8d9a-4bcfe83a055c service nova] Creating event network-changed:9abf7558-dc03-42b6-83ef-fb4dcd1736f0 for instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af on n-h2-846209-2 Jun 16 18:50:35.750696 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9d21f593-3645-4827-8548-b491b8eca6e7 req-aeb25375-6bbf-4f1f-8d9a-4bcfe83a055c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079021 Jun 16 18:50:35.751604 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2170/4248] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:35.769369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:35.772549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:35.782767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:35.783638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.797869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:35.798511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:35.892751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:35.902008 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-57cb0ee1-8a54-4a92-ac46-20a67c58698e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.777908 Jun 16 18:50:35.903142 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2079/4249] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:35 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:36.137349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:36.138191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:36.167732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.168239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:36.169037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.169484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:36.476195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:36.488287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:36.498009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:36.504556 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d792932f-8f88-4b91-9a88-7dcfa6b4bc57 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.747653 Jun 16 18:50:36.509606 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2171/4250] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:35 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:36.527716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:36.532614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:36.567778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.569974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:36.571533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.574218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:36.815136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:36.828381 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ac420ac3-5096-4db2-b591-6f0c4ed18b89 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1327 microversion: 2.1 time: 0.695589 Jun 16 18:50:36.843026 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2080/4251] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:36 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1327 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:36.848305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:36.849250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:36.858042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.863037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:36.864355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.865046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:36.894166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 HTTP/1.1 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '710e4c0f-a958-4070-92db-6df4658db530'} Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:36.897737 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:36.903959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:36.903959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:36.903959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:36.903959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:36.903959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:36.903959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:50:36.903959 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:36.906998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:36.908154 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-756ee6f2-7383-4762-bd1e-68fbacde87a4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 404 len: 111 microversion: 2.1 time: 0.063707 Jun 16 18:50:36.912826 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2081/4252] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:36 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:50:36.926509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c3ce94d-4641-4fa1-b3d1-1b9741c109dd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '.version_select at 0x7f866e1bfee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:36.967454 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c3ce94d-4641-4fa1-b3d1-1b9741c109dd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884088199" status: 202 len: 0 microversion: 2.1 time: 0.053476 Jun 16 18:50:36.968040 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2082/4253] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884088199 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:50:36.973076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:36.973694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:36.980718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.981187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:36.981997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:36.982439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:37.119750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:37.128816 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-847b527c-32d3-4169-af1d-8fe300412989 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.617424 Jun 16 18:50:37.129405 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2172/4254] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:36 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:37.527467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:37.528910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:37.542985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:37.547638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:37.549047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:37.549745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:37.590069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:37.683221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:37.810554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:37.836098 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ffc7c81b-6960-4465-b9f4-7d2f93b46824 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.866233 Jun 16 18:50:37.837057 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2083/4255] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:36 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:37.891162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-281a8d2c-193e-4c7b-96e3-bde760fa2484 req-43d1a3bf-1fec-4940-af92-55c771778193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710e4c0f-a958-4070-92db-6df4658db530", "name": "network-vif-deleted", "tag": "3959dbbd-8f75-465d-93b6-3f866f316353"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:37.975265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-281a8d2c-193e-4c7b-96e3-bde760fa2484 req-43d1a3bf-1fec-4940-af92-55c771778193 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:37.976396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-281a8d2c-193e-4c7b-96e3-bde760fa2484 req-43d1a3bf-1fec-4940-af92-55c771778193 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:38.072437 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-281a8d2c-193e-4c7b-96e3-bde760fa2484 req-43d1a3bf-1fec-4940-af92-55c771778193 service nova] Creating event network-vif-deleted:3959dbbd-8f75-465d-93b6-3f866f316353 for instance 710e4c0f-a958-4070-92db-6df4658db530 on n-h2-846209-2 Jun 16 18:50:38.078188 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-281a8d2c-193e-4c7b-96e3-bde760fa2484 req-43d1a3bf-1fec-4940-af92-55c771778193 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230865 Jun 16 18:50:38.079970 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2084/4256] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:38.085582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:38.086572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:38.098056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:38.098813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:38.100402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:38.101175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:38.327756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:38.341685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:38.359576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:38.366626 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a54ac5f6-d7e2-462a-bb23-b7004f38a914 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.841635 Jun 16 18:50:38.378092 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2173/4257] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:37 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:50:38.382019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-cbbc4bce-92b8-47c8-8fa9-7301156d7f61 req-cbd6c54a-b084-4fef-958d-44bceda3d674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632c2bc2-e51e-483e-95bf-182b65fdae1f", "tag": "da25047a-ed89-4cd9-b48f-c0dccc61dd27"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:38.412245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-cbbc4bce-92b8-47c8-8fa9-7301156d7f61 req-cbd6c54a-b084-4fef-958d-44bceda3d674 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:38.413824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-cbbc4bce-92b8-47c8-8fa9-7301156d7f61 req-cbd6c54a-b084-4fef-958d-44bceda3d674 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:38.449815 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-cbbc4bce-92b8-47c8-8fa9-7301156d7f61 req-cbd6c54a-b084-4fef-958d-44bceda3d674 service nova] Creating event network-changed:da25047a-ed89-4cd9-b48f-c0dccc61dd27 for instance 632c2bc2-e51e-483e-95bf-182b65fdae1f on n-h1-846209-2 Jun 16 18:50:38.460880 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-cbbc4bce-92b8-47c8-8fa9-7301156d7f61 req-cbd6c54a-b084-4fef-958d-44bceda3d674 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087937 Jun 16 18:50:38.464465 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2174/4258] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:38.476859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:38.477644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:38.499191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:38.499652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:38.500457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:38.500898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:38.930461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:38.938690 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-333c92ea-950d-4269-bc3d-c4ee4463dc46 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1327 microversion: 2.1 time: 0.857149 Jun 16 18:50:38.947869 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2085/4259] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:38 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1327 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:38.961509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:38.966309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:38.985297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:38.985990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:38.988132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:38.991250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.039092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:39.068722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:39.092626 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-913261a4-307c-457b-9169-265a72d70ec4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.626683 Jun 16 18:50:39.094499 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2175/4260] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:38 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:39.350993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:39.351757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:39.359665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.360441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.361529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.362164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.520995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lazy-loading 'services' on Instance uuid a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:50:39.644518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-db0ef78b-177d-40a1-8227-62c29de5ddae tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments/867f65a1-f411-4ca2-8096-75daa3024367" status: 202 len: 0 microversion: 2.1 time: 0.297285 Jun 16 18:50:39.645900 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2176/4261] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:50:39 2022] DELETE /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments/867f65a1-f411-4ca2-8096-75daa3024367 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:50:39.690008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:39.691834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:39.707835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.708676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.709640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.710277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.755060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:39.777558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:39.789066 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bfd5e51d-40a9-43cb-b458-ab4cbddd451e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.831374 Jun 16 18:50:39.791475 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2086/4262] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:38 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:39.800271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3ad69ee4-193a-4780-bd52-7769ca898e4c tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:39.802120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3ad69ee4-193a-4780-bd52-7769ca898e4c tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:39.818428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ad69ee4-193a-4780-bd52-7769ca898e4c tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.819175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ad69ee4-193a-4780-bd52-7769ca898e4c tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.820169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ad69ee4-193a-4780-bd52-7769ca898e4c tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.820856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3ad69ee4-193a-4780-bd52-7769ca898e4c tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.867639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3ad69ee4-193a-4780-bd52-7769ca898e4c tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074652 Jun 16 18:50:39.868794 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2087/4263] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:50:39 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:39.965278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:39.965902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:39.980476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.981801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:39.982657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:39.983074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:40.076547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:40.086325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:40.088828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:40.090124 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-83d0572c-bbdd-4f55-80eb-9571178f39dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1741 microversion: 2.20 time: 0.442763 Jun 16 18:50:40.101089 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2177/4264] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:39 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1741 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:40.116708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:40.117181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:40.125634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:40.126393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:40.127443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:40.128197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:40.386941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:40.397956 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c82c15be-197c-4b4a-8c66-4f559de7099a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1327 microversion: 2.1 time: 0.437474 Jun 16 18:50:40.401585 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2088/4265] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:39 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1327 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:40.568301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:40.577712 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fdbb52ef-47fb-4751-b3ca-dbcad3082454 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.465469 Jun 16 18:50:40.579046 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2178/4266] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:40 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:40.809398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:40.810170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:40.824335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:40.824808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:40.825617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:40.826112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:40.881005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-440ade2a-5a96-4422-ac78-36db36d21160 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:40.882246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-440ade2a-5a96-4422-ac78-36db36d21160 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:40.895686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-440ade2a-5a96-4422-ac78-36db36d21160 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:40.898556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-440ade2a-5a96-4422-ac78-36db36d21160 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:40.902938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-440ade2a-5a96-4422-ac78-36db36d21160 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:40.903711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-440ade2a-5a96-4422-ac78-36db36d21160 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:40.958377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-440ade2a-5a96-4422-ac78-36db36d21160 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079996 Jun 16 18:50:40.964674 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2179/4267] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:50:40 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:50:41.110471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:41.112082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:41.123541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:41.124356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:41.125401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:41.126088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:41.144733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:41.158363 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-84e8f9f0-a244-4bf4-99ee-53ce126b542f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.352840 Jun 16 18:50:41.161309 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2089/4268] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:40 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:41.382780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:41.408540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:41.414459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:41.417565 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-10784269-1662-4a16-9347-2ccf9251ee0d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1723 microversion: 2.20 time: 0.312413 Jun 16 18:50:41.419475 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2180/4269] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:41 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:41.421005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:41.422280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:41.441150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:41.442422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:41.445016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:41.445789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:41.594986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:41.595792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:41.609700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:41.610559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:41.611578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:41.614467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.168510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:42.177007 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b68aaf9b-f506-4b5e-85c1-e0619fc590cd tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1327 microversion: 2.1 time: 0.761577 Jun 16 18:50:42.187257 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2090/4270] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:41 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1327 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:42.192694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-09a9115f-f13f-48dc-a8c0-9853af40bd37 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:42.202060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09a9115f-f13f-48dc-a8c0-9853af40bd37 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.202744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09a9115f-f13f-48dc-a8c0-9853af40bd37 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.271249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:42.283501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b27d1be1-08d1-4e8c-9907-b2c5e987f420 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.692358 Jun 16 18:50:42.286025 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2181/4271] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:41 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:42.293701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ee082f48-d443-4a20-8ec0-717bcc676699 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:42.295175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-09a9115f-f13f-48dc-a8c0-9853af40bd37 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Going to try to stop instance {{(pid=119207) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:50:42.299136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ee082f48-d443-4a20-8ec0-717bcc676699 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:42.320858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee082f48-d443-4a20-8ec0-717bcc676699 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.322279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee082f48-d443-4a20-8ec0-717bcc676699 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.323260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee082f48-d443-4a20-8ec0-717bcc676699 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.323893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee082f48-d443-4a20-8ec0-717bcc676699 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.396290 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-09a9115f-f13f-48dc-a8c0-9853af40bd37 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action" status: 202 len: 0 microversion: 2.1 time: 0.207358 Jun 16 18:50:42.397224 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2091/4272] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:50:42 2022] POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:50:42.406600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a4150ff4-1998-48ef-b60c-615ba7d3cd4b req-cdc7ac64-ffce-4e12-a206-80c1599227db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af0385a-bcac-4ce6-9caf-f1dd86c0d4af", "name": "network-vif-plugged", "status": "completed", "tag": "9abf7558-dc03-42b6-83ef-fb4dcd1736f0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:42.408356 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ee082f48-d443-4a20-8ec0-717bcc676699 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118547 Jun 16 18:50:42.409201 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2182/4273] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:50:42 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:42.419708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:42.420346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:42.432944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a4150ff4-1998-48ef-b60c-615ba7d3cd4b req-cdc7ac64-ffce-4e12-a206-80c1599227db service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.433525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a4150ff4-1998-48ef-b60c-615ba7d3cd4b req-cdc7ac64-ffce-4e12-a206-80c1599227db service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.447493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.448283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.452558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.453792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.457415 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a4150ff4-1998-48ef-b60c-615ba7d3cd4b req-cdc7ac64-ffce-4e12-a206-80c1599227db service nova] Creating event network-vif-plugged:9abf7558-dc03-42b6-83ef-fb4dcd1736f0 for instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af on n-h2-846209-2 Jun 16 18:50:42.479684 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a4150ff4-1998-48ef-b60c-615ba7d3cd4b req-cdc7ac64-ffce-4e12-a206-80c1599227db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080754 Jun 16 18:50:42.483060 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2092/4274] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:42.488417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:42.489159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:42.514727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.515194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:42.516017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:42.516468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.007738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:43.017271 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5553ff2f-7a22-456d-8324-f4d91c6a1999 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.533100 Jun 16 18:50:43.021610 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2093/4275] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:42 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:43.028700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:43.029367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:43.037385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.037844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.038686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.039323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.209373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:43.223845 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-959b8565-55a6-4d6e-9c21-b149efc40f2e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1513 microversion: 2.1 time: 0.813337 Jun 16 18:50:43.237646 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2183/4276] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:42 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1513 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:43.251553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:43.253178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:43.262617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.263180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.263987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.264439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.394529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:43.403854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:43.405643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:43.407429 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9122a667-a7ee-4004-9cb5-84c8a1dee472 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1723 microversion: 2.20 time: 0.387225 Jun 16 18:50:43.408510 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2094/4277] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:43 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1723 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:43.413362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:43.416383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:43.423081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.423894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.424871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.425474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.684462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:43.709889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d5cd46d2-380c-46d2-a431-89ea07acb907 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1327 microversion: 2.1 time: 0.470664 Jun 16 18:50:43.726662 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2184/4278] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:43 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1327 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:43.736429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33e67a4b-55b3-4c6d-8efd-3a954ac83585 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:43.737729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33e67a4b-55b3-4c6d-8efd-3a954ac83585 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:43.749285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:43.749826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33e67a4b-55b3-4c6d-8efd-3a954ac83585 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.751679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33e67a4b-55b3-4c6d-8efd-3a954ac83585 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.753390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33e67a4b-55b3-4c6d-8efd-3a954ac83585 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:43.755473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33e67a4b-55b3-4c6d-8efd-3a954ac83585 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:43.757729 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3c01fccb-77cd-4d3e-beee-c7971d6581c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.347904 Jun 16 18:50:43.763276 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2095/4279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:43 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:43.807346 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33e67a4b-55b3-4c6d-8efd-3a954ac83585 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078389 Jun 16 18:50:43.807951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2185/4280] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:50:43 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:44.038272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:44.038915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:44.051212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:44.051668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:44.052455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:44.052892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:44.243246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:44.244137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:44.255091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:44.257470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:44.259235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:44.260673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:44.264463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:44.455548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:44.471719 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d2a9688-15a7-4e45-9144-617258b8d51c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.437254 Jun 16 18:50:44.474788 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2096/4281] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:44 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:44.484354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:44.485339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:44.498387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:44.512215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:44.514895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:44.517062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:44.518906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:44.897104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:44.906582 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-37f9794e-4230-4582-8486-5285ed22842a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1490 microversion: 2.1 time: 0.668760 Jun 16 18:50:44.923429 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2186/4282] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:44 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1490 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:44.924967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-445b9d53-139c-449f-b048-3024205a886f req-e805a7be-2dff-4022-9e8d-2fd247675a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ee4be-2727-4f03-9f09-0e87c82f5694", "name": "network-vif-unplugged", "status": "completed", "tag": "7e418d2c-584e-4d39-9444-c18f66d62054"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:44.951336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-445b9d53-139c-449f-b048-3024205a886f req-e805a7be-2dff-4022-9e8d-2fd247675a63 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:44.951964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-445b9d53-139c-449f-b048-3024205a886f req-e805a7be-2dff-4022-9e8d-2fd247675a63 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:44.976780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-445b9d53-139c-449f-b048-3024205a886f req-e805a7be-2dff-4022-9e8d-2fd247675a63 service nova] Creating event network-vif-unplugged:7e418d2c-584e-4d39-9444-c18f66d62054 for instance a53ee4be-2727-4f03-9f09-0e87c82f5694 on n-h1-846209-2 Jun 16 18:50:44.992576 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-445b9d53-139c-449f-b048-3024205a886f req-e805a7be-2dff-4022-9e8d-2fd247675a63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073227 Jun 16 18:50:44.998297 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2187/4283] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:45.012029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:45.012934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:45.017991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:45.023880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.027219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.028188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.028489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:45.029674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.030033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:45.033617 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e2f933dc-e97c-4325-a2b2-bf1434173e85 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1723 microversion: 2.20 time: 0.555261 Jun 16 18:50:45.042692 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2097/4284] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:44 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:45.068364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:45.072469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:45.089582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.090570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.098148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.098731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.665946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:45.675837 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c759916d-212b-4e30-a676-1e9b9f68c5f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.628744 Jun 16 18:50:45.691666 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2098/4285] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:45 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:45.710217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e6a785a2-96e4-457f-8930-9abea6b30dc8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:45.711258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e6a785a2-96e4-457f-8930-9abea6b30dc8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:45.726724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:45.733071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6a785a2-96e4-457f-8930-9abea6b30dc8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.733537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6a785a2-96e4-457f-8930-9abea6b30dc8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.734379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6a785a2-96e4-457f-8930-9abea6b30dc8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.740317 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54ad5657-8b69-42cd-8561-8d863fa19d26 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1527 microversion: 2.1 time: 0.740156 Jun 16 18:50:45.741993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6a785a2-96e4-457f-8930-9abea6b30dc8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.744910 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2188/4286] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:44 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1527 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:45.756229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c85e6bb5-8593-4f9a-b51c-ed6a42e35886 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:45.757371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c85e6bb5-8593-4f9a-b51c-ed6a42e35886 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:45.773604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85e6bb5-8593-4f9a-b51c-ed6a42e35886 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.777622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85e6bb5-8593-4f9a-b51c-ed6a42e35886 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.778655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85e6bb5-8593-4f9a-b51c-ed6a42e35886 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.781096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85e6bb5-8593-4f9a-b51c-ed6a42e35886 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.782793 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e6a785a2-96e4-457f-8930-9abea6b30dc8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095119 Jun 16 18:50:45.783877 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2099/4287] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:50:45 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:45.793474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:45.795425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:45.824676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.825594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.826650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.827932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.878814 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c85e6bb5-8593-4f9a-b51c-ed6a42e35886 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 200 len: 115 microversion: 2.1 time: 0.132221 Jun 16 18:50:45.879775 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2189/4288] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:50:45 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 115 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:45.894136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:45.898574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:45.918799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.919757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:45.921660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:45.923846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:46.287404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:46.300021 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3704ee60-aea7-451e-87c0-4db04ff00818 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1527 microversion: 2.1 time: 0.417168 Jun 16 18:50:46.303292 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2190/4289] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:45 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1527 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:46.315942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:46.317991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:46.320661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:46.335196 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ef6c869e-035e-41df-93f1-41b95a7c7e61 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.550072 Jun 16 18:50:46.342291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2100/4290] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:45 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:46.343733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:46.345628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:46.347825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:46.348558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:46.348835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:46.349470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:46.371758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:46.372352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:46.373166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:46.373614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:46.749824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:46.752242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:46.763644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:46.767070 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a477d6b-d304-47e4-8c8c-1f57854d7a37 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.457843 Jun 16 18:50:46.767786 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2191/4291] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:46 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:46.770056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:46.771605 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-30119386-2a00-4b7a-bdbc-1b2bb690fa0e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1666 microversion: 2.20 time: 0.427849 Jun 16 18:50:46.777320 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2101/4292] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:46 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1666 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:46.795515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:46.795515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:46.820080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:46.822778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:46.823640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:46.824088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:46.846318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:47.004451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:47.013479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-81daa0c4-a3d1-467b-ba71-8151a7bfcb8b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.233756 Jun 16 18:50:47.014607 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2102/4293] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:46 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:47.019602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f869d2b7-fcf9-4cdd-98be-dd2b8175bd12 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.020785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f869d2b7-fcf9-4cdd-98be-dd2b8175bd12 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.027472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f869d2b7-fcf9-4cdd-98be-dd2b8175bd12 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.027926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f869d2b7-fcf9-4cdd-98be-dd2b8175bd12 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.028710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f869d2b7-fcf9-4cdd-98be-dd2b8175bd12 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.028985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.029461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f869d2b7-fcf9-4cdd-98be-dd2b8175bd12 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.030208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.041645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.045113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.045940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.046388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.068702 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] HTTP exception thrown: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Request method failure captured: Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af HTTP/1.1 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3twpoIXquAQhfIDpPahS7BTJW8Niwt0PO_LXG9iwLq5O_8gNdFVBVnNTYVcHQeKfmfxr--tubOwYrq9lYLir9HPBAfSB39lnZDcfVrsaT5arMOETu4YnHHw2HxWmcLH4JVjclNNRH_WFNQwtXNEp6yDhy-bRZzLAtwQkj9C_CGr92A Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: cb5b896c7d8d43aeae8d7c701ccb019e Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-927216896 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb5b896c7d8d43aeae8d7c701ccb019e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb5b896c7d8d43aeae8d7c701ccb019e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb5b896c7d8d43aeae8d7c701ccb019e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb5b896c7d8d43aeae8d7c701ccb019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-927216896 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: cb5b896c7d8d43aeae8d7c701ccb019e Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-927216896 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestMultiTenantJSON-927216896-project Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 3837b7cd9c6a4de1903d2434951a7246 Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-927216896-project Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '7af0385a-bcac-4ce6-9caf-f1dd86c0d4af'} Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:50:47.071125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:47.076403 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:47.077134 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f869d2b7-fcf9-4cdd-98be-dd2b8175bd12 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057822 Jun 16 18:50:47.077134 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2103/4294] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:50:47 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:50:47.078234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Returning 404 to user: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:47.079255 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1ba5d2c6-aceb-4aec-b826-071d151e6d65 tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 404 len: 111 microversion: 2.1 time: 0.310419 Jun 16 18:50:47.080266 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2192/4295] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:50:46 2022] DELETE /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 111 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:50:47.085639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.085800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bcb1230e-30cf-4936-a98a-523c871a50a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28dd2932-e2a1-4587-9134-466e5e71c4e7"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:47.086328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.087184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bcb1230e-30cf-4936-a98a-523c871a50a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.093988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.094459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.094815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb1230e-30cf-4936-a98a-523c871a50a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.095494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb1230e-30cf-4936-a98a-523c871a50a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.096370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb1230e-30cf-4936-a98a-523c871a50a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.096987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb1230e-30cf-4936-a98a-523c871a50a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.097601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.098164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.308464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:47.318008 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e2c7bc0-ee3b-4088-86a0-ad37ddaa0723 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.236232 Jun 16 18:50:47.318547 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2193/4296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:47 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:47.324057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e81346ba-bcb1-47fc-a517-0c92ef71dd03 req-15d79d26-2286-4f08-aa80-c2b238b451f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c2bc2-e51e-483e-95bf-182b65fdae1f", "name": "network-vif-plugged", "status": "completed", "tag": "da25047a-ed89-4cd9-b48f-c0dccc61dd27"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:47.332873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e81346ba-bcb1-47fc-a517-0c92ef71dd03 req-15d79d26-2286-4f08-aa80-c2b238b451f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.333329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e81346ba-bcb1-47fc-a517-0c92ef71dd03 req-15d79d26-2286-4f08-aa80-c2b238b451f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.349097 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e81346ba-bcb1-47fc-a517-0c92ef71dd03 req-15d79d26-2286-4f08-aa80-c2b238b451f6 service nova] Creating event network-vif-plugged:da25047a-ed89-4cd9-b48f-c0dccc61dd27 for instance 632c2bc2-e51e-483e-95bf-182b65fdae1f on n-h1-846209-2 Jun 16 18:50:47.358167 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e81346ba-bcb1-47fc-a517-0c92ef71dd03 req-15d79d26-2286-4f08-aa80-c2b238b451f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037772 Jun 16 18:50:47.363115 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2194/4297] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:47.384412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.385672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.395367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.396178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.397551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.398484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.531851 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bcb1230e-30cf-4936-a98a-523c871a50a8 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.455119 Jun 16 18:50:47.534238 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2104/4298] 10.222.0.27 () {62 vars in 1363 bytes} [Thu Jun 16 18:50:47 2022] POST /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-volume_attachments => generated 188 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:50:47.542890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.543636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.558029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.558493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.563220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.563730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.621190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:50:47.681717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:47.695404 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a0253751-4ad3-4a8a-91fb-7f26e261e46c tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1527 microversion: 2.1 time: 0.330414 Jun 16 18:50:47.702239 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2195/4299] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:47 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1527 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:47.708838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.708838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.725616 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f72861ad-77b8-4732-bafa-3d17277ba121 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 204 len: 0 microversion: 2.1 time: 0.188502 Jun 16 18:50:47.725844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.728115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.728817 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2105/4300] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:50:47 2022] DELETE /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:50:47.730184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.730648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.736121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.737356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.745799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.746301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.747093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.747759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.753267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:47.929998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:47.940744 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7cc9b1b6-f135-4524-bc63-5e0ba63f7287 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.242514 Jun 16 18:50:47.941729 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2196/4301] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:47 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:47.949094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-035cf53e-1dcd-4652-9a1f-4f031ab1ec26 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:47.949753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-035cf53e-1dcd-4652-9a1f-4f031ab1ec26 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:47.957661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-035cf53e-1dcd-4652-9a1f-4f031ab1ec26 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.958019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-035cf53e-1dcd-4652-9a1f-4f031ab1ec26 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.958995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-035cf53e-1dcd-4652-9a1f-4f031ab1ec26 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:47.959455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-035cf53e-1dcd-4652-9a1f-4f031ab1ec26 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:47.992019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:48.009332 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91aa6d69-c56b-4e3c-9ec0-b281529f6aa0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.278897 Jun 16 18:50:48.010013 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2106/4302] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:47 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:48.027974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Action: 'update', calling method: >, body: {"server": {"name": "7af0385a-bcac-4ce6-9caf-f1dd86c0d4af_new"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:48.036753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:48.049532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.051850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.053089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.057139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.079670 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] HTTP exception thrown: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Request method failure captured: Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: request: PUT /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af HTTP/1.1 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 64 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3twpoIXquAQhfIDpPahS7BTJW8Niwt0PO_LXG9iwLq5O_8gNdFVBVnNTYVcHQeKfmfxr--tubOwYrq9lYLir9HPBAfSB39lnZDcfVrsaT5arMOETu4YnHHw2HxWmcLH4JVjclNNRH_WFNQwtXNEp6yDhy-bRZzLAtwQkj9C_CGr92A Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: cb5b896c7d8d43aeae8d7c701ccb019e Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-927216896 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb5b896c7d8d43aeae8d7c701ccb019e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb5b896c7d8d43aeae8d7c701ccb019e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb5b896c7d8d43aeae8d7c701ccb019e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb5b896c7d8d43aeae8d7c701ccb019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-927216896 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: cb5b896c7d8d43aeae8d7c701ccb019e Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-927216896 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestMultiTenantJSON-927216896-project Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 3837b7cd9c6a4de1903d2434951a7246 Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-927216896-project Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: {"server": {"name": "7af0385a-bcac-4ce6-9caf-f1dd86c0d4af_new"}} Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '7af0385a-bcac-4ce6-9caf-f1dd86c0d4af', 'body': {'server': {'name': '7af0385a-bcac-4ce6-9caf-f1dd86c0d4af_new'}}} Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 18:50:48.081440 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:48.085307 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:50:48.088766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] Returning 404 to user: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:48.089813 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3c2fc3cb-0c09-4fc2-bf82-8361a56340eb tempest-ServersNegativeTestMultiTenantJSON-927216896 tempest-ServersNegativeTestMultiTenantJSON-927216896-project] 10.222.0.27 "PUT /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 404 len: 111 microversion: 2.1 time: 0.078667 Jun 16 18:50:48.090922 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2107/4303] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 18:50:48 2022] PUT /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:50:48.098800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:48.103356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:48.112712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.113161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.114276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.116474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.323283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:48.332077 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26428f59-a94f-49f7-9bb0-3c573b62342d tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1680 microversion: 2.1 time: 0.239924 Jun 16 18:50:48.333719 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2108/4304] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:48 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:48.339882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:48.340531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:48.353902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.354957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.355988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.356596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.383898 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-035cf53e-1dcd-4652-9a1f-4f031ab1ec26 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-volume_attachments/28dd2932-e2a1-4587-9134-466e5e71c4e7" status: 202 len: 0 microversion: 2.20 time: 0.440818 Jun 16 18:50:48.385245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2197/4305] 10.222.0.27 () {60 vars in 1456 bytes} [Thu Jun 16 18:50:47 2022] DELETE /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-volume_attachments/28dd2932-e2a1-4587-9134-466e5e71c4e7 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:50:48.406877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:48.408645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:48.424794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.425280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.429277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.429736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.594643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:48.604276 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97bcf0bc-babe-4f04-ae5f-2044ca99fd92 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.269005 Jun 16 18:50:48.604932 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2109/4306] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:48 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:48.641493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:48.642459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:48.663245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.666048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.667628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.671654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.681058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:48.692016 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a99575f-7bf2-4402-8e0f-739b5899c4b4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1314 microversion: 2.1 time: 0.305551 Jun 16 18:50:48.695663 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2198/4307] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:48 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:48.704794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f6cbfec-5ff6-4c32-9609-ba73846eeea9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:48.705377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f6cbfec-5ff6-4c32-9609-ba73846eeea9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:48.722403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:50:48.726355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f6cbfec-5ff6-4c32-9609-ba73846eeea9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.726893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f6cbfec-5ff6-4c32-9609-ba73846eeea9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.727873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f6cbfec-5ff6-4c32-9609-ba73846eeea9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.728577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f6cbfec-5ff6-4c32-9609-ba73846eeea9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.864850 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b5dd31a-aa1f-4f22-be74-34bdcc3edfcc tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 204 len: 0 microversion: 2.1 time: 0.241051 Jun 16 18:50:48.865629 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2110/4308] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:50:48 2022] DELETE /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:50:48.872691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1613270456", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:48.912864 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f6cbfec-5ff6-4c32-9609-ba73846eeea9 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "POST /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/action" status: 202 len: 0 microversion: 2.20 time: 0.210830 Jun 16 18:50:48.916780 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2199/4309] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:50:48 2022] POST /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:50:48.942531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:48.944651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:48.969063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.969531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:48.970362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] validate_networks() for [('8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:50:48.970996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:48.971235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:49.389699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:49.400839 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61d3ea27-5e1e-483f-8ccc-df5f47878b7a tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1533 microversion: 2.1 time: 0.479221 Jun 16 18:50:49.405438 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2200/4310] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:48 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1533 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:49.440817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:49.441440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:49.448164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:49.448621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:49.449452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:49.449894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.061809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:50.077051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:50.083172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:50.086377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-10a0cf67-0dac-4a43-a9b0-dcf9617730fd tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1674 microversion: 2.20 time: 0.665326 Jun 16 18:50:50.089319 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2201/4311] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:49 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1674 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:50.095958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:50.097655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:50.107995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.109490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.111109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.111974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.341163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:50:50.341939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:50:50.342998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:50:50.343864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:50:50.344790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:50:50.380216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.380939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.382070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.382730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.433866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:50:50.446679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for user 0bad5f4aa84e4b978a5a92478b6772bf and project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:50:50.459567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:50.469088 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-640adced-67b8-4042-aeed-bef2c839d222 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.377176 Jun 16 18:50:50.469319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:50:50.471669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:50:50.471910 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2202/4312] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:50 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:50.478116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:50.478906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:50.490516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.491465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.492533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.493753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.562113 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a071844e-da94-4b1f-8f34-c9517d3108d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695009 Jun 16 18:50:50.563131 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2111/4313] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:50:50.578523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:50.579180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:50.586516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.587627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.588442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.589448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.809810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:50.823291 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a188a164-b5a4-4640-a194-72747778d366 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1680 microversion: 2.1 time: 0.346029 Jun 16 18:50:50.824022 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2203/4314] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:50 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1680 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:50.839154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:50.840325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:50.847869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.848367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.849589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:50.850237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:50.909826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:50.931730 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f74cd9d5-27a8-4030-82f2-7c379ed72fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1499 microversion: 2.1 time: 0.365647 Jun 16 18:50:50.932698 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2112/4315] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:50 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1499 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:50.953022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-01cddab5-3721-4ae2-978c-d4dac4ef2168 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:50.953597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-01cddab5-3721-4ae2-978c-d4dac4ef2168 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:51.096440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01cddab5-3721-4ae2-978c-d4dac4ef2168 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:51.108210 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-01cddab5-3721-4ae2-978c-d4dac4ef2168 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1215 microversion: 2.1 time: 0.172353 Jun 16 18:50:51.108820 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2113/4316] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:50 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:51.120743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:51.124616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:51.136492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:51.137315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:51.138679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:51.139357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:51.227676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:51.244914 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3f35645-c4a1-4b82-8183-8711cd3b9115 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1533 microversion: 2.1 time: 0.419777 Jun 16 18:50:51.245530 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2204/4317] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:50 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1533 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:51.489722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:51.491286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:51.515271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:51.515793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:51.516616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:51.517409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:51.607050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:51.633077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:51.638607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:51.649794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6866ab27-0ae5-4e37-b4e1-adf46119d7c0 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 0.535804 Jun 16 18:50:51.666706 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2114/4318] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:51 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:51.842751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:51.843707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:51.856627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:51.862093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:51.863801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:51.864446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:51.914997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:51.941295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:51.952400 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c03ce59b-4bc6-469f-8cc0-6d6c5b669de6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.465969 Jun 16 18:50:51.962934 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2205/4319] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:51 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:52.132221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:52.132956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:52.150735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:52.151305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:52.152191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:52.157153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:52.308854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:52.322817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8d1b8b2-c250-4919-b715-0bf1871bd563 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1680 microversion: 2.1 time: 0.485890 Jun 16 18:50:52.328125 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2115/4320] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:51 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1680 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:52.342049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:52.343028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:52.345524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:52.360043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:52.360665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:52.361696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:52.362412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:52.382548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f89f55eb-6d83-4e4e-ae2d-2bc43eeaabbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1267 microversion: 2.1 time: 0.261116 Jun 16 18:50:52.383143 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2206/4321] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:52 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:52.679964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:52.681515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:52.708847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:52.709328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:52.718443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:52.719175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:53.344297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:53.364319 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf4d0a3b-ff87-45d2-a1ce-aec0a03d51b1 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1533 microversion: 2.1 time: 1.034871 Jun 16 18:50:53.371080 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2116/4322] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:52 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1533 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:53.385150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:53.386068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:53.396229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:53.397007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:53.398048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:53.398659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:53.581259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:53.590980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:53.599335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:53.610735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-042184e5-1c59-4ac5-b63e-2a3c500a0381 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 0.935109 Jun 16 18:50:53.619107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2207/4323] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:52 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:53.644511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:53.645145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:53.670878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:53.671339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:53.672765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:53.673269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.041611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:54.076546 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61c57f4f-933a-40a2-bf51-1b20e62083c9 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1613 microversion: 2.1 time: 0.456090 Jun 16 18:50:54.085626 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2208/4324] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:53 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1613 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:54.106205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:54.106983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:54.119730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.120529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.121584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.129251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.170967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:54.322703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:54.333027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-11be67f3-cd64-4056-aa0e-af02f8f842a7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1273 microversion: 2.1 time: 0.246068 Jun 16 18:50:54.343396 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2209/4325] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:54 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:54.350730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-68beadb4-a5ac-4d19-8680-495e58a36fa1 req-1f86d391-6619-4e8d-bb71-ac1367aecab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af0385a-bcac-4ce6-9caf-f1dd86c0d4af", "name": "network-vif-deleted", "tag": "9abf7558-dc03-42b6-83ef-fb4dcd1736f0"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:54.405377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-68beadb4-a5ac-4d19-8680-495e58a36fa1 req-1f86d391-6619-4e8d-bb71-ac1367aecab7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.406462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-68beadb4-a5ac-4d19-8680-495e58a36fa1 req-1f86d391-6619-4e8d-bb71-ac1367aecab7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.448810 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-68beadb4-a5ac-4d19-8680-495e58a36fa1 req-1f86d391-6619-4e8d-bb71-ac1367aecab7 service nova] Creating event network-vif-deleted:9abf7558-dc03-42b6-83ef-fb4dcd1736f0 for instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af on n-h2-846209-2 Jun 16 18:50:54.461819 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-68beadb4-a5ac-4d19-8680-495e58a36fa1 req-1f86d391-6619-4e8d-bb71-ac1367aecab7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116705 Jun 16 18:50:54.464701 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2210/4326] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:54.477462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:54.478783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:54.494563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.499065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.503024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.503795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.598599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:54.618765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.622601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.625983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lazy-loading 'fault' on Instance uuid 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:50:54.627178 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-515cb76f-b801-4833-adb7-9f928bf65c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 1.249783 Jun 16 18:50:54.627853 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2117/4327] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:53 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:54.674857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:54.675890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:54.715385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.719832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.721725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:54.722220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:54.803085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f7dfa40ebd48e28fce056c13d124c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0be6d7c8e24ed8b015f3000dbb96a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:54.811822 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87c0c7ad-e895-4aac-a27d-d4383b4c6b64 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 200 len: 1317 microversion: 2.1 time: 0.345622 Jun 16 18:50:54.815811 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2211/4328] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:54 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:55.103506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:55.104878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:55.118397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:55.119270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:55.120429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:55.122387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:55.161763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:55.162631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:55.163798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lazy-loading 'fault' on Instance uuid a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:50:55.461200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:55.481732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9e1bfaae-679c-41fb-9172-a1b442c7948f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 200 len: 1331 microversion: 2.1 time: 0.383035 Jun 16 18:50:55.492405 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2212/4329] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:55 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 1331 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:55.502265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e1c4667-c42b-4b1d-a818-2ebaca59a863 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74c7288f-0b08-4942-b1c8-daa4069a9bea"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:55.502265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6e1c4667-c42b-4b1d-a818-2ebaca59a863 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:55.522035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e1c4667-c42b-4b1d-a818-2ebaca59a863 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:55.528730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e1c4667-c42b-4b1d-a818-2ebaca59a863 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:55.543172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e1c4667-c42b-4b1d-a818-2ebaca59a863 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:55.543813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e1c4667-c42b-4b1d-a818-2ebaca59a863 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:55.726765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:55.741680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:55.745836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:55.752631 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32d8632a-25f9-408a-854b-9031dfd4920d tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 1.098697 Jun 16 18:50:55.753343 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2118/4330] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:54 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:55.769637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:55.771157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:55.804036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:55.804501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:55.807515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:55.807967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.029104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:56.043838 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-42bb8404-2139-4a3f-b1be-e741fabf3e61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1273 microversion: 2.1 time: 0.285803 Jun 16 18:50:56.059474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2119/4331] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:55 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:56.089773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:56.092563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:56.111278 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6e1c4667-c42b-4b1d-a818-2ebaca59a863 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618657 Jun 16 18:50:56.114748 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2213/4332] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:50:55 2022] POST /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:56.142984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.149821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.153837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:56.155587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.156144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.156678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] [instance: 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:56.201042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.204054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.206975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.210814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.303181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] HTTP exception thrown: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Request method failure captured: Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af HTTP/1.1 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tirqJVR51fyDeCIAqPv-iGq_e1r4vMm9yUTbipmKYKwJqj1PPo8hs3R5wLOBsGcWGjU4xveWyoQO9H4KkQxNIC_dHc6JrP7jSudKhSd_C8BAWaqHbxfJ2RBJeDd6mboIrbX826PWlQxrF65BWRh2a6XHGX8H6A2az6nwKvIV3EPj0 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: ad0be6d7c8e24ed8b015f3000dbb96a7 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1870577137 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad0be6d7c8e24ed8b015f3000dbb96a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad0be6d7c8e24ed8b015f3000dbb96a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad0be6d7c8e24ed8b015f3000dbb96a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad0be6d7c8e24ed8b015f3000dbb96a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1870577137 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: ad0be6d7c8e24ed8b015f3000dbb96a7 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1870577137 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1870577137-project Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 16f7dfa40ebd48e28fce056c13d124c8 Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1870577137-project Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '7af0385a-bcac-4ce6-9caf-f1dd86c0d4af'} Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:56.317692 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. Jun 16 18:50:56.323599 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.329492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] Returning 404 to user: Instance 7af0385a-bcac-4ce6-9caf-f1dd86c0d4af could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:56.331205 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1564e476-f3d9-4c6c-8a9d-7ce1f9a58c18 tempest-ServersNegativeTestMultiTenantJSON-1870577137 tempest-ServersNegativeTestMultiTenantJSON-1870577137-project] 10.222.0.27 "GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af" status: 404 len: 111 microversion: 2.1 time: 0.213815 Jun 16 18:50:56.335002 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2214/4333] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:56 2022] GET /compute/v2.1/servers/7af0385a-bcac-4ce6-9caf-f1dd86c0d4af => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:50:56.513506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:56.514693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:56.535769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.541321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.544200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.547706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.580605 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 HTTP/1.1 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5'} Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:50:56.582947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.588361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:50:56.588361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:50:56.588361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:50:56.588361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:50:56.588361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:50:56.588361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:50:56.588361 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:50:56.591208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:50:56.592714 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-741b0874-d681-4c20-9b08-a1f9a6e72468 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 404 len: 111 microversion: 2.1 time: 0.085937 Jun 16 18:50:56.598111 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2215/4334] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:56 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:50:56.605189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7784912d-c2ba-4a18-aa9e-4583e06dc634 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '.version_select at 0x7f866f4f3430>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:56.632397 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7784912d-c2ba-4a18-aa9e-4583e06dc634 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896110164" status: 202 len: 0 microversion: 2.1 time: 0.031494 Jun 16 18:50:56.635844 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2216/4335] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896110164 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:50:56.780439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:56.781398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:56.816709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.818653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.821389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:56.822977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:56.896475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:56.910891 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0bba477e-88d1-4e36-918f-b5e9e33cba9c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.849363 Jun 16 18:50:56.911549 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2120/4336] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:56 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:57.063719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:57.064675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:57.081557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:57.082047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:57.083001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:57.083523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:57.347992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:57.360841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:57.372285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:57.379843 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ff624937-86e9-49e8-94f0-56c1cabf128f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 0.609865 Jun 16 18:50:57.385722 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2217/4337] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:56 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:57.399070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c682ae6e-3974-4e83-90c7-340e73d00d10 req-59abe0dd-2315-4fa8-ae84-55aaf1aa0173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5", "name": "network-vif-deleted", "tag": "1f59f32f-8cd9-4223-aa08-52dd71b45dc6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:50:57.414983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c682ae6e-3974-4e83-90c7-340e73d00d10 req-59abe0dd-2315-4fa8-ae84-55aaf1aa0173 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:57.416325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c682ae6e-3974-4e83-90c7-340e73d00d10 req-59abe0dd-2315-4fa8-ae84-55aaf1aa0173 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:57.435480 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c682ae6e-3974-4e83-90c7-340e73d00d10 req-59abe0dd-2315-4fa8-ae84-55aaf1aa0173 service nova] Creating event network-vif-deleted:1f59f32f-8cd9-4223-aa08-52dd71b45dc6 for instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 on n-h2-846209-2 Jun 16 18:50:57.444999 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c682ae6e-3974-4e83-90c7-340e73d00d10 req-59abe0dd-2315-4fa8-ae84-55aaf1aa0173 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057629 Jun 16 18:50:57.447449 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2218/4338] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:57.516309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:57.533560 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7833d2dd-586f-4c3d-8a49-1da2d8ba64fc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 0.474143 Jun 16 18:50:57.536507 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2121/4339] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:57 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:50:57.944600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:57.946613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:57.977096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:57.978697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:57.988607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:57.989518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:58.410776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:58.412579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:58.435252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:58.436565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:58.438623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:58.440757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:58.575336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:50:58.593739 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9dba456b-d8b9-40dd-a99f-167df93f8293 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 0.656125 Jun 16 18:50:58.598391 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2219/4340] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:57 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:58.616454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:58.622276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:50:58.651398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:58.653110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:58.656420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:58.660542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:00.173479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:00.195246 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6cc0734f-c5ce-4aa9-997e-41be5175063a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 1.589722 Jun 16 18:51:00.198597 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2220/4341] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:50:58 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:00.214049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:00.223006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:00.237602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:00.238146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:00.248393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:00.249015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:00.353030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:00.362257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:00.380039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:00.381335 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a24120e5-f9df-4adb-95a2-6b27d85709d4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 1.979189 Jun 16 18:51:00.381926 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2122/4342] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:50:58 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:51:01.047935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-288cb6d1-8258-470e-b544-94af3db49114 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: .version_select at 0x7f866e906af0>, body: {"keypair": {"name": "tempest-keypair-649615995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMU1V5csyMlXgRFIXoCKS61zpqIo19IX9B02vw7A3o4+TbEweRY8eoO7elruSpGTu1+bKla6tWtB3rSTqHdn0rYb2qWvkqT+XfAt9snxAqdxSmxOasYmwegulPKnh+bBw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:01.060349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:01.093943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-288cb6d1-8258-470e-b544-94af3db49114 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:51:01.116330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-288cb6d1-8258-470e-b544-94af3db49114 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:51:01.178190 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-288cb6d1-8258-470e-b544-94af3db49114 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134004 Jun 16 18:51:01.179152 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2123/4343] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:51:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:51:01.215923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:01.217048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:01.226983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:01.239987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:01.241009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:01.241552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:01.890968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:01.922778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cb527bde-c36d-4c6a-899a-71d94e2dc509 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1723 microversion: 2.1 time: 1.720551 Jun 16 18:51:01.941230 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2221/4344] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:00 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1723 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:01.959076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:01.961361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:01.969856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:01.971572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:01.973289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:01.979055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:02.544455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:02.573191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4d8685e-e1da-4db2-96c0-05860e061714 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 1.357414 Jun 16 18:51:02.592055 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2124/4345] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:01 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:02.613199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8bc85f1e-178a-42d7-93a6-fae87f62e1a6 req-3e28f635-4ebc-4276-9861-4858ff84ae8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b700f5-03b2-4f59-8431-533f3efdfb5e", "tag": "11b701ad-fee1-4ba8-867f-e68c7bdbe080"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:02.690746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8bc85f1e-178a-42d7-93a6-fae87f62e1a6 req-3e28f635-4ebc-4276-9861-4858ff84ae8d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:02.694613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8bc85f1e-178a-42d7-93a6-fae87f62e1a6 req-3e28f635-4ebc-4276-9861-4858ff84ae8d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:02.737430 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8bc85f1e-178a-42d7-93a6-fae87f62e1a6 req-3e28f635-4ebc-4276-9861-4858ff84ae8d service nova] Creating event network-changed:11b701ad-fee1-4ba8-867f-e68c7bdbe080 for instance 02b700f5-03b2-4f59-8431-533f3efdfb5e on n-h1-846209-2 Jun 16 18:51:02.763884 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8bc85f1e-178a-42d7-93a6-fae87f62e1a6 req-3e28f635-4ebc-4276-9861-4858ff84ae8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170369 Jun 16 18:51:02.766643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2125/4346] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:02.950458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:02.952771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:03.000793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:03.003283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:03.004807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:03.005868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:03.857482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:03.880193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:03.885240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:03.886601 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-062ec3d5-4475-4b8e-9808-2d08216164ef tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 1.944236 Jun 16 18:51:03.887196 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2222/4347] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:01 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:03.919493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:03.922961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:03.940723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:03.941541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:03.943225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:03.946791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:04.118709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:04.135817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5d91bc6c-6c2a-4e2a-8634-9d86dff1c58a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1700 microversion: 2.1 time: 1.193799 Jun 16 18:51:04.140744 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2126/4348] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:02 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1700 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:04.174413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11319706-bba2-4a53-8b54-824dc5322b60 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:04.184625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11319706-bba2-4a53-8b54-824dc5322b60 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:04.201186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11319706-bba2-4a53-8b54-824dc5322b60 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:04.320266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-11319706-bba2-4a53-8b54-824dc5322b60 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Going to try to start instance {{(pid=119207) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:51:04.427778 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-11319706-bba2-4a53-8b54-824dc5322b60 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action" status: 202 len: 0 microversion: 2.1 time: 0.257387 Jun 16 18:51:04.432749 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2127/4349] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:04 2022] POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:51:04.460113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:04.461520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:04.471621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:04.477745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:04.479239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:04.488561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:04.491635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:05.402030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:05.426182 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c5acc53-873f-4b00-bcd1-014276ca9bfd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 1.513318 Jun 16 18:51:05.427179 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2223/4350] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:03 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:05.438658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:05.441522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:05.459304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:05.460181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:05.463434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:05.468078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:05.878811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:05.896622 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-12f2c538-3dfa-45ab-85a2-b8ebcc95a17b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1709 microversion: 2.1 time: 1.462163 Jun 16 18:51:05.897490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2128/4351] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:04 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1709 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:05.983984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:05.998443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:06.001953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:06.004098 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8ef9e37d-de83-4703-87cb-45a09ce3f2f2 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 0.569633 Jun 16 18:51:06.010263 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2224/4352] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:05 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:06.446332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:06.447389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:06.474944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:06.475498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:06.476360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:06.483902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:06.916016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:06.916754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:06.942114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:06.942591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:06.943384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:06.945094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:08.649156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:08.665561 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cecd8554-97b4-4a70-b273-43f403e1c831 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1709 microversion: 2.1 time: 1.753121 Jun 16 18:51:08.669105 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2225/4353] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:06 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1709 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:08.688546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:08.689303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:08.726033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:08.726774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:08.728468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:08.729043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:08.982216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:08.991571 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90795c56-6bf4-4950-bc1d-cd41441ed069 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 2.551113 Jun 16 18:51:08.996185 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2129/4354] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:06 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:09.158506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1287662432", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "342ef20c-b425-4c3e-85a8-70079b12ec49"}], "security_groups": [{"name": "tempest-securitygroup--833216422"}], "key_name": "tempest-keypair-649615995", "user_data": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:09.927883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] validate_networks() for [('342ef20c-b425-4c3e-85a8-70079b12ec49', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:51:10.231562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:10.248448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:10.250071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:10.256849 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-16cedc89-fb8b-461a-9dd0-a26e05f11bdf tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 1.581230 Jun 16 18:51:10.259776 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2226/4355] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:08 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:10.270207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:10.278640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:10.285863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:10.288687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:10.290160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:10.294695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:10.867881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:10.875611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:10.886272 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c29c2342-7946-4a69-a882-f09ccab0c895 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1709 microversion: 2.1 time: 0.625289 Jun 16 18:51:10.888946 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2227/4356] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:10 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1709 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:10.897083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:10.899260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:10.912242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:10.913683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:10.916056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:10.916757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:11.135612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:11.379362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:51:11.379737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:51:11.380234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:51:11.380695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:51:11.381149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:51:11.401882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:11.404196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:11.405306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:11.405763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:11.463175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:51:11.471564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:11.481193 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-737ece50-5c6e-4a1e-b466-45739f233892 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 0.590822 Jun 16 18:51:11.494034 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2228/4357] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:10 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:11.497727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:51:11.517101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:11.518507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:11.550892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:11.551580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:11.553898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:51:11.556942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:11.558780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:11.567015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:51:11.681319 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b0ad44dd-c671-4595-9bf7-9f39f767346b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.526605 Jun 16 18:51:11.682929 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2130/4358] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:51:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:51:11.829359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-958236893", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "d1a257ec-5416-4c52-be05-6c184ae9fcee"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:11.954497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] validate_networks() for [('d1a257ec-5416-4c52-be05-6c184ae9fcee', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:51:13.001479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:13.017502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:13.019817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:13.021430 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6c6d365-1e0e-4e24-8d0a-33ddeecc77b4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 1.525979 Jun 16 18:51:13.051663 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2229/4359] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:11 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:13.076486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:13.077130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:13.138630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:13.147581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:13.149226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:13.149851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.093760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:14.106295 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4ab95350-49bd-4cf6-b3ea-f8de588a83c0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1237 microversion: 2.1 time: 1.050888 Jun 16 18:51:14.118246 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2230/4360] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:13 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1237 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:14.137039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:14.139864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:14.149684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.150462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.151653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.152265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.295044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:51:14.295536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:51:14.295893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:51:14.296304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:51:14.296916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:51:14.307444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.308189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.309159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.309755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.347230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Getting quotas for project 921a2e6f0170439ba37ea9c9a1b02d88. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:51:14.360437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Getting quotas for user df3816474bdd4b09a33af1aad8dabdb7 and project 921a2e6f0170439ba37ea9c9a1b02d88. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:51:14.377875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:51:14.380284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:51:14.439685 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a09232da-0faa-4f9b-97b9-4fc480f923de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.755340 Jun 16 18:51:14.447133 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2131/4361] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:51:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:51:14.453002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:14.453872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:14.466069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.466832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.467802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.468405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.781972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:14.807447 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9eaeeec0-dddd-4fad-8f78-936b7cad1ca0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1709 microversion: 2.1 time: 0.687628 Jun 16 18:51:14.810822 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2231/4362] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:14 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1709 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:14.825447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-99afd513-6d78-45ad-a55a-96ee5abc8f80 req-ffb3f617-7263-4ac5-ba3a-1cf8d9fb5d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b700f5-03b2-4f59-8431-533f3efdfb5e", "name": "network-vif-plugged", "status": "completed", "tag": "11b701ad-fee1-4ba8-867f-e68c7bdbe080"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:14.847305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:14.853835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-99afd513-6d78-45ad-a55a-96ee5abc8f80 req-ffb3f617-7263-4ac5-ba3a-1cf8d9fb5d5a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.855463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-99afd513-6d78-45ad-a55a-96ee5abc8f80 req-ffb3f617-7263-4ac5-ba3a-1cf8d9fb5d5a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.891588 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-99afd513-6d78-45ad-a55a-96ee5abc8f80 req-ffb3f617-7263-4ac5-ba3a-1cf8d9fb5d5a service nova] Creating event network-vif-plugged:11b701ad-fee1-4ba8-867f-e68c7bdbe080 for instance 02b700f5-03b2-4f59-8431-533f3efdfb5e on n-h1-846209-2 Jun 16 18:51:14.906229 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-99afd513-6d78-45ad-a55a-96ee5abc8f80 req-ffb3f617-7263-4ac5-ba3a-1cf8d9fb5d5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094040 Jun 16 18:51:14.910364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2232/4363] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:14.940385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:14.941584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:14.967439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.968274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.969355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:14.970035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:14.995688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:15.008345 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-416e3e03-de94-47b6-925a-469fcbbf4b49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 0.559723 Jun 16 18:51:15.020260 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2132/4364] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:14 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:15.024118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d9fb348-15d3-432d-99dc-02a714848b8b tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:15.028823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4d9fb348-15d3-432d-99dc-02a714848b8b tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:15.301901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4d9fb348-15d3-432d-99dc-02a714848b8b tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:15.316397 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d9fb348-15d3-432d-99dc-02a714848b8b tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1215 microversion: 2.1 time: 0.299266 Jun 16 18:51:15.318339 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2133/4365] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:15 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1215 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:15.327901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:15.329133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:15.356972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:15.358004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:15.359998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:15.361859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:15.564326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:15.579132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:15.586559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:15.588152 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1ae7e0a4-1c86-4f8c-bad8-2240b5d7c972 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 0.662326 Jun 16 18:51:15.594378 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2233/4366] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:14 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:15.635011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:15.649698 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-63b456b9-e460-4585-a4b0-414d0a313e1f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1299 microversion: 2.1 time: 0.328660 Jun 16 18:51:15.651209 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2134/4367] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:15 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1299 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:15.826224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:15.832392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:15.843932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:15.846690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:15.855102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:15.855665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:15.883647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:15.884441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:15.899725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:15.900436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:15.901436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:15.902103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:15.915615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:15.962585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:51:16.146015 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e2d2f2c6-c8ed-4053-9035-165a5ad83019 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 204 len: 0 microversion: 2.1 time: 0.266663 Jun 16 18:51:16.148896 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2135/4368] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:51:15 2022] DELETE /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:51:16.156045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:16.156768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:16.181058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.181515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.182345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.182790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.647179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:16.657972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:16.659554 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89352fda-29ab-42ca-9dec-8b605f5530ef tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1713 microversion: 2.1 time: 0.838141 Jun 16 18:51:16.660461 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2234/4369] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:15 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1713 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:16.665852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:16.666805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:16.678139 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4840ef62-d812-4a8d-a3d9-5b594c77799d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 0.526222 Jun 16 18:51:16.681366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.682122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.682242 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2136/4370] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:16 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:16.683300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.684268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.688359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:16.690846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:16.720647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.723659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.725536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.728406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.854436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:16.864117 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf6256d3-070a-4327-a4d7-1f518fd03210 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1273 microversion: 2.1 time: 0.180772 Jun 16 18:51:16.865406 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2137/4371] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:16 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:16.870915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:16.872345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:16.880600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.881298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.882412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:16.883709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:16.982759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:16.993228 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51fdf6ef-5747-4225-b828-57f1b97eb7e4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1551 microversion: 2.1 time: 0.331407 Jun 16 18:51:16.994005 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2235/4372] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:16 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1551 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:16.999384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:17.000306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:17.008135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:17.008954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:17.009966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:17.010555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:17.236692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:17.250909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:17.253118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:17.259781 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16077d89-fa65-4d6d-9cfa-6230c03b9e9e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 0.393078 Jun 16 18:51:17.264291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2138/4373] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:16 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:17.296538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:17.307236 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc15ac3e-6ccc-4a25-92ae-efcb3109f48e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.311802 Jun 16 18:51:17.307845 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2236/4374] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:16 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:17.695815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:17.696555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:17.709676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:17.711562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:17.712724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:17.713175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:17.887911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:17.888690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:17.889100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:17.897450 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7a3b2f3-b3a2-4beb-9dad-94ad961c4dd1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1315 microversion: 2.1 time: 0.205810 Jun 16 18:51:17.900147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2139/4375] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:17 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:17.902192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:17.902903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:17.903804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:17.904280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:17.985096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:17.996273 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fefa33fb-4804-4af4-8f46-4d08fa4a1d80 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1273 microversion: 2.1 time: 0.117908 Jun 16 18:51:17.997153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2237/4376] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:17 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:18.015200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:18.016251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:18.031230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:18.035580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:18.036696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:18.038292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:18.309530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:18.311699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:18.325251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:18.326264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:18.327591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:18.328522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:18.361721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:18.389074 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62317474-1c4e-4cd3-b50a-dd29be510c78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1551 microversion: 2.1 time: 0.381384 Jun 16 18:51:18.390318 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2140/4377] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:18 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1551 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:18.396557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:18.397515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:18.406217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:18.406935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:18.409223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:18.410160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:18.954314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:18.967546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:18.969126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:18.970699 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48484700-efaf-4e97-807d-b47422939560 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 0.687018 Jun 16 18:51:18.971880 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2238/4378] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:18 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:18.979426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:18.980426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d94093e5-31ea-4244-89bb-b69a21d52bc4 req-aa38e489-806e-4c47-9561-e7d8a5438b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ee4be-2727-4f03-9f09-0e87c82f5694", "name": "network-vif-plugged", "status": "completed", "tag": "7e418d2c-584e-4d39-9444-c18f66d62054"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:18.988296 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f2dc830-404a-4c50-9f89-c64ed266a90a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.596652 Jun 16 18:51:18.993268 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2141/4379] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:18 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:18.994875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d94093e5-31ea-4244-89bb-b69a21d52bc4 req-aa38e489-806e-4c47-9561-e7d8a5438b6a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:18.996077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d94093e5-31ea-4244-89bb-b69a21d52bc4 req-aa38e489-806e-4c47-9561-e7d8a5438b6a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:18.998374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:18.999112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:19.017106 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d94093e5-31ea-4244-89bb-b69a21d52bc4 req-aa38e489-806e-4c47-9561-e7d8a5438b6a service nova] Creating event network-vif-plugged:7e418d2c-584e-4d39-9444-c18f66d62054 for instance a53ee4be-2727-4f03-9f09-0e87c82f5694 on n-h1-846209-2 Jun 16 18:51:19.022100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.022618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.024054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.024449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.025274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d94093e5-31ea-4244-89bb-b69a21d52bc4 req-aa38e489-806e-4c47-9561-e7d8a5438b6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049474 Jun 16 18:51:19.027758 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2239/4380] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:19.050381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:19.058211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:19.079179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.079647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.080438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.081069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.655523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:19.672351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d936471e-8782-450f-a125-c4c775470fcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1502 microversion: 2.1 time: 0.677440 Jun 16 18:51:19.672709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:19.673454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2142/4381] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:18 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1502 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:19.680884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:19.682708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:19.692830 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59081aa6-2792-4a04-a676-e00fae2a3b54 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.663637 Jun 16 18:51:19.693957 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2240/4382] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:19 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:19.703324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.703324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.703324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.703324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.708724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f18c0ce-23ac-4403-b481-cf195874bb18 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:19.709896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f18c0ce-23ac-4403-b481-cf195874bb18 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:19.718570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f18c0ce-23ac-4403-b481-cf195874bb18 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.719272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f18c0ce-23ac-4403-b481-cf195874bb18 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.720236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f18c0ce-23ac-4403-b481-cf195874bb18 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:19.721027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f18c0ce-23ac-4403-b481-cf195874bb18 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:19.887077 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f18c0ce-23ac-4403-b481-cf195874bb18 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.181880 Jun 16 18:51:19.887764 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2241/4383] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:19 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:19.991593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:19.993832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:20.004354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:20.005148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:20.007239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:20.008326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:20.754197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:20.767428 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad46307c-d288-4eab-9790-596c51e68eea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1551 microversion: 2.1 time: 1.092394 Jun 16 18:51:20.783800 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2143/4384] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:19 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1551 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:20.796098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:20.797153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:20.829649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:20.830224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:20.838057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:20.838526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.293267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:21.316825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:21.318416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:21.319654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb6d3b4e-0cae-4ba3-9a1d-9f0bbb6a71e4 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1732 microversion: 2.20 time: 1.333875 Jun 16 18:51:21.320892 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2242/4385] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:19 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1732 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:51:21.325927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e492d8d9-5404-48bc-9f1b-a6a3756a0db2 req-ffb56b13-a312-4805-938d-582f6955bca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37", "tag": "1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:21.349078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e492d8d9-5404-48bc-9f1b-a6a3756a0db2 req-ffb56b13-a312-4805-938d-582f6955bca7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.349802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e492d8d9-5404-48bc-9f1b-a6a3756a0db2 req-ffb56b13-a312-4805-938d-582f6955bca7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.408376 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e492d8d9-5404-48bc-9f1b-a6a3756a0db2 req-ffb56b13-a312-4805-938d-582f6955bca7 service nova] Creating event network-changed:1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49 for instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 on n-h2-846209-2 Jun 16 18:51:21.441663 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e492d8d9-5404-48bc-9f1b-a6a3756a0db2 req-ffb56b13-a312-4805-938d-582f6955bca7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117710 Jun 16 18:51:21.441797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:21.443137 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2243/4386] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:21.454819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:21.455583 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-399ca39f-65b6-4879-ac99-09a3fd3367e4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.669769 Jun 16 18:51:21.461357 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2144/4387] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:20 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:21.466116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:21.466386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35c7d523-7f79-4a54-ba53-14b002c8e29d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:21.467416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35c7d523-7f79-4a54-ba53-14b002c8e29d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:21.481784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.487103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.490605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.490977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.492892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35c7d523-7f79-4a54-ba53-14b002c8e29d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.493357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35c7d523-7f79-4a54-ba53-14b002c8e29d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.494181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35c7d523-7f79-4a54-ba53-14b002c8e29d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.494631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35c7d523-7f79-4a54-ba53-14b002c8e29d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.608622 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35c7d523-7f79-4a54-ba53-14b002c8e29d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.145896 Jun 16 18:51:21.612211 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2145/4388] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:21 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:21.619179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c6438fed-d20b-4377-8286-d00904ef6f5a req-433d05ce-15e6-45d7-a75f-240451a6f430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c2bc2-e51e-483e-95bf-182b65fdae1f", "name": "network-vif-deleted", "tag": "da25047a-ed89-4cd9-b48f-c0dccc61dd27"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:21.643214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c6438fed-d20b-4377-8286-d00904ef6f5a req-433d05ce-15e6-45d7-a75f-240451a6f430 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.645832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c6438fed-d20b-4377-8286-d00904ef6f5a req-433d05ce-15e6-45d7-a75f-240451a6f430 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.691179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c6438fed-d20b-4377-8286-d00904ef6f5a req-433d05ce-15e6-45d7-a75f-240451a6f430 service nova] Creating event network-vif-deleted:da25047a-ed89-4cd9-b48f-c0dccc61dd27 for instance 632c2bc2-e51e-483e-95bf-182b65fdae1f on n-h1-846209-2 Jun 16 18:51:21.705990 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c6438fed-d20b-4377-8286-d00904ef6f5a req-433d05ce-15e6-45d7-a75f-240451a6f430 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092275 Jun 16 18:51:21.706810 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2146/4389] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:21.789471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:21.790957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:21.805996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.806354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.808969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:21.809393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:21.965457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:21.974294 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bfec86b4-a5cc-4d29-b22d-4121a09726f3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1345 microversion: 2.1 time: 0.189486 Jun 16 18:51:21.981436 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2147/4390] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:21 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:22.037743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:22.053473 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d12718b9-41dd-4965-ba1d-824441990fe0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.607098 Jun 16 18:51:22.056677 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2244/4391] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:21 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:22.340082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:22.340720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:22.352254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:22.356473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:22.359395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:22.366731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:22.477309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:22.478646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:22.500812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:22.501497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:22.502550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:22.504928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:22.698057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:22.713195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:22.715050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:22.716245 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53dd830a-1364-4781-921f-96e9f6eb0132 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1719 microversion: 2.20 time: 0.380545 Jun 16 18:51:22.716823 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2148/4392] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:51:22 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1719 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:51:22.721509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19b89704-de3c-474c-a7aa-cc519b93e555 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:22.722486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19b89704-de3c-474c-a7aa-cc519b93e555 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:22.749666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b89704-de3c-474c-a7aa-cc519b93e555 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:22.750165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b89704-de3c-474c-a7aa-cc519b93e555 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:22.750967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b89704-de3c-474c-a7aa-cc519b93e555 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:22.751416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19b89704-de3c-474c-a7aa-cc519b93e555 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:22.828521 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19b89704-de3c-474c-a7aa-cc519b93e555 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.108999 Jun 16 18:51:22.838419 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2149/4393] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:22 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:22.848541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:22.858992 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-58694deb-8b5c-4172-b2f4-1e126b82b95e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.389073 Jun 16 18:51:22.860252 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2245/4394] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:22 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:22.993177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:22.994046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:23.001416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.002719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.003737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.004185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.075833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:23.076328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:23.096179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.097008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.098084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.098702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.146078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:23.164412 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d714dab-ead6-4161-9b53-a8107f4b2fd4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1345 microversion: 2.1 time: 0.175973 Jun 16 18:51:23.171054 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2150/4395] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:22 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:23.372417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:23.379321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:23.387413 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e25121ed-ea15-4a55-8fcc-b168df3a5f99 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.318293 Jun 16 18:51:23.388556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2246/4396] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:23 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:23.572267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1502386b-0557-4874-a200-d49fe08596a6 req-c67da1ed-d3e6-448e-9a3b-d7c1c3812f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77241925-0dc8-4e7c-bbbb-7dc1ad404a24", "tag": "3191ef76-7641-431e-bcf9-d8c7d50ac632"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:23.587013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1502386b-0557-4874-a200-d49fe08596a6 req-c67da1ed-d3e6-448e-9a3b-d7c1c3812f02 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.589052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1502386b-0557-4874-a200-d49fe08596a6 req-c67da1ed-d3e6-448e-9a3b-d7c1c3812f02 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.606048 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1502386b-0557-4874-a200-d49fe08596a6 req-c67da1ed-d3e6-448e-9a3b-d7c1c3812f02 service nova] Creating event network-changed:3191ef76-7641-431e-bcf9-d8c7d50ac632 for instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 on n-h2-846209-2 Jun 16 18:51:23.614096 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1502386b-0557-4874-a200-d49fe08596a6 req-c67da1ed-d3e6-448e-9a3b-d7c1c3812f02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045137 Jun 16 18:51:23.614823 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2151/4397] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:23.853500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-427c46cb-4cb8-4cd9-b486-dcf8b5c0febf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:23.863890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-427c46cb-4cb8-4cd9-b486-dcf8b5c0febf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:23.876211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427c46cb-4cb8-4cd9-b486-dcf8b5c0febf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.877124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427c46cb-4cb8-4cd9-b486-dcf8b5c0febf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.877621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:23.878401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:23.879432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427c46cb-4cb8-4cd9-b486-dcf8b5c0febf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.880124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-427c46cb-4cb8-4cd9-b486-dcf8b5c0febf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.888905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.889868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.891157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:23.899595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:23.933259 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-427c46cb-4cb8-4cd9-b486-dcf8b5c0febf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.088058 Jun 16 18:51:23.936717 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2247/4398] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:23 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:23.944924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:24.182578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:24.183530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:24.187055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:24.202683 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f0a41fe3-cbfb-4a3a-9e77-2e9b20746dcf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.329384 Jun 16 18:51:24.203944 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2152/4399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:23 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:24.207599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:24.208059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:24.208848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:24.209285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:24.404403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:24.405038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:24.423485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:24.430338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:24.430726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:24.431772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:24.433011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:24.468879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:24.479522 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ba8081c-f38a-4057-bb80-92bada7402b2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1345 microversion: 2.1 time: 0.302462 Jun 16 18:51:24.488511 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2248/4400] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:24 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1345 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:24.779335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:24.792117 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-446d7cf3-e944-4687-8045-d93cc8c5a18a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.391413 Jun 16 18:51:24.795069 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2153/4401] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:24 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:24.947070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3996799-abc3-49e0-a4d4-95a4a52ee62e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:24.949035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3996799-abc3-49e0-a4d4-95a4a52ee62e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:24.957780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3996799-abc3-49e0-a4d4-95a4a52ee62e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:24.958549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3996799-abc3-49e0-a4d4-95a4a52ee62e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:24.959921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3996799-abc3-49e0-a4d4-95a4a52ee62e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:24.960525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3996799-abc3-49e0-a4d4-95a4a52ee62e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:25.004247 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3996799-abc3-49e0-a4d4-95a4a52ee62e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.062600 Jun 16 18:51:25.005656 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2249/4402] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:24 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:25.223711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:25.224345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:25.237605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:25.242907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:25.243917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:25.244524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:25.326931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:25.506632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:25.508141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:25.529678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:25.545014 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c767169-dc6e-4a29-940c-d783330c8fbc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.327629 Jun 16 18:51:25.545250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:25.546000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:25.548898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:25.549364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:25.556099 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2154/4403] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:25 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:25.684262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:25.699740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c2355ec-a9a0-4845-b0b8-e631c1290836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1345 microversion: 2.1 time: 0.198248 Jun 16 18:51:25.700702 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2250/4404] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:25 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1345 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:25.812343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:25.813312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:25.823243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:25.823813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:25.824615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:25.825086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:26.016898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7a237d17-5bfa-4ded-aa39-0886dfe7a839 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:26.017846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7a237d17-5bfa-4ded-aa39-0886dfe7a839 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:26.029391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:26.032251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a237d17-5bfa-4ded-aa39-0886dfe7a839 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:26.033143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a237d17-5bfa-4ded-aa39-0886dfe7a839 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:26.034277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a237d17-5bfa-4ded-aa39-0886dfe7a839 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:26.034875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a237d17-5bfa-4ded-aa39-0886dfe7a839 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:26.042684 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4426d7a1-710d-42d7-9eac-503653cd1881 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.235183 Jun 16 18:51:26.057580 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2155/4405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:25 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:26.100436 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7a237d17-5bfa-4ded-aa39-0886dfe7a839 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.087654 Jun 16 18:51:26.102159 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2251/4406] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:26 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:26.562770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:26.563337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:26.575754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:26.578908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:26.579969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:26.580603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:26.725358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:26.727537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:26.752910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:26.759449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:26.760418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:26.760880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:26.862348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:26.876280 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-013ec4af-4dea-43c9-acb0-ea09f5c002c5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.317569 Jun 16 18:51:26.877577 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2156/4407] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:26 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:26.933159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:26.941876 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bf31f6c4-a6b0-4c64-8f07-871ae7760109 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 200 len: 1345 microversion: 2.1 time: 0.226979 Jun 16 18:51:26.943153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2252/4408] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:26 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 1345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:27.061173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:27.061713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:27.069404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.070271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:27.083601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.084828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:27.115371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59d11d7b-8a78-4657-82b3-8d662d6d13c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:27.116397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59d11d7b-8a78-4657-82b3-8d662d6d13c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:27.124905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d11d7b-8a78-4657-82b3-8d662d6d13c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.125771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d11d7b-8a78-4657-82b3-8d662d6d13c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:27.126795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d11d7b-8a78-4657-82b3-8d662d6d13c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.127691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59d11d7b-8a78-4657-82b3-8d662d6d13c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:27.190440 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59d11d7b-8a78-4657-82b3-8d662d6d13c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.081322 Jun 16 18:51:27.191399 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2253/4409] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:27 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:51:27.304114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:27.314619 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d2b6a7ca-37ce-416c-aa38-b84788dda03d tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.257306 Jun 16 18:51:27.324103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2157/4410] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:27 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:27.897529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:27.898632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:27.907718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.908358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:27.909589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.910272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:27.963606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:27.965134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:27.975857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.976372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:27.977873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:27.978494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.001191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f HTTP/1.1 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '632c2bc2-e51e-483e-95bf-182b65fdae1f'} Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:28.004469 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.009575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:28.009575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:28.009575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:28.009575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:51:28.009575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:51:28.009575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.009575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.013157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:51:28.014307 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a0a0f388-e5b4-4ed5-bcb6-0e25fbdae1e3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 404 len: 111 microversion: 2.1 time: 0.056879 Jun 16 18:51:28.018881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2158/4411] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:27 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:51:28.099189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:28.109652 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f845d97-9556-4614-8cc7-b5f0e7fcf860 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.219809 Jun 16 18:51:28.111127 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2254/4412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:27 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:28.159658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:28.160663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:28.167144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:28.168845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:28.169345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.170381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:28.170829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.189743 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f/os-volume_attachments HTTP/1.1 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': '632c2bc2-e51e-483e-95bf-182b65fdae1f'} Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:51:28.191649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:51:28.196308 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:28.203234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41ba2327-7774-406c-8db8-61de4a3baf34 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:28.204865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-41ba2327-7774-406c-8db8-61de4a3baf34 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:28.206782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:51:28.208178 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2849c6a1-5796-4681-b031-76892749f122 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052805 Jun 16 18:51:28.210099 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2159/4413] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:51:28 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:51:28.217067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41ba2327-7774-406c-8db8-61de4a3baf34 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:28.217708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41ba2327-7774-406c-8db8-61de4a3baf34 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.218601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41ba2327-7774-406c-8db8-61de4a3baf34 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:28.219053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41ba2327-7774-406c-8db8-61de4a3baf34 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.291457 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41ba2327-7774-406c-8db8-61de4a3baf34 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.092264 Jun 16 18:51:28.292511 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2255/4414] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:28 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:51:28.332719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:28.333893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:28.340704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:28.341168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.350544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:28.350544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.452322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-893265374", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6b5d8611-2f93-4d68-b741-180fc0d2bfa6"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:28.522550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] validate_networks() for [('6b5d8611-2f93-4d68-b741-180fc0d2bfa6', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:51:28.609338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:28.618905 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-966a4ef5-6fd9-400d-8ebd-09d4a094e24a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.290789 Jun 16 18:51:28.619484 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2160/4415] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:28 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:28.638437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c6a2761e-e501-4cf8-a479-41682074e17c req-15ef76b2-df6a-49e5-a1bf-b64eaca0daf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37", "name": "network-vif-plugged", "status": "completed", "tag": "1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:28.650156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c6a2761e-e501-4cf8-a479-41682074e17c req-15ef76b2-df6a-49e5-a1bf-b64eaca0daf1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:28.650156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c6a2761e-e501-4cf8-a479-41682074e17c req-15ef76b2-df6a-49e5-a1bf-b64eaca0daf1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:28.675992 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c6a2761e-e501-4cf8-a479-41682074e17c req-15ef76b2-df6a-49e5-a1bf-b64eaca0daf1 service nova] Creating event network-vif-plugged:1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49 for instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 on n-h2-846209-2 Jun 16 18:51:28.694674 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c6a2761e-e501-4cf8-a479-41682074e17c req-15ef76b2-df6a-49e5-a1bf-b64eaca0daf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071364 Jun 16 18:51:28.695354 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2161/4416] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:29.162011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ac12e232-63a8-487c-8e62-9fe0f317a965 tempest-ComputeTenantNetworksTest-610947229 tempest-ComputeTenantNetworksTest-610947229-project] Calling method '.version_select at 0x7f86780315e0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:29.450734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:51:29.451236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:51:29.451690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:51:29.452157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:51:29.452530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:51:29.464457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:29.465200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:29.466041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:29.466606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:29.471642 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ac12e232-63a8-487c-8e62-9fe0f317a965 tempest-ComputeTenantNetworksTest-610947229 tempest-ComputeTenantNetworksTest-610947229-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.444580 Jun 16 18:51:29.473511 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2162/4417] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 18:51:29 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:29.483849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:29.486506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:29.488718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:51:29.494304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:29.494757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:29.495540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:29.496282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:29.497035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for user c60f8f3909974479836ac8b0363b9a08 and project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:51:29.511653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:51:29.514547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:51:29.567821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3e47ff13-2803-4f29-87be-87f9fa0f6310 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123790 Jun 16 18:51:29.569209 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2256/4418] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:51:29.575917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-611abade-fa23-4fdf-bd39-be152d3ca9cb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:29.577400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-611abade-fa23-4fdf-bd39-be152d3ca9cb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:29.585070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-611abade-fa23-4fdf-bd39-be152d3ca9cb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:29.586602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-611abade-fa23-4fdf-bd39-be152d3ca9cb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:29.587641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-611abade-fa23-4fdf-bd39-be152d3ca9cb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:29.588087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-611abade-fa23-4fdf-bd39-be152d3ca9cb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:29.644001 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-611abade-fa23-4fdf-bd39-be152d3ca9cb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.072541 Jun 16 18:51:29.649298 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2257/4419] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:29 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:29.654967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-266eddf9-4238-4904-9447-b0507bb5d6ee tempest-ComputeTenantNetworksTest-610947229 tempest-ComputeTenantNetworksTest-610947229-project] Calling method '.version_select at 0x7f866e3a4940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:29.670776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:29.688848 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-038f1969-15d6-467f-8df3-65c47df7d44f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1366 microversion: 2.1 time: 0.213683 Jun 16 18:51:29.699153 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2163/4420] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:29 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:29.706625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83221068-4bd1-4d58-9c36-d5b27c2d8c32 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:29.707127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83221068-4bd1-4d58-9c36-d5b27c2d8c32 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:30.227107 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-266eddf9-4238-4904-9447-b0507bb5d6ee tempest-ComputeTenantNetworksTest-610947229 tempest-ComputeTenantNetworksTest-610947229-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/eafef975-972a-4c72-9868-ee422340adcb" status: 200 len: 140 microversion: 2.1 time: 0.575258 Jun 16 18:51:30.228375 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2258/4421] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:51:29 2022] GET /compute/v2.1/os-tenant-networks/eafef975-972a-4c72-9868-ee422340adcb => generated 140 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:30.237638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:30.238928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:30.252267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.259774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.264083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.264869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.280691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83221068-4bd1-4d58-9c36-d5b27c2d8c32 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:30.290704 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83221068-4bd1-4d58-9c36-d5b27c2d8c32 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 200 len: 1214 microversion: 2.1 time: 0.589937 Jun 16 18:51:30.303181 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2164/4422] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:29 2022] GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 1214 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:30.310002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:30.310508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:30.318686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.319415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.320932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.321546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.360594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:51:30.385441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.386555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.443817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lazy-loading 'flavor' on Instance uuid b02c998a-da4a-4054-9753-7c0df81950eb {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:51:30.461340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lazy-loading 'system_metadata' on Instance uuid b02c998a-da4a-4054-9753-7c0df81950eb {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:51:30.478813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:30.496898 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ffd17de-481d-48ff-9800-7ad559e00a7f tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.265819 Jun 16 18:51:30.498910 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2259/4423] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:30 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:30.583131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lazy-loading 'metadata' on Instance uuid b02c998a-da4a-4054-9753-7c0df81950eb {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:51:30.655955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2fcfb888-7833-463c-b34f-1029a1c8653f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:30.656918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2fcfb888-7833-463c-b34f-1029a1c8653f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:30.671127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fcfb888-7833-463c-b34f-1029a1c8653f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.672780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fcfb888-7833-463c-b34f-1029a1c8653f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.673864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fcfb888-7833-463c-b34f-1029a1c8653f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.674651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fcfb888-7833-463c-b34f-1029a1c8653f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.768024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.768492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.888544 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4dccc1ea-f70b-4ab2-8846-c7133223dd2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 204 len: 0 microversion: 2.1 time: 0.583619 Jun 16 18:51:30.889289 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2165/4424] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:51:30 2022] DELETE /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:51:30.894627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:30.895599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:30.902623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.903164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.904025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.904505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.950398 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2fcfb888-7833-463c-b34f-1029a1c8653f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 14 microversion: 2.1 time: 0.297405 Jun 16 18:51:30.952190 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2260/4425] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:30 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 14 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:30.963593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-06cc8736-2641-4381-bfab-e72756abbe5b req-d7e057a0-3a8e-4026-8061-89023e870c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77241925-0dc8-4e7c-bbbb-7dc1ad404a24", "name": "network-vif-plugged", "status": "completed", "tag": "3191ef76-7641-431e-bcf9-d8c7d50ac632"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:30.978911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-06cc8736-2641-4381-bfab-e72756abbe5b req-d7e057a0-3a8e-4026-8061-89023e870c30 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:30.979733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-06cc8736-2641-4381-bfab-e72756abbe5b req-d7e057a0-3a8e-4026-8061-89023e870c30 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:30.996645 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-06cc8736-2641-4381-bfab-e72756abbe5b req-d7e057a0-3a8e-4026-8061-89023e870c30 service nova] Creating event network-vif-plugged:3191ef76-7641-431e-bcf9-d8c7d50ac632 for instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 on n-h2-846209-2 Jun 16 18:51:31.006143 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-06cc8736-2641-4381-bfab-e72756abbe5b req-d7e057a0-3a8e-4026-8061-89023e870c30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050429 Jun 16 18:51:31.008164 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2261/4426] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:31.016952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:31.018590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:31.029170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.030167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:31.031982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.032984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:31.218090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:31.221283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:31.232792 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-80008a44-2f8a-4352-b1fa-cd4be2d4fa95 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1555 microversion: 2.1 time: 0.342175 Jun 16 18:51:31.242411 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2166/4427] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:30 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1555 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:31.258333 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b4f5016-10dc-4b9f-966d-5b4f971094e0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 200 len: 1272 microversion: 2.1 time: 0.247540 Jun 16 18:51:31.259764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-090cbc65-bc4f-46aa-b490-3ad8089c7074 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:31.260281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-090cbc65-bc4f-46aa-b490-3ad8089c7074 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:31.270100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-090cbc65-bc4f-46aa-b490-3ad8089c7074 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.270565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-090cbc65-bc4f-46aa-b490-3ad8089c7074 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:31.271946 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2262/4428] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:31 2022] GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:31.274718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-090cbc65-bc4f-46aa-b490-3ad8089c7074 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.282739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-090cbc65-bc4f-46aa-b490-3ad8089c7074 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:31.410967 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-090cbc65-bc4f-46aa-b490-3ad8089c7074 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157180 Jun 16 18:51:31.412182 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2167/4429] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:51:31 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:51:31.515701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:31.516414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:31.524491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.525573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:31.526423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.526976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:31.963977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f2ba1b63-abc2-417c-bb57-109e3702bc23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:31.966287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f2ba1b63-abc2-417c-bb57-109e3702bc23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:31.979441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2ba1b63-abc2-417c-bb57-109e3702bc23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.979904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2ba1b63-abc2-417c-bb57-109e3702bc23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:31.980693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2ba1b63-abc2-417c-bb57-109e3702bc23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:31.982489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2ba1b63-abc2-417c-bb57-109e3702bc23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:32.007084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:32.044814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:32.059766 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e41507b1-5038-4a89-b56f-a787272c832e tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1315 microversion: 2.1 time: 0.543040 Jun 16 18:51:32.061412 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2263/4430] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:31 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:32.062252 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f2ba1b63-abc2-417c-bb57-109e3702bc23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action" status: 200 len: 8154 microversion: 2.1 time: 0.100094 Jun 16 18:51:32.063362 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2168/4431] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:31 2022] POST /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e/action => generated 8154 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:32.074511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:32.075531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:32.084003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:32.084740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:32.087264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:32.087713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:32.288074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:32.296993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:32.316554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:32.317014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:32.320560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:32.321102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:32.608291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:32.635592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:32.637351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fb15f393-1d31-452a-a4e8-0f5a121a3f00 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 200 len: 1216 microversion: 2.1 time: 0.354297 Jun 16 18:51:32.640517 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2169/4432] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:32 2022] GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 1216 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:32.651709 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc4eb36c-96d0-437d-84d8-99c95bf250c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.583085 Jun 16 18:51:32.654078 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2264/4433] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:32 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:32.686853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:32.687224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:32.707784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:32.709320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:32.710195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:32.711769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.042680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:33.068618 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32f1c31a-8f12-43df-9cb2-81d80dfaa466 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.385089 Jun 16 18:51:33.070525 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2170/4434] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:32 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:33.087315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:33.090344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:33.094959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:33.100781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:33.110194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.113940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.114976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.115585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.118407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.119208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.123569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.124230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.605491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:33.613869 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34223cbb-7778-47ca-9d5e-9215706b27e0 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1504 microversion: 2.1 time: 0.533609 Jun 16 18:51:33.619981 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2265/4435] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:33 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:33.637649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1230b43f-fc35-434b-a8f7-c60a9958be27 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:33.638281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1230b43f-fc35-434b-a8f7-c60a9958be27 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:33.650565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1230b43f-fc35-434b-a8f7-c60a9958be27 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.651027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1230b43f-fc35-434b-a8f7-c60a9958be27 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.651831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1230b43f-fc35-434b-a8f7-c60a9958be27 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.652272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1230b43f-fc35-434b-a8f7-c60a9958be27 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.707864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:33.718360 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd4c75c6-737c-4ab3-bee2-9facd109c94d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.632717 Jun 16 18:51:33.736179 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2171/4436] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:33 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:33.737299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:33.740319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:33.753651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.754143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.754938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.755590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.758292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:33.800871 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1230b43f-fc35-434b-a8f7-c60a9958be27 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.167625 Jun 16 18:51:33.812048 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2266/4437] 10.222.0.27 () {58 vars in 1295 bytes} [Thu Jun 16 18:51:33 2022] DELETE /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24/os-server-password => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:51:33.819259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:33.820294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:33.832648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.834118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.837398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.846480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.919166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:33.930625 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0db29645-320d-4218-a2bb-d98ddefee529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 200 len: 1218 microversion: 2.1 time: 0.202458 Jun 16 18:51:33.941522 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2172/4438] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:33 2022] GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:33.947790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc9aab3c-d497-4c52-9d73-d89d49f9091a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:33.948377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc9aab3c-d497-4c52-9d73-d89d49f9091a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:33.955268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc9aab3c-d497-4c52-9d73-d89d49f9091a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.956062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc9aab3c-d497-4c52-9d73-d89d49f9091a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:33.956836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc9aab3c-d497-4c52-9d73-d89d49f9091a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:33.957265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc9aab3c-d497-4c52-9d73-d89d49f9091a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.004243 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc9aab3c-d497-4c52-9d73-d89d49f9091a tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.060691 Jun 16 18:51:34.006096 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2173/4439] 10.222.0.27 () {58 vars in 1292 bytes} [Thu Jun 16 18:51:33 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24/os-server-password => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:51:34.015518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:34.016272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:34.022830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.024087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.025086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.025727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.056199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:51:34.127775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:34.147702 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c0bd6b9-8f8b-433f-9951-b11846fadedd tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.331191 Jun 16 18:51:34.150956 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2267/4440] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:33 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:34.182060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9b4a274e-3b72-4029-81a0-ae250f0bd1f5 req-db5d17d2-cbd5-4963-9cf9-e4d2dbd76d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37", "tag": "1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:34.194394 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-34b695ac-4653-43fd-b122-2d4264a54310 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 204 len: 0 microversion: 2.1 time: 0.182798 Jun 16 18:51:34.195678 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2174/4441] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:51:34 2022] DELETE /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:51:34.214148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9b4a274e-3b72-4029-81a0-ae250f0bd1f5 req-db5d17d2-cbd5-4963-9cf9-e4d2dbd76d03 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.214607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9b4a274e-3b72-4029-81a0-ae250f0bd1f5 req-db5d17d2-cbd5-4963-9cf9-e4d2dbd76d03 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.215856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:34.217414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:34.239990 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9b4a274e-3b72-4029-81a0-ae250f0bd1f5 req-db5d17d2-cbd5-4963-9cf9-e4d2dbd76d03 service nova] Creating event network-changed:1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49 for instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 on n-h2-846209-2 Jun 16 18:51:34.246639 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9b4a274e-3b72-4029-81a0-ae250f0bd1f5 req-db5d17d2-cbd5-4963-9cf9-e4d2dbd76d03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074409 Jun 16 18:51:34.247192 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2268/4442] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:34.252270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:34.252995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:34.264111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.264929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.266017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.266481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.266908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.267281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.267726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.267850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.331229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Locking {{(pid=119207) lock /opt/stack/nova/nova/compute/api.py:4700}} Jun 16 18:51:34.466205 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8f431767-a2c8-4abb-b1a5-625adabd615d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.267796 Jun 16 18:51:34.467637 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2175/4443] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:34 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:34.476612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:34.483063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:34.500373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.501361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.507349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.508999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.520259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:34.530754 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b1668743-21ca-4426-9429-de4e40ee81de tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1510 microversion: 2.1 time: 0.282323 Jun 16 18:51:34.531894 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2269/4444] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:34 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:34.702377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:34.711209 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17a649e0-ac72-4ae5-bfbb-ce9ec14f3bea tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.238340 Jun 16 18:51:34.722561 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2176/4445] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:34 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:34.728893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1456f97a-f481-4833-8269-9e7e9e09f949 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:34.735231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1456f97a-f481-4833-8269-9e7e9e09f949 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.735909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1456f97a-f481-4833-8269-9e7e9e09f949 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.766612 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1456f97a-f481-4833-8269-9e7e9e09f949 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] HTTP exception thrown: Instance d69cc468-c538-4554-8a3d-5ea10facc4d7 is locked Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1456f97a-f481-4833-8269-9e7e9e09f949 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Request method failure captured: Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action HTTP/1.1 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 15 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qQdnkg9my-1t7iorxlTdvAY7JoLX7pzKEeYb_M4KpJv--YSljcRPZ5tsuFxEn56Z9mV9LJEDpP7D3JgeEQwWwZA1r9aEbrhkYX9fOrKSTVKDKB6sFrCRqfMzr4ToDxrWC-vFVylVDVvwopGS-5VathrmG6eJr57nXSFKQ4AXQnExU Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e0ae0d9516c431f85b29c11cffea558", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-458867450 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0bad5f4aa84e4b978a5a92478b6772bf Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: {"os-stop": {}} Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance d69cc468-c538-4554-8a3d-5ea10facc4d7 is locked Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'd69cc468-c538-4554-8a3d-5ea10facc4d7', 'body': {'os-stop': {}}} Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance d69cc468-c538-4554-8a3d-5ea10facc4d7 is locked Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance d69cc468-c538-4554-8a3d-5ea10facc4d7 is locked Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69cc468-c538-4554-8a3d-5ea10facc4d7 is locked Jun 16 18:51:34.768496 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.774580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1456f97a-f481-4833-8269-9e7e9e09f949 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Returning 409 to user: Instance d69cc468-c538-4554-8a3d-5ea10facc4d7 is locked {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:51:34.775953 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1456f97a-f481-4833-8269-9e7e9e09f949 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 409 len: 107 microversion: 2.1 time: 0.052063 Jun 16 18:51:34.780221 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2270/4446] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:34 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 107 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:51:34.786732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:34.787407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:34.794298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.794752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.795528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.796147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.841415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Unlocking {{(pid=119207) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 16 18:51:34.892902 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b0996dd-6a9f-4dac-ae35-633f6d4925fa tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.110514 Jun 16 18:51:34.896553 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2177/4447] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:34 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:34.902176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48661278-a6de-466d-8447-f2da05f1e8d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:34.909058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48661278-a6de-466d-8447-f2da05f1e8d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.909512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48661278-a6de-466d-8447-f2da05f1e8d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.934602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-48661278-a6de-466d-8447-f2da05f1e8d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Going to try to stop instance {{(pid=119206) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:51:34.949513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:34.950200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:34.956644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.957841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.958872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:34.959596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:34.981694 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb HTTP/1.1 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'b02c998a-da4a-4054-9753-7c0df81950eb'} Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:34.983754 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cdb02927-7903-4f81-8307-6e83cc2935fc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 404 len: 111 microversion: 2.1 time: 0.040819 Jun 16 18:51:34.989350 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2178/4448] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:34 2022] GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:51:34.996830 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48661278-a6de-466d-8447-f2da05f1e8d8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.098626 Jun 16 18:51:34.997740 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2271/4449] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:34 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:35.005879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:35.006634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:35.015435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:35.015979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:35.016825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:35.017325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:35.046579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:35.128604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-24710943", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6b5d8611-2f93-4d68-b741-180fc0d2bfa6"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:35.212564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:35.214277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] validate_networks() for [('6b5d8611-2f93-4d68-b741-180fc0d2bfa6', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:51:35.222166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c1912dc1-cc65-47b7-aafa-87a78c5bdb0a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.220558 Jun 16 18:51:35.222749 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2179/4450] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:35 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:35.522743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-80d3f37e-5083-41d8-8a3c-c2ee038e7dcd tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866e16e1f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:35.627769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-80d3f37e-5083-41d8-8a3c-c2ee038e7dcd tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/80e33dcc-7be9-4c43-9835-b656786cf725" status: 200 len: 351 microversion: 2.1 time: 0.111420 Jun 16 18:51:35.637050 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2180/4451] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:51:35 2022] GET /compute/v2.1/os-volumes/80e33dcc-7be9-4c43-9835-b656786cf725 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:35.644344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:35.647891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:35.661237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:35.681429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:35.688029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:35.690618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:36.062294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:36.077461 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-238704e0-c05e-4aba-8c9f-36424ceefbec tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1510 microversion: 2.1 time: 0.437978 Jun 16 18:51:36.079550 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2181/4452] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:35 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:36.252454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:36.253979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:36.270919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:36.271510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:36.273851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:36.274702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:36.286605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:51:36.287383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:51:36.288364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:51:36.289784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:51:36.290647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:51:36.308819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:36.309585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:36.315482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:36.316026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:36.338114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:51:36.344663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for user c60f8f3909974479836ac8b0363b9a08 and project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:51:36.349188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:36.360736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:51:36.363621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:51:36.425700 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d9fd81a-8fef-474d-8e79-df34058d9b3d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306460 Jun 16 18:51:36.432770 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2272/4453] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:51:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:51:36.438517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-828d330a-19cd-45f3-9921-b2689d3bbba3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:36.439479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-828d330a-19cd-45f3-9921-b2689d3bbba3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:36.459454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:36.469191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3c8ba8e-1f53-4cf7-953d-ef873a2af5b1 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.229967 Jun 16 18:51:36.470000 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2182/4454] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:36 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:36.549351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-828d330a-19cd-45f3-9921-b2689d3bbba3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:36.559351 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-828d330a-19cd-45f3-9921-b2689d3bbba3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1213 microversion: 2.1 time: 0.124968 Jun 16 18:51:36.569808 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2273/4455] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:36 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:36.821977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1c0687fe-8557-48ec-b880-caa737acf7ae req-9b33d335-7676-4906-8c80-f12050a32e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77241925-0dc8-4e7c-bbbb-7dc1ad404a24", "name": "network-vif-deleted", "tag": "3191ef76-7641-431e-bcf9-d8c7d50ac632"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:36.834117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1c0687fe-8557-48ec-b880-caa737acf7ae req-9b33d335-7676-4906-8c80-f12050a32e38 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:36.840018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1c0687fe-8557-48ec-b880-caa737acf7ae req-9b33d335-7676-4906-8c80-f12050a32e38 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:36.865309 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1c0687fe-8557-48ec-b880-caa737acf7ae req-9b33d335-7676-4906-8c80-f12050a32e38 service nova] Creating event network-vif-deleted:3191ef76-7641-431e-bcf9-d8c7d50ac632 for instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 on n-h2-846209-2 Jun 16 18:51:36.874300 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1c0687fe-8557-48ec-b880-caa737acf7ae req-9b33d335-7676-4906-8c80-f12050a32e38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056926 Jun 16 18:51:36.879226 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2183/4456] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:37.097599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:37.098258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:37.116611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:37.118875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:37.120140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:37.122814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:37.182359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:37.183070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:37.183764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lazy-loading 'fault' on Instance uuid 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:51:37.239181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3816474bdd4b09a33af1aad8dabdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921a2e6f0170439ba37ea9c9a1b02d88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:37.249790 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aae0d3f6-1324-479a-baa2-5b78c93f77e3 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 200 len: 1305 microversion: 2.1 time: 0.157034 Jun 16 18:51:37.250773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2274/4457] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:37 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 1305 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:37.491793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:37.492804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:37.499268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:37.499721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:37.500483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:37.500911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:37.577941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:37.579143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:37.590298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:37.590754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:37.591989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:37.592447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:37.694186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:37.701826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:37.703793 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9a943d15-aafc-4d5d-850d-246b06153430 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1265 microversion: 2.1 time: 0.130271 Jun 16 18:51:37.716104 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2275/4458] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:37 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:37.716312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a6be3c7d-e77d-4656-b386-40e162cbda93 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.229083 Jun 16 18:51:37.718170 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2184/4459] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:37 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:38.214730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8aa77e4-8d61-4c15-8fc8-9fd6aab7de9b tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866f4dc820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:38.268518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e8aa77e4-8d61-4c15-8fc8-9fd6aab7de9b tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ded6c24b-4d24-42a3-b2f6-441f6a1484a5" status: 200 len: 351 microversion: 2.1 time: 0.057868 Jun 16 18:51:38.268836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:38.275354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] [instance: 77241925-0dc8-4e7c-bbbb-7dc1ad404a24] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:38.275540 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2276/4460] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:51:38 2022] GET /compute/v2.1/os-volumes/ded6c24b-4d24-42a3-b2f6-441f6a1484a5 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:38.278788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:38.279539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:38.280531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:38.282959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:38.300252 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] HTTP exception thrown: Instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 could not be found. Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Request method failure captured: Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 HTTP/1.1 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3ufTGyjDBxZgdIYigAuplFdXTadyDiT5muP05UJAjWpgKFgyRDm7ohwZ1Ec8wNd4dJrHK9hxmz1ajOzVb3mMDSLrGu_XPqs1jg9A-FL3zJhB-vdUNlVfOypsElrHt6EPVCDZuYA49w0_W9BpkFZr3r3NfUTos-zXvNmb_dxXM5QK6I Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 921a2e6f0170439ba37ea9c9a1b02d88 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerPasswordTestJSON-1902269702 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/921a2e6f0170439ba37ea9c9a1b02d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/921a2e6f0170439ba37ea9c9a1b02d88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_921a2e6f0170439ba37ea9c9a1b02d88", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/921a2e6f0170439ba37ea9c9a1b02d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerPasswordTestJSON-1902269702 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 921a2e6f0170439ba37ea9c9a1b02d88 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1902269702 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerPasswordTestJSON-1902269702-project Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: df3816474bdd4b09a33af1aad8dabdb7 Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerPasswordTestJSON-1902269702-project Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 could not be found. Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '77241925-0dc8-4e7c-bbbb-7dc1ad404a24'} Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 could not be found. Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 could not be found. Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:51:38.302670 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:38.308366 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:51:38.308366 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:51:38.308366 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:51:38.308366 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:51:38.308366 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:51:38.308366 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 could not be found. Jun 16 18:51:38.308366 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:51:38.310151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] Returning 404 to user: Instance 77241925-0dc8-4e7c-bbbb-7dc1ad404a24 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:51:38.311339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ee37a11-3764-4a96-9bd2-76ed58d3c3b2 tempest-ServerPasswordTestJSON-1902269702 tempest-ServerPasswordTestJSON-1902269702-project] 10.222.0.27 "GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24" status: 404 len: 111 microversion: 2.1 time: 0.047134 Jun 16 18:51:38.312485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2185/4461] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:38 2022] GET /compute/v2.1/servers/77241925-0dc8-4e7c-bbbb-7dc1ad404a24 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:51:38.728476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:38.729682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:38.736240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:38.737406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:38.766501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:38.766957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:38.767759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:38.771959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:38.775173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:38.775639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:38.780051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:38.781429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:39.269870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:39.277804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:39.281728 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92920d7e-b038-4a21-9cd6-e9449e4d40ea tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.562872 Jun 16 18:51:39.291137 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-20602200-82b7-4d6b-a549-51c10311b604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.558852 Jun 16 18:51:39.292328 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2186/4462] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:38 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:39.293985 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2277/4463] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:38 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:40.299779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:40.300407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:40.309507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:40.310858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:40.314250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:40.321106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:40.321885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:40.323046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:40.323727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:40.329338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:40.329855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:40.361065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:40.364665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:40.895459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:40.899742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:40.911574 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c412e84b-3632-48d5-872c-15ba76929803 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.615697 Jun 16 18:51:40.912895 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2187/4464] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:40 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:40.913121 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c870e519-67af-4048-91f0-26ec70886ed2 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.607831 Jun 16 18:51:40.920503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-82985b7b-290d-436a-8ff4-1ab7343ca79c tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866da29ee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:40.926323 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2278/4465] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:40 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:40.989355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8fca7127-6fcd-4fd1-bcde-57d72585c4e7 req-669c2063-b3e6-41eb-87bb-6f6f4682add9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9588bd87-0952-4881-9dad-e45bd98fab29", "tag": "0bd933e5-fca8-4f34-9b3f-d6c43e0718e5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:41.002326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8fca7127-6fcd-4fd1-bcde-57d72585c4e7 req-669c2063-b3e6-41eb-87bb-6f6f4682add9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:41.003121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8fca7127-6fcd-4fd1-bcde-57d72585c4e7 req-669c2063-b3e6-41eb-87bb-6f6f4682add9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:41.023862 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-82985b7b-290d-436a-8ff4-1ab7343ca79c tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0a04d133-a575-4b2d-869c-d1fb5cd67acb" status: 200 len: 351 microversion: 2.1 time: 0.108768 Jun 16 18:51:41.027324 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8fca7127-6fcd-4fd1-bcde-57d72585c4e7 req-669c2063-b3e6-41eb-87bb-6f6f4682add9 service nova] Creating event network-changed:0bd933e5-fca8-4f34-9b3f-d6c43e0718e5 for instance 9588bd87-0952-4881-9dad-e45bd98fab29 on n-h1-846209-2 Jun 16 18:51:41.031039 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2188/4466] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:51:40 2022] GET /compute/v2.1/os-volumes/0a04d133-a575-4b2d-869c-d1fb5cd67acb => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:41.035401 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8fca7127-6fcd-4fd1-bcde-57d72585c4e7 req-669c2063-b3e6-41eb-87bb-6f6f4682add9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049828 Jun 16 18:51:41.036329 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2279/4467] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:41.042911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2227c6a9-8080-458d-8ffa-57d2be46d6ff tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866d9bee50>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.165638 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2227c6a9-8080-458d-8ffa-57d2be46d6ff tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.127595 Jun 16 18:51:41.177981 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2189/4468] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jun 16 18:51:41 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:41.191466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a208a7e8-44b5-42c1-b756-505d37f3bf73 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866eac1c10>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.412989 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a208a7e8-44b5-42c1-b756-505d37f3bf73 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.229675 Jun 16 18:51:41.416256 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2280/4469] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jun 16 18:51:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:41.443650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6e780008-8399-4fe3-8d86-c94374bdb5da tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866d9e3ee0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.634828 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6e780008-8399-4fe3-8d86-c94374bdb5da tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.201774 Jun 16 18:51:41.640124 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2190/4470] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jun 16 18:51:41 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:41.653643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2392b01e-f542-4502-8c61-2dc508064378 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866f4dca60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.760694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2392b01e-f542-4502-8c61-2dc508064378 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.111110 Jun 16 18:51:41.761279 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2281/4471] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jun 16 18:51:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:41.774211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfb8122e-c12d-4147-acca-68cd99c00666 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866d9be040>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.871709 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bfb8122e-c12d-4147-acca-68cd99c00666 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101901 Jun 16 18:51:41.874294 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2191/4472] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jun 16 18:51:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:41.888654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f80b9a2a-f9d7-4eb5-a214-d7d1a02e3b67 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f867805f820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.931982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.932736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:41.943960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:41.945411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:41.947134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:41.947846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:41.996078 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f80b9a2a-f9d7-4eb5-a214-d7d1a02e3b67 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.112245 Jun 16 18:51:41.997128 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2282/4473] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:51:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:42.255509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:42.268920 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8f243d8-8348-4f8f-aa05-3977444d4259 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.342644 Jun 16 18:51:42.269989 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2192/4474] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:41 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:42.289174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2108784b-93e7-4124-85b0-e30a34e6672e tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866d9beca0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:42.425393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:42.428630 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2108784b-93e7-4124-85b0-e30a34e6672e tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.146018 Jun 16 18:51:42.429803 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2193/4475] 10.222.0.27 () {58 vars in 1187 bytes} [Thu Jun 16 18:51:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:42.430117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:42.442244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-120a7fd6-703b-48b4-902f-0ad2a47fde48 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] Calling method '.version_select at 0x7f866db2d9d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:42.454141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:42.454621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:42.458216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:42.462073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:42.542122 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-120a7fd6-703b-48b4-902f-0ad2a47fde48 tempest-VolumesTestJSON-453733737 tempest-VolumesTestJSON-453733737-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.104409 Jun 16 18:51:42.544032 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2194/4476] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 18:51:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:42.712376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:42.720608 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-034f8a20-e802-4a20-81f6-cc7c00db71da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.715803 Jun 16 18:51:42.727061 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2283/4477] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:42 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:43.289036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:43.289660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:43.306249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:43.306714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:43.307785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:43.307981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:43.677430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:43.687783 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9164a50-d5ae-44c6-ab07-e6fad4c19fba tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.402731 Jun 16 18:51:43.688961 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2195/4478] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:43 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:43.742647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:43.744127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:43.754727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:43.756396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:43.758036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:43.760096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:44.053073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:44.063484 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6dc3a795-b0b6-4448-8717-55d0dd2bdda5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.329301 Jun 16 18:51:44.065601 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2284/4479] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:43 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:44.717213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:44.717839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:44.736270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:44.736974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:44.738073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:44.738662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:45.088335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:45.089058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:45.091043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:45.100431 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0306ae7f-51ad-4d8d-a778-487655b0d406 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.390985 Jun 16 18:51:45.110036 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2196/4480] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:44 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:45.110411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:45.110411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:45.110411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:45.110411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:45.289867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:45.298911 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b4cbede-9598-4665-b3c2-8c38ba10cb94 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.216307 Jun 16 18:51:45.299615 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2285/4481] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:45 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:46.121063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:46.122547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:46.130395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:46.130860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:46.131677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:46.132145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:46.320746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:46.322031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:46.330868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:46.337608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:46.339339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:46.341382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:46.341999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:46.559165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=14 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:46.629760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:46.637782 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b7086090-5a86-4a42-9db2-ca2efa1570f0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.522179 Jun 16 18:51:46.642097 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2197/4482] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:46 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:46.721338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:46.732072 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ffdc5f5c-dae0-4c0b-90fb-9617b9bbf864 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1656 microversion: 2.1 time: 0.419324 Jun 16 18:51:46.742274 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2286/4483] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:46 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1656 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:46.752919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0e16fa2-d010-4e63-92b0-abed3cd45f29 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:46.761090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0e16fa2-d010-4e63-92b0-abed3cd45f29 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:46.761547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0e16fa2-d010-4e63-92b0-abed3cd45f29 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:46.826375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a0e16fa2-d010-4e63-92b0-abed3cd45f29 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Going to try to start instance {{(pid=119207) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:51:46.913018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a0e16fa2-d010-4e63-92b0-abed3cd45f29 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.164031 Jun 16 18:51:46.917096 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2198/4484] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:46 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:46.926074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:46.927046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:46.946982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:46.947760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:46.962593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:46.963753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:47.212302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:47.224131 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-065d721a-58a0-482f-91eb-1bd65f3fc3ae tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1665 microversion: 2.1 time: 0.303507 Jun 16 18:51:47.225890 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2287/4485] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:46 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1665 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:47.667984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:47.669537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:47.688528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:47.689416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:47.690472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:47.691272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:47.939372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:47.953442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e25c1404-663f-4f14-83d3-976f4bd87e35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.293938 Jun 16 18:51:47.956634 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2199/4486] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:47 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:48.245705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:48.246416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:48.263824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:48.265901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:48.267809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:48.271405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:48.796589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-01c2378c-6c66-4d4e-95fd-85e674c0bb1e req-4b74d1e4-8618-4279-8c27-f080037d5187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9588bd87-0952-4881-9dad-e45bd98fab29", "name": "network-vif-plugged", "status": "completed", "tag": "0bd933e5-fca8-4f34-9b3f-d6c43e0718e5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:48.815532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-01c2378c-6c66-4d4e-95fd-85e674c0bb1e req-4b74d1e4-8618-4279-8c27-f080037d5187 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:48.816278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-01c2378c-6c66-4d4e-95fd-85e674c0bb1e req-4b74d1e4-8618-4279-8c27-f080037d5187 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:48.833816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-01c2378c-6c66-4d4e-95fd-85e674c0bb1e req-4b74d1e4-8618-4279-8c27-f080037d5187 service nova] Creating event network-vif-plugged:0bd933e5-fca8-4f34-9b3f-d6c43e0718e5 for instance 9588bd87-0952-4881-9dad-e45bd98fab29 on n-h1-846209-2 Jun 16 18:51:48.865464 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-01c2378c-6c66-4d4e-95fd-85e674c0bb1e req-4b74d1e4-8618-4279-8c27-f080037d5187 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072628 Jun 16 18:51:48.869858 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2200/4487] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:51:48.893523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:48.908008 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0e18014-14de-4d58-98d5-291c5485dbed tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1665 microversion: 2.1 time: 0.668641 Jun 16 18:51:48.911545 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2288/4488] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:48 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1665 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:48.975800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:48.979138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:49.003181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:49.003181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:49.003915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:49.004358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:49.286403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:49.294632 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d0f07237-7bbb-405a-a2d6-634daeeb3bf8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.326500 Jun 16 18:51:49.307291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2201/4489] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:48 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:49.933519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:49.934806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:49.948206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:49.948869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:49.950417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:49.952231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:49.983741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:50.206373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:50.217508 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9245ed2-639b-4b54-b9d4-b5a6e18a8fd6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.288403 Jun 16 18:51:50.219149 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2289/4490] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:49 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:50.235758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:50.236661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:50.249978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:50.253154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:50.254456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:50.264237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:50.315591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:50.316443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:50.324245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:50.324954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:50.325999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:50.326609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:50.694132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:50.709616 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d9c23ec9-cf88-4465-a159-ac9c47226d23 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1313 microversion: 2.1 time: 0.399257 Jun 16 18:51:50.735740 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2290/4491] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:50 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:50.786405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:50.802141 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-85e34469-b517-4ce1-a043-9de4df960d28 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.565430 Jun 16 18:51:50.803570 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2202/4492] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:50 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:50.829426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:50.830021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:50.837962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:50.838532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:50.839332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:50.839773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:50.900726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Unlocking {{(pid=119206) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 16 18:51:51.004533 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a99de3c8-9d87-4484-b395-2661cc157962 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.179099 Jun 16 18:51:51.010583 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2291/4493] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:50 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:51.016577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:51.017436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:51.035374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.035828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.036625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.037061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.249086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:51.260069 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e158f84d-ea99-43d4-a230-a769fabd6535 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.248332 Jun 16 18:51:51.261556 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2203/4494] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:51 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:51.277345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:51.278356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:51.286816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.287564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.288685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.289385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.466302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:51.478704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ffe54071-ac95-4741-a20c-29170913f181 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.205148 Jun 16 18:51:51.486483 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2292/4495] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:51 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:51.496833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:51.497706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:51.505043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.505706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.507196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.508096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.514361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:51.691811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:51.706107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9e14eae5-a98e-452e-b204-ca697924b3af tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.212742 Jun 16 18:51:51.717505 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2204/4496] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:51 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:51.723949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0a7d62b-419a-4511-a83a-12de05b2e178 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:51.724495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0a7d62b-419a-4511-a83a-12de05b2e178 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:51.732122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a7d62b-419a-4511-a83a-12de05b2e178 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.732577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a7d62b-419a-4511-a83a-12de05b2e178 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.733366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a7d62b-419a-4511-a83a-12de05b2e178 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.733805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0a7d62b-419a-4511-a83a-12de05b2e178 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.745389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:51.746048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:51.755871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.756330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.763546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.763898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.861415 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0a7d62b-419a-4511-a83a-12de05b2e178 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.142116 Jun 16 18:51:51.870026 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2293/4497] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:51 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:51.886510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:51.887111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:51.915965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.931314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:51.932490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:51.933111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:52.062757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:52.079602 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5a6a8cd-7bb8-4cdd-96a0-cff9a45b27c6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1497 microversion: 2.1 time: 0.337266 Jun 16 18:51:52.080531 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2205/4498] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:51 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1497 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:52.099906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f839922e-aed4-4258-a34e-8737417d1e78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:52.101267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f839922e-aed4-4258-a34e-8737417d1e78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:52.111803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f839922e-aed4-4258-a34e-8737417d1e78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:52.116081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f839922e-aed4-4258-a34e-8737417d1e78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:52.118009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f839922e-aed4-4258-a34e-8737417d1e78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:52.118762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f839922e-aed4-4258-a34e-8737417d1e78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:52.305837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:52.315998 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f839922e-aed4-4258-a34e-8737417d1e78 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29/action" status: 202 len: 0 microversion: 2.1 time: 0.220853 Jun 16 18:51:52.320703 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2206/4499] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:52 2022] POST /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:51:52.321338 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6ee36e1-78c8-427f-831a-1c6c7e4ea739 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1674 microversion: 2.1 time: 0.446869 Jun 16 18:51:52.341933 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2294/4500] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:51 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1674 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:52.342572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:52.347264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:52.364504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:52.366991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:52.367654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:52.368704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:52.369290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:52.598498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:52.614709 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ef25ca11-6b87-4407-8e8e-fe17b2ab97c5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1502 microversion: 2.1 time: 0.281758 Jun 16 18:51:52.617209 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2207/4501] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:52 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:53.339465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:53.340090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:53.362085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.362902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.363900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.364590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.625409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:53.634732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:53.636080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:53.641340 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19276c62-1b35-4ff0-8bcb-299ec8e3c1a8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1654 microversion: 2.1 time: 0.307090 Jun 16 18:51:53.642914 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2295/4502] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:53 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1654 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:53.653779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.654804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.655810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.656414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.662864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-10d829e9-5707-4b9b-bde8-345cad423570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:53.666630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-10d829e9-5707-4b9b-bde8-345cad423570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:53.676825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10d829e9-5707-4b9b-bde8-345cad423570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.677300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10d829e9-5707-4b9b-bde8-345cad423570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.678203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10d829e9-5707-4b9b-bde8-345cad423570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.679318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10d829e9-5707-4b9b-bde8-345cad423570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.834020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-10d829e9-5707-4b9b-bde8-345cad423570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.176708 Jun 16 18:51:53.856227 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2296/4503] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:51:53 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:53.868696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:53.889964 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c6f26ef-0c78-485b-9d6a-a20b989d025a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1482 microversion: 2.1 time: 0.260622 Jun 16 18:51:53.891491 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2208/4504] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:53 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1482 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:53.904128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:53.905175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:53.917940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:53.918991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:53.930227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.932183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.933543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.934376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.935692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.936013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:53.937820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:53.938364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:54.018335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:51:54.219030 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-968a548d-5f8b-4dfb-b782-b21b271b9d39 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 204 len: 0 microversion: 2.1 time: 0.309441 Jun 16 18:51:54.222514 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2209/4505] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:51:53 2022] DELETE /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:51:54.231101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:54.239090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:54.239529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:54.243994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dd69d0d0-b531-4197-bedf-a7447fea8982 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1661 microversion: 2.1 time: 0.383588 Jun 16 18:51:54.246457 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2297/4506] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:53 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1661 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:54.267902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:54.268372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:54.271776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:54.273789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:54.670827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:54.689746 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a6bedf77-fcd3-4209-ab27-5b45ec175f5b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1488 microversion: 2.1 time: 0.460759 Jun 16 18:51:54.690968 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2210/4507] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:54 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1488 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:55.130843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1441236180", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:55.203980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] validate_networks() for [('983e0f98-4284-4e54-9a92-e530e186e60f', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:51:55.264818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:55.266310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:55.277148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:55.277983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:55.279085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:55.279715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:55.673049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:55.684904 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b525d6ea-ea61-40bd-923d-bee777da7a35 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.426611 Jun 16 18:51:55.695325 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2211/4508] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:55 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:55.702994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:55.703975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:55.711459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:55.712269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:55.713275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:55.713996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.049369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:56.063502 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3aa8633b-eb2f-417a-89f3-54541a31567e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.364235 Jun 16 18:51:56.068155 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2212/4509] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:55 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:56.092660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:56.093304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:56.113430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.114348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.115371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.115978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.301671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:51:56.302443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:51:56.302606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:51:56.303232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:51:56.303716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:51:56.323345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.324895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.325795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.326294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.384057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Getting quotas for project 645f9222653e4006ae6a399accb03d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:51:56.395515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Getting quotas for user ab06bc595cae4bcda2b784e4e0b2644c and project 645f9222653e4006ae6a399accb03d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:51:56.421544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:51:56.425245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:51:56.446250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:56.458039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7a7346ea-fa9e-4537-a1b6-5381d9d06af2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1488 microversion: 2.1 time: 0.388672 Jun 16 18:51:56.470265 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2213/4510] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:56 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1488 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:56.489076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:56.491970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:56.498114 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d9baaf7-b929-4b96-916f-f7c9cd19a825 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.761684 Jun 16 18:51:56.499032 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2298/4511] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:51:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:51:56.514281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.515381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b3a4954-98e6-4779-9713-d0b67dfebfd2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:56.515632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.516933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b3a4954-98e6-4779-9713-d0b67dfebfd2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:56.517269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.517857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.645137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b3a4954-98e6-4779-9713-d0b67dfebfd2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:56.657834 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b3a4954-98e6-4779-9713-d0b67dfebfd2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1214 microversion: 2.1 time: 0.151455 Jun 16 18:51:56.672982 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2299/4512] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:56 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:56.919775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:56.932898 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b38305a2-45bc-4814-923e-147fea65f317 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.460917 Jun 16 18:51:56.936614 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2214/4513] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:56 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:56.959343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:56.959343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:56.964448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:56.965504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:56.982754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.986326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.987521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.990638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:56.995076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:56.998535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.003459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.006360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.204168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lazy-loading 'services' on Instance uuid 40e7cff4-9488-49aa-b529-00d7ad69b2c7 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:51:57.324518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-34ed77c9-ccc6-43e7-965d-c29495aa657b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-volume_attachments/ad044d62-61a3-478e-940e-cbef31946e73" status: 202 len: 0 microversion: 2.1 time: 0.377115 Jun 16 18:51:57.327595 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2300/4514] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:51:56 2022] DELETE /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-volume_attachments/ad044d62-61a3-478e-940e-cbef31946e73 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:51:57.462939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e320343e-96c6-4f54-b60d-d8250f1ea050 req-b865f439-11c4-4ad1-be1a-6d82b2e3f045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9588bd87-0952-4881-9dad-e45bd98fab29", "name": "network-vif-deleted", "tag": "0bd933e5-fca8-4f34-9b3f-d6c43e0718e5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:57.480337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e320343e-96c6-4f54-b60d-d8250f1ea050 req-b865f439-11c4-4ad1-be1a-6d82b2e3f045 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.480688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e320343e-96c6-4f54-b60d-d8250f1ea050 req-b865f439-11c4-4ad1-be1a-6d82b2e3f045 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.521414 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e320343e-96c6-4f54-b60d-d8250f1ea050 req-b865f439-11c4-4ad1-be1a-6d82b2e3f045 service nova] Creating event network-vif-deleted:0bd933e5-fca8-4f34-9b3f-d6c43e0718e5 for instance 9588bd87-0952-4881-9dad-e45bd98fab29 on n-h1-846209-2 Jun 16 18:51:57.534955 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e320343e-96c6-4f54-b60d-d8250f1ea050 req-b865f439-11c4-4ad1-be1a-6d82b2e3f045 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078263 Jun 16 18:51:57.537111 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2301/4515] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:51:57.564538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:57.570741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:57.581067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.582239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.593579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.594385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.867479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:57.884810 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-791ec626-252c-47f7-8bc3-1c23e1028c20 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1283 microversion: 2.1 time: 0.340832 Jun 16 18:51:57.885473 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2302/4516] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:57 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1283 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:57.899507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:57.900374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:57.903396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:57.914102 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78ee0cda-3161-4339-a417-db4d39a4d21f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.964279 Jun 16 18:51:57.923413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.925730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.927287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.927560 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2215/4517] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:56 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:57.929824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.939986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:57.940895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:57.977169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.980870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:57.984254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:57.987551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:58.052034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:58.197076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:58.211430 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f5b8de04-71d7-47e0-8b84-29a277cb8666 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1266 microversion: 2.1 time: 0.321398 Jun 16 18:51:58.227666 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2303/4518] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:57 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:58.383273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:58.400055 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a393e684-7069-4b9a-bf7b-9ddb81684584 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.464612 Jun 16 18:51:58.413772 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2216/4519] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:57 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:58.422013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:58.425901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:58.457507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:58.458307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:58.459565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:58.462578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:58.903122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:58.904207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:58.925575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:58.926191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:58.927636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:58.932114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:58.933984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:58.952825 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b6e94c89-d5a9-4ad1-9aa5-0c4ace5ce877 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.536055 Jun 16 18:51:58.961826 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2304/4520] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:58 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:59.021179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:59.023818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:59.024206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lazy-loading 'fault' on Instance uuid 9588bd87-0952-4881-9dad-e45bd98fab29 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:51:59.193040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:59.202160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:59.212774 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e8d80e8-d6ea-45b5-ba55-14b0b1bc116d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 200 len: 1303 microversion: 2.1 time: 0.310270 Jun 16 18:51:59.224977 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2217/4521] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:58 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 1303 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:59.246653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:59.247741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:51:59.278943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:59.280528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:59.282872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:51:59.290707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:51:59.527727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:51:59.537513 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1840c36-a95d-46b1-99e4-afc2b8a0a984 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1272 microversion: 2.1 time: 0.299162 Jun 16 18:51:59.538538 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2305/4522] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:51:59 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1272 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:00.236760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:00.237401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:00.249421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:00.250477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:00.252005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:00.252905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:00.288363 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 HTTP/1.1 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '9588bd87-0952-4881-9dad-e45bd98fab29'} Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:00.290994 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:00.295252 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:00.295252 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:00.295252 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:00.295252 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:00.295252 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:00.295252 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:52:00.295252 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:00.298040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:00.299143 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-81f6d1b2-948f-474d-94f1-e961757c6bf7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 404 len: 111 microversion: 2.1 time: 0.071102 Jun 16 18:52:00.317814 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2218/4523] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:00 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:52:00.520546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2026135039", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6b5d8611-2f93-4d68-b741-180fc0d2bfa6"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:00.555252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:00.556378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:00.577474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:00.578294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:00.580488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:00.581097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:00.676722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] validate_networks() for [('6b5d8611-2f93-4d68-b741-180fc0d2bfa6', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:52:01.274863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:01.292094 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e2818748-3a3e-4b2e-9f8f-15d722c26512 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1314 microversion: 2.1 time: 0.738378 Jun 16 18:52:01.293050 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2219/4524] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:00 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:01.709585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37f83c52-58bc-4ede-858c-8bdb5a23ed78 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:01.712191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-37f83c52-58bc-4ede-858c-8bdb5a23ed78 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:01.722533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f83c52-58bc-4ede-858c-8bdb5a23ed78 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:01.732424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f83c52-58bc-4ede-858c-8bdb5a23ed78 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:01.734039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f83c52-58bc-4ede-858c-8bdb5a23ed78 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:01.735649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37f83c52-58bc-4ede-858c-8bdb5a23ed78 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:01.746983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:52:01.747622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:52:01.748333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:52:01.749056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:52:01.749737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:52:01.781198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:01.781678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:01.782778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:01.787932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:01.817088 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37f83c52-58bc-4ede-858c-8bdb5a23ed78 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.116822 Jun 16 18:52:01.823524 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2220/4525] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jun 16 18:52:01 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:01.837478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:52:01.858334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for user c60f8f3909974479836ac8b0363b9a08 and project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:52:01.890498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:52:01.893751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:52:01.950480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:01.980638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:01.981453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:02.004382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:02.010235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:02.011813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:02.018248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:02.021444 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-18f512fd-4fdf-4c40-a790-bacb297b7352 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505186 Jun 16 18:52:02.030916 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2306/4526] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:52:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:52:02.047893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-db290411-425b-4e44-8451-ce671998af52 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:02.051081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-db290411-425b-4e44-8451-ce671998af52 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:02.124864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:52:02.218768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-db290411-425b-4e44-8451-ce671998af52 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:02.229352 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-db290411-425b-4e44-8451-ce671998af52 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1215 microversion: 2.1 time: 0.192237 Jun 16 18:52:02.229980 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2307/4527] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:02 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:02.318071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:02.320988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:02.348288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:02.354292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:02.359979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:02.362027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:02.422968 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ebcfdbe0-a5e8-4841-bdc8-dce094e9864f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 204 len: 0 microversion: 2.20 time: 0.445411 Jun 16 18:52:02.430249 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2221/4528] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:52:01 2022] DELETE /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:52:02.447002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d6cae6fe-875b-4dd2-b98f-38503e12d064 req-87c2b15e-3bcf-411d-b3a5-33aecd9e8dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108df41f-4dbc-4b35-8ec3-c8a1b949d592", "tag": "10a05cf8-ddde-4db8-a889-879a31144a4c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:02.477212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d6cae6fe-875b-4dd2-b98f-38503e12d064 req-87c2b15e-3bcf-411d-b3a5-33aecd9e8dde service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:02.477682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d6cae6fe-875b-4dd2-b98f-38503e12d064 req-87c2b15e-3bcf-411d-b3a5-33aecd9e8dde service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:02.510020 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d6cae6fe-875b-4dd2-b98f-38503e12d064 req-87c2b15e-3bcf-411d-b3a5-33aecd9e8dde service nova] Creating event network-changed:10a05cf8-ddde-4db8-a889-879a31144a4c for instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 on n-h2-846209-2 Jun 16 18:52:02.539046 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d6cae6fe-875b-4dd2-b98f-38503e12d064 req-87c2b15e-3bcf-411d-b3a5-33aecd9e8dde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099717 Jun 16 18:52:02.547804 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2222/4529] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:02.565268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:02.571160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:02.613543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:02.614516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:02.615565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:02.618177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:02.878520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:02.923831 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-58e8f7f5-c71f-45d4-8d52-aa9fc02e02f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1314 microversion: 2.1 time: 0.615800 Jun 16 18:52:02.933364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2308/4530] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:02 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:02.964033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:02.979558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:02.982233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:02.985149 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ef3896d1-f6aa-450e-9fb1-66c8b3874e01 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.434594 Jun 16 18:52:02.988115 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2223/4531] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:52:02 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:03.250224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:03.252135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:03.273573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:03.275765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:03.276817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:03.277495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:03.460385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:03.480433 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0763e274-faff-4986-897f-a7a052087157 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1219 microversion: 2.1 time: 0.236423 Jun 16 18:52:03.481039 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2309/4532] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:03 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1219 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:03.944009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:03.945492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:03.966211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:03.967793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:03.971066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:03.972779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:04.013046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:04.013701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:04.035323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:04.037302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:04.040395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:04.041109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:04.308603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:04.324990 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cfb09f25-4026-417a-ad50-db323d504ec6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1314 microversion: 2.1 time: 0.386779 Jun 16 18:52:04.325590 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2224/4533] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:03 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:04.449544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:04.466126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:04.468556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:04.472780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8bef9cda-afdc-47a9-9527-fac5be229f36 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.460979 Jun 16 18:52:04.473959 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2310/4534] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:52:04 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:52:04.501144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:04.502069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:04.514507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:04.515058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:04.515904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:04.516346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:04.818776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:04.836541 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c2f050dc-d667-4ee8-994d-2434a41a9960 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1275 microversion: 2.1 time: 0.339227 Jun 16 18:52:04.837140 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2225/4535] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:04 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1275 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:05.343358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:05.344644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:05.378312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:05.380733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:05.382441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:05.386350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:05.494974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:05.500633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:05.512280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:05.512736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:05.513514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:05.513967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:05.844180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:05.853007 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3e5a3931-9014-45d5-9866-fc8f18808de9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1314 microversion: 2.1 time: 0.513902 Jun 16 18:52:05.862327 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2311/4536] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:05 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:05.870208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fdcaa6f1-5758-4ac3-aee1-2b2325a8893e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:05.877270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdcaa6f1-5758-4ac3-aee1-2b2325a8893e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:05.878034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdcaa6f1-5758-4ac3-aee1-2b2325a8893e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:05.906358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fdcaa6f1-5758-4ac3-aee1-2b2325a8893e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Going to try to stop instance {{(pid=119206) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:52:05.970503 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fdcaa6f1-5758-4ac3-aee1-2b2325a8893e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action" status: 202 len: 0 microversion: 2.1 time: 0.106285 Jun 16 18:52:05.971393 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2312/4537] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:52:05 2022] POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:52:05.979054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:05.980021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:05.991921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:05.993990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:05.994855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:05.996344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:05.997117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:06.001062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:06.012644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:06.014122 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a19ab699-6136-47d9-820b-08f060138921 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1725 microversion: 2.20 time: 0.524231 Jun 16 18:52:06.022475 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2226/4538] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:52:05 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1725 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:06.028681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:06.039226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:06.045873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:06.046474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:06.047325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:06.047962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:06.447951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:06.469946 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2cd3f7f1-225a-4eca-898f-d85975971c2a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1677 microversion: 2.1 time: 0.446054 Jun 16 18:52:06.471868 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2227/4539] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:06 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1677 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:06.872515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:06.873947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:06.896567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:06.897183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:06.898562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:06.899065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:06.974618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:06.987367 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15c60a30-0f12-423a-9046-a77ca2169c48 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 1.013916 Jun 16 18:52:06.988475 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2313/4540] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:05 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:07.032044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:07.033218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:07.040731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:07.041449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:07.046994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:07.047695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:07.214393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:07.230435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:07.232801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e1faf1cce864fa4b65a67074b879065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493b9facda24bb6849d297a47afd81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:07.235405 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c85732a8-8970-417b-9c2a-c6310ac6a876 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 200 len: 1658 microversion: 2.20 time: 0.207034 Jun 16 18:52:07.236424 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2314/4541] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:52:07 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 1658 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:07.499405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:07.500200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:07.520204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:07.522112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:07.526595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:07.528108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:07.632694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:07.645743 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7e538fb7-669f-4e41-950c-a80f29871a84 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1314 microversion: 2.1 time: 0.779881 Jun 16 18:52:07.646790 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2228/4542] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:06 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:07.660020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5dc3bcff-8e8c-4b83-9ef2-6f35be595b77 req-b7e58846-b2d8-4b0d-b911-90004e16d6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ee4be-2727-4f03-9f09-0e87c82f5694", "name": "network-vif-deleted", "tag": "7e418d2c-584e-4d39-9444-c18f66d62054"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:07.681700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5dc3bcff-8e8c-4b83-9ef2-6f35be595b77 req-b7e58846-b2d8-4b0d-b911-90004e16d6f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:07.682316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5dc3bcff-8e8c-4b83-9ef2-6f35be595b77 req-b7e58846-b2d8-4b0d-b911-90004e16d6f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:07.703148 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5dc3bcff-8e8c-4b83-9ef2-6f35be595b77 req-b7e58846-b2d8-4b0d-b911-90004e16d6f7 service nova] Creating event network-vif-deleted:7e418d2c-584e-4d39-9444-c18f66d62054 for instance a53ee4be-2727-4f03-9f09-0e87c82f5694 on n-h1-846209-2 Jun 16 18:52:07.711692 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5dc3bcff-8e8c-4b83-9ef2-6f35be595b77 req-b7e58846-b2d8-4b0d-b911-90004e16d6f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060703 Jun 16 18:52:07.713121 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2229/4543] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:07.805010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a62639cd-7d67-460e-b6bf-0196a27cfbcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:07.807128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a62639cd-7d67-460e-b6bf-0196a27cfbcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:07.822479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62639cd-7d67-460e-b6bf-0196a27cfbcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:07.825268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62639cd-7d67-460e-b6bf-0196a27cfbcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:07.828362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62639cd-7d67-460e-b6bf-0196a27cfbcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:07.829269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62639cd-7d67-460e-b6bf-0196a27cfbcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:07.895137 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a62639cd-7d67-460e-b6bf-0196a27cfbcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/ips" status: 200 len: 149 microversion: 2.1 time: 0.096088 Jun 16 18:52:07.898014 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2230/4544] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:52:07 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/ips => generated 149 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:07.922786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:07.935754 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f078048-b56e-41e8-a985-bd72bfd3c4c1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1677 microversion: 2.1 time: 0.443063 Jun 16 18:52:07.938921 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2315/4545] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:07 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1677 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:08.007270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:08.008526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:08.023666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.024556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.026070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.028357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.256228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:08.258914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:08.279884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.282111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.291808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.294109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.338981 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] HTTP exception thrown: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Request method failure captured: Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 HTTP/1.1 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oQSNUCbqEVo9tjqy9aJyTjXEUEdu_tJdwht-p0ilsRPcmWBErwDJuORwvV7OGrlPuDgkeV6au6pByR1FmdQ2FYDug0xJDixW-sEisfkbk6D1zEFPbiaj9OjObSkVibhfb1c9sBW2DLQ57f6qK5ykCzTD7GrCm6wGMYCWrKqol7Pe0 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8493b9facda24bb6849d297a47afd81b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 1e1faf1cce864fa4b65a67074b879065 Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a53ee4be-2727-4f03-9f09-0e87c82f5694'} Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:08.354797 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Returning 404 to user: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-93f320cd-c784-4e3a-9711-91bbdf76888f tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 404 len: 111 microversion: 2.20 time: 0.107658 Jun 16 18:52:08.362617 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2316/4546] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:52:08 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:52:08.382192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-281bcf34-edd2-48eb-a35b-54b8c180adff tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '.version_select at 0x7f866e34c5e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:08.459318 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-281bcf34-edd2-48eb-a35b-54b8c180adff tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966056705" status: 204 len: 0 microversion: 2.20 time: 0.085025 Jun 16 18:52:08.472158 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2317/4547] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jun 16 18:52:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966056705 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:52:08.663693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:08.664357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:08.678911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.679381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.680192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.680636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.820988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:08.831406 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91a1b747-433d-4271-9b33-da33334fb865 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 0.829628 Jun 16 18:52:08.838074 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2231/4548] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:08 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:08.851103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-df01da94-2a8a-4e30-a5fc-820c5a11ca2b req-32c8abb2-ac82-4137-be97-e429d13bc7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108df41f-4dbc-4b35-8ec3-c8a1b949d592", "name": "network-vif-plugged", "status": "completed", "tag": "10a05cf8-ddde-4db8-a889-879a31144a4c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:08.863295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-df01da94-2a8a-4e30-a5fc-820c5a11ca2b req-32c8abb2-ac82-4137-be97-e429d13bc7af service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.864005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-df01da94-2a8a-4e30-a5fc-820c5a11ca2b req-32c8abb2-ac82-4137-be97-e429d13bc7af service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.882624 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-df01da94-2a8a-4e30-a5fc-820c5a11ca2b req-32c8abb2-ac82-4137-be97-e429d13bc7af service nova] Creating event network-vif-plugged:10a05cf8-ddde-4db8-a889-879a31144a4c for instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 on n-h2-846209-2 Jun 16 18:52:08.904675 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-df01da94-2a8a-4e30-a5fc-820c5a11ca2b req-32c8abb2-ac82-4137-be97-e429d13bc7af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062708 Jun 16 18:52:08.906421 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2232/4549] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:08.956936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:08.959235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:08.981335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.981998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:08.982998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:08.983721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:09.614568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:09.662173 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5825ae95-1aef-4711-bedb-c944d23def1f tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1314 microversion: 2.1 time: 1.002891 Jun 16 18:52:09.667425 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2318/4550] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:08 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:09.801194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a06d689d-2d3b-46dc-8015-b1e82964e146 req-6bbd7b4c-7e54-4bca-9d09-34807e64e7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfa0c92-cc24-43e1-b93b-a5e2e6845459", "tag": "330b4c1f-c94a-417f-955b-471358e0adc4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:09.836447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a06d689d-2d3b-46dc-8015-b1e82964e146 req-6bbd7b4c-7e54-4bca-9d09-34807e64e7ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:09.838056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a06d689d-2d3b-46dc-8015-b1e82964e146 req-6bbd7b4c-7e54-4bca-9d09-34807e64e7ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:09.872145 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a06d689d-2d3b-46dc-8015-b1e82964e146 req-6bbd7b4c-7e54-4bca-9d09-34807e64e7ee service nova] Creating event network-changed:330b4c1f-c94a-417f-955b-471358e0adc4 for instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 on n-h1-846209-2 Jun 16 18:52:09.887691 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a06d689d-2d3b-46dc-8015-b1e82964e146 req-6bbd7b4c-7e54-4bca-9d09-34807e64e7ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111426 Jun 16 18:52:09.889164 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2319/4551] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:09.900436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:09.902425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:09.917099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:09.917750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:09.919740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:09.920552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:09.959084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:09.983760 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-95aa0afe-bfff-4925-a899-f668cb695c0c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1677 microversion: 2.1 time: 1.029538 Jun 16 18:52:09.998515 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2233/4552] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:08 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1677 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:10.322565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:10.339146 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12b540f7-addd-46e8-a4e3-568f2405e261 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 0.447946 Jun 16 18:52:10.339744 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2320/4553] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:09 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:10.625959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8aa89af4-dfdc-40ce-a6ea-4e65ee1661f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b651960e-a71e-4a53-a3fd-19decad82327"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:10.627463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8aa89af4-dfdc-40ce-a6ea-4e65ee1661f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:10.642759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aa89af4-dfdc-40ce-a6ea-4e65ee1661f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:10.643659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aa89af4-dfdc-40ce-a6ea-4e65ee1661f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:10.645642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aa89af4-dfdc-40ce-a6ea-4e65ee1661f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:10.646812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aa89af4-dfdc-40ce-a6ea-4e65ee1661f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:10.683464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:10.684322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:10.698798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:10.699263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:10.702357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:10.705457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:10.967513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:10.979014 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89708e68-d5de-4219-8844-9b557111f319 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1500 microversion: 2.1 time: 0.298211 Jun 16 18:52:10.979989 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2321/4554] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:10 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:10.996615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:10.998882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:11.006027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.007283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.008250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.008860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.059359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lazy-loading 'flavor' on Instance uuid 108df41f-4dbc-4b35-8ec3-c8a1b949d592 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:52:11.067242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:11.181891 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9f1c0ce1-3d30-45c3-9af2-2e2d182fc3fd tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "POST /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592/action" status: 200 len: 32 microversion: 2.1 time: 0.189158 Jun 16 18:52:11.187207 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2322/4555] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:52:10 2022] POST /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:52:11.196010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:11.197720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:11.207230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.207980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.209126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.210635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.509050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:11.535468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:11.550820 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9a26841b-f6f2-443a-b5c8-5be9d05cd290 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1677 microversion: 2.1 time: 0.361841 Jun 16 18:52:11.551859 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2323/4556] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:11 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1677 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:11.559712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:11.560330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:11.567293 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8aa89af4-dfdc-40ce-a6ea-4e65ee1661f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944632 Jun 16 18:52:11.568068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.568532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.569654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.570393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.578296 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2234/4557] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:52:10 2022] POST /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 194 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:11.594974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:11.602736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:11.639839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.640501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.641477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:11.641961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:11.808188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:12.122262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:12.131519 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da555427-98db-419a-966d-d40e604359e4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.577959 Jun 16 18:52:12.138996 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2324/4558] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:11 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:12.143586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:12.152439 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5bd10815-155c-4ffd-a28b-b1f6ed6c5b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 0.572369 Jun 16 18:52:12.156629 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2235/4559] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:11 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:12.568408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:12.569697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:12.573235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:12.591807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:12.592268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:12.593075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:12.602225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:13.001936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:13.013977 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-32fff651-8f7a-4339-ac39-d204f1b1610e tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1677 microversion: 2.1 time: 0.449313 Jun 16 18:52:13.019062 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2325/4560] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:12 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1677 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:13.156418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:13.157047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:13.174441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:13.175072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:13.180893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:13.181349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:13.185548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:13.186029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:13.186536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:13.191011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:13.196022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:13.196732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:13.559548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:13.577717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9490e02f-8270-446a-af97-2a422f48c067 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 0.407221 Jun 16 18:52:13.582291 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2326/4561] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:13 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:13.642378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:13.652481 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d976a3e2-e08e-4657-a451-5d49b6a67296 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.500772 Jun 16 18:52:13.656007 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2236/4562] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:13 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:14.034205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:14.036082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:14.057870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:14.062552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:14.063624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:14.067910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:14.399951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:14.417087 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c096d28-d482-4a34-8c5f-f4129759d776 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1677 microversion: 2.1 time: 0.388172 Jun 16 18:52:14.421998 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2327/4563] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:14 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1677 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:14.605604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:14.606453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:14.627851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:14.630657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:14.637101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:14.639427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:14.677434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:14.678637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:14.691062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:14.691522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:14.692556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:14.695689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:15.007293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:15.015901 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62697b66-505f-483c-9f8d-deefdea6b7d9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 0.416859 Jun 16 18:52:15.016417 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2237/4564] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:14 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:15.162318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:15.171350 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-97de51e0-be74-45dd-91f8-d956f6fcc329 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.498554 Jun 16 18:52:15.174003 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2328/4565] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:14 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:15.359320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:15.359696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:15.377783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:15.378321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:15.379140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:15.379591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:15.404280 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] HTTP exception thrown: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Request method failure captured: Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 HTTP/1.1 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3oQSNUCbqEVo9tjqy9aJyTjXEUEdu_tJdwht-p0ilsRPcmWBErwDJuORwvV7OGrlPuDgkeV6au6pByR1FmdQ2FYDug0xJDixW-sEisfkbk6D1zEFPbiaj9OjObSkVibhfb1c9sBW2DLQ57f6qK5ykCzTD7GrCm6wGMYCWrKqol7Pe0 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8493b9facda24bb6849d297a47afd81b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1e1faf1cce864fa4b65a67074b879065 Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a53ee4be-2727-4f03-9f09-0e87c82f5694'} Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:52:15.407415 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.413624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Returning 404 to user: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:15.416728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4efcfc99-d65b-4118-964a-bec6c53b2fc5 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 404 len: 111 microversion: 2.20 time: 0.060981 Jun 16 18:52:15.420418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2238/4566] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:52:15 2022] DELETE /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:52:15.430850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:15.431912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: a53ee4be-2727-4f03-9f09-0e87c82f5694] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:15.454436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:15.455207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:15.455579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:15.457039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:15.461126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:15.462373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:15.472900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:15.475291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:15.476738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:15.477969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:15.504983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] HTTP exception thrown: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Request method failure captured: Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 HTTP/1.1 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oQSNUCbqEVo9tjqy9aJyTjXEUEdu_tJdwht-p0ilsRPcmWBErwDJuORwvV7OGrlPuDgkeV6au6pByR1FmdQ2FYDug0xJDixW-sEisfkbk6D1zEFPbiaj9OjObSkVibhfb1c9sBW2DLQ57f6qK5ykCzTD7GrCm6wGMYCWrKqol7Pe0 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8493b9facda24bb6849d297a47afd81b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 1e1faf1cce864fa4b65a67074b879065 Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a53ee4be-2727-4f03-9f09-0e87c82f5694'} Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.509447 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. Jun 16 18:52:15.515090 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:15.518320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Returning 404 to user: Instance a53ee4be-2727-4f03-9f09-0e87c82f5694 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:15.523277 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b8b98882-ccf6-48dd-b80a-e8bebb4af322 tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694" status: 404 len: 111 microversion: 2.20 time: 0.095352 Jun 16 18:52:15.528975 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2329/4567] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:52:15 2022] GET /compute/v2.1/servers/a53ee4be-2727-4f03-9f09-0e87c82f5694 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:52:15.731038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:15.744317 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-96a759b2-b9e9-435f-8eaf-d69f31522c2d tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1677 microversion: 2.1 time: 0.307936 Jun 16 18:52:15.745564 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2239/4568] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:15 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1677 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:16.034198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:16.034856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:16.051488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:16.054404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:16.055427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:16.056400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:16.188902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:16.189446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:16.197391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:16.199175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:16.199175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:16.200527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:16.531238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:16.541349 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f3cb1a81-778d-4c3a-935b-f8161c425646 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 0.511622 Jun 16 18:52:16.560225 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2330/4569] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:16 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:16.578943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:16.588737 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-344341bc-c667-4449-bb71-84bf5e2422ac tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.403694 Jun 16 18:52:16.590111 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2240/4570] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:16 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:16.764957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:16.766308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:16.777423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:16.778309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:16.779344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:16.780028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:16.873830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7c8aec54-1790-484b-9e88-2d7d521e430c req-84355eac-cd96-4aed-a22e-93bcb9fe70ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfa0c92-cc24-43e1-b93b-a5e2e6845459", "name": "network-vif-plugged", "status": "completed", "tag": "330b4c1f-c94a-417f-955b-471358e0adc4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:16.898954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7c8aec54-1790-484b-9e88-2d7d521e430c req-84355eac-cd96-4aed-a22e-93bcb9fe70ea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:16.899707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7c8aec54-1790-484b-9e88-2d7d521e430c req-84355eac-cd96-4aed-a22e-93bcb9fe70ea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:16.918624 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7c8aec54-1790-484b-9e88-2d7d521e430c req-84355eac-cd96-4aed-a22e-93bcb9fe70ea service nova] Creating event network-vif-plugged:330b4c1f-c94a-417f-955b-471358e0adc4 for instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 on n-h1-846209-2 Jun 16 18:52:16.927844 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7c8aec54-1790-484b-9e88-2d7d521e430c req-84355eac-cd96-4aed-a22e-93bcb9fe70ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063771 Jun 16 18:52:16.930463 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2241/4571] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:17.083770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:17.102506 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e58ef5d5-d535-4f4a-973b-0be19531a3ff tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1654 microversion: 2.1 time: 0.343157 Jun 16 18:52:17.108726 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2331/4572] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:16 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1654 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:17.121197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ec9c183-af76-492f-be47-25d6b8eb6540 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:17.128221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ec9c183-af76-492f-be47-25d6b8eb6540 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:17.128939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ec9c183-af76-492f-be47-25d6b8eb6540 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:17.157069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ec9c183-af76-492f-be47-25d6b8eb6540 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Going to try to start instance {{(pid=119207) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:52:17.218134 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9ec9c183-af76-492f-be47-25d6b8eb6540 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action" status: 202 len: 0 microversion: 2.1 time: 0.102269 Jun 16 18:52:17.219016 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2242/4573] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:52:17 2022] POST /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:52:17.228781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:17.230429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:17.238164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:17.238871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:17.240017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:17.240618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:17.480431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:17.510529 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a0b5a9cd-de58-4ebd-bb33-1a445691c147 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1663 microversion: 2.1 time: 0.286949 Jun 16 18:52:17.513430 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2332/4574] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:17 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1663 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:17.565588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:17.567741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:17.598844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:17.599316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:17.601828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:17.606827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:17.607406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:17.610473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:17.623097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:17.623587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:17.624405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:17.624853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:17.948963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:17.960288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:17.961445 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-997dd387-e760-4bf1-bbce-f4e9651e8195 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.358488 Jun 16 18:52:17.962366 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2333/4575] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:17 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:17.972578 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8ba82a6-7d52-4503-b831-aa5d20aad205 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1315 microversion: 2.1 time: 0.416090 Jun 16 18:52:17.973495 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2243/4576] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:17 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:18.529741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:18.531291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:18.547057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:18.547529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:18.548325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:18.548773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:18.974931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:18.979138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:18.979768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:18.988799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:18.991158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:18.991357 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-07785ed1-4b9b-4428-8240-85f89b304d0a tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1663 microversion: 2.1 time: 0.465559 Jun 16 18:52:18.992245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2334/4577] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:18 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1663 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:19.002491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:19.002491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:19.011172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:19.013044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:19.027294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:19.036250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:19.038308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:19.040847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:19.559089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:19.594105 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-40fb1a14-64f1-43b4-af94-b240826f1b9e tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.609599 Jun 16 18:52:19.604634 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2244/4578] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:18 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:19.718812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:19.750029 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c3068e2-a6d5-4afe-99a9-0fa6619a0b8e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1499 microversion: 2.1 time: 0.745166 Jun 16 18:52:19.751454 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2335/4579] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:18 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1499 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:19.779461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:19.780755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:19.796322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:19.799672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:19.801159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:19.807279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:19.892574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lazy-loading 'flavor' on Instance uuid 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:52:20.015832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:20.017125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:20.042466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:20.046037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:20.048189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:20.049544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:20.573504 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8363816-7b7b-4d53-a136-e49df031fab3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459/action" status: 202 len: 0 microversion: 2.1 time: 0.806074 Jun 16 18:52:20.577941 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2245/4580] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:52:19 2022] POST /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459/action => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:52:20.591546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:20.593047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:20.613822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:20.617357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:20.619368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:20.621602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:20.636979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:20.653086 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a061cc4a-b1ee-49bd-9c37-f0196d59131f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1667 microversion: 2.1 time: 0.647269 Jun 16 18:52:20.654150 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2336/4581] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:20 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1667 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:20.676965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:20.685944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:20.704636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:20.708369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:20.709875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:20.710374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:21.020307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:21.037142 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c0d3e169-7dc8-408d-96a3-66416a1e76a6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.381570 Jun 16 18:52:21.041976 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2337/4582] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:20 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:21.059381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:21.067602 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3efb253b-cdef-424b-88ac-879d2751fd1a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.486300 Jun 16 18:52:21.075370 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2246/4583] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:20 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:22.053456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:22.058867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:22.059512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:22.062686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:22.071041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.071503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.072292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.072530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.072749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.073486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.075159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.075717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.104158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:22.110025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] HTTP exception thrown: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Request method failure captured: Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d HTTP/1.1 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3oQSNUCbqEVo9tjqy9aJyTjXEUEdu_tJdwht-p0ilsRPcmWBErwDJuORwvV7OGrlPuDgkeV6au6pByR1FmdQ2FYDug0xJDixW-sEisfkbk6D1zEFPbiaj9OjObSkVibhfb1c9sBW2DLQ57f6qK5ykCzTD7GrCm6wGMYCWrKqol7Pe0 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8493b9facda24bb6849d297a47afd81b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 1e1faf1cce864fa4b65a67074b879065 Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '31b6c0e5-0374-409e-928e-fef329282b9d'} Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:52:22.112296 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.118951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Returning 404 to user: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:22.124387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fd94e086-726e-4c1e-8f6e-db2d26ea494e tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 404 len: 111 microversion: 2.20 time: 0.076331 Jun 16 18:52:22.125002 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2338/4584] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:52:22 2022] DELETE /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:52:22.134367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:22.135020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:22.142646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.143480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.144274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.144719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.344593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:22.354643 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2fecfbf7-e5f7-471d-ba8b-f3ff0d406639 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.299543 Jun 16 18:52:22.363853 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2247/4585] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:22 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:22.374336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:22.374986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] [instance: 31b6c0e5-0374-409e-928e-fef329282b9d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:22.399180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.399517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.400480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:22.401093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:22.430071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] HTTP exception thrown: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.431392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Request method failure captured: Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d HTTP/1.1 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3oQSNUCbqEVo9tjqy9aJyTjXEUEdu_tJdwht-p0ilsRPcmWBErwDJuORwvV7OGrlPuDgkeV6au6pByR1FmdQ2FYDug0xJDixW-sEisfkbk6D1zEFPbiaj9OjObSkVibhfb1c9sBW2DLQ57f6qK5ykCzTD7GrCm6wGMYCWrKqol7Pe0 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8493b9facda24bb6849d297a47afd81b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8493b9facda24bb6849d297a47afd81b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 8493b9facda24bb6849d297a47afd81b Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1752608353 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 1e1faf1cce864fa4b65a67074b879065 Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1752608353-project Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '31b6c0e5-0374-409e-928e-fef329282b9d'} Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.431762 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] Returning 404 to user: Instance 31b6c0e5-0374-409e-928e-fef329282b9d could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e691882a-7273-4582-8b4b-5d49a50655dc tempest-AttachVolumeShelveTestJSON-1752608353 tempest-AttachVolumeShelveTestJSON-1752608353-project] 10.222.0.27 "GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d" status: 404 len: 111 microversion: 2.20 time: 0.077012 Jun 16 18:52:22.439926 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2248/4586] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:52:22 2022] GET /compute/v2.1/servers/31b6c0e5-0374-409e-928e-fef329282b9d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:52:22.441940 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-86c23600-df8d-4509-8d41-923aec459eeb tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.315770 Jun 16 18:52:22.442532 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2339/4587] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:22 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:23.371733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:23.372589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:23.392155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:23.393753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:23.395261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:23.395261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:23.395474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:23.462746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:23.462746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:23.476073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:23.476476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:23.477278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:23.477722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:23.767729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:23.794936 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6441355e-6d58-43b1-ad3b-a5de560b20a8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.338264 Jun 16 18:52:23.799477 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2340/4588] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:23 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:23.833311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:23.844325 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa5f223f-8fa4-4705-a731-d5384671c02a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.476348 Jun 16 18:52:23.849244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2249/4589] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:23 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:24.820474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:24.822467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:24.832365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:24.833442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:24.834707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:24.835362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:24.865408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:24.867213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:24.879008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:24.879947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:24.881108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:24.881854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:24.908797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:25.196682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:25.207513 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6205f452-c87b-40ae-a4e7-616bbc44ede7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.345814 Jun 16 18:52:25.208414 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2250/4590] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:24 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:25.216400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:25.227110 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bb53cf5b-1242-4992-828a-a541bf61297c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.411559 Jun 16 18:52:25.227710 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2341/4591] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:24 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:26.228519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:26.229237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:26.244850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:26.245550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:26.258998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:26.262488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:26.262962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:26.265062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:26.266034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:26.266898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:26.267348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:26.270524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:26.668909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:26.705647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:26.708458 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-79c91d46-ba16-435e-a493-fcfe32273e7c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.484981 Jun 16 18:52:26.718960 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2251/4592] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:26 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:26.737724 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f8fba19a-9419-4635-bd54-1a4095540d47 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.498074 Jun 16 18:52:26.742458 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2342/4593] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:26 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:27.430062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b651960e-a71e-4a53-a3fd-19decad82327"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:27.431904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:27.439131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.439598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:27.440394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.440836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:27.582503 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Invalid volume: volume b651960e-a71e-4a53-a3fd-19decad82327 is already attached to instances: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments HTTP/1.1 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 74 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: {"volumeAttachment": {"volumeId": "b651960e-a71e-4a53-a3fd-19decad82327"}} Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid volume: volume b651960e-a71e-4a53-a3fd-19decad82327 is already attached to instances: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': 'd5d23d4e-27f1-4cfc-95a7-e1c0fc316a37', 'body': {'volumeAttachment': {'volumeId': 'b651960e-a71e-4a53-a3fd-19decad82327'}}} Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b651960e-a71e-4a53-a3fd-19decad82327 is already attached to instances: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:52:27.584820 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b651960e-a71e-4a53-a3fd-19decad82327 is already attached to instances: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b651960e-a71e-4a53-a3fd-19decad82327 is already attached to instances: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 400 to user: Invalid volume: volume b651960e-a71e-4a53-a3fd-19decad82327 is already attached to instances: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61474998-0398-44e4-b851-944b8a7b0c13 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161714 Jun 16 18:52:27.597167 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2252/4594] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:52:27 2022] POST /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:52:27.696980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:27.697577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:27.705432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.706133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:27.707114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.707561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:27.728585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:27.729138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:27.754166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.754634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:27.755437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.756409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:27.815117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lazy-loading 'services' on Instance uuid d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:52:27.937766 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b4360ab-03cd-4038-a69a-f73385b6cc10 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments/b651960e-a71e-4a53-a3fd-19decad82327" status: 202 len: 0 microversion: 2.1 time: 0.245378 Jun 16 18:52:27.938554 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2343/4595] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:52:27 2022] DELETE /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments/b651960e-a71e-4a53-a3fd-19decad82327 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:52:27.954425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:27.958576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:27.981726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.982557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:27.984310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:27.984820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:28.002569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:28.017521 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-61929d9c-4150-4e88-99b5-43a5ead7e700 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.292601 Jun 16 18:52:28.019753 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2253/4596] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:27 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:28.027863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-060cf9f7-773f-4b6a-a62e-78797a97d355 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:28.031556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-060cf9f7-773f-4b6a-a62e-78797a97d355 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:28.048240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-060cf9f7-773f-4b6a-a62e-78797a97d355 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:28.054238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-060cf9f7-773f-4b6a-a62e-78797a97d355 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:28.055444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-060cf9f7-773f-4b6a-a62e-78797a97d355 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:28.056034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-060cf9f7-773f-4b6a-a62e-78797a97d355 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:28.110227 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-060cf9f7-773f-4b6a-a62e-78797a97d355 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087421 Jun 16 18:52:28.111158 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2254/4597] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:52:28 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:28.203424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:28.212005 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b56f8a1-ed5b-4e50-9d84-6930e3774752 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.270175 Jun 16 18:52:28.223013 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2344/4598] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:27 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:29.038306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:29.039110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:29.046599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:29.047390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:29.048447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:29.049123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:29.122386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-966aafe9-e494-4c00-9ab7-952f6ba64859 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:29.123435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-966aafe9-e494-4c00-9ab7-952f6ba64859 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:29.133305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-966aafe9-e494-4c00-9ab7-952f6ba64859 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:29.134611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-966aafe9-e494-4c00-9ab7-952f6ba64859 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:29.136071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-966aafe9-e494-4c00-9ab7-952f6ba64859 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:29.137011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-966aafe9-e494-4c00-9ab7-952f6ba64859 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:29.207225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-966aafe9-e494-4c00-9ab7-952f6ba64859 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088773 Jun 16 18:52:29.210533 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2345/4599] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:52:29 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:29.229704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:29.234186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:29.248702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:29.249662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:29.250770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:29.251577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:29.278660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:29.287782 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d92ee582-360a-4a1e-b644-763ea812bc4b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.254589 Jun 16 18:52:29.291814 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2255/4600] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:29 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:29.493186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:29.503940 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-630a4fa6-3c8e-4f61-a526-595869dfc43b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.278144 Jun 16 18:52:29.505131 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2346/4601] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:29 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:30.222423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2b28ccbf-fdb2-4a38-97d3-3f9dcb253a44 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:30.223242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2b28ccbf-fdb2-4a38-97d3-3f9dcb253a44 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:30.232104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b28ccbf-fdb2-4a38-97d3-3f9dcb253a44 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:30.232728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b28ccbf-fdb2-4a38-97d3-3f9dcb253a44 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:30.233686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b28ccbf-fdb2-4a38-97d3-3f9dcb253a44 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:30.234306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2b28ccbf-fdb2-4a38-97d3-3f9dcb253a44 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:30.286021 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2b28ccbf-fdb2-4a38-97d3-3f9dcb253a44 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068640 Jun 16 18:52:30.287320 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2256/4602] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:52:30 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:30.308938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:30.309855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:30.323699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:30.324313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:30.325314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:30.330573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:30.497432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:30.509524 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-69413d46-40af-432c-adcd-fa815bea2ee4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.204784 Jun 16 18:52:30.510765 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2347/4603] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:30 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:30.524688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:30.525661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:30.535408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:30.536249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:30.538619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:30.539097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:30.711552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:30.720171 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8681744-d64f-4ad4-8a96-0049bc49d353 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.203262 Jun 16 18:52:30.721348 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2257/4604] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:30 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:31.298710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f5ffb8a2-3fac-4b90-b67c-65c05cbeab88 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:31.299938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f5ffb8a2-3fac-4b90-b67c-65c05cbeab88 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:31.309073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ffb8a2-3fac-4b90-b67c-65c05cbeab88 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.314663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ffb8a2-3fac-4b90-b67c-65c05cbeab88 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.316565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ffb8a2-3fac-4b90-b67c-65c05cbeab88 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.319232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ffb8a2-3fac-4b90-b67c-65c05cbeab88 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.401110 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f5ffb8a2-3fac-4b90-b67c-65c05cbeab88 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106321 Jun 16 18:52:31.401969 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2348/4605] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:52:31 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:31.450274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e20d3e0a-8733-44ff-8c00-f33a594d73c0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:31.452086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e20d3e0a-8733-44ff-8c00-f33a594d73c0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:31.462228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e20d3e0a-8733-44ff-8c00-f33a594d73c0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.463028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e20d3e0a-8733-44ff-8c00-f33a594d73c0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.464465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e20d3e0a-8733-44ff-8c00-f33a594d73c0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.465431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e20d3e0a-8733-44ff-8c00-f33a594d73c0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.527608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:31.528463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:31.538924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.542680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.544454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.545572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.635138 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e20d3e0a-8733-44ff-8c00-f33a594d73c0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.191806 Jun 16 18:52:31.637963 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2258/4606] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:52:31 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:52:31.650216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:31.651100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:31.662482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.663732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.665181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.666362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.854398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:31.866152 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dbac64e6-ba1d-4af3-93ba-47d388ee55e9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.340580 Jun 16 18:52:31.868043 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2349/4607] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:31 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:31.877379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:31.879422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:31.893813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.896201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:31.898484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:31.899260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:32.026276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:32.034310 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f8bf81fb-a59d-4f25-b078-fe1bffe680eb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1671 microversion: 2.1 time: 0.393764 Jun 16 18:52:32.034883 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2259/4608] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:31 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1671 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:32.164562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:32.178893 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1eeb2257-a53b-45f0-ae96-b0af138b3ac4 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.306932 Jun 16 18:52:32.180718 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2350/4609] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:31 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:32.419579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22dd98fd-b8e1-4396-bffa-53302fb82de3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:32.421831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22dd98fd-b8e1-4396-bffa-53302fb82de3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:32.434352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22dd98fd-b8e1-4396-bffa-53302fb82de3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:32.435170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22dd98fd-b8e1-4396-bffa-53302fb82de3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:32.437759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22dd98fd-b8e1-4396-bffa-53302fb82de3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:32.440113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22dd98fd-b8e1-4396-bffa-53302fb82de3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:32.493216 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22dd98fd-b8e1-4396-bffa-53302fb82de3 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081141 Jun 16 18:52:32.495120 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2260/4610] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:52:32 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:32.884017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:32.884855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:32.895772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=92,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:32.897510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:32.898032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:32.898919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:32.899425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.054821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:33.054821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:33.061846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.062589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.063768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.064552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.339275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:33.350512 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-49cd3ef4-43b6-4d61-8bce-1e80df42b7f8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.469732 Jun 16 18:52:33.364088 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2351/4611] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:32 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:33.380233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:33.381860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:33.389317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.389772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.390844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.391293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.446294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:33.457036 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d6971e16-32cb-4482-a0bd-997d5b358f9c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1676 microversion: 2.1 time: 0.408350 Jun 16 18:52:33.458354 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2261/4612] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:33 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1676 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:33.508142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5002be92-5500-439a-8c44-60aa8d77a212 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:33.510619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5002be92-5500-439a-8c44-60aa8d77a212 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:33.524473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5002be92-5500-439a-8c44-60aa8d77a212 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.525852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5002be92-5500-439a-8c44-60aa8d77a212 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.530329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5002be92-5500-439a-8c44-60aa8d77a212 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.531145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5002be92-5500-439a-8c44-60aa8d77a212 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.575999 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5002be92-5500-439a-8c44-60aa8d77a212 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073009 Jun 16 18:52:33.576597 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2262/4613] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:52:33 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:52:33.644477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:33.648984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:33.651600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:33.656429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.658198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.660430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.661313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.664156 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-301fa87b-4c24-4962-8591-0f22fe1e2243 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.296434 Jun 16 18:52:33.665040 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2352/4614] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:33 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:33.694188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:52:33.809138 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8cbe8124-431b-4873-814d-5bbb76ab63b6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 204 len: 0 microversion: 2.1 time: 0.167706 Jun 16 18:52:33.811764 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2263/4615] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:52:33 2022] DELETE /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:52:33.820589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:33.821221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:33.828586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.829042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.830065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:33.830566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:33.983641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:33.993197 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-946be12b-b36a-4a1e-ba89-113500b018e1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1680 microversion: 2.1 time: 0.177148 Jun 16 18:52:33.994198 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2353/4616] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:33 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:34.376271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:34.377266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:34.384658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:34.385433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:34.386658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:34.387345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:34.392966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:34.476983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:34.478187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:34.487426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:34.490113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:34.492438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:34.493255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:34.613847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:34.624682 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-86490289-4a1f-4926-8b97-8dc8adad13a2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.253164 Jun 16 18:52:34.625454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2264/4617] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:34 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:34.681632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:34.682461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:34.693070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:34.694926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:34.695999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:34.696851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:34.716251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:34.719997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:34.724834 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-640efed6-2723-45c8-b9e9-f3d37fa44c59 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.252550 Jun 16 18:52:34.726018 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2354/4618] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:34 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:34.858042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:34.866698 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fcf8086f-1a1b-4182-83dc-e84f5d41ff2a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.189722 Jun 16 18:52:34.867274 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2265/4619] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:34 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:35.011538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:35.012384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:35.022332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:35.022796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:35.023604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:35.024076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:35.181501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:35.201454 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4d3f579b-4aad-4356-9bb5-ca7edfb80af4 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1680 microversion: 2.1 time: 0.193828 Jun 16 18:52:35.202116 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2355/4620] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:35 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:35.649895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:35.652445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:35.665966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:35.666845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:35.669030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:35.669798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:35.861668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:35.874531 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67afb884-09d9-4d4e-b298-16a8883ca809 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.232791 Jun 16 18:52:35.875122 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2266/4621] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:35 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:35.884692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:35.885318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:35.895778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:35.897475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:35.898615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:35.899285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:36.118383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:36.127056 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f6916bb-18aa-487d-80f9-6567ac26e0f7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.247080 Jun 16 18:52:36.138117 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2356/4622] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:35 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:36.220700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:36.221451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:36.228805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:36.229679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:36.230662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:36.231440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:36.320866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:36.331107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa660a9c-fecb-48c0-856a-1d2f4018f1ed tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 200 len: 1613 microversion: 2.1 time: 0.114454 Jun 16 18:52:36.332113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2267/4623] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:36 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 1613 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:36.664234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-67828e6a-949c-4b1f-b421-f756210cc2b4 req-a0f225a0-087d-43cc-984f-50802da046df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37", "name": "network-vif-deleted", "tag": "1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:36.686381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67828e6a-949c-4b1f-b421-f756210cc2b4 req-a0f225a0-087d-43cc-984f-50802da046df service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:36.698069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67828e6a-949c-4b1f-b421-f756210cc2b4 req-a0f225a0-087d-43cc-984f-50802da046df service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:36.734120 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-67828e6a-949c-4b1f-b421-f756210cc2b4 req-a0f225a0-087d-43cc-984f-50802da046df service nova] Creating event network-vif-deleted:1248863f-4ef5-4ec7-b9a9-0ec71f4b1c49 for instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 on n-h2-846209-2 Jun 16 18:52:36.749316 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-67828e6a-949c-4b1f-b421-f756210cc2b4 req-a0f225a0-087d-43cc-984f-50802da046df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376105 Jun 16 18:52:36.753763 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2357/4624] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:36.894197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:36.894890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:36.911013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:36.911719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:36.912997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:36.913682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:37.098111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:37.111114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-62c8ee0e-57e6-4205-a085-0720d1d63dc0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.222243 Jun 16 18:52:37.111927 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2268/4625] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:36 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:37.146945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.148425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:37.156076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:37.156869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:37.158280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:37.158954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:37.340119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:37.351509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.352456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:37.356563 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b4db621-ff87-41a0-b027-1ce8cdb3b676 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.215547 Jun 16 18:52:37.358823 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2358/4626] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:37 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:37.363590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:37.364050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:37.364847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:37.365415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:37.386062 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 HTTP/1.1 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'd5d23d4e-27f1-4cfc-95a7-e1c0fc316a37'} Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:37.388128 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.392485 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.392485 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:37.392485 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:37.392485 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:37.392485 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:37.392485 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:52:37.392485 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.394593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:37.395732 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f6ad6c2c-e3c9-4c6b-a44b-1a73b7188eba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 404 len: 111 microversion: 2.1 time: 0.048663 Jun 16 18:52:37.397056 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2269/4627] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:37 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:52:37.405647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fac0e24a-040c-4926-8eea-8d3d127a9716 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '.version_select at 0x7f866eef5b80>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.430683 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fac0e24a-040c-4926-8eea-8d3d127a9716 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-649615995" status: 202 len: 0 microversion: 2.1 time: 0.028941 Jun 16 18:52:37.431544 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2359/4628] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:52:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-649615995 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:52:38.128913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:38.130329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:38.137852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:38.138353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:38.139223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:38.139665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:38.303761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:38.312072 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9e8fc227-fe71-4c39-940d-e559a7f82e12 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.187016 Jun 16 18:52:38.312886 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2270/4629] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:38 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:38.377900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:38.378682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:38.390177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:38.390639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:38.391423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:38.391859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:38.505150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-501c1841-5464-41c6-a3f0-e99b43962b45 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: .version_select at 0x7f866d9023a0>, body: {"keypair": {"name": "tempest-keypair-1390987313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPOxyBoqD6YPDAZMVDv3bCAlev48WnaqIr1ZqCgPSva+aeXxOQqruWI5sOtgZILEKkoDaKC34mM/q9oSIjg4q/i4ZpGmqarW0DVgsl6IkGr1wyG89d+mL0cmsiZM2u/XA=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:38.521771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-501c1841-5464-41c6-a3f0-e99b43962b45 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:52:38.528561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-501c1841-5464-41c6-a3f0-e99b43962b45 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:52:38.555897 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-501c1841-5464-41c6-a3f0-e99b43962b45 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054658 Jun 16 18:52:38.556509 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2271/4630] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:52:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:52:38.606716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:38.615988 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6f134d4-2c93-418a-9cfc-f8f17c123d74 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.243855 Jun 16 18:52:38.625738 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2360/4631] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:38 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:39.337944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:39.342507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:39.367120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:39.367878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:39.368934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:39.369399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:39.580783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:39.598295 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-179c88c2-ff82-4036-81d7-3c8a66e58133 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1506 microversion: 2.1 time: 0.267959 Jun 16 18:52:39.599241 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2272/4632] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:39 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:39.633989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:39.634594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:39.642284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:39.642744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:39.643518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:39.643954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:39.808657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:39.820307 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4348d8a8-1786-4910-9ea2-1955500ab500 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.191120 Jun 16 18:52:39.830747 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2361/4633] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:39 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:40.366303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-579955892", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "342ef20c-b425-4c3e-85a8-70079b12ec49"}], "security_groups": [{"name": "tempest-securitygroup--91955432"}], "key_name": "tempest-keypair-1390987313", "user_data": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:40.520909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] validate_networks() for [('342ef20c-b425-4c3e-85a8-70079b12ec49', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:52:40.619590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:40.621099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:40.633634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:40.634617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:40.639123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:40.639979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:40.991386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:41.000948 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-09717f8b-95de-46cf-928e-1c266784c853 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1486 microversion: 2.1 time: 0.388217 Jun 16 18:52:41.018046 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2362/4634] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:40 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1486 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:41.033758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:41.035360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:41.042877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:41.043685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:41.044795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:41.045770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:41.293992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:52:41.294912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:52:41.295484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:52:41.295977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:52:41.296474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:52:41.317219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:41.318634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:41.319852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:41.320294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:41.344009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:52:41.352610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Getting quotas for user 720cc6d1352840a99028bf48ae9eb6a2 and project c72f1437a9c348ebb373cbed7855fd31. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:52:41.356637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:41.365244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:52:41.365449 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0134afd2-3364-4939-b83d-2be06282f38e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.348276 Jun 16 18:52:41.368074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:52:41.370766 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2363/4635] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:41 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:41.382840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1863450862", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:41.427757 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-570dd350-c83c-4df3-878a-4ce103c15fa0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.067039 Jun 16 18:52:41.429127 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2273/4636] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:52:40 2022] POST /compute/v2.1/servers => generated 400 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:52:41.449086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d4c5c1e0-6bdb-4fa4-a0be-b736cb1880d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:41.449748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d4c5c1e0-6bdb-4fa4-a0be-b736cb1880d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:41.460797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] validate_networks() for [('983e0f98-4284-4e54-9a92-e530e186e60f', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:52:41.588977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d4c5c1e0-6bdb-4fa4-a0be-b736cb1880d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:41.596788 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d4c5c1e0-6bdb-4fa4-a0be-b736cb1880d1 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1241 microversion: 2.1 time: 0.153877 Jun 16 18:52:41.602135 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2274/4637] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:41 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:42.119896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:52:42.120397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:52:42.120913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:52:42.121377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:52:42.122077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:52:42.144931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:42.145724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:42.147469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:42.148451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:42.170539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Getting quotas for project 645f9222653e4006ae6a399accb03d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:52:42.176959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Getting quotas for user ab06bc595cae4bcda2b784e4e0b2644c and project 645f9222653e4006ae6a399accb03d6b. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:52:42.192132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:52:42.195426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:52:42.266553 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59eb357b-7259-4d53-9a24-3b8bffd675cb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.894300 Jun 16 18:52:42.267295 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2364/4638] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:52:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:52:42.278214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c221abb6-aa0c-4645-b482-3d0ebf57baeb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:42.278842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c221abb6-aa0c-4645-b482-3d0ebf57baeb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:42.385624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:42.386595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:42.394512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:42.395173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:42.402917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:42.403281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c221abb6-aa0c-4645-b482-3d0ebf57baeb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:42.404664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:42.416557 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c221abb6-aa0c-4645-b482-3d0ebf57baeb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1214 microversion: 2.1 time: 0.142113 Jun 16 18:52:42.417949 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2275/4639] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:42 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:42.615757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:42.619123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:42.620688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:42.625644 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3fa20db3-306e-4ebe-8729-791241db9ede tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.245791 Jun 16 18:52:42.631643 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2365/4640] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:42 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:42.634984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:42.638076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:42.639891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:42.640542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:42.715837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:42.739231 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6d88e684-4484-445d-81ff-a64567fba9a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1293 microversion: 2.1 time: 0.125134 Jun 16 18:52:42.746780 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2276/4641] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:42 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:43.435283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:43.436600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:43.444200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:43.444868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:43.445968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:43.446657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:43.547079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:43.558468 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b6052d9-7a6c-43d6-8bd2-0c4ad501ece2 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1266 microversion: 2.1 time: 0.127305 Jun 16 18:52:43.559953 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2366/4642] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:43 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:43.645008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:43.645667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:43.665697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:43.666255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:43.667252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:43.667680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:43.758823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:43.760196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:43.769518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:43.772337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:43.773478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:43.774182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:43.919281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:43.929017 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b7005d08-7329-4d43-9fea-a13324f4a0a7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1299 microversion: 2.1 time: 0.176014 Jun 16 18:52:43.930621 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2367/4643] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:43 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:44.031534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:44.041486 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-adcc0169-4a59-469a-9039-a402056ab249 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.401433 Jun 16 18:52:44.042423 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2277/4644] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:43 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:44.578293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:44.579530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:44.588165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:44.589001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:44.590091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:44.590800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:44.953985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:44.960717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:44.965701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:44.974990 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b05874e-617e-481b-baa8-56bc761868b9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1272 microversion: 2.1 time: 0.398927 Jun 16 18:52:44.977307 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2368/4645] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:44 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1272 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:44.981239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:44.982015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:44.983044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:44.983787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:45.060590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:45.062053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:45.071189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:45.072080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:45.072938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:45.073403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:45.558740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:45.571289 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83b624ee-15bb-4927-aec7-7ce917b193f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1365 microversion: 2.1 time: 0.626267 Jun 16 18:52:45.573046 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2278/4646] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:44 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1365 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:45.595910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:45.607391 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b535a75c-b461-474f-ae46-5cdd588c736c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.551193 Jun 16 18:52:45.608910 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2369/4647] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:45 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:45.995546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:45.996929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:46.005108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:46.018398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:46.020056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:46.022942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:46.486193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e6ae3a4b-a38f-499d-bd05-1b7ad2db4ec2 req-26bd152c-6f54-4d65-aca4-ccc1486f8a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1090fa06-d332-40b5-93e1-43ac21219bfc", "tag": "57207631-1ef8-4f15-8f13-056f9349c284"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:46.507627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e6ae3a4b-a38f-499d-bd05-1b7ad2db4ec2 req-26bd152c-6f54-4d65-aca4-ccc1486f8a2e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:46.508347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e6ae3a4b-a38f-499d-bd05-1b7ad2db4ec2 req-26bd152c-6f54-4d65-aca4-ccc1486f8a2e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:46.534746 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e6ae3a4b-a38f-499d-bd05-1b7ad2db4ec2 req-26bd152c-6f54-4d65-aca4-ccc1486f8a2e service nova] Creating event network-changed:57207631-1ef8-4f15-8f13-056f9349c284 for instance 1090fa06-d332-40b5-93e1-43ac21219bfc on n-h1-846209-2 Jun 16 18:52:46.554738 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e6ae3a4b-a38f-499d-bd05-1b7ad2db4ec2 req-26bd152c-6f54-4d65-aca4-ccc1486f8a2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073249 Jun 16 18:52:46.555744 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2370/4648] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:52:46.593550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:46.594313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:46.595363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:46.606287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:46.606812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:46.607269 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17562813-a6f9-448b-ba19-fcf55e80c4ad tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.618338 Jun 16 18:52:46.607531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:46.607981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:46.608735 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2279/4649] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:45 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:46.629409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:46.631370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:46.656375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:46.658241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:46.669074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:46.669950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:47.093954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:47.108786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-949a3568-cf9c-42da-a577-63622b1881be tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1365 microversion: 2.1 time: 0.521972 Jun 16 18:52:47.114508 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2371/4650] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:46 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1365 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:47.155763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:47.166092 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bd6bec0-79eb-406f-a4fc-c0c8a58f655e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.545186 Jun 16 18:52:47.166778 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2280/4651] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:46 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:47.626789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:47.627463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:47.648585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:47.649143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:47.651160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:47.651400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:47.861029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:47.869471 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef718836-7c2b-41ce-85bf-6fee32101f64 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.247323 Jun 16 18:52:47.873959 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2372/4652] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:47 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:48.127598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:48.128241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:48.131005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:48.136613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:48.137060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:48.138045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:48.138660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:48.184446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:48.185838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:48.194213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:48.195055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:48.196140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:48.196953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:48.385122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:48.395170 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-43a088a4-4314-40e6-9a64-b2516a22e410 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.215376 Jun 16 18:52:48.411052 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2373/4653] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:48 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:48.627341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3b12ae4f-f511-4a16-a0bd-b23e0c51c045 req-fba4de43-1520-4c42-a6e6-ba48c9b4e0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe706ed5-8d87-40f3-96f8-d3270de6c7c1", "tag": "5521b3a5-e396-46a4-a2b0-8db4731ac0bf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:48.636085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3b12ae4f-f511-4a16-a0bd-b23e0c51c045 req-fba4de43-1520-4c42-a6e6-ba48c9b4e0e1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:48.636620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3b12ae4f-f511-4a16-a0bd-b23e0c51c045 req-fba4de43-1520-4c42-a6e6-ba48c9b4e0e1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:48.649031 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3b12ae4f-f511-4a16-a0bd-b23e0c51c045 req-fba4de43-1520-4c42-a6e6-ba48c9b4e0e1 service nova] Creating event network-changed:5521b3a5-e396-46a4-a2b0-8db4731ac0bf for instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 on n-h1-846209-2 Jun 16 18:52:48.654061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3b12ae4f-f511-4a16-a0bd-b23e0c51c045 req-fba4de43-1520-4c42-a6e6-ba48c9b4e0e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030632 Jun 16 18:52:48.654692 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2374/4654] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:52:48.824878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:48.833264 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afde74c3-3235-46c1-9a56-82c062abe2a2 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1365 microversion: 2.1 time: 0.709416 Jun 16 18:52:48.834059 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2281/4655] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:48 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1365 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:48.890128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:48.890916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:48.898933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:48.899581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:48.900635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:48.901141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:48.906774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:49.314730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:49.326475 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-06397cc9-5593-49f6-8247-26fe8c1840e8 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.441984 Jun 16 18:52:49.327452 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2375/4656] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:48 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:49.418704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:49.419325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:49.426544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:49.427135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:49.428636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:49.429300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:49.852885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:49.854097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:49.862240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:49.863639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:49.865294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:49.866124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:50.138264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:50.149047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:50.160569 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c141382-41ee-4f47-9d11-13e95ac53b64 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1365 microversion: 2.1 time: 0.312801 Jun 16 18:52:50.161075 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9efd8338-fca4-4003-bee4-997e6b07a4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.744301 Jun 16 18:52:50.163390 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2282/4657] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:49 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:50.170781 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2376/4658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:49 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:50.343818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:50.344474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:50.362811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:50.363574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:50.371125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:50.372044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:50.560221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:50.569744 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dae3415f-8209-4616-88bc-d564c1c532f4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.229677 Jun 16 18:52:50.578012 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2283/4659] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:50 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:51.183964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:51.184690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:51.191090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:51.191687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:51.209297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:51.209857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:51.210660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:51.211103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:51.215261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:51.215717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:51.222384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:51.223041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:51.332437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:51.562485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:51.572267 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d20c1084-f3ce-4705-8dbd-7e8574a11274 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1505 microversion: 2.1 time: 0.392399 Jun 16 18:52:51.582671 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2377/4660] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:51 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:51.588178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:51.589004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:51.601171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:51.601942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:51.602888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:51.603486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:51.709881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:51.719038 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-81887d84-ae14-44e0-87f0-e05e3b85da9a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1365 microversion: 2.1 time: 0.532278 Jun 16 18:52:51.719871 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2284/4661] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:51 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1365 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:51.869383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:51.879133 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fc2d69b4-85b8-41f4-8eff-eb2b31135014 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.295069 Jun 16 18:52:51.880314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2378/4662] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:51 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:52.600200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:52.600914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:52.604182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=14 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:52.610318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:52.610775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:52.612111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:52.612111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:52.617264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:52.745111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:52.748403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:52.755342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:52.758647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:52.766139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:52.766826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:52.767739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:52.768401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:52.839744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:52.851804 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-64355ea5-523c-4ce9-b51c-95e87f4ce390 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1526 microversion: 2.1 time: 0.255469 Jun 16 18:52:52.853560 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2285/4663] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:52 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1526 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:52.901050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:52.903105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:52.916852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:52.918137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:52.920511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:52.921553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:53.013722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:53.030796 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-829fbfb5-4048-49db-b4f5-16990ef7790f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1365 microversion: 2.1 time: 0.296604 Jun 16 18:52:53.042481 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2379/4664] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:52 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:53.192100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:53.206134 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-faae7558-a5a2-4829-8493-f092784be292 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.311809 Jun 16 18:52:53.217128 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2286/4665] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:52 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:53.611590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-72b71e51-062d-4e24-9296-0b3313906630 req-6bb1c327-570b-4d62-af06-4a2bfa8b078c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1090fa06-d332-40b5-93e1-43ac21219bfc", "name": "network-vif-plugged", "status": "completed", "tag": "57207631-1ef8-4f15-8f13-056f9349c284"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:53.624098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-72b71e51-062d-4e24-9296-0b3313906630 req-6bb1c327-570b-4d62-af06-4a2bfa8b078c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:53.625023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-72b71e51-062d-4e24-9296-0b3313906630 req-6bb1c327-570b-4d62-af06-4a2bfa8b078c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:53.640919 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-72b71e51-062d-4e24-9296-0b3313906630 req-6bb1c327-570b-4d62-af06-4a2bfa8b078c service nova] Creating event network-vif-plugged:57207631-1ef8-4f15-8f13-056f9349c284 for instance 1090fa06-d332-40b5-93e1-43ac21219bfc on n-h1-846209-2 Jun 16 18:52:53.649252 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-72b71e51-062d-4e24-9296-0b3313906630 req-6bb1c327-570b-4d62-af06-4a2bfa8b078c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311703 Jun 16 18:52:53.650008 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2380/4666] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:53.870376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:53.871091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:53.884705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:53.885162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:53.891797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:53.893278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:54.383880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:54.397487 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-235c63a1-9782-4683-bce7-6e458e91d5ca tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.530721 Jun 16 18:52:54.398861 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2287/4667] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:53 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:54.420497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:54.429203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:54.441098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:54.444364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:54.445244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:54.445729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:54.571746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:54.573054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:54.591703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:54.595043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:54.597448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:54.603570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:54.984009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:54.993601 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e238af8-49e1-4118-8198-e87dba63dfb8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1365 microversion: 2.1 time: 0.940751 Jun 16 18:52:54.996377 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2381/4668] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:54 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1365 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:55.008653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-671ee687-256f-4fd4-93df-f75173f80338 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:55.008653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-671ee687-256f-4fd4-93df-f75173f80338 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:55.015590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-671ee687-256f-4fd4-93df-f75173f80338 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.016650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-671ee687-256f-4fd4-93df-f75173f80338 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.017453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-671ee687-256f-4fd4-93df-f75173f80338 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.018078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-671ee687-256f-4fd4-93df-f75173f80338 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.073559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:55.086508 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bb0a07ca-9183-4b0f-b96d-7345f4db4e06 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.668496 Jun 16 18:52:55.097398 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2288/4669] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:54 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:55.100048 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-671ee687-256f-4fd4-93df-f75173f80338 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088636 Jun 16 18:52:55.101711 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2382/4670] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:52:54 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:52:55.238533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:55.239311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:55.247547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.248650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.249638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.250748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.289614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:52:55.424621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:55.425483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:55.444896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.446709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.448295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.450339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.461867 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8808d4de-a3b7-4f0d-8612-5b906a5a45cd tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 204 len: 0 microversion: 2.1 time: 0.221387 Jun 16 18:52:55.466938 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2289/4671] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:52:55 2022] DELETE /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:52:55.486490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:55.487512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:55.502212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.503013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.505966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:55.506616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:55.890702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:55.901053 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-06764fb5-8585-43c1-8fb9-cdf9f05a5fe9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.480295 Jun 16 18:52:55.901712 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2383/4672] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:55 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:56.022812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:56.024800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:56.047918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.050549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:56.055162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.062516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:56.085137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:56.135552 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-67af0248-dd35-4aca-9c86-2462e43260ac tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1673 microversion: 2.1 time: 0.663260 Jun 16 18:52:56.137036 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2290/4673] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:55 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1673 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:56.151785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:56.155689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:56.174541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.176683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:56.179774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.181682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:56.494066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:56.512739 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9fbfcfc6-efe2-433e-928d-e5d792af66bb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 0.364752 Jun 16 18:52:56.513342 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2291/4674] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:56 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:56.531140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:56.546093 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2e443d8e-3d01-42a3-997b-0cc650fd50aa tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1554 microversion: 2.1 time: 0.532527 Jun 16 18:52:56.546976 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2384/4675] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:56 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1554 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:56.569981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd97cf93-b56a-47db-bc31-1c9498beebcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:56.570656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd97cf93-b56a-47db-bc31-1c9498beebcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:56.594033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd97cf93-b56a-47db-bc31-1c9498beebcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.596491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd97cf93-b56a-47db-bc31-1c9498beebcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:56.598209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd97cf93-b56a-47db-bc31-1c9498beebcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.598663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd97cf93-b56a-47db-bc31-1c9498beebcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:56.731837 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd97cf93-b56a-47db-bc31-1c9498beebcc tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170249 Jun 16 18:52:56.733675 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2292/4676] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:52:56 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:56.918556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:56.919180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:56.925553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.926041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:56.926838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:56.927833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:57.154747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:57.155424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:57.166025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:57.166499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:57.185439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:57.187462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:57.322258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:57.332122 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-265773d4-2d09-4424-9ba4-251f5b62b007 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.417349 Jun 16 18:52:57.332728 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2385/4677] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:56 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:57.386036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6e6ece21-63db-4a59-893c-48072e6afa12 req-1db16530-a926-4c7b-ac30-e7390fc8c4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe706ed5-8d87-40f3-96f8-d3270de6c7c1", "name": "network-vif-plugged", "status": "completed", "tag": "5521b3a5-e396-46a4-a2b0-8db4731ac0bf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:57.450227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6e6ece21-63db-4a59-893c-48072e6afa12 req-1db16530-a926-4c7b-ac30-e7390fc8c4ad service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:57.453368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6e6ece21-63db-4a59-893c-48072e6afa12 req-1db16530-a926-4c7b-ac30-e7390fc8c4ad service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:57.531487 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6e6ece21-63db-4a59-893c-48072e6afa12 req-1db16530-a926-4c7b-ac30-e7390fc8c4ad service nova] Creating event network-vif-plugged:5521b3a5-e396-46a4-a2b0-8db4731ac0bf for instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 on n-h1-846209-2 Jun 16 18:52:57.534075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:57.554896 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6e6ece21-63db-4a59-893c-48072e6afa12 req-1db16530-a926-4c7b-ac30-e7390fc8c4ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184248 Jun 16 18:52:57.560871 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3d173e2-4499-4231-8f15-6556b7eb8767 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1673 microversion: 2.1 time: 0.410315 Jun 16 18:52:57.565024 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2386/4678] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:57.578180 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2293/4679] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:57 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1673 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:57.596193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:57.600888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:57.630396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:57.631854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:57.632868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:57.633470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:58.356751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:58.357393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:58.390528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:58.390987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:58.396735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:58.399814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:58.667088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:58.683805 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2cededfa-331a-403f-921d-aa79d581dd9d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 1.113709 Jun 16 18:52:58.685236 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2387/4680] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:57 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:58.697251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:58.698558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:58.706565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:58.707278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:58.709022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:58.709771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:58.905210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:58.919038 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f529846-d57a-482a-9cf3-f2e9f7fdfc87 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.574178 Jun 16 18:52:58.922162 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2294/4681] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:58 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:59.103126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:52:59.122381 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b6beca7-2642-4f96-9979-538ac321bb30 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1673 microversion: 2.1 time: 0.432867 Jun 16 18:52:59.126939 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2388/4682] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:58 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1673 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:59.478306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0f811b21-8c70-49c6-b5dd-c0d5c073f422 req-60204d70-e030-49f4-860d-ddb69ee21f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1090fa06-d332-40b5-93e1-43ac21219bfc", "tag": "57207631-1ef8-4f15-8f13-056f9349c284"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:59.518415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0f811b21-8c70-49c6-b5dd-c0d5c073f422 req-60204d70-e030-49f4-860d-ddb69ee21f18 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:59.518885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0f811b21-8c70-49c6-b5dd-c0d5c073f422 req-60204d70-e030-49f4-860d-ddb69ee21f18 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:59.575403 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0f811b21-8c70-49c6-b5dd-c0d5c073f422 req-60204d70-e030-49f4-860d-ddb69ee21f18 service nova] Creating event network-changed:57207631-1ef8-4f15-8f13-056f9349c284 for instance 1090fa06-d332-40b5-93e1-43ac21219bfc on n-h1-846209-2 Jun 16 18:52:59.602656 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0f811b21-8c70-49c6-b5dd-c0d5c073f422 req-60204d70-e030-49f4-860d-ddb69ee21f18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129202 Jun 16 18:52:59.604753 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2295/4683] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:59.707441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:59.709077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:52:59.746085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:59.750833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:59.751963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:59.755140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:59.764971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-474acb53-31f9-4ba5-95f1-d8c1d46985d1 req-ff221ae1-1306-4625-97b9-107f1a6531b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfa0c92-cc24-43e1-b93b-a5e2e6845459", "name": "network-vif-plugged", "status": "completed", "tag": "330b4c1f-c94a-417f-955b-471358e0adc4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:59.799635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-474acb53-31f9-4ba5-95f1-d8c1d46985d1 req-ff221ae1-1306-4625-97b9-107f1a6531b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:52:59.802448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-474acb53-31f9-4ba5-95f1-d8c1d46985d1 req-ff221ae1-1306-4625-97b9-107f1a6531b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:52:59.850710 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-474acb53-31f9-4ba5-95f1-d8c1d46985d1 req-ff221ae1-1306-4625-97b9-107f1a6531b2 service nova] Creating event network-vif-plugged:330b4c1f-c94a-417f-955b-471358e0adc4 for instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 on n-h1-846209-2 Jun 16 18:52:59.874527 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-474acb53-31f9-4ba5-95f1-d8c1d46985d1 req-ff221ae1-1306-4625-97b9-107f1a6531b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115922 Jun 16 18:52:59.891218 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2296/4684] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:52:59.940536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:59.941298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:00.005820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:00.006013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:00.010772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:00.011555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:00.876441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:00.886620 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6709251d-6ea3-43bd-9544-03fe321be730 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1314 microversion: 2.1 time: 1.186073 Jun 16 18:53:00.887227 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2389/4685] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:59 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1314 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:00.915347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:00.915982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:00.942309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:00.942821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:00.951406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:00.957755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:01.172941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:01.192303 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fe313acb-115d-4762-8162-ea289a7667c3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 1.253246 Jun 16 18:53:01.197326 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2297/4686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:52:59 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:01.307302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:01.325114 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-495e75ff-346f-4940-a357-7cf0fa3f9eb1 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1605 microversion: 2.1 time: 0.434282 Jun 16 18:53:01.327547 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2390/4687] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:00 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1605 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:01.903846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:01.905583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:01.918445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:01.924577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:01.925841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:01.926484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:02.211191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:02.213122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:02.241567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:02.242555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:02.243588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:02.250669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:03.453490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:03.469282 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b4d663c3-916f-4226-8e24-f987484d2299 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1500 microversion: 2.1 time: 1.570027 Jun 16 18:53:03.475684 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2298/4688] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:01 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1500 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:03.489329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:03.490723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:03.511569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:03.517712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:03.518526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:03.526025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:03.526693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:03.534838 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c81a11b3-6c83-4da5-b120-e6a7957a8e67 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 1.325631 Jun 16 18:53:03.537370 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2391/4689] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:02 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:03.555534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-22093ac6-83b1-4b18-91db-94fa75d515d2 req-9bbeec24-b2b7-4613-aa01-ff9298a58933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e7cff4-9488-49aa-b529-00d7ad69b2c7", "name": "network-vif-deleted", "tag": "e16c32e7-5eed-4ad5-aef8-724c589780ac"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:03.576194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:03.582544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-22093ac6-83b1-4b18-91db-94fa75d515d2 req-9bbeec24-b2b7-4613-aa01-ff9298a58933 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:03.584313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-22093ac6-83b1-4b18-91db-94fa75d515d2 req-9bbeec24-b2b7-4613-aa01-ff9298a58933 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:03.626716 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-22093ac6-83b1-4b18-91db-94fa75d515d2 req-9bbeec24-b2b7-4613-aa01-ff9298a58933 service nova] Creating event network-vif-deleted:e16c32e7-5eed-4ad5-aef8-724c589780ac for instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 on n-h1-846209-2 Jun 16 18:53:03.642895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:03.643825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:03.644537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lazy-loading 'fault' on Instance uuid 40e7cff4-9488-49aa-b529-00d7ad69b2c7 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:53:03.646771 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-22093ac6-83b1-4b18-91db-94fa75d515d2 req-9bbeec24-b2b7-4613-aa01-ff9298a58933 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104817 Jun 16 18:53:03.648038 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2392/4690] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:03.693692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:03.695361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:03.738059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:03.743570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:03.746363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:03.747222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:03.826168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:03.836594 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d85cb7b3-fd52-41b8-834c-e9687281e16f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 200 len: 1326 microversion: 2.1 time: 0.359430 Jun 16 18:53:03.841775 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2299/4691] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:03 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 1326 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:03.875862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lazy-loading 'flavor' on Instance uuid fe706ed5-8d87-40f3-96f8-d3270de6c7c1 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:53:03.888578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:03.987629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a78a1436-76af-43f9-9af3-cbda24027fb4 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "POST /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1/action" status: 200 len: 32 microversion: 2.1 time: 0.336616 Jun 16 18:53:03.995061 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2393/4692] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:53:03 2022] POST /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:53:04.011345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:04.018025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:04.056006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:04.065037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:04.067217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:04.073133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:04.560770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:04.564547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:04.597486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:04.598377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:04.600087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:04.602558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:04.867695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:04.876631 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6808d04b-16e2-489c-9a8b-49e829c220a7 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.880994 Jun 16 18:53:04.883992 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2300/4693] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:03 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:04.894896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:04.895634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:04.921194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:04.921666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:04.922498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:04.922940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:04.953026 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] HTTP exception thrown: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Request method failure captured: Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 HTTP/1.1 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3sYNyFDeqc8yTn7L9g8d1rzX9oxl0U18a2uyCSpu6xirve6_Xg-xVzILVfejrne60B01MnxSCXG44kiz4VAO4y1lMhyolsqaVQKanNSc4sZ3cBIxOJE0P0DL5Aq1VEcmfW1Tk0453WxLeTO2adKJ0K8osUKPO8ijzoBjDGOPSgw6Qs Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a625bc4b5480485189cb007113356b39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a625bc4b5480485189cb007113356b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fe2a00a0282a4a0f80d6ab03cd8cf21a Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '40e7cff4-9488-49aa-b529-00d7ad69b2c7'} Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:04.954774 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Returning 404 to user: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:53:04.960036 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b8b5bc58-6003-413a-b88a-933a364c05e4 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 404 len: 111 microversion: 2.1 time: 0.070925 Jun 16 18:53:04.963882 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2301/4694] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:04 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:53:04.980840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-54cc468a-f5dd-482c-9602-06cb9deb25e6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '.version_select at 0x7f866da090d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:05.016449 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-54cc468a-f5dd-482c-9602-06cb9deb25e6 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838189399" status: 202 len: 0 microversion: 2.1 time: 0.051383 Jun 16 18:53:05.017245 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2302/4695] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838189399 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:53:05.197860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:05.216677 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5af3fc83-376e-46c1-b55c-c2fd088bed61 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.659963 Jun 16 18:53:05.227401 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2394/4696] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:04 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:05.899164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:05.900509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:05.908851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:05.909686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:05.911005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:05.912406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:05.940359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:06.213569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:06.227901 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ecbf421a-0c1b-44e4-8c0c-482e4a52b19a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.335834 Jun 16 18:53:06.229048 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2303/4697] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:05 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:06.238151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:06.240033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:06.258470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:06.260843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:06.263888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:06.264376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:06.468027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8fd30d0-4c38-4d48-a2fc-c70c76d3fe71 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'create', calling method: .version_select at 0x7f866d974670>, body: {"keypair": {"name": "tempest-keypair-1573732751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNorAxfGZufrHQK3it2hpc39qkNFDWzoUZQXagE2XVFEQZLF7Y5EwlZOfdJjbZv8sCMvU2TjcXfaIcvUNsCDz2eE1T1ChQ1ZVPesd+WF2sBUp+ch6UiRsJYyRHVasQDobw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:06.500867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a8fd30d0-4c38-4d48-a2fc-c70c76d3fe71 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for project a625bc4b5480485189cb007113356b39. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:53:06.515271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a8fd30d0-4c38-4d48-a2fc-c70c76d3fe71 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for user fe2a00a0282a4a0f80d6ab03cd8cf21a and project a625bc4b5480485189cb007113356b39. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:53:06.575791 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8fd30d0-4c38-4d48-a2fc-c70c76d3fe71 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111873 Jun 16 18:53:06.576852 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2304/4698] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 18:53:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:53:06.625103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:06.640101 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ff552ba-7800-4c7b-a4f3-34860b6f474a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.408158 Jun 16 18:53:06.641686 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2395/4699] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:06 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:06.984946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:06.986167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:07.001483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.002511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.003660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.004269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.247515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:07.248896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:07.266490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.267328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.269070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.269737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.331871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:07.342983 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-129d0b51-b4fe-4975-bce8-dbf71e15a907 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.362757 Jun 16 18:53:07.346178 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2305/4700] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:06 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:07.375593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:07.376239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:07.404448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.404923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.405726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.406188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.685950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:07.698206 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c833f2db-f9b5-495e-9651-7c610749bd28 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.455586 Jun 16 18:53:07.707778 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2396/4701] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:07 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:07.720773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:07.721650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:07.774122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.782016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.783145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.789550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.840380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:07.852875 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91bc1824-da8a-45a7-9aae-0e71767d0165 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.490854 Jun 16 18:53:07.854284 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2306/4702] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:07 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:07.881805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:07.882936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:07.901675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.902570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:07.904161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:07.906099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:08.225700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:08.248314 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0505a8cc-3ccc-413c-8495-2a7495765c66 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.547960 Jun 16 18:53:08.251446 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2397/4703] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:07 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:08.281673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:08.297042 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-279a2b72-85f8-4d96-86f5-2b2db4e2222d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.423378 Jun 16 18:53:08.299102 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2307/4704] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:07 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:08.322390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:08.323009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:08.339110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:08.339581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:08.340383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:08.340838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:08.541398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:08.557407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b21dbce-5919-4860-af07-55b86daee326 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.241228 Jun 16 18:53:08.559159 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2398/4705] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:08 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:08.718824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:08.719858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:08.733887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:08.737415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:08.742815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:08.743582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:08.906469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-736826753", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:09.035527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:09.047866 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2bff7111-270a-4735-b55a-e7ff963749d9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.335637 Jun 16 18:53:09.050816 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2308/4706] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:08 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:09.271193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:09.272172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:09.297112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:09.297835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:09.298417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:09.298872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:09.399531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] validate_networks() for [('8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:53:09.863368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:09.872496 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e685554-a74f-488e-bb7e-f8c9f16dcaab tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.605999 Jun 16 18:53:09.878464 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2309/4707] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:09 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:09.944076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1111461488", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14b492a6-fcde-467e-acd6-c6be898b2ffe"}], "security_groups": [{"name": "tempest-securitygroup--960653220"}], "key_name": "tempest-keypair-1573732751", "user_data": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:10.434990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] validate_networks() for [('14b492a6-fcde-467e-acd6-c6be898b2ffe', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:53:10.825923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:53:10.827251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:53:10.827748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:53:10.828170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:53:10.828587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:53:10.847375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:10.847842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:10.848732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:10.849745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:10.914608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:53:10.925315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for user 0bad5f4aa84e4b978a5a92478b6772bf and project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:53:10.947150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:53:10.952180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:53:11.096744 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1ca0ed9c-4ce2-48d7-b457-88aa990af5f4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.197976 Jun 16 18:53:11.100173 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2399/4708] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:53:11.125409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:11.126095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:11.137221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:11.137975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:11.138991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:11.139696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:11.535225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:11.538571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:53:11.539215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:53:11.540318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:53:11.542067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:53:11.543289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:53:11.546856 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b33132cd-b561-4d6c-9f15-ab5523223b16 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.445293 Jun 16 18:53:11.557402 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2400/4709] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:11 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:11.564787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:11.565731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:11.573042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:11.573832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:11.575830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:11.577303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:11.587907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:11.588553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:11.589479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:11.589953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:11.663188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for project a625bc4b5480485189cb007113356b39. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:53:11.689265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Getting quotas for user fe2a00a0282a4a0f80d6ab03cd8cf21a and project a625bc4b5480485189cb007113356b39. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:53:11.749231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:53:11.760766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:53:11.808677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:11.822112 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4e3d01ff-d659-433b-98b0-ca7d59784f60 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.262742 Jun 16 18:53:11.837397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2401/4710] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:11 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:11.854920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad2dc6d2-80bf-426c-93b9-caa6cb610996 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:11.861825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ad2dc6d2-80bf-426c-93b9-caa6cb610996 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:11.918562 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03aab684-234c-4b82-beb5-df09f689f715 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.995495 Jun 16 18:53:11.927181 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2310/4711] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:53:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:53:11.953582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cea93234-de00-4599-b5cd-f58f37fce3c3 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:11.967170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cea93234-de00-4599-b5cd-f58f37fce3c3 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:12.074109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ad2dc6d2-80bf-426c-93b9-caa6cb610996 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:12.082652 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ad2dc6d2-80bf-426c-93b9-caa6cb610996 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1214 microversion: 2.1 time: 0.242320 Jun 16 18:53:12.086240 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2402/4712] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:11 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:12.198153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cea93234-de00-4599-b5cd-f58f37fce3c3 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:12.206998 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cea93234-de00-4599-b5cd-f58f37fce3c3 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1238 microversion: 2.1 time: 0.271212 Jun 16 18:53:12.214631 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2311/4713] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:11 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1238 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:12.564391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:12.565439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:12.589061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:12.590897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:12.592127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:12.593275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:12.844294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:12.846819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:12.858357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:12.877372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:12.877888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:12.878767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:12.879224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:12.975566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:12.984537 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aaf01f1b-ab73-47a4-99f5-21cecb6c58a1 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.423937 Jun 16 18:53:13.006335 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2403/4714] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:12 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:13.102082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:13.102762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:13.118089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:13.118560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:13.119351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:13.119795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:13.338935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:13.357293 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f6fff4d-3581-4b92-9ab7-d42b53399d5e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.517840 Jun 16 18:53:13.361771 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2312/4715] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:12 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:13.392184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:13.394659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:13.414714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:13.424540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:13.427181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:13.428375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:13.491295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:13.499822 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a1289ab-6937-4593-9503-f4549dacbc54 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1210 microversion: 2.1 time: 0.402803 Jun 16 18:53:13.511791 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2404/4716] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:13 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1210 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:13.589760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:13.602674 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b8a8621a-4802-4e10-b614-90f50d6d34fa tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1234 microversion: 2.1 time: 0.234546 Jun 16 18:53:13.620987 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2313/4717] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:13 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1234 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:14.012674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:14.013301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:14.029205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:14.032591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:14.033961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:14.037272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:14.380879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:14.381436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:14.407894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:14.408770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:14.413242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:14.415581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:14.849631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:14.885110 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3eebe86b-ddfb-44fc-8e20-ca175c26520d tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.864442 Jun 16 18:53:14.888044 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2405/4718] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:14 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:14.903502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:14.909580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:14.927563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:14.928344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:14.930390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:14.931966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:14.973842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:14.984151 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad2fe5ff-0e70-49fd-9dc4-8d9628060f08 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.607435 Jun 16 18:53:14.990979 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2314/4719] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:14 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:15.007089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:15.010842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:15.021124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:15.024040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:15.026812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:15.030550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:15.274690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:15.284553 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3c86ae7-e629-4252-8be6-d9a39f64de30 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1266 microversion: 2.1 time: 0.393364 Jun 16 18:53:15.289077 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2406/4720] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:14 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:15.596946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:15.611459 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03a15f8e-b5b8-4b4c-ab65-6c748792a13f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1308 microversion: 2.1 time: 0.618953 Jun 16 18:53:15.614951 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2315/4721] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:14 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:15.907113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:15.908279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:15.954067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:15.957174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:15.967249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:15.969206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:16.013556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:16.014555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:16.056096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:16.057282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:16.062098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:16.063360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:17.025938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:17.039313 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2db5afaa-1388-4c6b-b740-df10bfb341dc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 1.035346 Jun 16 18:53:17.049227 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2316/4722] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:16 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:17.061035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:17.061654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:17.090444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:17.091201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:17.092041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:17.093297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:17.421074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:17.443512 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5b82a28d-d49d-4443-9602-bdeda7ee98a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1272 microversion: 2.1 time: 0.397381 Jun 16 18:53:17.444894 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2317/4723] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:17 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:17.461965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:17.464992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:17.485156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:17.487399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:17.490770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:17.491544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:17.702900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:17.722293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:17.735852 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7fc75e52-4e2d-4109-846b-ad5ce5fe709f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1296 microversion: 2.1 time: 0.289474 Jun 16 18:53:17.736925 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2318/4724] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:17 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1296 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:17.737069 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fee9e194-d2d4-42ca-87fc-0b01ceed7da9 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 1.831962 Jun 16 18:53:17.756145 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2407/4725] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:15 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:18.057359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:18.058784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:18.073043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:18.073995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:18.075057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:18.076547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:18.461594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:18.462243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:18.486463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:18.487208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:18.488239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:18.489439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:18.737734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:18.764135 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f196e8c-b334-401f-b58a-b9811f2a70ad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 0.710942 Jun 16 18:53:18.764739 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2319/4726] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:18 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:18.774930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:18.774930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:18.783174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:18.783800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:18.785280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:18.786403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:19.052527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:19.065868 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-984ebd90-1b3e-474a-bd0b-ce0c5055a088 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1296 microversion: 2.1 time: 0.299935 Jun 16 18:53:19.073581 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2320/4727] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:18 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1296 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:19.081861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:19.083095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:19.111875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:19.112194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:19.115383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:19.116178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:19.144163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:19.158625 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b29fef32-11e6-423a-9810-8ab3f0edfb4e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 0.696473 Jun 16 18:53:19.163196 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2408/4728] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:18 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:19.465358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:19.473940 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a6e44ed-38cd-4a5d-a30d-28652aae56d6 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.398711 Jun 16 18:53:19.475372 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2321/4729] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:19 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:19.782180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:19.783133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:19.814041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:19.815662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:19.816846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:19.818073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:20.084187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:20.084773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:20.113043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:20.118225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:20.128199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:20.136861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:20.215843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:20.877005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:21.405360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:21.419224 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b3db6306-48c2-438a-a77b-04485b00851d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1521 microversion: 2.1 time: 1.641048 Jun 16 18:53:21.432961 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2409/4730] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:19 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1521 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:21.441385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:21.444311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:21.451556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:21.452343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:21.454219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:21.454895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:21.513362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:21.624892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:21.903748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:21.920275 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-839e8e21-52b7-4b8b-8c01-b0b37a2ec343 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1363 microversion: 2.1 time: 1.840751 Jun 16 18:53:21.944703 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2322/4731] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:20 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1363 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:21.978187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:21.979328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:21.987883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:21.988610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:21.991081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:21.991728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.081875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:22.203649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:22.352687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:22.365478 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b534c9f-20fb-4c52-87c6-1338b54de0cf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 0.930535 Jun 16 18:53:22.375081 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2410/4732] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:21 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:22.647635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] Calling method '.version_select at 0x7f866dd0a3a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:22.648625 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:53:22.648625 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:53:22.649856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.650341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.710765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.712028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.746838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.748650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.776847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:22.795479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9ff85f41-0ed5-494e-869b-01a2883ed63a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.841598 Jun 16 18:53:22.800037 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2323/4733] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:21 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:22.827076 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2c1d642d-04a2-4280-a445-ca243eb45ea1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1059934918-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.450503 Jun 16 18:53:22.827691 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2411/4734] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:53:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:22.831106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3a543185-a1d2-46de-8fd3-c18c3ba535e5 req-7ab4819d-e8f4-4d92-b212-4066eaf8f518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f19262-d920-4de6-a314-24ed97ac6411", "tag": "65d760b7-4da8-4082-9548-7de9b4d8e55e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:22.849155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:22.850806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:22.875008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3a543185-a1d2-46de-8fd3-c18c3ba535e5 req-7ab4819d-e8f4-4d92-b212-4066eaf8f518 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.876486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3a543185-a1d2-46de-8fd3-c18c3ba535e5 req-7ab4819d-e8f4-4d92-b212-4066eaf8f518 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.876983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.877636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.878646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.880632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.917623 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3a543185-a1d2-46de-8fd3-c18c3ba535e5 req-7ab4819d-e8f4-4d92-b212-4066eaf8f518 service nova] Creating event network-changed:65d760b7-4da8-4082-9548-7de9b4d8e55e for instance 66f19262-d920-4de6-a314-24ed97ac6411 on n-h2-846209-2 Jun 16 18:53:22.932090 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3a543185-a1d2-46de-8fd3-c18c3ba535e5 req-7ab4819d-e8f4-4d92-b212-4066eaf8f518 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118903 Jun 16 18:53:22.935785 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2324/4735] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:22.954043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:22.955096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:22.971971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.973846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:22.975165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:22.976006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:23.512183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:23.525201 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a48714f-7483-434c-bba3-7b01d6003f97 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1503 microversion: 2.1 time: 0.696429 Jun 16 18:53:23.525828 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2412/4736] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:22 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1503 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:23.543768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:23.545421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:23.565691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:23.570513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:23.571556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:23.572020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:23.656328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:23.674013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-33d82e1b-78dd-4b3a-9af9-1a76dce2997c tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1363 microversion: 2.1 time: 0.736680 Jun 16 18:53:23.675943 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2325/4737] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:22 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1363 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:23.816044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:23.816767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:23.828424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:23.828888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:23.829675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:23.830144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:24.229751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:24.248359 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-328044c9-c9b6-4b18-80e2-6931ae4c8acb tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.436334 Jun 16 18:53:24.248971 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2326/4738] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:23 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:24.284337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:24.299086 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8e600ac4-cab9-47ed-a6e3-22792c858ad7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 0.767767 Jun 16 18:53:24.300553 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2413/4739] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:23 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:24.545752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:24.547604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:24.569157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:24.570392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:24.571567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:24.573943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:24.691409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:24.693271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:24.705445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:24.705988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:24.706834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:24.707286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:25.201550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:25.216521 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83d27da6-3d23-4a3e-ab1e-602ed212b44e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1503 microversion: 2.1 time: 0.677122 Jun 16 18:53:25.217461 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2327/4740] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:24 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1503 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:25.222366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9b5cddf5-e4c4-4b2b-8acc-db0781bb78b7 req-f072d011-1cf1-48b1-9e15-01e9de06c551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d89515d-9120-4299-ac71-21eca43467c5", "tag": "4dbc5775-f226-49da-8d7c-22da33199596"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:25.245849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9b5cddf5-e4c4-4b2b-8acc-db0781bb78b7 req-f072d011-1cf1-48b1-9e15-01e9de06c551 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:25.255287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9b5cddf5-e4c4-4b2b-8acc-db0781bb78b7 req-f072d011-1cf1-48b1-9e15-01e9de06c551 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:25.282451 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9b5cddf5-e4c4-4b2b-8acc-db0781bb78b7 req-f072d011-1cf1-48b1-9e15-01e9de06c551 service nova] Creating event network-changed:4dbc5775-f226-49da-8d7c-22da33199596 for instance 5d89515d-9120-4299-ac71-21eca43467c5 on n-h2-846209-2 Jun 16 18:53:25.292108 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9b5cddf5-e4c4-4b2b-8acc-db0781bb78b7 req-f072d011-1cf1-48b1-9e15-01e9de06c551 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073103 Jun 16 18:53:25.297780 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2328/4741] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:25.308790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:25.309514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:25.322905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:25.322905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:25.323383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:25.324008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:25.371619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:25.386600 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0608a028-8f0e-4472-a21f-5f6c3e879ae7 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1363 microversion: 2.1 time: 0.699207 Jun 16 18:53:25.390444 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2414/4742] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:24 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1363 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:25.395575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:25.404113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:25.421237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:25.423773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:25.426994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:25.433990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:25.974877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:25.987682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c8b4e769-9f00-4d48-81b5-c57e3944d41e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 0.595869 Jun 16 18:53:25.989106 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2415/4743] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:25 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:25.994144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c2f092a0-52a9-477e-a055-603763b95dc3 req-f211e4c7-9ab0-4067-9788-272a2e31cf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfa0c92-cc24-43e1-b93b-a5e2e6845459", "name": "network-vif-unplugged", "status": "completed", "tag": "330b4c1f-c94a-417f-955b-471358e0adc4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:26.005687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c2f092a0-52a9-477e-a055-603763b95dc3 req-f211e4c7-9ab0-4067-9788-272a2e31cf9a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.006433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c2f092a0-52a9-477e-a055-603763b95dc3 req-f211e4c7-9ab0-4067-9788-272a2e31cf9a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.012293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:26.023353 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d72c6431-8eec-4805-af90-6b4e89d290c0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1486 microversion: 2.1 time: 0.723703 Jun 16 18:53:26.024238 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2329/4744] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:25 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1486 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:26.037049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c2f092a0-52a9-477e-a055-603763b95dc3 req-f211e4c7-9ab0-4067-9788-272a2e31cf9a service nova] Creating event network-vif-unplugged:330b4c1f-c94a-417f-955b-471358e0adc4 for instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 on n-h1-846209-2 Jun 16 18:53:26.047209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c2f092a0-52a9-477e-a055-603763b95dc3 req-f211e4c7-9ab0-4067-9788-272a2e31cf9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056476 Jun 16 18:53:26.052150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a7be1b1-9685-4cc7-a92a-2ee886ea144c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:26.053426 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2416/4745] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:26.056189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a7be1b1-9685-4cc7-a92a-2ee886ea144c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:26.076038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a7be1b1-9685-4cc7-a92a-2ee886ea144c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.076785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a7be1b1-9685-4cc7-a92a-2ee886ea144c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.077603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a7be1b1-9685-4cc7-a92a-2ee886ea144c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.078443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a7be1b1-9685-4cc7-a92a-2ee886ea144c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.238134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:26.239592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:26.254820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.255844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.257163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.258868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.322254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a7be1b1-9685-4cc7-a92a-2ee886ea144c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "POST /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1/action" status: 202 len: 0 microversion: 2.1 time: 0.283645 Jun 16 18:53:26.328986 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2330/4746] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:53:26 2022] POST /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:53:26.335388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:26.336121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:26.342936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.343677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.344800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.354557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.846058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:26.859500 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f86ab5e8-6858-4594-af67-1df849c6bd0a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1494 microversion: 2.1 time: 0.529691 Jun 16 18:53:26.862247 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2331/4747] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:26 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1494 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:26.876866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:26.877507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:26.891839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.900201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.901290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:26.902134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:26.939383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:26.954274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ebae86db-3383-4ca6-b791-0e6a20743836 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1503 microversion: 2.1 time: 0.721624 Jun 16 18:53:26.963181 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2417/4748] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:26 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1503 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:27.007271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:27.008706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:27.020126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:27.024850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:27.025950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:27.026801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:28.095992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:28.114921 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98935ff9-544e-4da6-90f1-4c5690bcdbe5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1363 microversion: 2.1 time: 1.251235 Jun 16 18:53:28.120624 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2332/4749] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:26 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1363 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:28.131738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:28.144471 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1085e9c-de46-4b47-8bf9-2294246474a4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 1.142758 Jun 16 18:53:28.147473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:28.148609 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2418/4750] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:27 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:28.150804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:28.156346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:28.171961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:28.176571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:28.187735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:28.194281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:28.198152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:28.202443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:28.202898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:28.203696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:28.205509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:28.669348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:28.696691 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8cd6c3dd-139d-42ad-9cfc-4d629b35702b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1494 microversion: 2.1 time: 0.574440 Jun 16 18:53:28.720580 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2333/4751] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:28 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1494 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:28.828846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:28.850943 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0980bfef-1eba-4f41-9891-0a53ba94fe05 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 200 len: 1506 microversion: 2.1 time: 0.701000 Jun 16 18:53:28.851942 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2419/4752] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:28 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:28.869344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:28.870875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:28.887653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:28.888207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:28.890235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:28.891298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:28.963853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:53:28.981750 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.compute.api [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Working on deleting snapshot 3a372802-afd9-45e1-bd27-d5877eb5540c from shelved instance... Jun 16 18:53:29.128406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3a53a6ea-8fa2-4bd4-8748-5e483fde90eb req-df0536cd-4e41-4c03-9d58-66e41a1b5ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f19262-d920-4de6-a314-24ed97ac6411", "name": "network-vif-plugged", "status": "completed", "tag": "65d760b7-4da8-4082-9548-7de9b4d8e55e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:29.155909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3a53a6ea-8fa2-4bd4-8748-5e483fde90eb req-df0536cd-4e41-4c03-9d58-66e41a1b5ebc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:29.163448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3a53a6ea-8fa2-4bd4-8748-5e483fde90eb req-df0536cd-4e41-4c03-9d58-66e41a1b5ebc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:29.196430 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3a53a6ea-8fa2-4bd4-8748-5e483fde90eb req-df0536cd-4e41-4c03-9d58-66e41a1b5ebc service nova] Creating event network-vif-plugged:65d760b7-4da8-4082-9548-7de9b4d8e55e for instance 66f19262-d920-4de6-a314-24ed97ac6411 on n-h2-846209-2 Jun 16 18:53:29.206485 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3a53a6ea-8fa2-4bd4-8748-5e483fde90eb req-df0536cd-4e41-4c03-9d58-66e41a1b5ebc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084203 Jun 16 18:53:29.209256 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2420/4753] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:29.220321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:29.223339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:29.239057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:29.239057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:29.240176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:29.240642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:29.538909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:29.548701 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-024448cc-d86f-4322-b76b-b21c682220d2 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1363 microversion: 2.1 time: 0.335274 Jun 16 18:53:29.550185 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2421/4754] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:29 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:29.555606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:29.556509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:29.564400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:29.565089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:29.569378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:29.570348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:29.794312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:29.807635 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-01aef0a5-1385-4dc5-a611-3153db3b37b6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 0.251832 Jun 16 18:53:29.808936 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2422/4755] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:29 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:29.819048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:29.826411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:29.842741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:29.843367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:29.844599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:29.845186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:30.121617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:30.131627 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8ff77f18-97fd-4842-ae74-2099b3799a1c tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1494 microversion: 2.1 time: 0.317389 Jun 16 18:53:30.145481 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2423/4756] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:29 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1494 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:30.350278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Doing local delete in cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119207) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 16 18:53:30.362823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:30.363381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:30.374339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.compute.api [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 16 18:53:30.388101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] deallocate_for_instance() {{(pid=119207) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 16 18:53:30.569455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:30.570301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:30.579361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:30.580154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:30.581796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:30.583206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:31.032224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:31.053482 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9fa2f6c6-4314-42ae-b065-5bd30fe3476b tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1363 microversion: 2.1 time: 0.484307 Jun 16 18:53:31.056779 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2424/4757] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:30 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1363 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:31.064588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:31.071699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:31.110152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:31.110442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:31.111518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:31.112000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:31.473164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:31.493199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd50fc54-270e-4dc6-9b75-9f67f9da0c68 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 0.434929 Jun 16 18:53:31.495464 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2425/4758] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:31 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:31.515392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:31.516579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:31.533079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:31.534111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:31.536485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:31.538612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:32.050383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:32.067879 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a7727dc5-8d32-491f-aca0-60d290cbe0ec tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1500 microversion: 2.1 time: 0.558550 Jun 16 18:53:32.076809 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2426/4759] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:31 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1500 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:32.082875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-149322ac-d210-440d-b7d2-e2543fd9f378 req-9e17a6eb-3946-4208-b102-35fbc22765bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d89515d-9120-4299-ac71-21eca43467c5", "name": "network-vif-plugged", "status": "completed", "tag": "4dbc5775-f226-49da-8d7c-22da33199596"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:32.115093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-149322ac-d210-440d-b7d2-e2543fd9f378 req-9e17a6eb-3946-4208-b102-35fbc22765bc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:32.118931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-149322ac-d210-440d-b7d2-e2543fd9f378 req-9e17a6eb-3946-4208-b102-35fbc22765bc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:32.128488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Updating instance_info_cache with network_info: [] {{(pid=119207) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:53:32.150297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-149322ac-d210-440d-b7d2-e2543fd9f378 req-9e17a6eb-3946-4208-b102-35fbc22765bc service nova] Creating event network-vif-plugged:4dbc5775-f226-49da-8d7c-22da33199596 for instance 5d89515d-9120-4299-ac71-21eca43467c5 on n-h2-846209-2 Jun 16 18:53:32.167281 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-149322ac-d210-440d-b7d2-e2543fd9f378 req-9e17a6eb-3946-4208-b102-35fbc22765bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088497 Jun 16 18:53:32.173245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2427/4760] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:32.184856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:32.190091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:32.206690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:32.211093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:32.218103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:32.219174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:32.599775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:32.604127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:32.612134 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b71c9ed6-830a-49c7-8407-f55511c92980 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1550 microversion: 2.1 time: 0.437086 Jun 16 18:53:32.612730 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2428/4761] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:32 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1550 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:32.647132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:32.648115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:32.658197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:32.663315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:32.664394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:32.665157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:32.729538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:53:33.011209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bfb5bc51-1312-4bc7-9381-4dd21b7a2940 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 204 len: 0 microversion: 2.1 time: 0.390801 Jun 16 18:53:33.015552 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2429/4762] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:53:32 2022] DELETE /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:53:33.022843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-98acffcd-e352-4282-a97f-9d0a24c014df req-73a1940e-0a51-4486-8670-cc3278dae70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfa0c92-cc24-43e1-b93b-a5e2e6845459", "name": "network-vif-deleted", "tag": "330b4c1f-c94a-417f-955b-471358e0adc4"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:33.044907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:33.047137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-98acffcd-e352-4282-a97f-9d0a24c014df req-73a1940e-0a51-4486-8670-cc3278dae70b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.047595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-98acffcd-e352-4282-a97f-9d0a24c014df req-73a1940e-0a51-4486-8670-cc3278dae70b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.068609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_external_events [req-98acffcd-e352-4282-a97f-9d0a24c014df req-73a1940e-0a51-4486-8670-cc3278dae70b service nova] Unable to find a host for instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459. Dropping event network-vif-deleted {{(pid=119206) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 18:53:33.070324 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-98acffcd-e352-4282-a97f-9d0a24c014df req-73a1940e-0a51-4486-8670-cc3278dae70b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053655 Jun 16 18:53:33.071444 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2430/4763] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 18:53:33.082026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:33.083879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:33.092549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.093283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.094490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.095152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.140019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=9,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:33.236879 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-23c3fec7-d3c0-4d2e-b4b8-35d4ad598c98 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 204 len: 0 microversion: 2.1 time: 4.369270 Jun 16 18:53:33.237502 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2334/4764] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:53:28 2022] DELETE /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 0 bytes in 4375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:53:33.262725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ef09438-756c-4272-9056-256972813ddf tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:33.266655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ef09438-756c-4272-9056-256972813ddf tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:33.290024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ef09438-756c-4272-9056-256972813ddf tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.290495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ef09438-756c-4272-9056-256972813ddf tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.291402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ef09438-756c-4272-9056-256972813ddf tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.292054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ef09438-756c-4272-9056-256972813ddf tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.479011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:33.488001 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ceef4c8-f912-4104-96c1-5143e30a4fcc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1314 microversion: 2.1 time: 0.415291 Jun 16 18:53:33.489814 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2431/4765] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:33 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:33.500228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ef09438-756c-4272-9056-256972813ddf tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.253667 Jun 16 18:53:33.500228 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2335/4766] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 18:53:33 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:33.503344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:33.504380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:33.507796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:33.508687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:33.517743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.518594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.523022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.523884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.528058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.533189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.534734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:33.536363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:33.555500 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 HTTP/1.1 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2dfa0c92-cc24-43e1-b93b-a5e2e6845459'} Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:33.558458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:33.563741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:33.563741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:33.563741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:33.563741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:53:33.563741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:53:33.563741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:53:33.563741 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:33.565064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:53:33.566167 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72152b25-f610-4d44-ac66-29ccdd0b0c46 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 404 len: 111 microversion: 2.1 time: 0.064125 Jun 16 18:53:33.567510 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2432/4767] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:33 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:53:33.850854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1862715173", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6b5d8611-2f93-4d68-b741-180fc0d2bfa6"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:33.982398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] validate_networks() for [('6b5d8611-2f93-4d68-b741-180fc0d2bfa6', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:53:34.773742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:34.793555 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a7cb7188-6c27-4259-91d1-1a77e3bfc063 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 1.292990 Jun 16 18:53:34.803992 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2336/4768] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:33 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:34.803992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:34.803992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:34.811626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:34.812209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:34.813132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:34.813828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:35.186706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:35.197292 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-700bb7ab-99a5-4e25-be88-dc543f674ca7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1501 microversion: 2.1 time: 0.401350 Jun 16 18:53:35.211049 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2337/4769] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:34 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1501 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:35.227164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:35.228019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:35.237260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:35.248787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:35.249800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:35.250448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:35.562003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:53:35.564579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:53:35.565263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:53:35.565859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:53:35.566654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:53:35.606013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:35.606694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:35.607866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:35.609042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:35.651444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:53:35.667057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for user c60f8f3909974479836ac8b0363b9a08 and project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:53:35.689410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:53:35.695366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:53:35.736340 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.network.security_group_api [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Removing security group 4cb62854-4d3d-4cb7-af93-0564481bfdf9 from port 4dbc5775-f226-49da-8d7c-22da33199596 Jun 16 18:53:35.790204 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb46a9b5-0ff0-4703-ae6f-3e183577c316 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946548 Jun 16 18:53:35.791502 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2433/4770] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:53:35.807535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d30cfd4-d12b-4076-bf02-1a325ef1bc8d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:35.808167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d30cfd4-d12b-4076-bf02-1a325ef1bc8d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:36.006286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d30cfd4-d12b-4076-bf02-1a325ef1bc8d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:36.016220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d30cfd4-d12b-4076-bf02-1a325ef1bc8d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1215 microversion: 2.1 time: 0.218279 Jun 16 18:53:36.018590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2434/4771] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:35 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:36.026544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:36.034336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:36.055965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:36.056580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:36.060131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:36.060699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:36.984354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:37.003414 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-950ff307-bae1-4311-8ea4-8b9befd4c4f5 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 0.978718 Jun 16 18:53:37.013948 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2435/4772] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:36 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:37.047950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:37.054718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:37.079010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:37.082922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:37.085337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:37.087939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:37.810577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:37.833209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-588839bc-2e72-433e-a5b1-a7df8368fee3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1267 microversion: 2.1 time: 0.798571 Jun 16 18:53:37.849717 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2436/4773] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:37 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1267 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:37.869770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8f541334-4386-4143-bc71-05e0af03248e req-8ece37fe-b9f6-41ce-9a51-fe37fe0ca2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f19262-d920-4de6-a314-24ed97ac6411", "tag": "65d760b7-4da8-4082-9548-7de9b4d8e55e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:37.904172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8f541334-4386-4143-bc71-05e0af03248e req-8ece37fe-b9f6-41ce-9a51-fe37fe0ca2d5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:37.906127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8f541334-4386-4143-bc71-05e0af03248e req-8ece37fe-b9f6-41ce-9a51-fe37fe0ca2d5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:37.940420 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8f541334-4386-4143-bc71-05e0af03248e req-8ece37fe-b9f6-41ce-9a51-fe37fe0ca2d5 service nova] Creating event network-changed:65d760b7-4da8-4082-9548-7de9b4d8e55e for instance 66f19262-d920-4de6-a314-24ed97ac6411 on n-h2-846209-2 Jun 16 18:53:37.951933 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8f541334-4386-4143-bc71-05e0af03248e req-8ece37fe-b9f6-41ce-9a51-fe37fe0ca2d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099363 Jun 16 18:53:37.958624 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2437/4774] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:37.967936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-02fd53fb-3423-4aed-8dcf-815aee12278b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:37.972466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-02fd53fb-3423-4aed-8dcf-815aee12278b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:37.990928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02fd53fb-3423-4aed-8dcf-815aee12278b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:37.991784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02fd53fb-3423-4aed-8dcf-815aee12278b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:37.997187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02fd53fb-3423-4aed-8dcf-815aee12278b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:37.998252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02fd53fb-3423-4aed-8dcf-815aee12278b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:38.078871 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-02fd53fb-3423-4aed-8dcf-815aee12278b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/ips" status: 200 len: 148 microversion: 2.1 time: 0.117269 Jun 16 18:53:38.079811 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2438/4775] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:53:37 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/ips => generated 148 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:38.093725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:38.095071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:38.112984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:38.115619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:38.118778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:38.119482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:38.633053 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4cbbe966-3a59-4d19-9572-659e67b48e42 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5/action" status: 202 len: 0 microversion: 2.1 time: 3.410569 Jun 16 18:53:38.634180 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2338/4776] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:53:35 2022] POST /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5/action => generated 0 bytes in 3412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:53:38.642388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:38.643586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:38.670229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:38.685047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:38.686035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:38.690577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:39.196767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:39.209975 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c0096fe6-414d-449a-929d-05bbe2eb9ee6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1459 microversion: 2.1 time: 0.569288 Jun 16 18:53:39.224741 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2339/4777] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:38 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1459 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:39.243226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:39.246361 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:39.259031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:39.268165 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3ce58e57-a438-4d50-b4e1-8aa457cffe62 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 200 len: 1506 microversion: 2.1 time: 1.187090 Jun 16 18:53:39.268762 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2439/4778] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:38 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 1506 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:39.270443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:39.270838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:39.274209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:39.276591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:39.294228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:39.295850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:39.317200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:39.318156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:39.320588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:39.323100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:39.579574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:39.592626 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32ac01ee-2521-41cf-a690-80ffcf1fc37f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1273 microversion: 2.1 time: 0.366608 Jun 16 18:53:39.606656 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2340/4779] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:39 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:40.031770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-739208f8-2d90-46a7-a15c-f8b8da70f2bd req-1e481e42-5f95-4ce9-805d-8f5cad008ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d89515d-9120-4299-ac71-21eca43467c5", "tag": "4dbc5775-f226-49da-8d7c-22da33199596"}, {"server_uuid": "fe706ed5-8d87-40f3-96f8-d3270de6c7c1", "name": "network-vif-deleted", "tag": "5521b3a5-e396-46a4-a2b0-8db4731ac0bf"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:40.052130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-739208f8-2d90-46a7-a15c-f8b8da70f2bd req-1e481e42-5f95-4ce9-805d-8f5cad008ddc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.056906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-739208f8-2d90-46a7-a15c-f8b8da70f2bd req-1e481e42-5f95-4ce9-805d-8f5cad008ddc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.106217 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-739208f8-2d90-46a7-a15c-f8b8da70f2bd req-1e481e42-5f95-4ce9-805d-8f5cad008ddc service nova] Creating event network-changed:4dbc5775-f226-49da-8d7c-22da33199596 for instance 5d89515d-9120-4299-ac71-21eca43467c5 on n-h2-846209-2 Jun 16 18:53:40.106800 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-739208f8-2d90-46a7-a15c-f8b8da70f2bd req-1e481e42-5f95-4ce9-805d-8f5cad008ddc service nova] Creating event network-vif-deleted:5521b3a5-e396-46a4-a2b0-8db4731ac0bf for instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 on n-h1-846209-2 Jun 16 18:53:40.139142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-739208f8-2d90-46a7-a15c-f8b8da70f2bd req-1e481e42-5f95-4ce9-805d-8f5cad008ddc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.107665 Jun 16 18:53:40.142316 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2341/4780] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:53:40.178675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:40.194180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7019c28e-e7a3-408a-843b-eb14d81a26c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.906606 Jun 16 18:53:40.195471 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2440/4781] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:39 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:40.218155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:40.219145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:40.235948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.236699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.237716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.239573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.285686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:40.286570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: fe706ed5-8d87-40f3-96f8-d3270de6c7c1] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:40.305365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.307297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.308281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.315067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.368810 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] HTTP exception thrown: Instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 could not be found. Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Request method failure captured: Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 HTTP/1.1 Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3vKiRiEc2mZ_7JiHX70OHpAWEIPmDo2iePDN9_mqY-MID-wyaMJL-OjLF_zkT39fW5tAJL640bhsGFJQKzsMDaQatzJsjVctWHn-Wo-Fp0SLhfsaDcgXeRYUnLPMSOqrQjyIUyjSPZ2f21MyVDg7O9pAhqiN7TvCgW2Jktx-sRe9Zg Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 645f9222653e4006ae6a399accb03d6b Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerRescueTestJSON-1376475963 Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645f9222653e4006ae6a399accb03d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/645f9222653e4006ae6a399accb03d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_645f9222653e4006ae6a399accb03d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645f9222653e4006ae6a399accb03d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerRescueTestJSON-1376475963 Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 645f9222653e4006ae6a399accb03d6b Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerRescueTestJSON-1376475963 Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerRescueTestJSON-1376475963-project Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: ab06bc595cae4bcda2b784e4e0b2644c Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerRescueTestJSON-1376475963-project Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 could not be found. Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'fe706ed5-8d87-40f3-96f8-d3270de6c7c1'} Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 could not be found. Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 could not be found. Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:40.370847 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:40.375041 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:40.375041 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:40.375041 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:40.375041 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:53:40.375041 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:53:40.375041 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 could not be found. Jun 16 18:53:40.375041 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:53:40.379389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Returning 404 to user: Instance fe706ed5-8d87-40f3-96f8-d3270de6c7c1 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:53:40.380661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77681554-2811-40f2-bd6c-63e4133e88f3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1" status: 404 len: 111 microversion: 2.1 time: 0.099969 Jun 16 18:53:40.386776 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2441/4782] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:40 2022] GET /compute/v2.1/servers/fe706ed5-8d87-40f3-96f8-d3270de6c7c1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:53:40.397002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:40.401662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:40.414538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.415367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.418873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.419607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.487789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:53:40.728477 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f71e1c1f-c0c4-4c80-9352-36f392d120a3 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "DELETE /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 204 len: 0 microversion: 2.1 time: 0.339923 Jun 16 18:53:40.729642 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2442/4783] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:53:40 2022] DELETE /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:53:40.742760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:40.744264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:40.762169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.763075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.770060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.770986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.857571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:40.868917 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b0b56db-4ad5-4a8a-97db-59db1f54191b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.655030 Jun 16 18:53:40.873065 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2342/4784] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:40 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:40.905415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:40.906966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:40.922470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.923942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.925648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:40.928083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:40.928978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:40.955363 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2c6b08a5-99cc-4dde-a4ca-a9ffb0bb5ee8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1273 microversion: 2.1 time: 0.221134 Jun 16 18:53:40.958550 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2443/4785] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:40 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:40.980292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:40.982190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:41.000836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:41.002208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:41.005848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:41.007450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:41.681026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:41.695733 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27668037-93ec-4abb-a356-c2cd0e4fd177 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1492 microversion: 2.1 time: 0.807171 Jun 16 18:53:41.698165 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2343/4786] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:40 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1492 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:41.719801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:41.730525 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6a0ef772-0c06-4fbe-a95f-3946ce5cffa7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.759728 Jun 16 18:53:41.746475 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2444/4787] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:40 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:41.749006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:41.750272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:41.778588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:41.786399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:41.787748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:41.792052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:41.976366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:41.977183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:41.987702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:41.996997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:42.001496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:42.002622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:42.645780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:42.668359 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10aec15d-4e11-45c0-8503-52f62a6a1874 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.922533 Jun 16 18:53:42.676218 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2344/4788] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:41 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:42.693488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a354049-4532-4d91-b0a3-033214f9f1fd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59abf7c4-17ba-460c-87a1-8d5b69802d70"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:42.701343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a354049-4532-4d91-b0a3-033214f9f1fd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:42.728069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a354049-4532-4d91-b0a3-033214f9f1fd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:42.731269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a354049-4532-4d91-b0a3-033214f9f1fd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:42.735284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a354049-4532-4d91-b0a3-033214f9f1fd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:42.735284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a354049-4532-4d91-b0a3-033214f9f1fd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:42.813023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:42.859765 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-206049c1-0f73-4a5f-8792-ec48cda712b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 0.888829 Jun 16 18:53:42.874156 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2445/4789] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:41 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:42.879871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:42.880549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:42.924314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:42.924781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:42.926236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:42.926236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:43.504794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a354049-4532-4d91-b0a3-033214f9f1fd tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "POST /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823282 Jun 16 18:53:43.505240 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2345/4790] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:53:42 2022] POST /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:43.555286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1231658685", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:43.583330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:43.754660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] validate_networks() for [('8ff7f91a-12ca-412c-9bc8-ea3c23e8fa43', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:53:43.960345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:43.966677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:43.990487 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d10622e-2f25-41f3-86d0-10c93d4ea09b tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1492 microversion: 2.1 time: 1.115035 Jun 16 18:53:43.991097 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2446/4791] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:42 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1492 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:44.011866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:44.014224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:44.050455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:44.054116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:44.056999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:44.059187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:44.503099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:44.513548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cfdc65cb-988e-491a-a5e9-ef7914fba2f6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 0.519697 Jun 16 18:53:44.519692 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2447/4792] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:43 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:44.719676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-39d38cc0-6b5b-420b-ae61-1107c0e14cf2 req-915d5b28-0b24-42f8-b01b-364e9ca23283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24fb59fd-f5c4-4a3f-85d5-00646548c839", "tag": "d8c04507-2ac8-46e5-b67c-d1b67a3c54cb"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:44.748077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-39d38cc0-6b5b-420b-ae61-1107c0e14cf2 req-915d5b28-0b24-42f8-b01b-364e9ca23283 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:44.750268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-39d38cc0-6b5b-420b-ae61-1107c0e14cf2 req-915d5b28-0b24-42f8-b01b-364e9ca23283 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:44.798301 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-39d38cc0-6b5b-420b-ae61-1107c0e14cf2 req-915d5b28-0b24-42f8-b01b-364e9ca23283 service nova] Creating event network-changed:d8c04507-2ac8-46e5-b67c-d1b67a3c54cb for instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 on n-h1-846209-2 Jun 16 18:53:44.816927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-39d38cc0-6b5b-420b-ae61-1107c0e14cf2 req-915d5b28-0b24-42f8-b01b-364e9ca23283 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100254 Jun 16 18:53:44.817853 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2448/4793] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:45.009129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:45.010996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:45.027004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:45.038382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:45.040521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:45.041967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:45.626488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:46.014693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:46.364508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:53:46.365020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:53:46.365429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:53:46.375211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:53:46.375863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:53:46.388962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06bc595cae4bcda2b784e4e0b2644c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645f9222653e4006ae6a399accb03d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:46.398571 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-899cc258-2358-4884-952e-396093f4296a tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 200 len: 1492 microversion: 2.1 time: 1.394496 Jun 16 18:53:46.401183 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2449/4794] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:45 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 1492 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:46.404585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:46.405313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:46.406390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:46.407045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:46.414131 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:46.415775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:46.430856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:46.433560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:46.434953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:46.436564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:46.463279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:53:46.469572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Getting quotas for user 0bad5f4aa84e4b978a5a92478b6772bf and project 3e0ae0d9516c431f85b29c11cffea558. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:53:46.508353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:53:46.512255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:53:46.611331 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-48f67dbc-2051-4909-8fb1-0bb45507be64 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.104074 Jun 16 18:53:46.612612 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2346/4795] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:53:46.622231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c88aff58-a0f5-4508-985a-5b7579cda8cd req-bf19419e-7ef1-416a-af25-a943f22130ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108df41f-4dbc-4b35-8ec3-c8a1b949d592", "name": "network-vif-unplugged", "status": "completed", "tag": "10a05cf8-ddde-4db8-a889-879a31144a4c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:46.649883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c88aff58-a0f5-4508-985a-5b7579cda8cd req-bf19419e-7ef1-416a-af25-a943f22130ea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:46.653439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c88aff58-a0f5-4508-985a-5b7579cda8cd req-bf19419e-7ef1-416a-af25-a943f22130ea service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:46.672048 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c88aff58-a0f5-4508-985a-5b7579cda8cd req-bf19419e-7ef1-416a-af25-a943f22130ea service nova] Creating event network-vif-unplugged:10a05cf8-ddde-4db8-a889-879a31144a4c for instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 on n-h2-846209-2 Jun 16 18:53:46.683826 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c88aff58-a0f5-4508-985a-5b7579cda8cd req-bf19419e-7ef1-416a-af25-a943f22130ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067388 Jun 16 18:53:46.689893 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2347/4796] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:46.699480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4fdb74cd-ce97-410b-94cd-f5203d25430c req-691e330e-597e-4ac7-ad0f-d1930a031715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108df41f-4dbc-4b35-8ec3-c8a1b949d592", "name": "network-vif-deleted", "tag": "10a05cf8-ddde-4db8-a889-879a31144a4c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:46.712900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4fdb74cd-ce97-410b-94cd-f5203d25430c req-691e330e-597e-4ac7-ad0f-d1930a031715 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:46.714339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4fdb74cd-ce97-410b-94cd-f5203d25430c req-691e330e-597e-4ac7-ad0f-d1930a031715 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:46.735736 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4fdb74cd-ce97-410b-94cd-f5203d25430c req-691e330e-597e-4ac7-ad0f-d1930a031715 service nova] Creating event network-vif-deleted:10a05cf8-ddde-4db8-a889-879a31144a4c for instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 on n-h2-846209-2 Jun 16 18:53:46.746831 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4fdb74cd-ce97-410b-94cd-f5203d25430c req-691e330e-597e-4ac7-ad0f-d1930a031715 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054844 Jun 16 18:53:46.748812 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2348/4797] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:46.758477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dab0c0d2-8632-41d4-9ff9-143fe0666223 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:46.760269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dab0c0d2-8632-41d4-9ff9-143fe0666223 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:47.166378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dab0c0d2-8632-41d4-9ff9-143fe0666223 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:47.182394 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dab0c0d2-8632-41d4-9ff9-143fe0666223 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1215 microversion: 2.1 time: 0.423858 Jun 16 18:53:47.183091 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2349/4798] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:46 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:47.422430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:47.423892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] [instance: 108df41f-4dbc-4b35-8ec3-c8a1b949d592] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:47.449708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:47.450382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:47.451342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:47.454997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:47.491631 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] HTTP exception thrown: Instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 could not be found. Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Request method failure captured: Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 HTTP/1.1 Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3vKiRiEc2mZ_7JiHX70OHpAWEIPmDo2iePDN9_mqY-MID-wyaMJL-OjLF_zkT39fW5tAJL640bhsGFJQKzsMDaQatzJsjVctWHn-Wo-Fp0SLhfsaDcgXeRYUnLPMSOqrQjyIUyjSPZ2f21MyVDg7O9pAhqiN7TvCgW2Jktx-sRe9Zg Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 645f9222653e4006ae6a399accb03d6b Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerRescueTestJSON-1376475963 Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645f9222653e4006ae6a399accb03d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/645f9222653e4006ae6a399accb03d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_645f9222653e4006ae6a399accb03d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645f9222653e4006ae6a399accb03d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerRescueTestJSON-1376475963 Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 645f9222653e4006ae6a399accb03d6b Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerRescueTestJSON-1376475963 Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerRescueTestJSON-1376475963-project Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: ab06bc595cae4bcda2b784e4e0b2644c Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerRescueTestJSON-1376475963-project Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 could not be found. Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '108df41f-4dbc-4b35-8ec3-c8a1b949d592'} Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 could not be found. Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 could not be found. Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:53:47.493373 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 could not be found. Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:53:47.498834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] Returning 404 to user: Instance 108df41f-4dbc-4b35-8ec3-c8a1b949d592 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:53:47.499471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:47.499915 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd6b60f6-bf87-4539-b006-8530e234f8d0 tempest-ServerRescueTestJSON-1376475963 tempest-ServerRescueTestJSON-1376475963-project] 10.222.0.27 "GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592" status: 404 len: 111 microversion: 2.1 time: 0.081512 Jun 16 18:53:47.505290 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2350/4799] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:47 2022] GET /compute/v2.1/servers/108df41f-4dbc-4b35-8ec3-c8a1b949d592 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:53:47.510107 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5e75364d-c6e2-4636-96fb-a920f9fcc8dd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 1.107436 Jun 16 18:53:47.514628 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2450/4800] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:46 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:48.200944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:48.204624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:48.224309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:48.227720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:48.228862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:48.230559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:48.500017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:48.535742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:48.536817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:48.546264 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a67c8668-a9c8-4c00-935f-312f61294ebc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1211 microversion: 2.1 time: 0.350080 Jun 16 18:53:48.554977 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2351/4801] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:48 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1211 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:48.568048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:48.570752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:48.574354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:48.574990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:49.018936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:49.026990 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-63ce9517-2eee-42f0-b70a-fec765099584 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 0.499526 Jun 16 18:53:49.030049 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2451/4802] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:48 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:49.569854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:49.570534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:49.581579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:49.590749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:49.591889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:49.592514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:49.788277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:49.801976 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e92e3bcc-4532-48b3-988c-b70b7760b6ac tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1285 microversion: 2.1 time: 0.236938 Jun 16 18:53:49.803250 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2352/4803] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:49 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:50.047798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:50.049041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:50.062339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:50.069638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:50.070765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:50.071434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:50.669960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:50.688267 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-83bc608c-cb14-4650-b487-fb2854eb4529 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 0.644316 Jun 16 18:53:50.688873 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2452/4804] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:50 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:50.820207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:50.820993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:50.848638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:50.849399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:50.850503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:50.855655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:50.894020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:UPDATE=10,nova_cell1:DELETE=2,nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:51.232245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:51.246357 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27e25878-15d8-435c-9547-56eec2268a50 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1273 microversion: 2.1 time: 0.430722 Jun 16 18:53:51.252844 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2353/4805] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:50 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1273 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:51.709175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:51.709175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:51.726574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:51.727212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:51.728048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:51.728508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:52.229320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:52.239031 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-364651a0-782e-458a-b98c-0cf297dc81e6 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 0.537827 Jun 16 18:53:52.246773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2453/4806] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:51 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:52.266406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:52.266406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:52.274243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:52.274917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:52.276035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:52.276714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:53.154363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:53.169306 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-680ed19d-d936-4d3b-b50d-f90d120f0039 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.904134 Jun 16 18:53:53.181143 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2354/4807] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:52 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:53.256777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:53.257415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:53.289466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:53.290261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:53.291607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:53.292312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:54.189039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:54.189838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:54.203969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:54.207753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:54.211327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:54.216251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:54.455322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:54.468731 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0c83c318-50ca-42c3-905d-ee07759ebaa9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 1.216870 Jun 16 18:53:54.481527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2454/4808] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:53 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:54.493110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c9be3372-b619-44cd-9f77-0b0073adcc63 req-276b5be9-2b8c-40d2-80d1-97c4cae7ef76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fb59fd-f5c4-4a3f-85d5-00646548c839", "name": "network-vif-plugged", "status": "completed", "tag": "d8c04507-2ac8-46e5-b67c-d1b67a3c54cb"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:54.511730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c9be3372-b619-44cd-9f77-0b0073adcc63 req-276b5be9-2b8c-40d2-80d1-97c4cae7ef76 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:54.514453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c9be3372-b619-44cd-9f77-0b0073adcc63 req-276b5be9-2b8c-40d2-80d1-97c4cae7ef76 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:54.545643 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c9be3372-b619-44cd-9f77-0b0073adcc63 req-276b5be9-2b8c-40d2-80d1-97c4cae7ef76 service nova] Creating event network-vif-plugged:d8c04507-2ac8-46e5-b67c-d1b67a3c54cb for instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 on n-h1-846209-2 Jun 16 18:53:54.558504 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c9be3372-b619-44cd-9f77-0b0073adcc63 req-276b5be9-2b8c-40d2-80d1-97c4cae7ef76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075185 Jun 16 18:53:54.559424 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2455/4809] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:54.799434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:54.809201 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-226558c8-9d39-4327-b2a3-79e41b89598d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.624878 Jun 16 18:53:54.821318 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2355/4810] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:54 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:55.485766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:55.487397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:55.505410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:55.507691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:55.530287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:55.531220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:55.827426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:55.828266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:55.836288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:55.836756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:55.837550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:55.838063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:56.107115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:56.142806 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3515cd7b-9ee3-4eaa-8b0d-2684f4005c3f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1315 microversion: 2.1 time: 0.660573 Jun 16 18:53:56.154086 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2456/4811] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:55 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:56.444132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:56.481241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:56.492548 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a70cf41a-5c7e-443a-b63c-4c752a1133d5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.669615 Jun 16 18:53:56.502939 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2356/4812] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:55 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:56.516015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-773576023", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:56.637503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] validate_networks() for None {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:53:56.836712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0be190b7-afb3-4b00-8011-e233f19359fc req-d571591a-ea82-4023-8698-56ab1b84b28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee92661-d99f-4c7f-84cb-e4def53a7473", "tag": "5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:56.850778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0be190b7-afb3-4b00-8011-e233f19359fc req-d571591a-ea82-4023-8698-56ab1b84b28e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:56.852443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0be190b7-afb3-4b00-8011-e233f19359fc req-d571591a-ea82-4023-8698-56ab1b84b28e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:56.881404 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0be190b7-afb3-4b00-8011-e233f19359fc req-d571591a-ea82-4023-8698-56ab1b84b28e service nova] Creating event network-changed:5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6 for instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 on n-h1-846209-2 Jun 16 18:53:56.895602 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0be190b7-afb3-4b00-8011-e233f19359fc req-d571591a-ea82-4023-8698-56ab1b84b28e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.731247 Jun 16 18:53:56.896970 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2457/4813] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:57.165948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:57.166718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:57.175171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:57.177126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:57.177824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:57.179337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:57.179951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:57.928942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:53:57.929419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:53:57.930655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:53:57.931663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:53:57.932140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:53:57.933876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:57.951048 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2611375f-a699-4bd6-baf8-fbf4bd46cfad tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1500 microversion: 2.1 time: 0.787840 Jun 16 18:53:57.951978 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2458/4814] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:57 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1500 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:57.964124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:57.964124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:57.964124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:57.964124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:57.973752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:57.993534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:58.013707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:58.014196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Getting quotas for project 5e9f046fe52643848b37f1096f4bd733. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:53:58.014650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:58.015648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:58.016255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:58.021586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Getting quotas for user adf825487ce340068541ebfa73ab24f0 and project 5e9f046fe52643848b37f1096f4bd733. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:53:58.053143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:53:58.060542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:53:58.228503 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9acb00c3-b991-452e-a0af-48b04665727a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725268 Jun 16 18:53:58.229215 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2357/4815] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:53:58.253962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e16fbb02-0953-4dc6-b03d-e926bd889d35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:53:58.281606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e16fbb02-0953-4dc6-b03d-e926bd889d35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:58.287132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e16fbb02-0953-4dc6-b03d-e926bd889d35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:58.376567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e16fbb02-0953-4dc6-b03d-e926bd889d35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Going to try to stop instance {{(pid=119207) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:53:58.492747 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e16fbb02-0953-4dc6-b03d-e926bd889d35 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839/action" status: 202 len: 0 microversion: 2.1 time: 0.254130 Jun 16 18:53:58.494986 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2358/4816] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:53:58 2022] POST /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:53:58.505585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b3f4a915-49dd-4aba-a66a-5317424749bc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:58.507732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b3f4a915-49dd-4aba-a66a-5317424749bc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:58.623977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b3f4a915-49dd-4aba-a66a-5317424749bc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:58.634952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b3f4a915-49dd-4aba-a66a-5317424749bc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1213 microversion: 2.1 time: 0.137781 Jun 16 18:53:58.638744 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2359/4817] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:58 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1213 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:58.639058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:58.653261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:58.653892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:58.658541 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4c5876fd-f127-44be-88d0-092ac5751694 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.690991 Jun 16 18:53:58.659732 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2459/4818] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:57 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:58.661299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:58.662458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:58.663290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:58.663747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:59.044966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:59.058255 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab569b74-b11f-47f5-a255-fa8447e32b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.404229 Jun 16 18:53:59.059377 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2360/4819] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:58 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:59.658136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:59.658888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:59.677165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:59.679481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:53:59.686210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:59.686486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:59.686808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:59.687651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:59.688061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:59.688191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:59.689454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:59.690932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:59.775065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:53:59.791069 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-272028c6-ad4e-45fc-819b-5c707e1e5812 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1265 microversion: 2.1 time: 0.139578 Jun 16 18:53:59.791691 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2460/4820] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:59 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:00.020551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:00.048267 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c956b3a-9c95-4b58-9306-8bd25e97e70b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.376178 Jun 16 18:54:00.049423 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2361/4821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:53:59 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:00.080073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.080911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:00.091020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aa1c09b4-905b-47ff-adf8-9b49aac6c87d tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] Calling method '.version_select at 0x7f866dd2c160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.094719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:00.100576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:00.101693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:00.102819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:00.195380 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aa1c09b4-905b-47ff-adf8-9b49aac6c87d tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.400210 Jun 16 18:54:00.197282 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2461/4822] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:53:59 2022] GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc/defaults => generated 371 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:00.214386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c7fe5bd-490a-411e-8361-51d81b6d35ef tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] Calling method '.version_select at 0x7f866e352700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.342367 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c7fe5bd-490a-411e-8361-51d81b6d35ef tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc" status: 200 len: 371 microversion: 2.1 time: 0.130493 Jun 16 18:54:00.343215 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2462/4823] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:54:00 2022] GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc => generated 371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:00.357662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-276f4fa6-0151-466c-bbe8-032980fd701e tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] Calling method '.version_select at 0x7f866ea6d4c0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.488158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-276f4fa6-0151-466c-bbe8-032980fd701e tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.133575 Jun 16 18:54:00.489078 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2463/4824] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 18:54:00 2022] GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc/defaults => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:00.501507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-06a59f8f-d87d-447f-ae82-2b8a4c5c8fdb tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] Calling method '.version_select at 0x7f866ea6d160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.623192 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-06a59f8f-d87d-447f-ae82-2b8a4c5c8fdb tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc" status: 200 len: 371 microversion: 2.1 time: 0.125425 Jun 16 18:54:00.631218 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2464/4825] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 18:54:00 2022] GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:00.637094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd46f24f-9ca0-4aff-a7af-0d26ef6074c4 tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] Calling method '.version_select at 0x7f866dd2c820>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.767539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:00.772193 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fd46f24f-9ca0-4aff-a7af-0d26ef6074c4 tempest-QuotasTestJSON-1298158647 tempest-QuotasTestJSON-1298158647-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc?user_id=668550f15e7d4e33b499927c65beff26" status: 200 len: 371 microversion: 2.1 time: 0.139549 Jun 16 18:54:00.773789 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2465/4826] 10.222.0.27 () {58 vars in 1322 bytes} [Thu Jun 16 18:54:00 2022] GET /compute/v2.1/os-quota-sets/2d212ac955bc4043b601768b988ea1fc?user_id=668550f15e7d4e33b499927c65beff26 => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:00.824009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.829323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:00.846064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:00.847963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:00.850363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:00.851826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:00.871253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:00.887101 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f61f4b5a-bbc0-4882-8c52-1289fe3a77d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.812714 Jun 16 18:54:00.898186 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2362/4827] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:00 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:00.907171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:00.908054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:00.916486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:00.917036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:00.918216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:00.919325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:01.078599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lazy-loading 'services' on Instance uuid 1090fa06-d332-40b5-93e1-43ac21219bfc {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:54:01.115665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:01.126859 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-888f9fdd-fe1f-417f-8781-9e2f7f58c325 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1271 microversion: 2.1 time: 0.317453 Jun 16 18:54:01.138640 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2466/4828] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:00 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:01.147038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:01.148005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:01.158641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:01.160124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:01.161657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:01.162407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:01.272812 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6d902a34-56c2-49b5-a49b-e0048c7978a8 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments/59abf7c4-17ba-460c-87a1-8d5b69802d70" status: 202 len: 0 microversion: 2.1 time: 0.368916 Jun 16 18:54:01.278206 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2363/4829] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:54:00 2022] DELETE /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments/59abf7c4-17ba-460c-87a1-8d5b69802d70 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:54:01.285041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-24d36cce-9a5b-4446-80df-ab61dc0d2b38 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:01.286709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-24d36cce-9a5b-4446-80df-ab61dc0d2b38 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:01.295510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24d36cce-9a5b-4446-80df-ab61dc0d2b38 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:01.296689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24d36cce-9a5b-4446-80df-ab61dc0d2b38 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:01.297740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24d36cce-9a5b-4446-80df-ab61dc0d2b38 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:01.299483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-24d36cce-9a5b-4446-80df-ab61dc0d2b38 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:01.383507 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-24d36cce-9a5b-4446-80df-ab61dc0d2b38 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103408 Jun 16 18:54:01.384108 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2364/4830] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:01 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:01.689541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:01.711742 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a71f4f94-2e1d-4de3-aa5f-114587aacdaf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.571227 Jun 16 18:54:01.715157 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2467/4831] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:01 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:01.907433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:01.908323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:01.933343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:01.933810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:01.934672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:01.935085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:02.147293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:02.148958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:02.160667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:02.161763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:02.164300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:02.168000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:02.352970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:02.375058 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-114ab628-671b-441f-8ddf-2316498b26c9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.465531 Jun 16 18:54:02.376757 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2365/4832] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:01 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:02.396652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-84e03453-7491-43b7-9443-25aedeb3752a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:02.397920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-84e03453-7491-43b7-9443-25aedeb3752a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:02.410969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e03453-7491-43b7-9443-25aedeb3752a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:02.414306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e03453-7491-43b7-9443-25aedeb3752a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:02.415408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e03453-7491-43b7-9443-25aedeb3752a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:02.416026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-84e03453-7491-43b7-9443-25aedeb3752a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:02.482436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-84e03453-7491-43b7-9443-25aedeb3752a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089249 Jun 16 18:54:02.486270 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2366/4833] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:02 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:02.729932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:02.730606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:02.741105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:02.741829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:02.743877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:02.745350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:02.821327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:02.830962 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b9683fd-efb9-4560-9073-6d6bdf43b0f1 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1271 microversion: 2.1 time: 0.689552 Jun 16 18:54:02.841731 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2468/4834] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:02 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1271 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:03.161419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:03.177537 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-34f0d509-3633-4cb1-8c73-e50ec34ce137 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.451504 Jun 16 18:54:03.180314 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2367/4835] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:02 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:03.412553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:03.413357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:03.429799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:03.430632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:03.431670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:03.439032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:03.494816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bfd09cf-adca-4764-9b61-b4ab8b3de42a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:03.495949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9bfd09cf-adca-4764-9b61-b4ab8b3de42a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:03.512236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bfd09cf-adca-4764-9b61-b4ab8b3de42a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:03.522240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bfd09cf-adca-4764-9b61-b4ab8b3de42a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:03.524157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bfd09cf-adca-4764-9b61-b4ab8b3de42a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:03.524728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bfd09cf-adca-4764-9b61-b4ab8b3de42a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:03.593845 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bfd09cf-adca-4764-9b61-b4ab8b3de42a tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103540 Jun 16 18:54:03.595386 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2368/4836] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:03 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:03.834862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:03.850174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:03.852274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:03.867370 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e4af45f2-1991-424f-b697-b2ed2833c018 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.466165 Jun 16 18:54:03.870073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:03.872397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2469/4837] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:03 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:03.873835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:03.877054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:03.877677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.197009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:04.198196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:04.210171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.211135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.220546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.223526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.286568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:04.341816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:04.357396 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0f6f8cb1-f98e-4e79-835f-6cce6987d7a6 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1313 microversion: 2.1 time: 0.511331 Jun 16 18:54:04.358556 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2369/4838] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:03 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:04.614210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-315c4a3d-2106-40ba-9082-9d8b8b47fd8f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:04.615237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-315c4a3d-2106-40ba-9082-9d8b8b47fd8f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:04.625058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315c4a3d-2106-40ba-9082-9d8b8b47fd8f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.625737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315c4a3d-2106-40ba-9082-9d8b8b47fd8f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.626789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315c4a3d-2106-40ba-9082-9d8b8b47fd8f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.627866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-315c4a3d-2106-40ba-9082-9d8b8b47fd8f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.697296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:04.726233 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-315c4a3d-2106-40ba-9082-9d8b8b47fd8f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122272 Jun 16 18:54:04.727150 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2370/4839] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:04 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:04.807303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:04.817022 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.623341 Jun 16 18:54:04.817623 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2470/4840] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:04 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:04.891528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:04.892169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:04.926398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.926907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.933984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.935880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.131485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.132902 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001815 Jun 16 18:54:05.139011 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2471/4841] 10.222.0.27 () {56 vars in 885 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jun 16 18:54:05.140886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.142421 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001899 Jun 16 18:54:05.148615 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2472/4842] 10.222.0.27 () {54 vars in 1034 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jun 16 18:54:05.151357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.152797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002885 Jun 16 18:54:05.153459 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2473/4843] 10.222.0.27 () {54 vars in 1040 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:05.161443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.162940 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d2590ec-8910-450e-bfa0-235aabee18c9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001835 Jun 16 18:54:05.173082 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2474/4844] 10.222.0.27 () {56 vars in 885 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 16 18:54:05.378223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.379103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:05.390120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.390571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.395237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.396040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.847700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:05.866550 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77fac87b-6c39-4047-8074-4a7e52e861dc tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1313 microversion: 2.1 time: 0.489979 Jun 16 18:54:05.873621 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2475/4845] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:05.892663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:05.897460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-98df9952-342b-4df0-9389-249c21f279d6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.898887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-98df9952-342b-4df0-9389-249c21f279d6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:05.904638 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-691ab8b5-45ed-43e4-9ad8-cce482394cc3 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 1.020997 Jun 16 18:54:05.915281 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2371/4846] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:04 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:05.929124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98df9952-342b-4df0-9389-249c21f279d6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.932350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98df9952-342b-4df0-9389-249c21f279d6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.933543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.934686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:05.934909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98df9952-342b-4df0-9389-249c21f279d6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.936499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98df9952-342b-4df0-9389-249c21f279d6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.963252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.965317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.966579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.970567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:06.037653 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-98df9952-342b-4df0-9389-249c21f279d6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157426 Jun 16 18:54:06.041638 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2476/4847] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:06.321609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:06.330412 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-25e1c48f-15a9-4798-8f83-cbc7b625f772 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.413882 Jun 16 18:54:06.335677 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2372/4848] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:06.413734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8bd999c4-baf5-4f3e-ba77-fda71dd8c316 req-1ec88770-938c-491a-a5b5-b47ce4a542a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5065e4a5-2e2d-4219-bd43-4da8525f7831", "tag": "e4fed56d-c781-4a26-84e2-3095590ab3c8"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:06.436536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8bd999c4-baf5-4f3e-ba77-fda71dd8c316 req-1ec88770-938c-491a-a5b5-b47ce4a542a0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:06.438186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8bd999c4-baf5-4f3e-ba77-fda71dd8c316 req-1ec88770-938c-491a-a5b5-b47ce4a542a0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:06.470501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8bd999c4-baf5-4f3e-ba77-fda71dd8c316 req-1ec88770-938c-491a-a5b5-b47ce4a542a0 service nova] Creating event network-changed:e4fed56d-c781-4a26-84e2-3095590ab3c8 for instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 on n-h2-846209-2 Jun 16 18:54:06.476729 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8bd999c4-baf5-4f3e-ba77-fda71dd8c316 req-1ec88770-938c-491a-a5b5-b47ce4a542a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067388 Jun 16 18:54:06.477620 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2477/4849] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:06.889523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:06.890186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:06.899508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:06.907520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:06.909248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:06.911117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:06.938805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:06.949182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:06.976660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:06.978281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:06.981309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:06.983975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:07.478052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:07.487983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:07.494149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9e35e747-8f30-4db1-a8c8-761b824bb878 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.569069 Jun 16 18:54:07.494754 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2478/4850] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:06 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:07.502034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6a90306b-413b-4395-a0b1-be717f8aaeaf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:07.503682 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bf1f8ceb-c110-4e17-b22e-e7cb24351b90 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1313 microversion: 2.1 time: 0.611310 Jun 16 18:54:07.512953 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2373/4851] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:06 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:07.512953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:07.512953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:07.513335 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6a90306b-413b-4395-a0b1-be717f8aaeaf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:07.518126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:07.518595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:07.519948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:07.520509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:07.541550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a90306b-413b-4395-a0b1-be717f8aaeaf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:07.543473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a90306b-413b-4395-a0b1-be717f8aaeaf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:07.546712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a90306b-413b-4395-a0b1-be717f8aaeaf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:07.548518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a90306b-413b-4395-a0b1-be717f8aaeaf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:07.599523 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6a90306b-413b-4395-a0b1-be717f8aaeaf tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103096 Jun 16 18:54:07.603562 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2479/4852] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:07 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:07.608341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a30abf94-08f6-4455-b865-cc8c03e8eb60 req-3cef3ffb-9ab2-4831-97ae-7e310c0e27e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee92661-d99f-4c7f-84cb-e4def53a7473", "name": "network-vif-plugged", "status": "completed", "tag": "5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:07.618062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a30abf94-08f6-4455-b865-cc8c03e8eb60 req-3cef3ffb-9ab2-4831-97ae-7e310c0e27e0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:07.618508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a30abf94-08f6-4455-b865-cc8c03e8eb60 req-3cef3ffb-9ab2-4831-97ae-7e310c0e27e0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:07.633278 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a30abf94-08f6-4455-b865-cc8c03e8eb60 req-3cef3ffb-9ab2-4831-97ae-7e310c0e27e0 service nova] Creating event network-vif-plugged:5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6 for instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 on n-h1-846209-2 Jun 16 18:54:07.643162 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a30abf94-08f6-4455-b865-cc8c03e8eb60 req-3cef3ffb-9ab2-4831-97ae-7e310c0e27e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038208 Jun 16 18:54:07.644749 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2480/4853] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:07.923164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:07.942739 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b754f65-3a18-42cf-a31b-cfaf22af7842 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1315 microversion: 2.1 time: 0.434601 Jun 16 18:54:07.955015 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2374/4854] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:07 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:08.512440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:08.513721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:08.529356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:08.536234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:08.537728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:08.539445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:08.543619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:08.631012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:09.153111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e83cfd02-2f1a-435c-a509-cdf5620b5c77 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:09.153850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e83cfd02-2f1a-435c-a509-cdf5620b5c77 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:09.169305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e83cfd02-2f1a-435c-a509-cdf5620b5c77 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.174534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e83cfd02-2f1a-435c-a509-cdf5620b5c77 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.175538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e83cfd02-2f1a-435c-a509-cdf5620b5c77 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.175999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e83cfd02-2f1a-435c-a509-cdf5620b5c77 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.194330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:09.228297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-45bd88ba-c5c1-48fd-a7ff-71b5f666959b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.719706 Jun 16 18:54:09.234447 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2375/4855] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:08 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:09.251203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:09.262852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:09.269144 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e83cfd02-2f1a-435c-a509-cdf5620b5c77 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/ips" status: 200 len: 147 microversion: 2.1 time: 0.761807 Jun 16 18:54:09.275076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2481/4856] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:54:08 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/ips => generated 147 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:09.291517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-39363eb2-74de-4f5b-bee4-658516d0be6b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:09.291776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.292274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.293053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.293503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.303112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-39363eb2-74de-4f5b-bee4-658516d0be6b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:09.327666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39363eb2-74de-4f5b-bee4-658516d0be6b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.327862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39363eb2-74de-4f5b-bee4-658516d0be6b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.329495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39363eb2-74de-4f5b-bee4-658516d0be6b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.331638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-39363eb2-74de-4f5b-bee4-658516d0be6b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.460121 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-39363eb2-74de-4f5b-bee4-658516d0be6b tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176417 Jun 16 18:54:09.460121 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2482/4857] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:09 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:09.482344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:09.482998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:09.498648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.500059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.502947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:09.505298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:09.825092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:09.839413 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-307b07f9-b0f7-4fda-b37f-142b65f8c5f9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1313 microversion: 2.1 time: 0.599833 Jun 16 18:54:09.848938 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2376/4858] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:09 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:10.034149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:10.046786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc060c6b-ac95-4925-b5f1-80774cc955df tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1502 microversion: 2.1 time: 0.586003 Jun 16 18:54:10.048833 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2483/4859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:09 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1502 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:10.067923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87010985-560e-4a41-912d-1d82d77e5f96 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:10.068463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87010985-560e-4a41-912d-1d82d77e5f96 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:10.078298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87010985-560e-4a41-912d-1d82d77e5f96 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:10.087046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87010985-560e-4a41-912d-1d82d77e5f96 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:10.089424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87010985-560e-4a41-912d-1d82d77e5f96 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:10.090235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87010985-560e-4a41-912d-1d82d77e5f96 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:10.195577 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87010985-560e-4a41-912d-1d82d77e5f96 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473/action" status: 202 len: 0 microversion: 2.1 time: 0.132527 Jun 16 18:54:10.199194 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2377/4860] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:54:10 2022] POST /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:54:10.215981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:10.217244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:10.233717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:10.234752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:10.235896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:10.236967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:10.257192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:10.258790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:10.275709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:10.276664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:10.278701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:10.280044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:10.754157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:11.238576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:11.249378 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5f262d88-035a-40e8-8a9d-a76b9504180d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.999400 Jun 16 18:54:11.266521 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2378/4861] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:10 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:11.280932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-957e0845-1bb3-4434-81b3-488314f694f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:11.282026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-957e0845-1bb3-4434-81b3-488314f694f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:11.293117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-957e0845-1bb3-4434-81b3-488314f694f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.296069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-957e0845-1bb3-4434-81b3-488314f694f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.310400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-957e0845-1bb3-4434-81b3-488314f694f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.313489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-957e0845-1bb3-4434-81b3-488314f694f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.367792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:11.384596 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dadb4677-888e-4a6a-a4f4-b63654e30fe9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1507 microversion: 2.1 time: 1.178628 Jun 16 18:54:11.386832 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2484/4862] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:10 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1507 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:11.403444 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-957e0845-1bb3-4434-81b3-488314f694f6 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134170 Jun 16 18:54:11.406160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:11.406836 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2379/4863] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:11 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:54:11.408357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:11.418379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.419743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.421784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.423459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.517953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:11.518475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:11.522320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:11.534835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.535295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.536290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.540960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.609871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:54:11.780183 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ab1ded7-bade-42d7-8e99-494b510b6064 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 204 len: 0 microversion: 2.1 time: 0.266011 Jun 16 18:54:11.783520 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2380/4864] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:54:11 2022] DELETE /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:54:11.793604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:11.794698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:11.813544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.814848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.824888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:11.825995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:11.827840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:11.849695 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4337ca40-0d2b-49fa-8df7-e0a24c9eb6ab tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1313 microversion: 2.1 time: 0.454611 Jun 16 18:54:11.850853 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2485/4865] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:11 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:12.062652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3db7d2a2-21cd-46f1-8941-482f0208a6e8 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e58302d3-98a1-45bc-8056-58a432e00bb8"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:12.063822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3db7d2a2-21cd-46f1-8941-482f0208a6e8 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:12.075891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3db7d2a2-21cd-46f1-8941-482f0208a6e8 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.078794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3db7d2a2-21cd-46f1-8941-482f0208a6e8 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:12.079719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3db7d2a2-21cd-46f1-8941-482f0208a6e8 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.080585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3db7d2a2-21cd-46f1-8941-482f0208a6e8 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:12.126942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:12.142115 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c1fce98-a0ab-441d-a249-6d05ffa4e3b5 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1678 microversion: 2.1 time: 0.352404 Jun 16 18:54:12.143725 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2381/4866] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:11 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1678 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:12.276976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:12.278512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:12.294075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.294580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:12.295387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.295832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:12.498994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3db7d2a2-21cd-46f1-8941-482f0208a6e8 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440048 Jun 16 18:54:12.500400 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2486/4867] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:54:12 2022] POST /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:12.516445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:12.518654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:12.548094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.549549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:12.557729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.558664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:12.797577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:12.807477 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-31603c25-6b67-4a3c-af41-f33e1662d794 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.540786 Jun 16 18:54:12.811610 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2382/4868] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:12 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:12.871671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:12.872688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:12.886289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.891638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:12.892739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:12.893592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:13.272272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:13.289680 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e42c71d-b46b-407d-958c-569b55abb400 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1313 microversion: 2.1 time: 0.422975 Jun 16 18:54:13.300088 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2383/4869] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:12 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:13.306118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:13.307031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:13.320390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:13.333500 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3d2db89-1b6f-423b-a8d4-f58670a3e604 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1487 microversion: 2.1 time: 0.827560 Jun 16 18:54:13.334368 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2487/4870] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:12 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1487 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:13.339778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:13.340811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:13.341827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:13.342512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:13.354930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:13.360054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:13.388128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:13.389202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:13.390866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:13.393279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:13.396497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:13.453246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lazy-loading 'flavor' on Instance uuid 1ee92661-d99f-4c7f-84cb-e4def53a7473 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:54:14.047726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f1713aa8-554d-451e-a68a-454dcc555444 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473/action" status: 202 len: 0 microversion: 2.1 time: 0.698952 Jun 16 18:54:14.051198 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2488/4871] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:54:13 2022] POST /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:54:14.075829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:14.078837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:14.087171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:14.087628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:14.088439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:14.088860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:14.149977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:14.236571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:14.252208 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ba5eb011-5a28-40cd-93fb-828f27170f34 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1678 microversion: 2.1 time: 0.948955 Jun 16 18:54:14.266599 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2384/4872] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:13 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1678 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:14.285028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9717580b-9540-4973-a905-d8e01cd775be req-d99bbd72-6887-43ed-8b76-5acfbce2a685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5065e4a5-2e2d-4219-bd43-4da8525f7831", "name": "network-vif-plugged", "status": "completed", "tag": "e4fed56d-c781-4a26-84e2-3095590ab3c8"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:14.320968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9717580b-9540-4973-a905-d8e01cd775be req-d99bbd72-6887-43ed-8b76-5acfbce2a685 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:14.327004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9717580b-9540-4973-a905-d8e01cd775be req-d99bbd72-6887-43ed-8b76-5acfbce2a685 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:14.371159 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9717580b-9540-4973-a905-d8e01cd775be req-d99bbd72-6887-43ed-8b76-5acfbce2a685 service nova] Creating event network-vif-plugged:e4fed56d-c781-4a26-84e2-3095590ab3c8 for instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 on n-h2-846209-2 Jun 16 18:54:14.398963 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9717580b-9540-4973-a905-d8e01cd775be req-d99bbd72-6887-43ed-8b76-5acfbce2a685 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130542 Jun 16 18:54:14.405420 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2385/4873] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:14.435776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:14.437023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:14.454273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:14.460983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:14.462113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:14.462784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:15.256523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:15.274694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d06575f-e190-48eb-82cd-73c7e176a65a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 1.221888 Jun 16 18:54:15.278585 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2489/4874] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:14 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:15.291699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:15.292379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:15.301921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:15.302717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:15.303717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:15.304310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:15.621317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:15.638804 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6eb8cb6d-8438-4757-bfa6-58d86dade134 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1493 microversion: 2.1 time: 1.224957 Jun 16 18:54:15.655184 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2386/4875] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:14 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1493 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:15.674516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:15.681325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:15.709052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:15.711635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:15.714587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:15.718330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:15.935007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:15.953403 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2c1f8538-e0d8-4314-9d62-68e5fdfca1f7 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1313 microversion: 2.1 time: 0.665339 Jun 16 18:54:15.955479 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2490/4876] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:15 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:15.997757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:16.014675 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bf97e317-28bd-440a-a77a-6a314b78a123 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1612 microversion: 2.1 time: 0.353466 Jun 16 18:54:16.030576 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2387/4877] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:15 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1612 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:16.297135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:16.298792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:16.312015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:16.313606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:16.316649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:16.319655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:16.675439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:16.676495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:16.693102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:16.693732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:16.694670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:16.696589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:17.739982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:17.764837 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c018de8a-8878-4692-b45a-76608dd42be4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.093542 Jun 16 18:54:17.766524 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2388/4878] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:16 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:17.788592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:17.792200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:17.808827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:17.812934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:17.814542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:17.817793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:17.857265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:17.870146 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b7f224d-e95e-4d09-82d1-289b4c61174e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 1.577857 Jun 16 18:54:17.872827 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2491/4879] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:16 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:17.892057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:17.894551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:17.911013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:17.911828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:17.912822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:17.914262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:18.225167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720cc6d1352840a99028bf48ae9eb6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72f1437a9c348ebb373cbed7855fd31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:18.241982 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1ed3b7f4-e023-40c9-8f69-c329b6b78129 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 200 len: 1612 microversion: 2.1 time: 0.362777 Jun 16 18:54:18.242995 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2492/4880] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:17 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 1612 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:18.429467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a35b96e4-75d1-41b8-a7ec-a65e5b1d0f35 req-1dcc78eb-2b0f-4bc6-83e7-d74fb1dae7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1090fa06-d332-40b5-93e1-43ac21219bfc", "name": "network-vif-deleted", "tag": "57207631-1ef8-4f15-8f13-056f9349c284"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:18.453864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a35b96e4-75d1-41b8-a7ec-a65e5b1d0f35 req-1dcc78eb-2b0f-4bc6-83e7-d74fb1dae7c2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:18.454812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a35b96e4-75d1-41b8-a7ec-a65e5b1d0f35 req-1dcc78eb-2b0f-4bc6-83e7-d74fb1dae7c2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:18.501464 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a35b96e4-75d1-41b8-a7ec-a65e5b1d0f35 req-1dcc78eb-2b0f-4bc6-83e7-d74fb1dae7c2 service nova] Creating event network-vif-deleted:57207631-1ef8-4f15-8f13-056f9349c284 for instance 1090fa06-d332-40b5-93e1-43ac21219bfc on n-h1-846209-2 Jun 16 18:54:18.524358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a35b96e4-75d1-41b8-a7ec-a65e5b1d0f35 req-1dcc78eb-2b0f-4bc6-83e7-d74fb1dae7c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099431 Jun 16 18:54:18.533770 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2493/4881] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:18.576245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:18.592114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f94c9b8-b7e4-4670-92d0-a28322d358ae tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1463 microversion: 2.1 time: 0.821718 Jun 16 18:54:18.592958 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2389/4882] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:17 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1463 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:18.610984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-997e4ca0-c036-402c-b013-111de578c2e9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38b79c24-c9fa-4b44-983d-e40e1a2ec123", "device": "/dev/sdb"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:18.613005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-997e4ca0-c036-402c-b013-111de578c2e9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:18.645125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997e4ca0-c036-402c-b013-111de578c2e9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:18.649987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997e4ca0-c036-402c-b013-111de578c2e9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:18.653381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997e4ca0-c036-402c-b013-111de578c2e9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:18.655530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-997e4ca0-c036-402c-b013-111de578c2e9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:18.784861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:18.785607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:18.796676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:18.797146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:18.802067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:18.824686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:19.462835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-997e4ca0-c036-402c-b013-111de578c2e9 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "POST /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856344 Jun 16 18:54:19.474596 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2494/4883] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:54:18 2022] POST /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:19.494123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:19.495785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:19.510175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:19.512916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:19.514183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:19.516615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:19.599337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:19.609096 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-423f345d-8918-41b8-ba4f-f123b8d9571d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.828813 Jun 16 18:54:19.623061 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2390/4884] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:18 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:19.629070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:19.630043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:19.648081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:19.649025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:19.650130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:19.650791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:19.685855 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc HTTP/1.1 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '1090fa06-d332-40b5-93e1-43ac21219bfc'} Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:19.688303 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:19.692749 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:19.692749 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:19.692749 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:19.692749 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:19.692749 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:19.692749 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:19.692749 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:19.694996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:19.696111 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35574a13-0094-4d28-a592-0fec32c42251 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 404 len: 111 microversion: 2.1 time: 0.071755 Jun 16 18:54:19.702770 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2391/4885] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:19 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:54:19.709952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d50bccb-59ef-4c11-a70f-b8b2a4125a02 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '.version_select at 0x7f866e9343a0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:19.760766 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d50bccb-59ef-4c11-a70f-b8b2a4125a02 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390987313" status: 202 len: 0 microversion: 2.1 time: 0.056499 Jun 16 18:54:19.767959 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2392/4886] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:54:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390987313 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:54:20.508635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:20.520251 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb0f1c9d-f0c7-44c9-97fa-f87bbbeda4d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 1.043461 Jun 16 18:54:20.535725 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2495/4887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:19 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:20.648601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:20.649409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:20.676375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:20.681226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:20.682449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:20.683626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:21.543659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:21.545249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:21.567851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:21.573571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:21.574463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:21.586317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:21.999595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:22.009339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3e55114f-5f5d-49e3-98c0-0839b255bc01 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.372466 Jun 16 18:54:22.020010 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2393/4888] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:20 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:22.356682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ce6d507c-0f19-445e-9eca-9d23564ab7a6 req-97bd63e2-1e0a-4b3e-b93a-2e0b7c4f91d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee92661-d99f-4c7f-84cb-e4def53a7473", "name": "network-vif-plugged", "status": "completed", "tag": "5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:22.372068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ce6d507c-0f19-445e-9eca-9d23564ab7a6 req-97bd63e2-1e0a-4b3e-b93a-2e0b7c4f91d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:22.372528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ce6d507c-0f19-445e-9eca-9d23564ab7a6 req-97bd63e2-1e0a-4b3e-b93a-2e0b7c4f91d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:22.416492 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ce6d507c-0f19-445e-9eca-9d23564ab7a6 req-97bd63e2-1e0a-4b3e-b93a-2e0b7c4f91d7 service nova] Creating event network-vif-plugged:5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6 for instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 on n-h1-846209-2 Jun 16 18:54:22.435424 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ce6d507c-0f19-445e-9eca-9d23564ab7a6 req-97bd63e2-1e0a-4b3e-b93a-2e0b7c4f91d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088040 Jun 16 18:54:22.446132 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2394/4889] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 18:54:22.462314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:22.481389 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d66ab57f-91c7-419b-bc04-5c2478fdc9b8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.939361 Jun 16 18:54:22.483636 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2496/4890] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:21 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:23.031680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:23.032402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:23.048957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:23.053787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:23.055660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:23.058465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:23.500801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:23.501365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:23.521274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:23.521735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:23.530926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:23.531394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:23.703417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:23.715313 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-02a29c7e-c27b-4f72-8a7e-b8d488ec2831 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.687939 Jun 16 18:54:23.723341 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2395/4891] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:23 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:23.977238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:23.989660 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a5d66fc2-97e2-4e87-befb-7e254a054ee2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.492843 Jun 16 18:54:23.994831 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2497/4892] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:23 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:24.742835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:24.744196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:24.774371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:24.774769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:24.775591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:24.776044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:25.010876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:25.011506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:25.027108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:25.027573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:25.028365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:25.029061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:25.215856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:25.234046 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f410088-8e5f-434b-a7d6-2465f5f85f0c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.497025 Jun 16 18:54:25.261805 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2396/4893] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:24 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:25.356510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:25.365792 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9df0b96-325c-4925-a804-458fce869fbc tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.358966 Jun 16 18:54:25.366429 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2498/4894] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:25 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:26.253263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:26.254822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:26.277013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:26.277891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:26.281421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:26.285243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:26.385280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:26.386928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:26.426770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:26.431081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:26.438597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:26.445835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:27.311325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:27.342399 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-332911b1-43fe-4e9a-aa8c-8acf80aae909 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.957072 Jun 16 18:54:27.343789 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2499/4895] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:26 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:27.374789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:27.412445 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b8da251-b304-480e-a396-a0c675ad20b0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.160557 Jun 16 18:54:27.413323 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2397/4896] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:26 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:28.368033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:28.369554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:28.408582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:28.409802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:28.410830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:28.411642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:28.430913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:28.431879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:28.457927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:28.458334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:28.459338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:28.466678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:29.060837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:29.096865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:29.097379 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4567fc0b-51ad-40d3-95e1-b463b6178740 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.670175 Jun 16 18:54:29.114463 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2398/4897] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:28 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:29.119630 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e7ee8506-f6eb-4144-a4c0-9204267774d5 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1510 microversion: 2.1 time: 0.750133 Jun 16 18:54:29.122098 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2500/4898] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:28 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1510 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:30.123808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:30.125582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:30.141109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:30.142769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:30.171391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:30.174939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:30.175654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:30.180570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:30.180851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:30.183825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:30.188102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:30.191314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.067495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:31.082477 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9eeda231-17d3-4783-82a9-6717ac4bc064 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1487 microversion: 2.1 time: 0.943528 Jun 16 18:54:31.096442 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2501/4899] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:30 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1487 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:31.112700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-05cd1a71-6e6f-4352-a0fb-7139f19719f9 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:31.124329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-05cd1a71-6e6f-4352-a0fb-7139f19719f9 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:31.140092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=66 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:31.146888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05cd1a71-6e6f-4352-a0fb-7139f19719f9 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.148964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05cd1a71-6e6f-4352-a0fb-7139f19719f9 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.153676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05cd1a71-6e6f-4352-a0fb-7139f19719f9 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.154610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-05cd1a71-6e6f-4352-a0fb-7139f19719f9 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.268730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:31.282229 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-baf7e99e-6145-4d7a-8da9-a6d413e2460f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.166182 Jun 16 18:54:31.288632 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2399/4900] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:30 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:31.299062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-05cd1a71-6e6f-4352-a0fb-7139f19719f9 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199125 Jun 16 18:54:31.305714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:31.309845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:31.311571 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2502/4901] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:31 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:31.326299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.327150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.328245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.329111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.342073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b76f1c3-cf81-4523-adda-2fbe4cdf5bda tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:31.342533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b76f1c3-cf81-4523-adda-2fbe4cdf5bda tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:31.388014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b76f1c3-cf81-4523-adda-2fbe4cdf5bda tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.388216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b76f1c3-cf81-4523-adda-2fbe4cdf5bda tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.388970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b76f1c3-cf81-4523-adda-2fbe4cdf5bda tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.389407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b76f1c3-cf81-4523-adda-2fbe4cdf5bda tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.390900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:54:31.575168 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b76f1c3-cf81-4523-adda-2fbe4cdf5bda tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e58302d3-98a1-45bc-8056-58a432e00bb8" status: 200 len: 194 microversion: 2.1 time: 0.249479 Jun 16 18:54:31.577547 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2503/4902] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jun 16 18:54:31 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e58302d3-98a1-45bc-8056-58a432e00bb8 => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:31.610954 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-39e29a36-0648-42f3-9639-73165c7ab76a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 204 len: 0 microversion: 2.1 time: 0.320362 Jun 16 18:54:31.613017 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2400/4903] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:54:31 2022] DELETE /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:54:31.625256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:31.625883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:31.655046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.656068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:31.661554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:31.662153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:32.088893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:32.121704 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c840895-0858-4735-a53d-e9c7a8fc264f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1493 microversion: 2.1 time: 0.502440 Jun 16 18:54:32.126408 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2504/4904] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:31 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1493 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:32.306348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:32.307078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:32.329458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:32.344476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:32.345772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:32.354452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:33.142193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:33.144656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:33.158039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:33.161668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:33.164515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:33.165182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:33.224764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:34.051464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:34.084561 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ca3866a-f154-4d41-8bf6-cd9c673d3524 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.784304 Jun 16 18:54:34.102417 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2401/4905] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:32 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:34.625359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:34.642197 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-44ab9b3c-8ff8-497b-9fb0-4ddff4de945d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1493 microversion: 2.1 time: 1.503359 Jun 16 18:54:34.644519 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2505/4906] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:33 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1493 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:34.659280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17006991-1611-4805-8225-a328772cc887 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4e00d80-5b33-412a-87ce-69191e0a5dcc"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:34.671407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17006991-1611-4805-8225-a328772cc887 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:34.701996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17006991-1611-4805-8225-a328772cc887 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:34.702469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17006991-1611-4805-8225-a328772cc887 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:34.704876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17006991-1611-4805-8225-a328772cc887 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:34.705349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17006991-1611-4805-8225-a328772cc887 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:34.799729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:35.117651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:35.119746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:35.155846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:35.159717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:35.162344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:35.168303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:35.521032 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17006991-1611-4805-8225-a328772cc887 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "POST /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867873 Jun 16 18:54:35.522557 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2402/4907] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 18:54:34 2022] POST /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:35.664381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:35.665162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:35.683253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:35.683754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:35.686999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:35.688755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:36.172098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:36.189049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0b0cc253-385f-4dd3-91d0-880f0532cdb5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.084175 Jun 16 18:54:36.198649 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2506/4908] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:35 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:36.204579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6c383de1-8b43-4ce7-ba5f-8a6790837248 req-40c5e93b-7ee3-431f-91de-cf26d7efd5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fb59fd-f5c4-4a3f-85d5-00646548c839", "name": "network-vif-deleted", "tag": "d8c04507-2ac8-46e5-b67c-d1b67a3c54cb"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:36.224760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6c383de1-8b43-4ce7-ba5f-8a6790837248 req-40c5e93b-7ee3-431f-91de-cf26d7efd5dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:36.228380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6c383de1-8b43-4ce7-ba5f-8a6790837248 req-40c5e93b-7ee3-431f-91de-cf26d7efd5dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:36.232253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:36.252230 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6c383de1-8b43-4ce7-ba5f-8a6790837248 req-40c5e93b-7ee3-431f-91de-cf26d7efd5dc service nova] Creating event network-vif-deleted:d8c04507-2ac8-46e5-b67c-d1b67a3c54cb for instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 on n-h1-846209-2 Jun 16 18:54:36.262664 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dcea85f7-cac1-4473-a3d7-02cc81a1c6f8 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 200 len: 1451 microversion: 2.1 time: 0.595176 Jun 16 18:54:36.266113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2403/4909] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:35 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 1451 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:36.284160 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6c383de1-8b43-4ce7-ba5f-8a6790837248 req-40c5e93b-7ee3-431f-91de-cf26d7efd5dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063588 Jun 16 18:54:36.290721 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2507/4910] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:37.208683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:37.210128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:37.230274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:37.234169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:37.237232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:37.238039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:37.284876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:37.285591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:37.320525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:37.321299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:37.326213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:37.330230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:37.395244 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 HTTP/1.1 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '24fb59fd-f5c4-4a3f-85d5-00646548c839'} Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:37.406014 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:37.416342 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0612bd66-8ea1-4c12-835e-1914664188e9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 404 len: 111 microversion: 2.1 time: 0.128058 Jun 16 18:54:37.421350 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2508/4911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:37 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:54:37.683927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1355331545", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "6b5d8611-2f93-4d68-b741-180fc0d2bfa6"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:37.798582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:37.811124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-75f03fc3-95ae-4a9f-a5c3-7a55550446e0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.607817 Jun 16 18:54:37.812289 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2404/4912] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:37 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:37.837660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] validate_networks() for [('6b5d8611-2f93-4d68-b741-180fc0d2bfa6', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:54:38.418132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:38.423278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:38.447219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:38.447833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:38.448781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:38.451482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:38.494421 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc HTTP/1.1 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '1090fa06-d332-40b5-93e1-43ac21219bfc'} Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:38.504008 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.510527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:38.512186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-70f1c2e6-2506-4207-876e-968086a86464 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 404 len: 111 microversion: 2.1 time: 0.094700 Jun 16 18:54:38.518622 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2405/4913] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:54:38 2022] DELETE /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:54:38.530636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:38.531290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 1090fa06-d332-40b5-93e1-43ac21219bfc] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:38.547355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:38.559499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:38.560762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:38.561229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:38.598866 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc HTTP/1.1 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '1090fa06-d332-40b5-93e1-43ac21219bfc'} Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:38.605964 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance 1090fa06-d332-40b5-93e1-43ac21219bfc could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:38.611255 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b56b06ab-f73c-4ed0-a4ae-31813edda4ff tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc" status: 404 len: 111 microversion: 2.1 time: 0.089756 Jun 16 18:54:38.612896 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2406/4914] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:38 2022] GET /compute/v2.1/servers/1090fa06-d332-40b5-93e1-43ac21219bfc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:54:38.832330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:38.833400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:38.857482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:38.857932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:38.863471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:38.863931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:41.013805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:41.026597 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2c7fdec6-c899-4bed-a80d-5c5a475ccb36 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 2.200943 Jun 16 18:54:41.026960 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2407/4915] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:38 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:41.761309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:54:41.761962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:54:41.763439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:54:41.763980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:54:41.764481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:54:41.788345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:41.788926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:41.791538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:41.795244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:41.844149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:54:41.860420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Getting quotas for user c60f8f3909974479836ac8b0363b9a08 and project 01e05e5c7d4a4bf0a59096588f7fcd97. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:54:41.907348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:54:41.915919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:54:42.043786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3210ab46-4de6-4b66-84a0-d8a10207cdbd tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.367805 Jun 16 18:54:42.046841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:42.048124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:42.050188 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2509/4916] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:54:42.067620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2c8cb993-a665-49e9-a30d-d2c68097be93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:42.072378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2c8cb993-a665-49e9-a30d-d2c68097be93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:42.077857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:42.130393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:42.131431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:42.135628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:42.139246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:42.383948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2c8cb993-a665-49e9-a30d-d2c68097be93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:42.395778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2c8cb993-a665-49e9-a30d-d2c68097be93 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1215 microversion: 2.1 time: 0.339359 Jun 16 18:54:42.407304 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2510/4917] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:42 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1215 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:42.665880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:42.676897 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6bf20b72-1725-43ed-aec3-e5264069c189 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.633964 Jun 16 18:54:42.683917 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2408/4918] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:42 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:43.425752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:43.427026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:43.445505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:43.446290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:43.447922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:43.448546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:43.582647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:43.616279 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-514a602d-7443-4ca7-bf40-fdb6d03b6704 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1219 microversion: 2.1 time: 0.195480 Jun 16 18:54:43.618191 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2511/4919] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:43 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1219 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:43.700042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:43.700613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:43.728046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:43.728504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:43.733669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:43.734401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:44.276237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:44.291272 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b6dcc151-4128-4595-b0de-04a0391264c3 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.595281 Jun 16 18:54:44.293289 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2409/4920] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:43 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:44.633877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:44.636363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:44.659032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:44.661036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:44.664165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:44.678488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:45.041080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:45.054397 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e7d2691b-51da-4750-866d-fb62ff8bac85 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1285 microversion: 2.1 time: 0.424228 Jun 16 18:54:45.055047 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2512/4921] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:44 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1285 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:45.315107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:45.316604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:45.331813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:45.333743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:45.335304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:45.336028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:46.610912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:46.612283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:46.620068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:46.634637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:46.641993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:46.648837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:46.792652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:46.805090 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52f1e27a-7116-4d62-8531-b4c359025483 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.498690 Jun 16 18:54:46.843390 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2410/4922] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:45 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:47.582777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:47.592113 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d785e26b-2499-441e-99aa-4d392430f0aa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 1.523055 Jun 16 18:54:47.598310 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2513/4923] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:46 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:47.824648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:47.825385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:47.866823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:47.872106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:47.874517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:47.878985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:48.615365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:48.617399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:48.649121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:48.652068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:48.652908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:48.658827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:49.258678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:49.268067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-baf5db59-46ed-4744-a416-c4f95aed5bcf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.448220 Jun 16 18:54:49.269407 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2411/4924] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:47 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:50.286990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:50.288380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:50.304957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:50.308352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:50.310165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:50.313363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:50.354546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:50.375621 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-de4297d8-2dc6-4c7e-a984-24335b14c9d0 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 1.765070 Jun 16 18:54:50.377751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2514/4925] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:48 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:51.144388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:51.153121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4fb2c4e6-8a18-4d64-90b7-15ae7f19458d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 0.871365 Jun 16 18:54:51.159242 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2412/4926] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:50 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:51.337665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ec1b558d-e220-45e9-9bbe-a022619e78bf req-b1495b55-9156-4934-8675-9255906f7dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b", "tag": "0dc149b1-192d-4641-8a4a-4335f9c546ab"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:51.362722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ec1b558d-e220-45e9-9bbe-a022619e78bf req-b1495b55-9156-4934-8675-9255906f7dc2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:51.364473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ec1b558d-e220-45e9-9bbe-a022619e78bf req-b1495b55-9156-4934-8675-9255906f7dc2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:51.382883 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ec1b558d-e220-45e9-9bbe-a022619e78bf req-b1495b55-9156-4934-8675-9255906f7dc2 service nova] Creating event network-changed:0dc149b1-192d-4641-8a4a-4335f9c546ab for instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b on n-h1-846209-2 Jun 16 18:54:51.390041 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ec1b558d-e220-45e9-9bbe-a022619e78bf req-b1495b55-9156-4934-8675-9255906f7dc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056727 Jun 16 18:54:51.393638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:51.396347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:51.402238 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2515/4927] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:51.409888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:51.427839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:51.429579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:51.430200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:52.186010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:52.186010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:52.186010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:52.203424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:52.208135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:52.209097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:52.209562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:52.366971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:52.374897 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3abc0f0a-a360-4176-8377-5bdf9dbf8057 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 0.986050 Jun 16 18:54:52.375505 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2413/4928] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:51 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:52.389016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:52.864648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:52.865231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:52.881492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:52.882010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:52.882946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:52.883491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:52.924845 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 HTTP/1.1 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'd5d23d4e-27f1-4cfc-95a7-e1c0fc316a37'} Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:52.926530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:52.932245 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-81c559f3-66a8-479b-aeb7-d8e9d4969cd0 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 404 len: 111 microversion: 2.1 time: 0.069313 Jun 16 18:54:52.939008 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2414/4929] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:54:52 2022] DELETE /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:54:52.949890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:52.950549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:52.973153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:52.973616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:52.974478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:52.975111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:53.015078 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 HTTP/1.1 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'd5d23d4e-27f1-4cfc-95a7-e1c0fc316a37'} Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:53.018512 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f55784ac-47b1-448a-985c-1b05dbc84ca7 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37" status: 404 len: 111 microversion: 2.1 time: 0.079502 Jun 16 18:54:53.024675 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2415/4930] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:52 2022] GET /compute/v2.1/servers/d5d23d4e-27f1-4cfc-95a7-e1c0fc316a37 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:54:53.042362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:53.042869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:53.074974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:53.075432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:53.076231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:53.076670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:53.116664 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 HTTP/1.1 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '710e4c0f-a958-4070-92db-6df4658db530'} Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:53.118354 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:53.122346 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-727ed6c8-4ebb-40ef-abdd-c6c42308bf1e tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 404 len: 111 microversion: 2.1 time: 0.093754 Jun 16 18:54:53.129186 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2416/4931] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:54:53 2022] DELETE /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:54:53.145324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:53.150937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: 710e4c0f-a958-4070-92db-6df4658db530] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:53.169805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:53.174557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:53.175649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:53.176226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:53.228032 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 HTTP/1.1 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '710e4c0f-a958-4070-92db-6df4658db530'} Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:53.229982 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance 710e4c0f-a958-4070-92db-6df4658db530 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78e16808-43ea-4045-a1a6-d9a45c19b2ba tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530" status: 404 len: 111 microversion: 2.1 time: 0.101116 Jun 16 18:54:53.234123 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2417/4932] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:53 2022] GET /compute/v2.1/servers/710e4c0f-a958-4070-92db-6df4658db530 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:54:53.393307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:53.394128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:53.418055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:53.418522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:53.419321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:53.440848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:53.803215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:53.816424 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3bf36a89-df1e-48c9-8b47-f1ebe02bff23 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1509 microversion: 2.1 time: 1.643976 Jun 16 18:54:53.817039 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2516/4933] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:52 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1509 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:54.785593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:54.799048 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7142d869-f974-4821-ac93-78392f06021c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 1.410085 Jun 16 18:54:54.800140 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2418/4934] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:53 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:54:54.833279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:54.834184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:54.853432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:54.855765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:54.856662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:54.860188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:55.586085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-fbc98a4e-a589-43c5-8746-723a78e8da65 req-89d6b3c8-599c-404f-9d7f-c80587d6731e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee92661-d99f-4c7f-84cb-e4def53a7473", "name": "network-vif-unplugged", "status": "completed", "tag": "5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:54:55.609369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fbc98a4e-a589-43c5-8746-723a78e8da65 req-89d6b3c8-599c-404f-9d7f-c80587d6731e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:55.609828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fbc98a4e-a589-43c5-8746-723a78e8da65 req-89d6b3c8-599c-404f-9d7f-c80587d6731e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:55.626684 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-fbc98a4e-a589-43c5-8746-723a78e8da65 req-89d6b3c8-599c-404f-9d7f-c80587d6731e service nova] Creating event network-vif-unplugged:5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6 for instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 on n-h1-846209-2 Jun 16 18:54:55.634056 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-fbc98a4e-a589-43c5-8746-723a78e8da65 req-89d6b3c8-599c-404f-9d7f-c80587d6731e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051657 Jun 16 18:54:55.635319 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2419/4935] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:55.817280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:55.818368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:55.831158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:55.832070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:55.834584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:55.836732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:55.947653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:55.959158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-148710fc-43de-4479-8249-685502c47aee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1506 microversion: 2.1 time: 1.130321 Jun 16 18:54:55.962179 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2517/4936] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:54 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1506 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:56.875850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:56.885809 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-073958cc-836c-4524-87ca-e5908777d3db tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 1.073711 Jun 16 18:54:56.896746 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2420/4937] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:55 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:56.980179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:56.980991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:56.992652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:56.994233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:56.995163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:56.995727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:57.478528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:57.500776 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d33daad-415b-40e9-86d5-e91a01f5051f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1506 microversion: 2.1 time: 0.524721 Jun 16 18:54:57.501533 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2518/4938] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:56 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:57.920473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:57.921786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:57.961029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:57.969234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:57.970662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:57.971520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:58.536643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:58.538186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:58.561845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:58.562484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:58.568164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:58.571320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:58.703308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:58.718176 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-08c973b9-af93-42d1-bddc-834a273fc04f tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 0.818460 Jun 16 18:54:58.719162 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2421/4939] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:57 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:59.195916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:54:59.220342 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4d34b474-86a7-452c-b6b4-b9be2b1e7b71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1506 microversion: 2.1 time: 0.678673 Jun 16 18:54:59.221013 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2519/4940] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:58 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1506 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:54:59.253414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:59.253934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:59.275550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.276011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.276836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.277356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.301585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:59.337175 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 HTTP/1.1 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5'} Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:59.339072 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:59.343530 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a024d95-9ccc-4611-8857-d1cdaed6c98f tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 404 len: 111 microversion: 2.1 time: 0.091848 Jun 16 18:54:59.349388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:59.350054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] [instance: a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:59.362273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.362735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.364440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.364891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.373179 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2422/4941] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:54:59 2022] DELETE /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:54:59.474611 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] HTTP exception thrown: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Request method failure captured: Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 HTTP/1.1 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3raFflntI8fhxYG94X4V2KH_d6oNSm3OizHYTOSvPkmiXR4FjFYvE8R0fzRAGbxBK2yyhk1VjGK6zZFzImgTCImAAbIvp0YC5NOPSVTctV4Hu0KOnJY-0CognFtUGnPqBfhztjvJRLSkEukG6QyTfmRzHZIXaHP0YiX2Psyt_RZ9gE Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c72f1437a9c348ebb373cbed7855fd31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c72f1437a9c348ebb373cbed7855fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: c72f1437a9c348ebb373cbed7855fd31 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1882131866 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 720cc6d1352840a99028bf48ae9eb6a2 Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeNegativeTest-1882131866-project Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5'} Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:54:59.483064 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.489219 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:54:59.489219 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:54:59.489219 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:54:59.489219 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:54:59.489219 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:54:59.489219 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. Jun 16 18:54:59.489219 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:54:59.495060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] Returning 404 to user: Instance a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:54:59.498109 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41e10cec-67f4-4241-9969-c923bd4df008 tempest-AttachVolumeNegativeTest-1882131866 tempest-AttachVolumeNegativeTest-1882131866-project] 10.222.0.27 "GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5" status: 404 len: 111 microversion: 2.1 time: 0.152557 Jun 16 18:54:59.506271 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2520/4942] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:59 2022] GET /compute/v2.1/servers/a0e0c1b1-5ce8-48c0-b382-b9e1f37c86d5 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:54:59.652564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a769bd6b-1ae8-41ff-b9ad-f18dfc9c6577 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:59.654133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a769bd6b-1ae8-41ff-b9ad-f18dfc9c6577 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:59.669830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a769bd6b-1ae8-41ff-b9ad-f18dfc9c6577 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.670691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a769bd6b-1ae8-41ff-b9ad-f18dfc9c6577 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.676415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a769bd6b-1ae8-41ff-b9ad-f18dfc9c6577 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.676873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a769bd6b-1ae8-41ff-b9ad-f18dfc9c6577 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.746943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:59.750491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:59.766668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.768716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.771986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.775642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.791400 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a769bd6b-1ae8-41ff-b9ad-f18dfc9c6577 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.143451 Jun 16 18:54:59.794150 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2423/4943] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:54:59 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:59.939342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59f380f8-6660-44ca-8fdb-161ee6b4379f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:59.940091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-59f380f8-6660-44ca-8fdb-161ee6b4379f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:54:59.952227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59f380f8-6660-44ca-8fdb-161ee6b4379f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.952796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59f380f8-6660-44ca-8fdb-161ee6b4379f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:59.953623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59f380f8-6660-44ca-8fdb-161ee6b4379f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:59.954111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59f380f8-6660-44ca-8fdb-161ee6b4379f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:00.070130 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-59f380f8-6660-44ca-8fdb-161ee6b4379f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e58302d3-98a1-45bc-8056-58a432e00bb8" status: 200 len: 194 microversion: 2.1 time: 0.135105 Jun 16 18:55:00.077436 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2424/4944] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jun 16 18:54:59 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e58302d3-98a1-45bc-8056-58a432e00bb8 => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:55:00.084102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:00.084594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:00.099242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:00.101833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:00.103021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:00.107661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:00.375134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lazy-loading 'services' on Instance uuid 66f19262-d920-4de6-a314-24ed97ac6411 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:55:00.531216 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3b23d614-e9da-482f-b30d-b41ce36d7989 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e58302d3-98a1-45bc-8056-58a432e00bb8" status: 202 len: 0 microversion: 2.1 time: 0.449376 Jun 16 18:55:00.532188 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2425/4945] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:55:00 2022] DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e58302d3-98a1-45bc-8056-58a432e00bb8 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:55:00.569332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:00.572337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:00.592508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:00.594470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:00.598950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:00.599610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:01.053146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:01.070333 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1f7559f7-361f-4357-95fd-06fd72d9ed3e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 1.337006 Jun 16 18:55:01.071965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2521/4946] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:54:59 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:01.157152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:01.172102 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cc3fc190-3585-42f3-9a46-bb0719bc9ea4 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 200 len: 1449 microversion: 2.1 time: 0.633815 Jun 16 18:55:01.173137 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2426/4947] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:00 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 1449 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:01.190448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:01.191444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:01.202954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:01.207646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:01.209432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:01.212445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:01.213936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:01.994590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b3f79a5e-e82a-4faf-9651-ac8903111b4c req-547423ee-abc2-466d-91a0-3f3a7dfdce71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b", "name": "network-vif-plugged", "status": "completed", "tag": "0dc149b1-192d-4641-8a4a-4335f9c546ab"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:02.023503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b3f79a5e-e82a-4faf-9651-ac8903111b4c req-547423ee-abc2-466d-91a0-3f3a7dfdce71 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:02.030338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b3f79a5e-e82a-4faf-9651-ac8903111b4c req-547423ee-abc2-466d-91a0-3f3a7dfdce71 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:02.076067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b3f79a5e-e82a-4faf-9651-ac8903111b4c req-547423ee-abc2-466d-91a0-3f3a7dfdce71 service nova] Creating event network-vif-plugged:0dc149b1-192d-4641-8a4a-4335f9c546ab for instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b on n-h1-846209-2 Jun 16 18:55:02.093944 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b3f79a5e-e82a-4faf-9651-ac8903111b4c req-547423ee-abc2-466d-91a0-3f3a7dfdce71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102658 Jun 16 18:55:02.096004 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2427/4948] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:55:02.118035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:02.119204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:02.128470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:02.129475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:02.130501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:02.131103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:03.393269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:03.408960 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d5bfc0a-a6e1-4cf6-a826-74fedd14c147 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 1.303832 Jun 16 18:55:03.413490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2428/4949] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:02 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:03.574496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:03.583851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=77 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:03.590951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8ddc8911-4a3a-4498-886a-974b32472ee5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 2.405488 Jun 16 18:55:03.603092 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2522/4950] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:01 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 2418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:03.645975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:03.648310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:03.670677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:03.672762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:03.675339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:03.676660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:04.021762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:04.034536 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-604e2a46-aa19-4fb4-9695-ad4861ac3c6b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.404986 Jun 16 18:55:04.036697 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2429/4951] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:03 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:04.055747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:04.056383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:04.065601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:04.065884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:04.097704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:04.099407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:04.428838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:04.429470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:04.451530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:04.456087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:04.462860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:04.463067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:04.761002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:04.776582 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9d68783e-80c8-4085-8745-7444284d3217 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.724972 Jun 16 18:55:04.777464 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2523/4952] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:04 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:04.797848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:04.799878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:04.820324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:04.824324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:04.825301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:04.825687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:05.265887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:05.275615 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2fe930dc-60d1-4c27-b634-c8aa8dc6276a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1315 microversion: 2.1 time: 0.853003 Jun 16 18:55:05.283275 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2430/4953] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:04 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:05.462540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:05.478038 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-754d87cc-c871-4c9d-9a7f-2f2b282e9b13 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.684660 Jun 16 18:55:05.478679 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2524/4954] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:04 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:55:05.508241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-049b7172-ed13-4f1e-a6a9-f612747f863c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:05.538041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-049b7172-ed13-4f1e-a6a9-f612747f863c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:05.538516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-049b7172-ed13-4f1e-a6a9-f612747f863c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:05.630141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-049b7172-ed13-4f1e-a6a9-f612747f863c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Going to try to stop instance {{(pid=119207) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:55:05.724259 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-049b7172-ed13-4f1e-a6a9-f612747f863c tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.232857 Jun 16 18:55:05.724895 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2431/4955] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:55:05 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:55:05.732863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:05.733484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:05.758675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:05.759191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:05.760054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:05.760512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:06.116709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:06.131349 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-921dc51c-b9c9-49a8-a73a-6619ec5899da tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.398905 Jun 16 18:55:06.137493 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2525/4956] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:05 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:06.301801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:06.302799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:06.318268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:06.318735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:06.321787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:06.322307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:06.950598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:06.975288 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5bc59064-2800-4546-aeb1-5288c95c3b01 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1500 microversion: 2.1 time: 0.676502 Jun 16 18:55:06.977395 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2432/4957] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:06 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1500 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:06.996185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:06.997568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:07.007105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:07.007736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:07.008762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:07.009595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:07.063236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lazy-loading 'flavor' on Instance uuid 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:55:07.151895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:07.153636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:07.166041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:07.167579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:07.170401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:07.170401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:07.261646 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-174c4be2-1091-4000-b525-4ced137ea290 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "POST /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b/action" status: 202 len: 0 microversion: 2.1 time: 0.268071 Jun 16 18:55:07.266238 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2526/4958] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:55:06 2022] POST /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:55:07.314269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:07.318553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:07.374897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:07.386270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:07.388583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:07.389052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:08.030281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:08.046496 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dbc1cfc1-c6c2-4fb9-b38c-36d31fb0d9c6 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.900502 Jun 16 18:55:08.057386 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2433/4959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:07 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:08.260566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:08.289248 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b51b587-4f92-49bd-91d2-04ab22adbeae tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1508 microversion: 2.1 time: 1.020027 Jun 16 18:55:08.297995 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2527/4960] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:07 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1508 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:09.065303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:09.065955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:09.077807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:09.078298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:09.079108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:09.079679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:09.311006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:09.311637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:09.328927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:09.335810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:09.336891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:09.337513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:09.495834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:09.506501 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f178d52-fa4a-4a93-9263-c71ade0a3e02 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.445678 Jun 16 18:55:09.507104 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2434/4961] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:09 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:10.524329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:10.525612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:10.536571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:10.537264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:10.538265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:10.538911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:10.757112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:10.781993 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0d36229-b282-43b9-9e36-821b561201c2 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1491 microversion: 2.1 time: 1.458788 Jun 16 18:55:10.783852 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2528/4962] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:09 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1491 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:55:10.802684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:10.806076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:10.826617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:10.827265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:10.828594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:10.829479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:10.887219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:55:11.084229 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef125e3c-463b-4d34-892b-b53b0cea526b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 204 len: 0 microversion: 2.1 time: 0.287443 Jun 16 18:55:11.085157 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2529/4963] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:10 2022] DELETE /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:55:11.110258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bacdffff-0a2c-4de4-99e5-e444f501c149 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:11.116933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bacdffff-0a2c-4de4-99e5-e444f501c149 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:11.139378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bacdffff-0a2c-4de4-99e5-e444f501c149 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:11.144454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bacdffff-0a2c-4de4-99e5-e444f501c149 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:11.146732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bacdffff-0a2c-4de4-99e5-e444f501c149 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:11.147184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bacdffff-0a2c-4de4-99e5-e444f501c149 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:11.213126 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bacdffff-0a2c-4de4-99e5-e444f501c149 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e4e00d80-5b33-412a-87ce-69191e0a5dcc" status: 200 len: 194 microversion: 2.1 time: 0.126464 Jun 16 18:55:11.213968 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2530/4964] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jun 16 18:55:11 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e4e00d80-5b33-412a-87ce-69191e0a5dcc => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:55:11.241627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:11.242291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:11.260993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:11.261459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:11.262299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:11.262746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:11.544503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:11.559250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-033523bb-d578-40a5-9c3c-403928b2640a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 1.038755 Jun 16 18:55:11.583275 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2435/4965] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:10 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:11.591843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:11.594477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:11.614038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:11.614574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:11.615764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:11.616454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:11.829510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lazy-loading 'services' on Instance uuid 66f19262-d920-4de6-a314-24ed97ac6411 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:55:11.878952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:11.892541 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d40c11dc-1add-4e49-906a-3f2fe5eeac68 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1497 microversion: 2.1 time: 0.657441 Jun 16 18:55:11.896954 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2531/4966] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:11 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1497 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:11.974522 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8969b14b-7321-40f3-97b4-394af5881a74 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e4e00d80-5b33-412a-87ce-69191e0a5dcc" status: 202 len: 0 microversion: 2.1 time: 0.389497 Jun 16 18:55:11.975643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2436/4967] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:55:11 2022] DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments/e4e00d80-5b33-412a-87ce-69191e0a5dcc => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:55:12.591338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:12.592281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:12.614549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:12.618796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:12.634295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:12.635308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:12.914597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:12.916069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:12.918521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=58 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:12.935904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:12.936631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:12.937624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:12.938264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:13.134490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:13.145587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f7d5a4dc-c582-4c07-9f2a-29b17ae07570 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.559157 Jun 16 18:55:13.158496 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2532/4968] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:12 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:13.418389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:13.425423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:13.429372 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5d5a376c-1f0c-46b4-8e57-6df88032b10c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1497 microversion: 2.1 time: 0.522531 Jun 16 18:55:13.435226 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2437/4969] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:12 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1497 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:55:14.168455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:14.170111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:14.191048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:14.191828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:14.192902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:14.195734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:14.456838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:14.458709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:14.478145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:14.479085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:14.480179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:14.480876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:14.803836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60f8f3909974479836ac8b0363b9a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e05e5c7d4a4bf0a59096588f7fcd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:14.812880 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a3250a0-0c3c-4a10-96c7-cc373fa012b9 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 200 len: 1455 microversion: 2.1 time: 0.363050 Jun 16 18:55:14.819301 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2438/4970] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:14 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 1455 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:14.824836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6f0ef93d-87a8-4dd3-a39c-f4ec09d82f16 req-4713f3a2-ebaa-49ab-b76b-29973f02dfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b", "name": "network-vif-deleted", "tag": "0dc149b1-192d-4641-8a4a-4335f9c546ab"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:14.866824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6f0ef93d-87a8-4dd3-a39c-f4ec09d82f16 req-4713f3a2-ebaa-49ab-b76b-29973f02dfe7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:14.868070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6f0ef93d-87a8-4dd3-a39c-f4ec09d82f16 req-4713f3a2-ebaa-49ab-b76b-29973f02dfe7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:14.907194 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6f0ef93d-87a8-4dd3-a39c-f4ec09d82f16 req-4713f3a2-ebaa-49ab-b76b-29973f02dfe7 service nova] Creating event network-vif-deleted:0dc149b1-192d-4641-8a4a-4335f9c546ab for instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b on n-h1-846209-2 Jun 16 18:55:14.921448 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6f0ef93d-87a8-4dd3-a39c-f4ec09d82f16 req-4713f3a2-ebaa-49ab-b76b-29973f02dfe7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099458 Jun 16 18:55:14.927832 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2439/4971] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:55:14.990759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:15.004291 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6c93a61-0ee1-42ef-8290-974c367a3150 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.842003 Jun 16 18:55:15.005147 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2533/4972] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:14 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:15.844071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:15.845836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:15.857651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:15.858473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:15.875866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:15.877117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:15.909563 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b HTTP/1.1 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b'} Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:15.911326 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:15.916280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:15.922013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f314907-d2aa-4f98-9899-961bc9ef630c tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 404 len: 111 microversion: 2.1 time: 0.078785 Jun 16 18:55:15.923071 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2440/4973] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:15 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:15.941176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:15.942261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:15.982149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:15.986126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:15.986857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:15.997284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.022014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.022659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.038769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.039227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.040032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.040479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.052356 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b HTTP/1.1 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b'} Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.067376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.073761 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-62383ae4-ca01-4a86-91c5-191028bad443 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 404 len: 111 microversion: 2.1 time: 0.142832 Jun 16 18:55:16.075883 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2534/4974] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:15 2022] DELETE /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.100284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.110022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.137743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.138232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.139018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.141448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.182305 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b HTTP/1.1 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b'} Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.206083 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.211034 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.211034 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.211034 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.211034 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.211034 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.211034 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. Jun 16 18:55:16.211034 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.212600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.218254 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0f3eec53-8be6-4cf0-ab2f-2254e72279fa tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b" status: 404 len: 111 microversion: 2.1 time: 0.140983 Jun 16 18:55:16.219060 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2535/4975] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:16 2022] GET /compute/v2.1/servers/0f4f8819-c4c4-4ba2-a145-99e57ea1ea3b => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.237812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.242056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.259386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.259848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.267673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.269036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.303325 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 HTTP/1.1 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '24fb59fd-f5c4-4a3f-85d5-00646548c839'} Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.304950 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.309188 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-78add065-b141-48c1-ae93-5b63f1597121 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 404 len: 111 microversion: 2.1 time: 0.076892 Jun 16 18:55:16.312917 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2536/4976] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:16 2022] DELETE /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.315899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.316527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 24fb59fd-f5c4-4a3f-85d5-00646548c839] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.355922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.356598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.357460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.358126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.390219 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 HTTP/1.1 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '24fb59fd-f5c4-4a3f-85d5-00646548c839'} Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.392853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.397500 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.397500 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.397500 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.397500 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.397500 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.397500 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. Jun 16 18:55:16.397500 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.400075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 24fb59fd-f5c4-4a3f-85d5-00646548c839 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.401282 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-44557773-01b3-46e7-b11a-3293889ca4c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839" status: 404 len: 111 microversion: 2.1 time: 0.089968 Jun 16 18:55:16.405320 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2537/4977] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:16 2022] GET /compute/v2.1/servers/24fb59fd-f5c4-4a3f-85d5-00646548c839 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.412565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.413276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.431252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.431872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.432835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.434401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.464055 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 HTTP/1.1 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2dfa0c92-cc24-43e1-b93b-a5e2e6845459'} Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.466216 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.470586 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.473560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.474752 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-08114248-d039-4a0d-a2cb-30b1d18f5d0a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 404 len: 111 microversion: 2.1 time: 0.068193 Jun 16 18:55:16.475601 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2538/4978] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:16 2022] DELETE /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.491652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.492631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 2dfa0c92-cc24-43e1-b93b-a5e2e6845459] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.500024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.500903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.502723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.503410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.537497 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 HTTP/1.1 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2dfa0c92-cc24-43e1-b93b-a5e2e6845459'} Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.539781 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.545079 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.545079 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.545079 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.545079 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.545079 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.545079 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. Jun 16 18:55:16.545079 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.549436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 2dfa0c92-cc24-43e1-b93b-a5e2e6845459 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.550688 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be4fe443-306a-4c1e-b091-67dc3937fdbf tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459" status: 404 len: 111 microversion: 2.1 time: 0.063085 Jun 16 18:55:16.551523 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2539/4979] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:16 2022] GET /compute/v2.1/servers/2dfa0c92-cc24-43e1-b93b-a5e2e6845459 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.560045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.560960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.569191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.569399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:16.570264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.571783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.573266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.579081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:16.581312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3edb8165-5d84-4154-bf02-41f721d1e846 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1679 microversion: 2.1 time: 0.561482 Jun 16 18:55:16.583309 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2441/4980] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:16 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1679 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:55:16.609055 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 HTTP/1.1 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '9588bd87-0952-4881-9dad-e45bd98fab29'} Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.611835 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.616458 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.621849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.623050 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be7efa25-e28c-4df2-bc85-408185fb01c7 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 404 len: 111 microversion: 2.1 time: 0.067570 Jun 16 18:55:16.624200 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2540/4981] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:16 2022] DELETE /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.639405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.640135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 9588bd87-0952-4881-9dad-e45bd98fab29] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.647805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.648291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.653813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.664518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.687708 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 HTTP/1.1 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '9588bd87-0952-4881-9dad-e45bd98fab29'} Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.691436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 9588bd87-0952-4881-9dad-e45bd98fab29 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.697636 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-014b8e33-81cf-41e7-8f12-f97643b7579e tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29" status: 404 len: 111 microversion: 2.1 time: 0.068282 Jun 16 18:55:16.707119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.707630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.713818 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2442/4982] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:16 2022] GET /compute/v2.1/servers/9588bd87-0952-4881-9dad-e45bd98fab29 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.715288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.716039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.716825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.717275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.749157 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb HTTP/1.1 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b02c998a-da4a-4054-9753-7c0df81950eb'} Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.753289 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.758968 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.761270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.764154 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b323db18-bf2c-4713-badb-c34a736c8a2b tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 404 len: 111 microversion: 2.1 time: 0.062485 Jun 16 18:55:16.765238 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2541/4983] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:16 2022] DELETE /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:16.773513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:16.774335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: b02c998a-da4a-4054-9753-7c0df81950eb] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:16.785303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.785771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.794546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:16.794546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:16.836780 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb HTTP/1.1 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'b02c998a-da4a-4054-9753-7c0df81950eb'} Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:16.838467 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.842917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:16.842917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:16.842917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:16.842917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:16.842917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:16.842917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. Jun 16 18:55:16.842917 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:16.844400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance b02c998a-da4a-4054-9753-7c0df81950eb could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:16.850128 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ec0d9b6-f771-4d45-96c3-3b310831400a tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb" status: 404 len: 111 microversion: 2.1 time: 0.076810 Jun 16 18:55:16.851061 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2443/4984] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:16 2022] GET /compute/v2.1/servers/b02c998a-da4a-4054-9753-7c0df81950eb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:17.602267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:17.603176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:17.618667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:17.619200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:17.620087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:17.620713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:18.120604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:18.138960 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f9f50e37-7cae-4c7c-bc71-826179c3f462 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1656 microversion: 2.1 time: 0.536424 Jun 16 18:55:18.139795 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2542/4985] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:17 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1656 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:18.156031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d372835-7289-4fb2-8110-8941e8f3f574 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:18.185309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d372835-7289-4fb2-8110-8941e8f3f574 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:18.186060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d372835-7289-4fb2-8110-8941e8f3f574 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:18.244982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d372835-7289-4fb2-8110-8941e8f3f574 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Going to try to start instance {{(pid=119207) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:55:18.319004 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d372835-7289-4fb2-8110-8941e8f3f574 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.166324 Jun 16 18:55:18.320263 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2444/4986] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:55:18 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:55:18.331827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:18.332742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:18.383683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:18.383683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:18.387823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:18.390281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:19.408078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:19.416870 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d1782b38-35b3-496c-bdd1-0416f9ed9b74 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1665 microversion: 2.1 time: 1.092315 Jun 16 18:55:19.422072 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2543/4987] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:18 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1665 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:20.443669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:20.445599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:20.472236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:20.473101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:20.486348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:20.491504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:20.919612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:20.932914 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32f2a213-83de-4ee2-8417-09d56f878cbb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1665 microversion: 2.1 time: 0.498421 Jun 16 18:55:20.935670 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2445/4988] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:20 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1665 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:21.954022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:21.956129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:21.981557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:21.984153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:21.987784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:21.988462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:22.962856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:22.978067 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c493947d-6913-45ad-b0c1-a674c8fcd1a9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1665 microversion: 2.1 time: 1.029136 Jun 16 18:55:22.979670 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2544/4989] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:21 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1665 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:23.999216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:24.000056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:24.014576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:24.017168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:24.030326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:24.031066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:24.470373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:24.484699 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3be6ca3c-32d3-4f75-a1f2-94f277117fdb tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.488931 Jun 16 18:55:24.485929 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2446/4990] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:23 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:24.502707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:24.503859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:24.525545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:24.526090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:24.527089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:24.527689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:25.042250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:25.056719 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51017843-8485-42e2-89ed-ee871076d470 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.558035 Jun 16 18:55:25.057536 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2545/4991] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:24 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:25.074896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:25.076197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:25.084081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:25.091082 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:25.103150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:25.105750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:25.721955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2e787d81-1036-416e-9ed6-3f573a63f4c0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:25.722989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2e787d81-1036-416e-9ed6-3f573a63f4c0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:25.741739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e787d81-1036-416e-9ed6-3f573a63f4c0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:25.742292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e787d81-1036-416e-9ed6-3f573a63f4c0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:25.743118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e787d81-1036-416e-9ed6-3f573a63f4c0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:25.743558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e787d81-1036-416e-9ed6-3f573a63f4c0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:25.836974 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2e787d81-1036-416e-9ed6-3f573a63f4c0 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123048 Jun 16 18:55:25.838411 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2546/4992] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:55:25 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:55:25.843579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:25.865180 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-34e19d99-e5a9-490c-8f03-85aa0191e106 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.794039 Jun 16 18:55:25.880271 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2447/4993] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:25 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:25.886021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:25.886647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:25.900194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:25.901246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:25.904341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:25.906097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:26.137994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53a329b8-000f-483f-94bd-50da9ce610d5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:26.139031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53a329b8-000f-483f-94bd-50da9ce610d5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:26.161177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a329b8-000f-483f-94bd-50da9ce610d5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:26.161556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a329b8-000f-483f-94bd-50da9ce610d5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:26.162391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a329b8-000f-483f-94bd-50da9ce610d5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:26.162847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53a329b8-000f-483f-94bd-50da9ce610d5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:26.199039 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:55:26.199299 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 18:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 (ip 10.222.0.27) !!! Jun 16 18:55:26.264035 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53a329b8-000f-483f-94bd-50da9ce610d5 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130189 Jun 16 18:55:26.272564 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2448/4994] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 18:55:26 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:55:26.394050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:26.394570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:26.402920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:26.403775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:26.404803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:26.405499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:26.461431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:55:26.685499 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9ae6b97b-1457-4fc4-af49-67d1346d8f6f tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 204 len: 0 microversion: 2.1 time: 0.295536 Jun 16 18:55:26.686623 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2449/4995] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:26 2022] DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:55:26.702477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:26.703555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:26.716203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:26.717210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:26.718111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:26.725207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:27.265752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:27.281761 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fd36e79b-a760-41b1-b00a-02d9b3879745 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 1.401086 Jun 16 18:55:27.284212 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2547/4996] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:25 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:27.302589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:27.314622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:27.315425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:27.323054 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f06f14bb-54b8-48b6-83da-60442e60a680 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1675 microversion: 2.1 time: 0.617844 Jun 16 18:55:27.324890 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2450/4997] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:26 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1675 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:55:27.348835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:27.352099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:27.356867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:27.359008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:28.343094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:28.343725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:28.365341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:28.366324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:28.367667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:28.368341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:28.636366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:28.645136 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-02beb7b2-47cb-4eac-a7d3-0f367a4ce3de tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 1.347019 Jun 16 18:55:28.651295 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2548/4998] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:27 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:28.669516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:28.670096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:28.683414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:28.683885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:28.684654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:28.685075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:28.822227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lazy-loading 'flavor' on Instance uuid d69cc468-c538-4554-8a3d-5ea10facc4d7 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:55:28.975316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:29.013667 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19580118-5169-465a-b26c-28743154ae80 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1675 microversion: 2.1 time: 0.672270 Jun 16 18:55:29.029234 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2451/4999] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:28 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1675 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:55:29.186496 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ac61209-4e6a-4122-ad02-9315635c5817 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.518513 Jun 16 18:55:29.195835 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2549/5000] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:55:28 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:55:29.201109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:29.201880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:29.212783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:29.218525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:29.222199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:29.224170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:29.964882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:29.983473 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9b60d1e-01d7-4b0f-ae13-250869185f63 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1677 microversion: 2.1 time: 0.786766 Jun 16 18:55:29.987016 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2452/5001] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:29 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1677 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:30.036775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:30.038142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:30.074246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:30.074712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:30.085737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:30.086372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:31.007449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:31.008095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:31.034292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:31.034858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:31.035714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:31.036166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:32.081779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:32.093122 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-48f8d8e6-8d3c-41ec-a210-74a29fbaf000 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1675 microversion: 2.1 time: 2.059587 Jun 16 18:55:32.095121 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2550/5002] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:30 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1675 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:32.283971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:32.296258 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e24ec2d7-7317-4421-baa5-2a1cdb232f44 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1660 microversion: 2.1 time: 1.296460 Jun 16 18:55:32.312324 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2453/5003] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:30 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1660 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:55:32.320673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce1e3e34-89af-4dce-a8dc-e8efefa67130 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:32.322412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ce1e3e34-89af-4dce-a8dc-e8efefa67130 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:32.325606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:32.334492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce1e3e34-89af-4dce-a8dc-e8efefa67130 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:32.335259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce1e3e34-89af-4dce-a8dc-e8efefa67130 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:32.336976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce1e3e34-89af-4dce-a8dc-e8efefa67130 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:32.337602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce1e3e34-89af-4dce-a8dc-e8efefa67130 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:32.487693 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ce1e3e34-89af-4dce-a8dc-e8efefa67130 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.177006 Jun 16 18:55:32.492923 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2551/5004] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 18:55:32 2022] POST /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:55:32.505275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:32.506138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:32.533980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:32.536301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:32.540105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:32.541809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:32.627946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:33.069759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-24012cc4-e4ed-49e0-a932-8d50dc5cb4f5 req-e72b31fb-714e-4893-8df4-cd580017de83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f19262-d920-4de6-a314-24ed97ac6411", "name": "network-vif-deleted", "tag": "65d760b7-4da8-4082-9548-7de9b4d8e55e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:33.120355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-24012cc4-e4ed-49e0-a932-8d50dc5cb4f5 req-e72b31fb-714e-4893-8df4-cd580017de83 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:33.121022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-24012cc4-e4ed-49e0-a932-8d50dc5cb4f5 req-e72b31fb-714e-4893-8df4-cd580017de83 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:33.184892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-24012cc4-e4ed-49e0-a932-8d50dc5cb4f5 req-e72b31fb-714e-4893-8df4-cd580017de83 service nova] Creating event network-vif-deleted:65d760b7-4da8-4082-9548-7de9b4d8e55e for instance 66f19262-d920-4de6-a314-24ed97ac6411 on n-h2-846209-2 Jun 16 18:55:33.219528 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-24012cc4-e4ed-49e0-a932-8d50dc5cb4f5 req-e72b31fb-714e-4893-8df4-cd580017de83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152335 Jun 16 18:55:33.224489 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2552/5005] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:55:33.253963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:33.256952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:33.281336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:33.281834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:33.288290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:33.288761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:33.447678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:33.448171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:33.451494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lazy-loading 'fault' on Instance uuid 66f19262-d920-4de6-a314-24ed97ac6411 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:55:33.748237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe2a00a0282a4a0f80d6ab03cd8cf21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a625bc4b5480485189cb007113356b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:33.782551 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-098d7e47-9bfa-4503-9fa0-2078572eff73 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 200 len: 1328 microversion: 2.1 time: 0.543194 Jun 16 18:55:33.786740 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2553/5006] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:33 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 1328 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:33.913370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:33.925408 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cbe8e011-d89c-40a4-b1f9-3b56d05cab71 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1666 microversion: 2.1 time: 1.430205 Jun 16 18:55:33.933418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2454/5007] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:32 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1666 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:34.802712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:34.803409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:34.824046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:34.824507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:34.825310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:34.833752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:34.877954 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] HTTP exception thrown: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Request method failure captured: Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 HTTP/1.1 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sYNyFDeqc8yTn7L9g8d1rzX9oxl0U18a2uyCSpu6xirve6_Xg-xVzILVfejrne60B01MnxSCXG44kiz4VAO4y1lMhyolsqaVQKanNSc4sZ3cBIxOJE0P0DL5Aq1VEcmfW1Tk0453WxLeTO2adKJ0K8osUKPO8ijzoBjDGOPSgw6Qs Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a625bc4b5480485189cb007113356b39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a625bc4b5480485189cb007113356b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fe2a00a0282a4a0f80d6ab03cd8cf21a Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '66f19262-d920-4de6-a314-24ed97ac6411'} Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:34.885089 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:34.890364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Returning 404 to user: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:34.894050 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-20d58528-b3a3-4f5f-bd3a-0a6dd0a51172 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 404 len: 111 microversion: 2.1 time: 0.089840 Jun 16 18:55:34.905706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf71844b-c8d0-4cca-9430-2acc07d25648 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '.version_select at 0x7f866e1440d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:34.933258 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2554/5008] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:34 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:34.965603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:34.967873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:34.982909 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf71844b-c8d0-4cca-9430-2acc07d25648 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573732751" status: 202 len: 0 microversion: 2.1 time: 0.081983 Jun 16 18:55:34.989208 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2455/5009] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jun 16 18:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573732751 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:55:35.007783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:35.015182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:35.022092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:35.023393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:35.853024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:35.869849 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-63855f48-4cf9-45fc-a5c9-5cd4794dbf79 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1666 microversion: 2.1 time: 0.925961 Jun 16 18:55:35.873248 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2555/5010] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:34 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1666 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:36.163928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:36.165021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:36.179099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.182413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.184956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.189085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.222211 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f HTTP/1.1 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '632c2bc2-e51e-483e-95bf-182b65fdae1f'} Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:36.224285 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.229470 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.233380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:36.237702 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4bd30dab-2b76-419d-98bf-67c8d73910da tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 404 len: 111 microversion: 2.1 time: 0.078223 Jun 16 18:55:36.241826 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2456/5011] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:36 2022] DELETE /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:36.246947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:36.247587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 632c2bc2-e51e-483e-95bf-182b65fdae1f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:36.266868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.267428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.269498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.271569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.316644 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f HTTP/1.1 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '632c2bc2-e51e-483e-95bf-182b65fdae1f'} Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.320915 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.326436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.326436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.326436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.326436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:36.326436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:36.326436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. Jun 16 18:55:36.326436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.330641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 632c2bc2-e51e-483e-95bf-182b65fdae1f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:36.331746 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca75aeee-2f67-4ab3-aa3c-daf9dc8c10d1 tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f" status: 404 len: 111 microversion: 2.1 time: 0.089100 Jun 16 18:55:36.337704 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2556/5012] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:36 2022] GET /compute/v2.1/servers/632c2bc2-e51e-483e-95bf-182b65fdae1f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:55:36.342501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:36.343313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:36.358868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.360379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.364227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.365403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.406848 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d HTTP/1.1 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '4d6fec83-81c5-4527-9f5e-46c894a7dc7d'} Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:36.411379 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:36.416116 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-19573544-7020-4475-86c2-54d92424a48d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 404 len: 111 microversion: 2.1 time: 0.077559 Jun 16 18:55:36.420794 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2457/5013] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:36 2022] DELETE /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:36.426789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:36.427360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] [instance: 4d6fec83-81c5-4527-9f5e-46c894a7dc7d] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:36.452392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.453063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.455379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.457699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.510254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:36.512104 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] HTTP exception thrown: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Request method failure captured: Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d HTTP/1.1 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3tIxjua3JS2e2ultg0y0ceurK12d7puf5F--UIhag3TccfOp3Kq7QUvreBicwcP6luf7wksi_uGl3xBaloSOJqtaY3JmffJ5u-e62w4GQYrqAQRAiE6lZngiTaxxzSADsUDSFR-zeAm7ijva-GWsjvW98nNwuVUQjdJTyajkjzwNQ0 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01e05e5c7d4a4bf0a59096588f7fcd97", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01e05e5c7d4a4bf0a59096588f7fcd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 01e05e5c7d4a4bf0a59096588f7fcd97 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238459026 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c60f8f3909974479836ac8b0363b9a08 Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1238459026-project Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '4d6fec83-81c5-4527-9f5e-46c894a7dc7d'} Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:36.526749 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] Returning 404 to user: Instance 4d6fec83-81c5-4527-9f5e-46c894a7dc7d could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:36.533265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-caf56eac-d8be-466b-b2cb-95e32a01601d tempest-DeleteServersTestJSON-1238459026 tempest-DeleteServersTestJSON-1238459026-project] 10.222.0.27 "GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d" status: 404 len: 111 microversion: 2.1 time: 0.106446 Jun 16 18:55:36.540175 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2557/5014] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:36 2022] GET /compute/v2.1/servers/4d6fec83-81c5-4527-9f5e-46c894a7dc7d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:36.890235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:36.891864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:36.905281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.910703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:36.919711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:36.920250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:37.906349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:37.923239 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd764068-4a15-4171-b126-99d9b906ba55 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1666 microversion: 2.1 time: 1.037656 Jun 16 18:55:37.927519 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2458/5015] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:36 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1666 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:38.949183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:38.950568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:38.984684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:38.990721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:38.991674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:38.994545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:39.870051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:39.883171 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-45bd33f5-7d6e-473e-9ed8-3c6535489ac7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 0.942269 Jun 16 18:55:39.884121 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2558/5016] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:38 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:39.901953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:39.903701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:39.926255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:39.928150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:39.932201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:39.933071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:40.957642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:40.967823 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8f198394-15f9-4d94-b74c-db1e13e5087f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1669 microversion: 2.1 time: 1.069987 Jun 16 18:55:40.974544 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2459/5017] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:39 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1669 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:40.998164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:40.998623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:41.011630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:41.012112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:41.012914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:41.013376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:41.061330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:55:41.069058 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Working on deleting snapshot 10d3ca39-db21-4432-8ac8-7afc85bd8660 from shelved instance... Jun 16 18:55:42.517038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Doing local delete in cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119206) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 16 18:55:42.517870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:42.531020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:42.532418 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 16 18:55:42.541192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] deallocate_for_instance() {{(pid=119206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 16 18:55:46.720039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Updating instance_info_cache with network_info: [] {{(pid=119206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:55:46.770116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ca0bb25c-6617-4fd2-911a-e59682ab86da req-c177bdaa-4fb7-4fbb-823c-05b1c2200202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee92661-d99f-4c7f-84cb-e4def53a7473", "name": "network-vif-deleted", "tag": "5dd1cad1-a72e-4f6a-9b1a-b4d0eff144b6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:46.797781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:46.807983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ca0bb25c-6617-4fd2-911a-e59682ab86da req-c177bdaa-4fb7-4fbb-823c-05b1c2200202 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:46.808883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ca0bb25c-6617-4fd2-911a-e59682ab86da req-c177bdaa-4fb7-4fbb-823c-05b1c2200202 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:46.886022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.compute.server_external_events [req-ca0bb25c-6617-4fd2-911a-e59682ab86da req-c177bdaa-4fb7-4fbb-823c-05b1c2200202 service nova] Unable to find a host for instance 1ee92661-d99f-4c7f-84cb-e4def53a7473. Dropping event network-vif-deleted {{(pid=119207) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 18:55:46.887393 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ca0bb25c-6617-4fd2-911a-e59682ab86da req-c177bdaa-4fb7-4fbb-823c-05b1c2200202 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.122175 Jun 16 18:55:46.891532 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2460/5018] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 127 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 18:55:47.736983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0ca49da-ddb0-41ab-a158-0da1a71c94e8 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 204 len: 0 microversion: 2.1 time: 6.743441 Jun 16 18:55:47.738525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2559/5019] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:40 2022] DELETE /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 0 bytes in 6746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:55:47.747393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:47.748314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 1ee92661-d99f-4c7f-84cb-e4def53a7473] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:47.761511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:47.764581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:47.765753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:47.766585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:47.817870 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] HTTP exception thrown: Instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 could not be found. Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Request method failure captured: Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 HTTP/1.1 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3qQdnkg9my-1t7iorxlTdvAY7JoLX7pzKEeYb_M4KpJv--YSljcRPZ5tsuFxEn56Z9mV9LJEDpP7D3JgeEQwWwZA1r9aEbrhkYX9fOrKSTVKDKB6sFrCRqfMzr4ToDxrWC-vFVylVDVvwopGS-5VathrmG6eJr57nXSFKQ4AXQnExU Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e0ae0d9516c431f85b29c11cffea558", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-458867450 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 0bad5f4aa84e4b978a5a92478b6772bf Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 could not be found. Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '1ee92661-d99f-4c7f-84cb-e4def53a7473'} Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 could not be found. Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 could not be found. Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:47.824018 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:47.829108 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:47.829108 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:47.829108 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:47.829108 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:47.829108 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:47.829108 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 could not be found. Jun 16 18:55:47.829108 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:47.832013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Returning 404 to user: Instance 1ee92661-d99f-4c7f-84cb-e4def53a7473 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:47.836180 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b9651930-0818-45d8-842c-144bb9bbe315 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473" status: 404 len: 111 microversion: 2.1 time: 0.093466 Jun 16 18:55:47.844738 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2461/5020] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:47 2022] GET /compute/v2.1/servers/1ee92661-d99f-4c7f-84cb-e4def53a7473 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:47.856331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:47.857337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:47.868148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:47.869008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:47.870099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:47.870790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:47.969546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:55:48.252186 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4dd7a61f-7307-4590-afae-7feb7b4ffa9b tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 204 len: 0 microversion: 2.1 time: 0.402654 Jun 16 18:55:48.256253 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2560/5021] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:47 2022] DELETE /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:55:48.264845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:48.265545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:48.289089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:48.289089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:48.289931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:48.290391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:49.025110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:49.040648 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-69f9a418-c68f-4584-ade9-d7b764d47daf tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1465 microversion: 2.1 time: 0.781313 Jun 16 18:55:49.050830 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2462/5022] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:48 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1465 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:50.061434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:50.063703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:50.099650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:50.101122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:50.108741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:50.110181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:50.740311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:50.756005 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b717bd5b-8704-4bdf-8d4f-ef67faee6023 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1465 microversion: 2.1 time: 0.698966 Jun 16 18:55:50.756627 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2561/5023] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:50 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1465 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:51.773459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:51.774905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:51.793120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:51.801525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:51.802264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:51.813630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:51.823984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:51.827190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:51.838490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:51.842526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:51.846980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:51.848567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:51.941878 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] HTTP exception thrown: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Request method failure captured: Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 HTTP/1.1 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sYNyFDeqc8yTn7L9g8d1rzX9oxl0U18a2uyCSpu6xirve6_Xg-xVzILVfejrne60B01MnxSCXG44kiz4VAO4y1lMhyolsqaVQKanNSc4sZ3cBIxOJE0P0DL5Aq1VEcmfW1Tk0453WxLeTO2adKJ0K8osUKPO8ijzoBjDGOPSgw6Qs Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a625bc4b5480485189cb007113356b39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a625bc4b5480485189cb007113356b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fe2a00a0282a4a0f80d6ab03cd8cf21a Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '66f19262-d920-4de6-a314-24ed97ac6411'} Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:51.943853 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:51.950429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Returning 404 to user: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:51.966173 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da3a2a50-56dc-4fb6-8cc7-990937eec697 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 404 len: 111 microversion: 2.1 time: 0.169899 Jun 16 18:55:51.974392 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2562/5024] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:51 2022] DELETE /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:52.009763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:52.018488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 66f19262-d920-4de6-a314-24ed97ac6411] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:52.065108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:52.078625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:52.081089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:52.081827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:52.153228 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] HTTP exception thrown: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Request method failure captured: Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 HTTP/1.1 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sYNyFDeqc8yTn7L9g8d1rzX9oxl0U18a2uyCSpu6xirve6_Xg-xVzILVfejrne60B01MnxSCXG44kiz4VAO4y1lMhyolsqaVQKanNSc4sZ3cBIxOJE0P0DL5Aq1VEcmfW1Tk0453WxLeTO2adKJ0K8osUKPO8ijzoBjDGOPSgw6Qs Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a625bc4b5480485189cb007113356b39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a625bc4b5480485189cb007113356b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fe2a00a0282a4a0f80d6ab03cd8cf21a Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '66f19262-d920-4de6-a314-24ed97ac6411'} Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:52.154904 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:52.162366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Returning 404 to user: Instance 66f19262-d920-4de6-a314-24ed97ac6411 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:52.164684 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-95b8fdb9-2e14-419b-894c-760e8094a025 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411" status: 404 len: 111 microversion: 2.1 time: 0.186847 Jun 16 18:55:52.165287 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2563/5025] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:51 2022] GET /compute/v2.1/servers/66f19262-d920-4de6-a314-24ed97ac6411 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:52.358105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:52.384503 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7db7602e-8e86-4f96-887e-89a0d956b079 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1465 microversion: 2.1 time: 0.615039 Jun 16 18:55:52.392974 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2463/5026] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:51 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1465 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:53.415018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:53.415018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:53.490344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:53.493808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:53.496227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:53.499590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:53.995164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:54.007284 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9447ebf8-1ae1-4de7-84c5-976615d9776f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 200 len: 1465 microversion: 2.1 time: 0.602209 Jun 16 18:55:54.010206 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2564/5027] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:53 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 1465 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:54.179458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7dfa0379-a50c-49d9-a32b-ce0070c8d517 req-56ae974a-ac72-4586-8f58-996f9fb6851e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d89515d-9120-4299-ac71-21eca43467c5", "name": "network-vif-deleted", "tag": "4dbc5775-f226-49da-8d7c-22da33199596"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:54.209316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7dfa0379-a50c-49d9-a32b-ce0070c8d517 req-56ae974a-ac72-4586-8f58-996f9fb6851e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:54.209818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7dfa0379-a50c-49d9-a32b-ce0070c8d517 req-56ae974a-ac72-4586-8f58-996f9fb6851e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:54.233713 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7dfa0379-a50c-49d9-a32b-ce0070c8d517 req-56ae974a-ac72-4586-8f58-996f9fb6851e service nova] Creating event network-vif-deleted:4dbc5775-f226-49da-8d7c-22da33199596 for instance 5d89515d-9120-4299-ac71-21eca43467c5 on n-h2-846209-2 Jun 16 18:55:54.240663 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7dfa0379-a50c-49d9-a32b-ce0070c8d517 req-56ae974a-ac72-4586-8f58-996f9fb6851e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069218 Jun 16 18:55:54.241860 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2464/5028] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:55:55.039849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:55.042303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 5d89515d-9120-4299-ac71-21eca43467c5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:55.066370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:55.067305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:55.075797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:55.077997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:55.164173 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] HTTP exception thrown: Instance 5d89515d-9120-4299-ac71-21eca43467c5 could not be found. Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Request method failure captured: Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 HTTP/1.1 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qQdnkg9my-1t7iorxlTdvAY7JoLX7pzKEeYb_M4KpJv--YSljcRPZ5tsuFxEn56Z9mV9LJEDpP7D3JgeEQwWwZA1r9aEbrhkYX9fOrKSTVKDKB6sFrCRqfMzr4ToDxrWC-vFVylVDVvwopGS-5VathrmG6eJr57nXSFKQ4AXQnExU Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e0ae0d9516c431f85b29c11cffea558", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-458867450 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0bad5f4aa84e4b978a5a92478b6772bf Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5d89515d-9120-4299-ac71-21eca43467c5 could not be found. Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5d89515d-9120-4299-ac71-21eca43467c5'} Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d89515d-9120-4299-ac71-21eca43467c5 could not be found. Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d89515d-9120-4299-ac71-21eca43467c5 could not be found. Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:55.177532 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:55.183044 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:55.183044 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:55.183044 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:55.183044 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:55.183044 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:55.183044 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d89515d-9120-4299-ac71-21eca43467c5 could not be found. Jun 16 18:55:55.183044 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:55.184643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Returning 404 to user: Instance 5d89515d-9120-4299-ac71-21eca43467c5 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:55.191756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0051475f-5e77-4817-b1c8-0efd9a52ed49 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5" status: 404 len: 111 microversion: 2.1 time: 0.169810 Jun 16 18:55:55.195259 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2565/5029] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:55 2022] GET /compute/v2.1/servers/5d89515d-9120-4299-ac71-21eca43467c5 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:55.205988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:55.206705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:55.227878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:55.227878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:55.231598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:55.232162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:55.324673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:55:55.518684 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d0756ac2-fadb-4e07-a681-ea97e75a9899 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 204 len: 0 microversion: 2.1 time: 0.318683 Jun 16 18:55:55.519830 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2465/5030] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:55 2022] DELETE /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:55:55.528397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:55.529037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:55.540960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:55.550632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:55.551493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:55.551947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:56.738193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:56.773319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04285480-6e70-4821-a097-13ec04444eb9 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1508 microversion: 2.1 time: 1.249162 Jun 16 18:55:56.782173 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2566/5031] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:55 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1508 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:57.795274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:57.796275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:57.807884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:57.808344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:57.809127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:57.809568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:58.749454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:55:58.762832 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-acf358a0-6338-45c8-8585-12b4e9cf858f tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1508 microversion: 2.1 time: 0.972068 Jun 16 18:55:58.763948 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2466/5032] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:57 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1508 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:55:59.203747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:59.205305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:59.221561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:59.222337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:59.223690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:59.224343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:59.288440 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] HTTP exception thrown: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Request method failure captured: Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 HTTP/1.1 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3sYNyFDeqc8yTn7L9g8d1rzX9oxl0U18a2uyCSpu6xirve6_Xg-xVzILVfejrne60B01MnxSCXG44kiz4VAO4y1lMhyolsqaVQKanNSc4sZ3cBIxOJE0P0DL5Aq1VEcmfW1Tk0453WxLeTO2adKJ0K8osUKPO8ijzoBjDGOPSgw6Qs Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a625bc4b5480485189cb007113356b39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a625bc4b5480485189cb007113356b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: fe2a00a0282a4a0f80d6ab03cd8cf21a Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '40e7cff4-9488-49aa-b529-00d7ad69b2c7'} Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:59.300965 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.307268 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.311681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Returning 404 to user: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:59.313016 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72109e0e-cc13-4d4a-948d-52eb8e0ffb81 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 404 len: 111 microversion: 2.1 time: 0.114768 Jun 16 18:55:59.319627 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2567/5033] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:55:59 2022] DELETE /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:59.333259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:59.334195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] [instance: 40e7cff4-9488-49aa-b529-00d7ad69b2c7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:59.348722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:59.354540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:59.355533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:59.356088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:59.385833 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] HTTP exception thrown: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.394823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bd7b92c5-d79d-4ba1-aedd-d17de6f25a9f req-53cce888-6c4f-4787-b22f-bc7cdc29a993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b700f5-03b2-4f59-8431-533f3efdfb5e", "name": "network-vif-deleted", "tag": "11b701ad-fee1-4ba8-867f-e68c7bdbe080"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Request method failure captured: Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 HTTP/1.1 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3sYNyFDeqc8yTn7L9g8d1rzX9oxl0U18a2uyCSpu6xirve6_Xg-xVzILVfejrne60B01MnxSCXG44kiz4VAO4y1lMhyolsqaVQKanNSc4sZ3cBIxOJE0P0DL5Aq1VEcmfW1Tk0453WxLeTO2adKJ0K8osUKPO8ijzoBjDGOPSgw6Qs Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a625bc4b5480485189cb007113356b39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a625bc4b5480485189cb007113356b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a625bc4b5480485189cb007113356b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: a625bc4b5480485189cb007113356b39 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-AttachVolumeTestJSON-6534872 Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: fe2a00a0282a4a0f80d6ab03cd8cf21a Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-AttachVolumeTestJSON-6534872-project Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '40e7cff4-9488-49aa-b529-00d7ad69b2c7'} Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:55:59.406336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.412451 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:55:59.412451 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:55:59.412451 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:55:59.412451 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:55:59.412451 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:55:59.412451 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. Jun 16 18:55:59.412451 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:55:59.416723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] Returning 404 to user: Instance 40e7cff4-9488-49aa-b529-00d7ad69b2c7 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:55:59.419383 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9ef7e2f7-438a-4292-9dc0-c9fc454aa840 tempest-AttachVolumeTestJSON-6534872 tempest-AttachVolumeTestJSON-6534872-project] 10.222.0.27 "GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7" status: 404 len: 111 microversion: 2.1 time: 0.089669 Jun 16 18:55:59.419569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bd7b92c5-d79d-4ba1-aedd-d17de6f25a9f req-53cce888-6c4f-4787-b22f-bc7cdc29a993 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:59.419698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bd7b92c5-d79d-4ba1-aedd-d17de6f25a9f req-53cce888-6c4f-4787-b22f-bc7cdc29a993 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:59.431807 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2467/5034] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:59 2022] GET /compute/v2.1/servers/40e7cff4-9488-49aa-b529-00d7ad69b2c7 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:59.486175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bd7b92c5-d79d-4ba1-aedd-d17de6f25a9f req-53cce888-6c4f-4787-b22f-bc7cdc29a993 service nova] Creating event network-vif-deleted:11b701ad-fee1-4ba8-867f-e68c7bdbe080 for instance 02b700f5-03b2-4f59-8431-533f3efdfb5e on n-h1-846209-2 Jun 16 18:55:59.510016 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bd7b92c5-d79d-4ba1-aedd-d17de6f25a9f req-53cce888-6c4f-4787-b22f-bc7cdc29a993 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120216 Jun 16 18:55:59.522886 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2568/5035] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 18:55:59.783379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:55:59.784371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:55:59.817947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:59.826488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:59.827588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:59.828925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:00.000809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:00.006466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:00.010511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lazy-loading 'fault' on Instance uuid 02b700f5-03b2-4f59-8431-533f3efdfb5e {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:56:00.279884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:00.293822 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5bfc88e-3e7d-486e-915d-f6ef370750dc tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 200 len: 1305 microversion: 2.1 time: 0.515699 Jun 16 18:56:00.309856 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2468/5036] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:55:59 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 1305 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:01.327043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:01.327043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 02b700f5-03b2-4f59-8431-533f3efdfb5e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:01.345689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:01.348822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:01.350958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:01.352658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:01.398649 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] HTTP exception thrown: Instance 02b700f5-03b2-4f59-8431-533f3efdfb5e could not be found. Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Request method failure captured: Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e HTTP/1.1 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qQdnkg9my-1t7iorxlTdvAY7JoLX7pzKEeYb_M4KpJv--YSljcRPZ5tsuFxEn56Z9mV9LJEDpP7D3JgeEQwWwZA1r9aEbrhkYX9fOrKSTVKDKB6sFrCRqfMzr4ToDxrWC-vFVylVDVvwopGS-5VathrmG6eJr57nXSFKQ4AXQnExU Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e0ae0d9516c431f85b29c11cffea558", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-458867450 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0bad5f4aa84e4b978a5a92478b6772bf Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 02b700f5-03b2-4f59-8431-533f3efdfb5e could not be found. Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '02b700f5-03b2-4f59-8431-533f3efdfb5e'} Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b700f5-03b2-4f59-8431-533f3efdfb5e could not be found. Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b700f5-03b2-4f59-8431-533f3efdfb5e could not be found. Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:56:01.401125 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b700f5-03b2-4f59-8431-533f3efdfb5e could not be found. Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:01.409597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Returning 404 to user: Instance 02b700f5-03b2-4f59-8431-533f3efdfb5e could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:56:01.411465 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2732a26b-848d-46bf-943d-e120c6e720ce tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e" status: 404 len: 111 microversion: 2.1 time: 0.091676 Jun 16 18:56:01.412185 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2569/5037] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:01 2022] GET /compute/v2.1/servers/02b700f5-03b2-4f59-8431-533f3efdfb5e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:56:01.424178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:01.424800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:01.433271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:01.434268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:01.435461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:01.436067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:01.496675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:56:01.699737 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d19987ba-ca0f-4631-b59c-d1517b53ff75 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 204 len: 0 microversion: 2.1 time: 0.282616 Jun 16 18:56:01.701045 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2469/5038] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:56:01 2022] DELETE /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:56:01.713889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:01.715151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:01.729521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:01.730317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:01.731595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:01.732765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:01.776629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:03.170415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:03.222469 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f6a2e2bb-138e-462f-b7e2-30be3304f6a0 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1496 microversion: 2.1 time: 1.511772 Jun 16 18:56:03.224723 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2570/5039] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:01 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1496 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:04.248710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:04.268425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:04.319887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:04.321095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:04.322217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:04.323069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:04.333627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:04.677343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:04.689889 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5057afa3-c555-492f-a3d0-2289f640cb61 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1454 microversion: 2.1 time: 0.450838 Jun 16 18:56:04.693385 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2470/5040] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:04 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1454 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:05.561152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-cc73e3c4-9ac2-43a1-828f-536eae6ee148 req-1d5b7ecd-68e3-4f26-9f6e-1f232bd577bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a85c52-12bf-45a7-8ab8-dbd43e9b9258", "name": "network-vif-deleted", "tag": "529246b9-6b76-4044-bb7f-33d0d3d00baf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:05.580909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:05.605485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-cc73e3c4-9ac2-43a1-828f-536eae6ee148 req-1d5b7ecd-68e3-4f26-9f6e-1f232bd577bf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:05.624111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-cc73e3c4-9ac2-43a1-828f-536eae6ee148 req-1d5b7ecd-68e3-4f26-9f6e-1f232bd577bf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:05.711143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:05.711729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:05.728122 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-cc73e3c4-9ac2-43a1-828f-536eae6ee148 req-1d5b7ecd-68e3-4f26-9f6e-1f232bd577bf service nova] Creating event network-vif-deleted:529246b9-6b76-4044-bb7f-33d0d3d00baf for instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 on n-h2-846209-2 Jun 16 18:56:05.743074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:05.745847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:05.748560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:05.749129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:05.759984 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-cc73e3c4-9ac2-43a1-828f-536eae6ee148 req-1d5b7ecd-68e3-4f26-9f6e-1f232bd577bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203825 Jun 16 18:56:05.772269 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2571/5041] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:05.935232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:05.938492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:05.941434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lazy-loading 'fault' on Instance uuid 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:56:06.229833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:06.238825 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c247f8a5-d288-44a9-9c22-564a1dc7e51e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 200 len: 1305 microversion: 2.1 time: 0.532531 Jun 16 18:56:06.244466 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2471/5042] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:05 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 1305 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:07.258890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:07.266038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: 73a85c52-12bf-45a7-8ab8-dbd43e9b9258] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:07.315268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:07.326458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:07.326458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:07.326458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:07.379176 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] HTTP exception thrown: Instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 could not be found. Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Request method failure captured: Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 HTTP/1.1 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3qQdnkg9my-1t7iorxlTdvAY7JoLX7pzKEeYb_M4KpJv--YSljcRPZ5tsuFxEn56Z9mV9LJEDpP7D3JgeEQwWwZA1r9aEbrhkYX9fOrKSTVKDKB6sFrCRqfMzr4ToDxrWC-vFVylVDVvwopGS-5VathrmG6eJr57nXSFKQ4AXQnExU Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e0ae0d9516c431f85b29c11cffea558", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e0ae0d9516c431f85b29c11cffea558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-458867450 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 3e0ae0d9516c431f85b29c11cffea558 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-458867450 Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0bad5f4aa84e4b978a5a92478b6772bf Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-458867450-project Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 could not be found. Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '73a85c52-12bf-45a7-8ab8-dbd43e9b9258'} Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 could not be found. Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 could not be found. Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:56:07.380885 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 could not be found. Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Returning 404 to user: Instance 73a85c52-12bf-45a7-8ab8-dbd43e9b9258 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:56:07.386846 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c88e8863-0522-4c41-a4a6-34ffa00fda89 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258" status: 404 len: 111 microversion: 2.1 time: 0.130424 Jun 16 18:56:07.391170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:07.391829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:07.399059 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2572/5043] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:07 2022] GET /compute/v2.1/servers/73a85c52-12bf-45a7-8ab8-dbd43e9b9258 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:56:07.403961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:07.404469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:07.405216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:07.405664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:07.518407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:56:07.745001 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c1b24275-121a-4989-9ea9-045e3be5994e tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 204 len: 0 microversion: 2.1 time: 0.357502 Jun 16 18:56:07.746334 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2472/5044] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:56:07 2022] DELETE /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:56:07.757361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:07.759252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:07.775546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:07.776632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:07.790271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:07.795063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:07.978921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ca6b5e36-0fd5-406d-90a2-869dcd15b0e4 req-3022587e-a026-4d72-a1a0-967fc3bdf3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5065e4a5-2e2d-4219-bd43-4da8525f7831", "name": "network-vif-unplugged", "status": "completed", "tag": "e4fed56d-c781-4a26-84e2-3095590ab3c8"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:08.004702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ca6b5e36-0fd5-406d-90a2-869dcd15b0e4 req-3022587e-a026-4d72-a1a0-967fc3bdf3a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:08.005159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ca6b5e36-0fd5-406d-90a2-869dcd15b0e4 req-3022587e-a026-4d72-a1a0-967fc3bdf3a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:08.058997 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ca6b5e36-0fd5-406d-90a2-869dcd15b0e4 req-3022587e-a026-4d72-a1a0-967fc3bdf3a7 service nova] Creating event network-vif-unplugged:e4fed56d-c781-4a26-84e2-3095590ab3c8 for instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 on n-h2-846209-2 Jun 16 18:56:08.077483 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ca6b5e36-0fd5-406d-90a2-869dcd15b0e4 req-3022587e-a026-4d72-a1a0-967fc3bdf3a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102312 Jun 16 18:56:08.081427 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2473/5045] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:56:08.452945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:08.466583 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d7cef95e-2f76-45b3-9e7d-57869477c771 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1675 microversion: 2.1 time: 0.715755 Jun 16 18:56:08.486866 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2573/5046] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:07 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1675 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:09.493563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:09.495068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:09.502688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:09.503499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:09.504546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:09.505224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:10.409516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:10.420065 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-109d94ea-72f0-4a94-b8da-9936e58b62e5 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1675 microversion: 2.1 time: 0.931750 Jun 16 18:56:10.425312 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2474/5047] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:09 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1675 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:11.448713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:11.455032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:11.486342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:11.490426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:11.492426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:11.493638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:12.252097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:12.272505 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9806b933-b26c-4d40-9119-9b064035e2ee tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1675 microversion: 2.1 time: 0.823691 Jun 16 18:56:12.273514 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2574/5048] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:11 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1675 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:13.292062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:13.292695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:13.311350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:13.312809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:13.314038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:13.314500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:13.642386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:13.654176 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ec60b0e3-bd58-41a0-83d3-5ae54c5883c7 tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1608 microversion: 2.1 time: 0.366342 Jun 16 18:56:13.654805 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2475/5049] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:13 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1608 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:13.800164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2ad6e603-7025-446d-a529-8011125c1304 req-9064deea-dd4d-4d23-ba38-60d396d170e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69cc468-c538-4554-8a3d-5ea10facc4d7", "name": "network-vif-deleted", "tag": "82bf12e7-8f93-4a76-a6e6-2e9fcd909a23"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:13.837167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2ad6e603-7025-446d-a529-8011125c1304 req-9064deea-dd4d-4d23-ba38-60d396d170e7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:13.837634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2ad6e603-7025-446d-a529-8011125c1304 req-9064deea-dd4d-4d23-ba38-60d396d170e7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:13.876297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2ad6e603-7025-446d-a529-8011125c1304 req-9064deea-dd4d-4d23-ba38-60d396d170e7 service nova] Creating event network-vif-deleted:82bf12e7-8f93-4a76-a6e6-2e9fcd909a23 for instance d69cc468-c538-4554-8a3d-5ea10facc4d7 on n-h2-846209-2 Jun 16 18:56:13.881639 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2ad6e603-7025-446d-a529-8011125c1304 req-9064deea-dd4d-4d23-ba38-60d396d170e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086927 Jun 16 18:56:13.886474 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2575/5050] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:14.674397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:14.675028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] [instance: d69cc468-c538-4554-8a3d-5ea10facc4d7] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:14.688138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:14.688601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:14.689392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:14.694127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:14.786202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:14.786737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:14.787207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Lazy-loading 'fault' on Instance uuid d69cc468-c538-4554-8a3d-5ea10facc4d7 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:56:15.668165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bad5f4aa84e4b978a5a92478b6772bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0ae0d9516c431f85b29c11cffea558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:15.677105 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-40253f9a-1123-44ae-94c6-0568ab7fe21d tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7" status: 200 len: 1389 microversion: 2.1 time: 1.008198 Jun 16 18:56:15.711888 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2476/5051] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:14 2022] GET /compute/v2.1/servers/d69cc468-c538-4554-8a3d-5ea10facc4d7 => generated 1389 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:15.712132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-895471a9-980e-45d4-82b2-a276b3fcb88a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] Calling method '.version_select at 0x7f866eac11f0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:15.758359 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-895471a9-980e-45d4-82b2-a276b3fcb88a tempest-ServerActionsTestJSON-458867450 tempest-ServerActionsTestJSON-458867450-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657024561" status: 202 len: 0 microversion: 2.1 time: 0.060929 Jun 16 18:56:15.759786 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2576/5052] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 18:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657024561 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:56:17.465042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1534901491", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "62dd3edf-8c09-47c1-a2f9-a9d080c4d86d"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:17.641736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] validate_networks() for [('62dd3edf-8c09-47c1-a2f9-a9d080c4d86d', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:56:23.816238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:56:23.818298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:56:23.819043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:56:23.819905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:56:23.820509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:56:23.826714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:23.838761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.839231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.840153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.840847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.868309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Getting quotas for project 1dd869e613a5497996665adb490898d9. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:56:23.879699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Getting quotas for user c947097f19e445db81afbe0c1ba8b8e4 and project 1dd869e613a5497996665adb490898d9. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:56:23.896262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Going to run 3 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:56:23.899303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 13c05022-81ff-48ef-80bb-0210b139c44e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:23.957438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=13c05022-81ff-48ef-80bb-0210b139c44e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:24.011248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=67a4bd83-e1f1-4936-b60b-23ce7f117041,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:24.195934 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 18:56:25.234162 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34862. Jun 16 18:56:25.258169 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ded1d50-5fa1-4d9d-a64d-5fddb986d93e tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.073909 Jun 16 18:56:25.260330 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2477/5053] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 18:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 8077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:56:25.267577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=21 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:25.272233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:25.285117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:25.286294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Searching by: {'deleted': False, 'project_id': '1dd869e613a5497996665adb490898d9'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:56:25.362598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:25.363092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:25.364002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:25.364450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:25.423220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a481572-836f-4a28-8c11-762708aa7365 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.157678 Jun 16 18:56:25.424147 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2577/5054] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 18:56:25 2022] GET /compute/v2.1/servers => generated 1018 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:25.439720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f934813-8239-4587-ab38-0b92ab3bfeea tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:25.440722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f934813-8239-4587-ab38-0b92ab3bfeea tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:25.679936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1f934813-8239-4587-ab38-0b92ab3bfeea tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:25.688653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f934813-8239-4587-ab38-0b92ab3bfeea tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1223 microversion: 2.1 time: 0.257795 Jun 16 18:56:25.689614 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2478/5055] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:25 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1223 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:26.706014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-204b14d0-15c6-4b88-9567-720e02d342a1 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:26.706752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-204b14d0-15c6-4b88-9567-720e02d342a1 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:26.978688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-204b14d0-15c6-4b88-9567-720e02d342a1 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:26.992532 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-204b14d0-15c6-4b88-9567-720e02d342a1 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1223 microversion: 2.1 time: 0.290585 Jun 16 18:56:26.993773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2578/5056] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:26 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1223 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:28.024954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b56cfd16-bd2e-446a-88ad-154d44d4c685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:28.027251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b56cfd16-bd2e-446a-88ad-154d44d4c685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:28.360262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b56cfd16-bd2e-446a-88ad-154d44d4c685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:28.382733 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b56cfd16-bd2e-446a-88ad-154d44d4c685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1223 microversion: 2.1 time: 0.375656 Jun 16 18:56:28.384450 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2479/5057] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:28 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1223 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:29.405936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d87fc0d-7dcc-49e7-a7b8-97c961a50685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:29.407238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d87fc0d-7dcc-49e7-a7b8-97c961a50685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:29.694885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d87fc0d-7dcc-49e7-a7b8-97c961a50685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:29.712102 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d87fc0d-7dcc-49e7-a7b8-97c961a50685 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1223 microversion: 2.1 time: 0.313572 Jun 16 18:56:29.717515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2579/5058] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:29 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1223 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:30.732056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1bc0d53d-8c99-4959-82a8-ee9856bf9d23 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:30.735245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1bc0d53d-8c99-4959-82a8-ee9856bf9d23 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:30.892604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1bc0d53d-8c99-4959-82a8-ee9856bf9d23 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:30.900820 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1bc0d53d-8c99-4959-82a8-ee9856bf9d23 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1223 microversion: 2.1 time: 0.172853 Jun 16 18:56:30.916399 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2480/5059] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:30 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:31.924383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6257601e-7ac2-4a23-a6b5-6d512ab926c8 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:31.925204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6257601e-7ac2-4a23-a6b5-6d512ab926c8 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:33.072308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6257601e-7ac2-4a23-a6b5-6d512ab926c8 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:33.089094 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6257601e-7ac2-4a23-a6b5-6d512ab926c8 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1223 microversion: 2.1 time: 1.168917 Jun 16 18:56:33.090199 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2580/5060] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:31 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1223 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:34.113652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:34.114889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:34.119006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:34.123699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:34.138242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.141828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.145479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.146515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.318070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:34.329227 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fe248395-18de-4e2f-a286-5ccc01d3c899 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1281 microversion: 2.1 time: 0.220788 Jun 16 18:56:34.329830 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2481/5061] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:34 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:35.347075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:35.348425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:35.363259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:35.363983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:35.368887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:35.369554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:35.422035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:35.506367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:35.522675 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-421fcfd1-663a-4fc5-adad-777f3838a2c2 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1281 microversion: 2.1 time: 0.180040 Jun 16 18:56:35.526271 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2581/5062] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:35 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:36.540958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:36.541698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:36.558720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:36.561023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:36.565282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:36.566085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.170089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:37.182720 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa01114a-72f8-4371-9b39-98c7df46f754 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 0.647139 Jun 16 18:56:37.202632 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2482/5063] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:36 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:38.208234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:38.208871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:38.221548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:38.223706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.224407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.228072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.228839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.103538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9515ad66-8ff4-4638-8679-57001cd33f5c req-2c73dfef-e6c6-4471-b2c9-7ba97fde73e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a4bd83-e1f1-4936-b60b-23ce7f117041", "tag": "d083c29a-4331-4dd9-99c6-adc2ac46bee6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:39.127009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9515ad66-8ff4-4638-8679-57001cd33f5c req-2c73dfef-e6c6-4471-b2c9-7ba97fde73e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.129946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9515ad66-8ff4-4638-8679-57001cd33f5c req-2c73dfef-e6c6-4471-b2c9-7ba97fde73e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.153435 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9515ad66-8ff4-4638-8679-57001cd33f5c req-2c73dfef-e6c6-4471-b2c9-7ba97fde73e8 service nova] Creating event network-changed:d083c29a-4331-4dd9-99c6-adc2ac46bee6 for instance 67a4bd83-e1f1-4936-b60b-23ce7f117041 on n-h2-846209-2 Jun 16 18:56:39.183173 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9515ad66-8ff4-4638-8679-57001cd33f5c req-2c73dfef-e6c6-4471-b2c9-7ba97fde73e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082009 Jun 16 18:56:39.189643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2483/5064] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:56:40.105653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:40.129616 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ffb0bcd-0cb7-468e-9f5b-bf9a84a5a1be tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 1.921888 Jun 16 18:56:40.132236 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2582/5065] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:38 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:41.148828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:41.149727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:41.159496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:41.183317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.183317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.183317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.190057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:42.446556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:42.456351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3fc17223-f88e-4f9a-9c6c-d1090a26fa88 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 1.312938 Jun 16 18:56:42.465283 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2484/5066] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:41 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:42.982437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a717f305-e90f-49b8-8fe1-8b384aee1e19 req-3956a10d-8ebe-4d40-a494-448ed30a604b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a973f1d-d043-444c-aa19-1b3a5da8ec36", "tag": "95c7c770-a726-4b64-97a2-62c574cfdd0e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:42.997717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a717f305-e90f-49b8-8fe1-8b384aee1e19 req-3956a10d-8ebe-4d40-a494-448ed30a604b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.002173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a717f305-e90f-49b8-8fe1-8b384aee1e19 req-3956a10d-8ebe-4d40-a494-448ed30a604b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.045601 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a717f305-e90f-49b8-8fe1-8b384aee1e19 req-3956a10d-8ebe-4d40-a494-448ed30a604b service nova] Creating event network-changed:95c7c770-a726-4b64-97a2-62c574cfdd0e for instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 on n-h1-846209-2 Jun 16 18:56:43.072405 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a717f305-e90f-49b8-8fe1-8b384aee1e19 req-3956a10d-8ebe-4d40-a494-448ed30a604b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093552 Jun 16 18:56:43.088014 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2583/5067] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:43.487194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:43.489565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:43.513521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.517093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.520759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.521207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:45.326542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:45.349663 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5266a721-6967-4679-b479-ebc3e9db0da6 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 1.877859 Jun 16 18:56:45.353180 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2485/5068] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:43 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:45.462299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6e566046-062c-4b7d-a489-a4e601d27fd8 req-46daf954-53f1-49eb-b41e-2ad66852f2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a4bd83-e1f1-4936-b60b-23ce7f117041", "name": "network-vif-deleted", "tag": "d083c29a-4331-4dd9-99c6-adc2ac46bee6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:45.472809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:45.477933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6e566046-062c-4b7d-a489-a4e601d27fd8 req-46daf954-53f1-49eb-b41e-2ad66852f2e4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:45.478424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6e566046-062c-4b7d-a489-a4e601d27fd8 req-46daf954-53f1-49eb-b41e-2ad66852f2e4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:45.493663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_external_events [req-6e566046-062c-4b7d-a489-a4e601d27fd8 req-46daf954-53f1-49eb-b41e-2ad66852f2e4 service nova] Unable to find a host for instance 67a4bd83-e1f1-4936-b60b-23ce7f117041. Dropping event network-vif-deleted {{(pid=119206) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 18:56:45.497062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6e566046-062c-4b7d-a489-a4e601d27fd8 req-46daf954-53f1-49eb-b41e-2ad66852f2e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.038438 Jun 16 18:56:45.500076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2584/5069] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 18:56:46.371404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:46.374304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:46.375042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:46.375544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:46.388045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.393027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.393902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.395462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.397369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.397965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.407695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.409995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.682536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lazy-loading 'services' on Instance uuid 5065e4a5-2e2d-4219-bd43-4da8525f7831 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:56:46.848559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:46.870833 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9fccfd2-cb68-443c-8f9a-79a83a61c566 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 0.506700 Jun 16 18:56:46.876393 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2486/5070] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:46 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:46.885421 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f326979e-1f0a-4d8f-b37a-22f461ff3097 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831/os-volume_attachments/38b79c24-c9fa-4b44-983d-e40e1a2ec123" status: 202 len: 0 microversion: 2.1 time: 0.517738 Jun 16 18:56:46.888440 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2585/5071] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 18:56:46 2022] DELETE /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831/os-volume_attachments/38b79c24-c9fa-4b44-983d-e40e1a2ec123 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:56:47.193695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6b4b5652-8255-4171-9a08-15ef0a7a8888 req-fba0209a-37ce-4985-9839-f56c5fbaee08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c05022-81ff-48ef-80bb-0210b139c44e", "tag": "7cb3257c-6510-4ef8-a082-de8d208ed096"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:47.222386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6b4b5652-8255-4171-9a08-15ef0a7a8888 req-fba0209a-37ce-4985-9839-f56c5fbaee08 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.222946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6b4b5652-8255-4171-9a08-15ef0a7a8888 req-fba0209a-37ce-4985-9839-f56c5fbaee08 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.253544 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6b4b5652-8255-4171-9a08-15ef0a7a8888 req-fba0209a-37ce-4985-9839-f56c5fbaee08 service nova] Creating event network-changed:7cb3257c-6510-4ef8-a082-de8d208ed096 for instance 13c05022-81ff-48ef-80bb-0210b139c44e on n-h1-846209-2 Jun 16 18:56:47.261925 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6b4b5652-8255-4171-9a08-15ef0a7a8888 req-fba0209a-37ce-4985-9839-f56c5fbaee08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072624 Jun 16 18:56:47.262564 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2487/5072] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:47.889639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:47.890448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:47.909789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.910626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.911813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.912461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:48.416314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:48.425252 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-200b3aec-f9e4-4edc-8a5a-d4aecb0928ca tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 0.540470 Jun 16 18:56:48.429404 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2586/5073] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:47 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:49.447886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:49.448586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:49.460977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.461441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:49.462249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.462687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.065318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:50.077481 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa46d65f-7c3c-43f3-a6dd-424d1883e071 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 0.634098 Jun 16 18:56:50.081244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2488/5074] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:49 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:50.523185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9ea8256b-f96e-44cc-8e71-4b348377d24e req-b63ce99d-3024-41b1-a673-27b11f036b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a973f1d-d043-444c-aa19-1b3a5da8ec36", "name": "network-vif-plugged", "status": "completed", "tag": "95c7c770-a726-4b64-97a2-62c574cfdd0e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:50.541679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9ea8256b-f96e-44cc-8e71-4b348377d24e req-b63ce99d-3024-41b1-a673-27b11f036b4d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.542989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9ea8256b-f96e-44cc-8e71-4b348377d24e req-b63ce99d-3024-41b1-a673-27b11f036b4d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.574528 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9ea8256b-f96e-44cc-8e71-4b348377d24e req-b63ce99d-3024-41b1-a673-27b11f036b4d service nova] Creating event network-vif-plugged:95c7c770-a726-4b64-97a2-62c574cfdd0e for instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 on n-h1-846209-2 Jun 16 18:56:50.584123 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9ea8256b-f96e-44cc-8e71-4b348377d24e req-b63ce99d-3024-41b1-a673-27b11f036b4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065747 Jun 16 18:56:50.587326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2587/5075] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:51.097742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:51.098377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:51.115065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.115829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.116312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.116783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.842441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:51.850690 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8eeaf944-1b7f-4332-882c-f0285ee0aed5 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 0.757142 Jun 16 18:56:51.859797 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2489/5076] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:51 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:52.877329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:52.879016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:52.888808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:52.889899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:52.891263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:52.892063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:53.684674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:53.718718 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be8c2857-ae11-4905-a935-2af5b68dd279 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1323 microversion: 2.1 time: 0.846673 Jun 16 18:56:53.723291 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2588/5077] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:52 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1323 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:54.736879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:54.737685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:54.746713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=9 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:54.751040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:54.752087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:54.753133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:54.754585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:55.031187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d3e261d8-5926-43b4-9925-f72b68b09868 req-745f5b90-fbf0-4a06-ada0-1fad359594d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c05022-81ff-48ef-80bb-0210b139c44e", "name": "network-vif-plugged", "status": "completed", "tag": "7cb3257c-6510-4ef8-a082-de8d208ed096"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:55.051116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d3e261d8-5926-43b4-9925-f72b68b09868 req-745f5b90-fbf0-4a06-ada0-1fad359594d5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:55.057734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d3e261d8-5926-43b4-9925-f72b68b09868 req-745f5b90-fbf0-4a06-ada0-1fad359594d5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:55.102908 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d3e261d8-5926-43b4-9925-f72b68b09868 req-745f5b90-fbf0-4a06-ada0-1fad359594d5 service nova] Creating event network-vif-plugged:7cb3257c-6510-4ef8-a082-de8d208ed096 for instance 13c05022-81ff-48ef-80bb-0210b139c44e on n-h1-846209-2 Jun 16 18:56:55.124311 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d3e261d8-5926-43b4-9925-f72b68b09868 req-745f5b90-fbf0-4a06-ada0-1fad359594d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098550 Jun 16 18:56:55.124941 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2589/5078] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:56:55.352869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:55.378794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f02bbf67-73d5-45aa-899b-b585a1497e7a tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1517 microversion: 2.1 time: 0.647451 Jun 16 18:56:55.382055 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2490/5079] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:54 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1517 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:55.396185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:55.397538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:55.413059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:55.413534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:55.414367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:55.414812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:55.435197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:55.531129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:55.531588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:55.532057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lazy-loading 'fault' on Instance uuid 67a4bd83-e1f1-4936-b60b-23ce7f117041 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:56:55.666944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:55.683206 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5bb98987-1793-44da-b047-5066ad72831c tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041" status: 200 len: 1415 microversion: 2.1 time: 0.290862 Jun 16 18:56:55.684873 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2590/5080] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:55 2022] GET /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041 => generated 1415 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:56.700755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:56.701497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:56.711327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:56.720273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:56.722217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:56.723028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:56.843368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:56.847352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:56.847843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lazy-loading 'fault' on Instance uuid 67a4bd83-e1f1-4936-b60b-23ce7f117041 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:56:56.989450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:57.011802 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-75c7c462-2260-41f8-a194-29ad29d8fd2f tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041" status: 200 len: 1415 microversion: 2.1 time: 0.314025 Jun 16 18:56:57.015641 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2491/5081] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:56 2022] GET /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041 => generated 1415 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:57.031006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:57.031592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:57.040701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:57.048277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:57.049266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:57.049721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:57.108936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:56:57.274471 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-402906ea-6db7-45f3-9157-f1d59678ad25 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 204 len: 0 microversion: 2.1 time: 0.247417 Jun 16 18:56:57.275805 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2591/5082] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:56:57 2022] DELETE /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:56:57.284800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:57.286314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:57.319388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:57.319906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:57.320760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:57.321211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:57.389615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:56:57.503350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Doing local delete in cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119207) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 16 18:56:57.506122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:57.512386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:57.513074 n-d-846209-2 devstack@n-api.service[119207]: WARNING nova.compute.api [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] instance's host None is down, deleting from database Jun 16 18:56:57.520628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] deallocate_for_instance() {{(pid=119207) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 16 18:56:57.725706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Instance cache missing network info. {{(pid=119207) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jun 16 18:56:57.735930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Updating instance_info_cache with network_info: [] {{(pid=119207) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 18:56:58.099159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=14,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:58.141810 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-34da1608-a2ff-42d3-94a7-bba212430870 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041" status: 204 len: 0 microversion: 2.1 time: 0.861507 Jun 16 18:56:58.147310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2492/5083] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:56:57 2022] DELETE /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:56:58.159740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:58.160772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 13c05022-81ff-48ef-80bb-0210b139c44e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:58.193384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:58.194180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:58.197648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:58.200263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:58.334738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 13c05022-81ff-48ef-80bb-0210b139c44e] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:56:58.574932 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc279fa2-9af8-49a5-adb3-c61dd7019b10 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13c05022-81ff-48ef-80bb-0210b139c44e" status: 204 len: 0 microversion: 2.1 time: 0.422120 Jun 16 18:56:58.582596 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2592/5084] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 18:56:58 2022] DELETE /compute/v2.1/servers/13c05022-81ff-48ef-80bb-0210b139c44e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:56:58.587479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:58.588380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:58.608912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:58.609586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:58.610537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:58.611891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:59.131114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:59.142952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f146b4af-0b9e-48bb-82c2-82aeb9d84854 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1523 microversion: 2.1 time: 0.560531 Jun 16 18:56:59.149657 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2493/5085] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:58 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:00.172662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:00.173421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:00.194815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:00.195403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:00.196214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:00.196765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:01.537999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:01.554729 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6a4e9c4-1198-469d-b428-f6a739ca3bb7 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1523 microversion: 2.1 time: 1.390885 Jun 16 18:57:01.568344 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2593/5086] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:00 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1523 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:02.359888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d5ebd9b2-fa3b-4f0d-8b5d-5460beb20473 req-39335406-68df-4635-a829-cacf90fb37e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a973f1d-d043-444c-aa19-1b3a5da8ec36", "name": "network-vif-deleted", "tag": "95c7c770-a726-4b64-97a2-62c574cfdd0e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:02.412770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d5ebd9b2-fa3b-4f0d-8b5d-5460beb20473 req-39335406-68df-4635-a829-cacf90fb37e6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:02.420780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d5ebd9b2-fa3b-4f0d-8b5d-5460beb20473 req-39335406-68df-4635-a829-cacf90fb37e6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:02.475311 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d5ebd9b2-fa3b-4f0d-8b5d-5460beb20473 req-39335406-68df-4635-a829-cacf90fb37e6 service nova] Creating event network-vif-deleted:95c7c770-a726-4b64-97a2-62c574cfdd0e for instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 on n-h1-846209-2 Jun 16 18:57:02.494900 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d5ebd9b2-fa3b-4f0d-8b5d-5460beb20473 req-39335406-68df-4635-a829-cacf90fb37e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140430 Jun 16 18:57:02.500473 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2494/5087] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:02.576223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:02.577468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:02.600834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:02.605387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:02.617098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:02.619878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:02.726800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:02.727580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:02.729471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lazy-loading 'fault' on Instance uuid 9a973f1d-d043-444c-aa19-1b3a5da8ec36 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:57:03.017746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c947097f19e445db81afbe0c1ba8b8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd869e613a5497996665adb490898d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:03.039471 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-691ae4a7-542c-489b-837b-266a2f68f850 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 200 len: 1313 microversion: 2.1 time: 0.467541 Jun 16 18:57:03.042487 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2594/5088] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:02 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:04.063963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:04.066293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 9a973f1d-d043-444c-aa19-1b3a5da8ec36] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:04.085697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.087528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.094330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.095699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.137048 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] HTTP exception thrown: Instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 could not be found. Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Request method failure captured: Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 HTTP/1.1 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3zQ_mq8ljcOlVpXdniIMZAUUObtmSEq6d1Eq4gTvK2naNRqYMJbTArXSNPKVsfUhrO3dPDVPPogAfGipVLBO5DiGD3iuf98erXFW5M33WutXmCHsUt7RpYlV0g0Rr00yPkQnRdhLQHZfJNYTCEU29ECR3zNh073DY5vZR4QinqnJXg Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 1dd869e613a5497996665adb490898d9 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd869e613a5497996665adb490898d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1dd869e613a5497996665adb490898d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1dd869e613a5497996665adb490898d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd869e613a5497996665adb490898d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 1dd869e613a5497996665adb490898d9 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ListServersNegativeTestJSON-1978962029-project Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c947097f19e445db81afbe0c1ba8b8e4 Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ListServersNegativeTestJSON-1978962029-project Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 could not be found. Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '9a973f1d-d043-444c-aa19-1b3a5da8ec36'} Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 could not be found. Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 could not be found. Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:04.140183 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.147695 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.147695 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:04.147695 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:04.147695 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:04.147695 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:04.147695 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 could not be found. Jun 16 18:57:04.147695 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.151445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Returning 404 to user: Instance 9a973f1d-d043-444c-aa19-1b3a5da8ec36 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:04.166175 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-110420d4-15a1-4633-a60e-12d5c887c442 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36" status: 404 len: 111 microversion: 2.1 time: 0.107340 Jun 16 18:57:04.178838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:04.180618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 67a4bd83-e1f1-4936-b60b-23ce7f117041] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:04.185221 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2495/5089] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:04 2022] GET /compute/v2.1/servers/9a973f1d-d043-444c-aa19-1b3a5da8ec36 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:04.206658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.207513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.208808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.209560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.240996 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] HTTP exception thrown: Instance 67a4bd83-e1f1-4936-b60b-23ce7f117041 could not be found. Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Request method failure captured: Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041 HTTP/1.1 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3zQ_mq8ljcOlVpXdniIMZAUUObtmSEq6d1Eq4gTvK2naNRqYMJbTArXSNPKVsfUhrO3dPDVPPogAfGipVLBO5DiGD3iuf98erXFW5M33WutXmCHsUt7RpYlV0g0Rr00yPkQnRdhLQHZfJNYTCEU29ECR3zNh073DY5vZR4QinqnJXg Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 1dd869e613a5497996665adb490898d9 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd869e613a5497996665adb490898d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1dd869e613a5497996665adb490898d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1dd869e613a5497996665adb490898d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd869e613a5497996665adb490898d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 1dd869e613a5497996665adb490898d9 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ListServersNegativeTestJSON-1978962029-project Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c947097f19e445db81afbe0c1ba8b8e4 Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ListServersNegativeTestJSON-1978962029-project Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 67a4bd83-e1f1-4936-b60b-23ce7f117041 could not be found. Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '67a4bd83-e1f1-4936-b60b-23ce7f117041'} Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67a4bd83-e1f1-4936-b60b-23ce7f117041 could not be found. Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67a4bd83-e1f1-4936-b60b-23ce7f117041 could not be found. Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:04.244652 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.249474 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.249474 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:04.249474 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:04.249474 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:04.249474 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:04.249474 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67a4bd83-e1f1-4936-b60b-23ce7f117041 could not be found. Jun 16 18:57:04.249474 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.251975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Returning 404 to user: Instance 67a4bd83-e1f1-4936-b60b-23ce7f117041 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:04.256753 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8cf7f9f4-601d-429a-b782-87c7e82be934 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041" status: 404 len: 111 microversion: 2.1 time: 0.083251 Jun 16 18:57:04.265847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:04.267174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] [instance: 13c05022-81ff-48ef-80bb-0210b139c44e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:04.270527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2595/5090] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:04 2022] GET /compute/v2.1/servers/67a4bd83-e1f1-4936-b60b-23ce7f117041 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:04.286201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.286682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.288993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.293384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.380035 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] HTTP exception thrown: Instance 13c05022-81ff-48ef-80bb-0210b139c44e could not be found. Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Request method failure captured: Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/13c05022-81ff-48ef-80bb-0210b139c44e HTTP/1.1 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3zQ_mq8ljcOlVpXdniIMZAUUObtmSEq6d1Eq4gTvK2naNRqYMJbTArXSNPKVsfUhrO3dPDVPPogAfGipVLBO5DiGD3iuf98erXFW5M33WutXmCHsUt7RpYlV0g0Rr00yPkQnRdhLQHZfJNYTCEU29ECR3zNh073DY5vZR4QinqnJXg Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 1dd869e613a5497996665adb490898d9 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd869e613a5497996665adb490898d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1dd869e613a5497996665adb490898d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1dd869e613a5497996665adb490898d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd869e613a5497996665adb490898d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 1dd869e613a5497996665adb490898d9 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1978962029 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ListServersNegativeTestJSON-1978962029-project Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: c947097f19e445db81afbe0c1ba8b8e4 Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ListServersNegativeTestJSON-1978962029-project Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 13c05022-81ff-48ef-80bb-0210b139c44e could not be found. Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '13c05022-81ff-48ef-80bb-0210b139c44e'} Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c05022-81ff-48ef-80bb-0210b139c44e could not be found. Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c05022-81ff-48ef-80bb-0210b139c44e could not be found. Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:04.382296 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c05022-81ff-48ef-80bb-0210b139c44e could not be found. Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] Returning 404 to user: Instance 13c05022-81ff-48ef-80bb-0210b139c44e could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:04.387758 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8c9d974-23ce-4b26-ae54-c0cad76fe603 tempest-ListServersNegativeTestJSON-1978962029 tempest-ListServersNegativeTestJSON-1978962029-project] 10.222.0.27 "GET /compute/v2.1/servers/13c05022-81ff-48ef-80bb-0210b139c44e" status: 404 len: 111 microversion: 2.1 time: 0.123065 Jun 16 18:57:04.392407 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2496/5091] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:04 2022] GET /compute/v2.1/servers/13c05022-81ff-48ef-80bb-0210b139c44e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:04.550307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fd0c3f67-3a0d-4a4d-91ce-d4d7a9ccc5a6 req-a0d3daa1-0272-40b8-98db-ce523694287f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c05022-81ff-48ef-80bb-0210b139c44e", "name": "network-vif-deleted", "tag": "7cb3257c-6510-4ef8-a082-de8d208ed096"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:04.566925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fd0c3f67-3a0d-4a4d-91ce-d4d7a9ccc5a6 req-a0d3daa1-0272-40b8-98db-ce523694287f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.567395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fd0c3f67-3a0d-4a4d-91ce-d4d7a9ccc5a6 req-a0d3daa1-0272-40b8-98db-ce523694287f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.587480 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fd0c3f67-3a0d-4a4d-91ce-d4d7a9ccc5a6 req-a0d3daa1-0272-40b8-98db-ce523694287f service nova] Creating event network-vif-deleted:7cb3257c-6510-4ef8-a082-de8d208ed096 for instance 13c05022-81ff-48ef-80bb-0210b139c44e on n-h1-846209-2 Jun 16 18:57:04.606283 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fd0c3f67-3a0d-4a4d-91ce-d4d7a9ccc5a6 req-a0d3daa1-0272-40b8-98db-ce523694287f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060050 Jun 16 18:57:04.610569 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2596/5092] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:57:06.042481 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:57:06.043179 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 18:57:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:57:19.532401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:19.533497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:DELETE=2,nova_cell1:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:20.036283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-219679011", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": "none"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:20.734328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:57:20.734919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:57:20.735326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:57:20.735732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:57:20.736181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:57:20.749413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:20.750191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:20.751699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:20.752286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:20.776587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Getting quotas for project 90b936186b20496f8c45f60cebe8f9ab. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:57:20.786367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Getting quotas for user 2fb620157c3c46ae8500944bf95c2dea and project 90b936186b20496f8c45f60cebe8f9ab. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:57:20.811022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:57:20.814238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:57:20.905811 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50dad90d-d476-4869-810d-75e5cc5dc24f tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.379749 Jun 16 18:57:20.906860 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2497/5093] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:57:20.918709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-125614e2-fb9b-4b9b-92c4-cc33c657ca40 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:20.920809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-125614e2-fb9b-4b9b-92c4-cc33c657ca40 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:20.925863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:20.929284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:21.654746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-125614e2-fb9b-4b9b-92c4-cc33c657ca40 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:21.668950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-125614e2-fb9b-4b9b-92c4-cc33c657ca40 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:21.672257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-125614e2-fb9b-4b9b-92c4-cc33c657ca40 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:21.673453 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-125614e2-fb9b-4b9b-92c4-cc33c657ca40 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1280 microversion: 2.47 time: 0.759916 Jun 16 18:57:21.686645 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2597/5094] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:20 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1280 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:57:22.696411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:22.697090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:22.721960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:22.724052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:22.726762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:22.727408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:23.131381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:23.140841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:23.147699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:23.150788 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dfd6e4a5-5d7f-4fba-9a4a-860776c95e01 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1340 microversion: 2.47 time: 0.461852 Jun 16 18:57:23.166066 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2498/5095] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:22 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1340 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:24.175153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:24.177243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:24.198529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:24.201495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:24.203653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:24.205202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:24.410941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:24.433564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:24.445265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:24.446565 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66dbf0d1-0797-4249-8d15-c08306b0a557 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1338 microversion: 2.47 time: 0.278367 Jun 16 18:57:24.455986 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2598/5096] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:24 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1338 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:57:25.473029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:25.473652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:25.499844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:25.500303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:25.501157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:25.501589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:26.344583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:26.360835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:26.373535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:26.378441 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1b680b76-10d9-47f6-9e38-96a3d2ff3269 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1338 microversion: 2.47 time: 0.909451 Jun 16 18:57:26.382502 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2499/5097] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:25 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1338 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:27.402740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:27.404149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:27.430307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:27.431482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:27.434299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:27.437744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:27.715769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:27.739196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:27.741722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:27.792044 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-56a9f516-ecaf-4571-aed0-5d1d2b456388 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1359 microversion: 2.47 time: 0.368277 Jun 16 18:57:27.812850 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2599/5098] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:27 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:27.822052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-839e23e1-662e-4402-b0ea-93b07b2c82bb tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-262228823"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:27.829320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-839e23e1-662e-4402-b0ea-93b07b2c82bb tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:27.849197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e23e1-662e-4402-b0ea-93b07b2c82bb tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:27.850787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e23e1-662e-4402-b0ea-93b07b2c82bb tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:27.865178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e23e1-662e-4402-b0ea-93b07b2c82bb tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:27.866731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-839e23e1-662e-4402-b0ea-93b07b2c82bb tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:28.598316 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-839e23e1-662e-4402-b0ea-93b07b2c82bb tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "POST /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5/action" status: 202 len: 52 microversion: 2.47 time: 0.784097 Jun 16 18:57:28.602032 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2500/5099] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jun 16 18:57:27 2022] POST /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5/action => generated 52 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Jun 16 18:57:28.621563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:28.622119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:28.659500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:28.661438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:28.664122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:28.664695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:28.727124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:57:28.985555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-458e7c21-0804-4c97-9623-73052acb4013 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 204 len: 0 microversion: 2.47 time: 0.376762 Jun 16 18:57:28.990122 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2600/5100] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:57:28 2022] DELETE /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:57:28.998504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:28.999213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:29.020064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:29.020432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:29.021223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:29.021668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:29.177824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:29.187066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:29.189475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:29.190974 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a6303a4b-6f3c-430b-9ea9-df83a91322df tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1365 microversion: 2.47 time: 0.199892 Jun 16 18:57:29.204693 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2501/5101] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:28 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:30.213354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:30.215540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:30.225065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:30.225863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:30.227407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:30.228067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:30.317310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:30.328126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:30.330601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:30.332733 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c5f13511-2864-4147-98b4-e845150f61e2 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1365 microversion: 2.47 time: 0.124860 Jun 16 18:57:30.334076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2601/5102] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:30 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:31.352847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:31.356306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:31.360965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:31.366683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:31.379226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:31.379769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:31.389596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:31.390324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:31.582902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:31.602370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:31.613510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fb620157c3c46ae8500944bf95c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b936186b20496f8c45f60cebe8f9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:31.620982 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-377560b7-cabd-443d-88b8-d67c2a76b53e tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 200 len: 1365 microversion: 2.47 time: 0.272516 Jun 16 18:57:31.624924 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2502/5103] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:31 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:32.645344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:32.646685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] [instance: 53aa3745-fbb0-4ee4-9635-ae434c8798d5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:32.663077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:32.685605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:32.687101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:32.689077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:32.690199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:32.738328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] HTTP exception thrown: Instance 53aa3745-fbb0-4ee4-9635-ae434c8798d5 could not be found. Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Request method failure captured: Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 HTTP/1.1 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq30P8NZfZ58BRnauQVUwTgz6Ixcd46KQxemgjnLUyBYAcGcgkUBVCRheagpLHDCUOrSsNcwzWCVkFkug_LfSRn0XOmLbdT82nDTshZGkkTeX0LD3lhfNj7C-IEPcR2Qm28ZPNMu6KjV-3Fqwr5Y2CBmZULj2GnLLDbsmzWgvjDrkWbc Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Openstack-Nova-Api-Version: 2.47 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 90b936186b20496f8c45f60cebe8f9ab Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAaction247Test-2113342015 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90b936186b20496f8c45f60cebe8f9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90b936186b20496f8c45f60cebe8f9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90b936186b20496f8c45f60cebe8f9ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90b936186b20496f8c45f60cebe8f9ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAaction247Test-2113342015 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 90b936186b20496f8c45f60cebe8f9ab Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAaction247Test-2113342015 Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAaction247Test-2113342015-project Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 2fb620157c3c46ae8500944bf95c2dea Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAaction247Test-2113342015-project Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 53aa3745-fbb0-4ee4-9635-ae434c8798d5 could not be found. Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '53aa3745-fbb0-4ee4-9635-ae434c8798d5'} Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aa3745-fbb0-4ee4-9635-ae434c8798d5 could not be found. Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aa3745-fbb0-4ee4-9635-ae434c8798d5 could not be found. Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:32.744224 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aa3745-fbb0-4ee4-9635-ae434c8798d5 could not be found. Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:57:32.748782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] Returning 404 to user: Instance 53aa3745-fbb0-4ee4-9635-ae434c8798d5 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:32.752661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a9ddf578-2d57-46ed-b2c6-9475131a89e1 tempest-ServersAaction247Test-2113342015 tempest-ServersAaction247Test-2113342015-project] 10.222.0.27 "GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5" status: 404 len: 111 microversion: 2.47 time: 0.108990 Jun 16 18:57:32.753664 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2602/5104] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:32 2022] GET /compute/v2.1/servers/53aa3745-fbb0-4ee4-9635-ae434c8798d5 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:57:38.158951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-685175742", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": "none"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:38.245992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:57:38.246424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:57:38.247561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:57:38.248281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:57:38.248708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:57:38.262531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:38.272119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:38.273235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:38.273827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:38.312518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Getting quotas for project 121f85c003ad4ab5a0f9ab5019ebd915. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:57:38.320249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Getting quotas for user 593e59ec9892459da7be7f9afe17ac77 and project 121f85c003ad4ab5a0f9ab5019ebd915. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:57:38.351193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:57:38.359811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:57:38.470114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-43f029d8-65f3-43e5-a6ba-1837942a3325 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.805463 Jun 16 18:57:38.470784 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2503/5105] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jun 16 18:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:57:38.485573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2279663-8049-4362-89dd-d99fa4c50e2a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:38.487091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a2279663-8049-4362-89dd-d99fa4c50e2a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:38.574681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2279663-8049-4362-89dd-d99fa4c50e2a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:38.588456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2279663-8049-4362-89dd-d99fa4c50e2a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:38.590412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2279663-8049-4362-89dd-d99fa4c50e2a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:38.593471 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2279663-8049-4362-89dd-d99fa4c50e2a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1277 microversion: 2.54 time: 0.116037 Jun 16 18:57:38.594571 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2603/5106] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:38 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:39.614403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:39.615898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:39.632993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:39.635338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:39.637683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:39.639149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:39.776638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:39.787275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:39.789651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:39.794331 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b43f2080-62e9-42f0-b686-be45ce2f3538 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1281 microversion: 2.54 time: 0.182671 Jun 16 18:57:39.799096 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2504/5107] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:39 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:40.818095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:40.818830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:40.850915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:40.852435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:40.854092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:40.858608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:41.501877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:41.521431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:41.535428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:41.544524 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-740294b3-fe83-4b6f-85aa-ce41bf83cfd2 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1347 microversion: 2.54 time: 0.730453 Jun 16 18:57:41.550231 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2604/5108] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:40 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1347 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:42.568908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:42.570272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:42.580835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:42.582784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:42.584020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:42.587993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:42.736768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:42.749991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:42.756737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:42.760411 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a838ba4-1d8b-4339-86b4-913c3a2a07c4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1335 microversion: 2.54 time: 0.195822 Jun 16 18:57:42.763636 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2505/5109] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:42 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1335 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:43.782207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:43.782834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:43.799720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:43.800190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:43.800992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:43.801440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.103473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:44.123316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:44.125576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:44.128208 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4254099-5205-4900-b4fa-5b57fa6fd83a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1356 microversion: 2.54 time: 0.351351 Jun 16 18:57:44.134114 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2605/5110] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:43 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1356 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:44.160237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90478d80-76f6-451f-9d59-d1522adcb1b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Action: 'create', calling method: .version_select at 0x7f866def64c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-243461716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMerzwd3e5RdLYpm8N2ZUdv3XAMa7x+1H7Anntp42bBxoFqwEwjuq2tz0vf5IHj34LP1BXNE8Vr5Fox+LXUXy+f0a92WKDKd4QJLVdeCRPv6+7srYURhOVMdB4UO2DVK/A=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:44.193228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-90478d80-76f6-451f-9d59-d1522adcb1b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Getting quotas for project 121f85c003ad4ab5a0f9ab5019ebd915. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:57:44.215270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-90478d80-76f6-451f-9d59-d1522adcb1b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Getting quotas for user 593e59ec9892459da7be7f9afe17ac77 and project 121f85c003ad4ab5a0f9ab5019ebd915. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:57:44.279741 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90478d80-76f6-451f-9d59-d1522adcb1b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.124041 Jun 16 18:57:44.280873 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2506/5111] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jun 16 18:57:44 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:57:44.291615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-243461716", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:44.294278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:44.305331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.308138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.312030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.312844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.531558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:57:44.534549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:57:44.534753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:57:44.536267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:57:44.537810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:57:44.750923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:44.777597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.778590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.779833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.780283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.880287 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-00ac16de-3be9-4581-b84b-2e1a5c603350 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "POST /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e/action" status: 202 len: 1138 microversion: 2.54 time: 0.592932 Jun 16 18:57:44.882403 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2606/5112] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Jun 16 18:57:44 2022] POST /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e/action => generated 1138 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 16 18:57:44.918448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:44.923669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:44.962078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.962649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.965927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.969375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:45.219432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:45.239348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:45.243842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:45.250563 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1c2e3d4b-e3c2-488b-b947-fc1dbd2043ba tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.355208 Jun 16 18:57:45.251443 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2507/5113] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:44 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:46.270176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:46.272281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:46.288453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:46.290675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:46.293384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:46.297395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:46.424287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:46.436822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:46.439373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:46.443242 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-29b128cd-166e-4987-acc1-77a2a9d447ca tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.177849 Jun 16 18:57:46.443827 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2607/5114] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:46 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:47.464783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:47.466535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:47.479019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:47.479895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:47.481028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:47.482378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:47.609335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:47.622127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:47.624007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:47.625616 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0538aa0c-2783-4883-853a-be964abd0f57 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.167159 Jun 16 18:57:47.626961 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2508/5115] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:47 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:48.645170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:48.645798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:48.649891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:48.671846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:48.672307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:48.673097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:48.673740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:48.805365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:48.821328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:48.823061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:48.824288 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2d0b9a31-75a5-4646-8cb7-28d165e1f2b5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.183607 Jun 16 18:57:48.831380 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2608/5116] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:48 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:49.851457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:49.852728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:49.855231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:49.859393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:49.875458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:49.875921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:49.878365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:49.880003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:49.925802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:49.996030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:50.017193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:50.019882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:50.023312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c615476-1f24-43f6-82b9-64df02c7f94b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.176403 Jun 16 18:57:50.025787 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2509/5117] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:49 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:51.063163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:51.063850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:51.074174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:51.102238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:51.104593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:51.107254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:51.109019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:51.121261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:51.338326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:51.376067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:51.378500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:51.380921 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6391b04e-7603-4f95-ae7b-8459b1324113 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.337327 Jun 16 18:57:51.382078 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2609/5118] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:51 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:52.400648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:52.402131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:52.410382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:52.411001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:52.412993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:52.413943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:52.652851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:52.669608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:52.671439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:52.675050 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5e58e9c0-65e9-4fd7-b9e9-e496bcc9c971 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.278370 Jun 16 18:57:52.675631 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2510/5119] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:52 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:53.698700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:53.699375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:53.714194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:53.716257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:53.717928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:53.720332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:53.988490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:54.008933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:54.018721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:54.021481 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-30540cd9-dc25-4964-9263-d24c42e1e773 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.328764 Jun 16 18:57:54.022985 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2610/5120] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:53 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:55.041871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:55.043702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:55.047454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:55.067229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:55.068321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:55.071298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:55.072333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:55.258608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:55.270273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:55.272195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:55.274510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bd4fc893-0a38-48ef-a5b5-20c1597f90b4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.237682 Jun 16 18:57:55.278580 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2511/5121] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:55 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:56.299787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:56.301178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:56.324101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:56.324728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:56.326526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:56.328194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:56.559978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:56.585405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:56.597641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:56.604292 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6bd4708c-b369-4a53-85cf-abf2b6b311f6 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.309957 Jun 16 18:57:56.606877 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2611/5122] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:56 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:57.630927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:57.631553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:57.651239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:57.651702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:57.652596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:57.653029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:57.939410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:57.958904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:57.977558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:57.978854 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-02c1ebba-0bac-4084-8143-84788a92f426 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.352035 Jun 16 18:57:57.979449 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2512/5123] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:57 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:59.001052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:59.001949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:59.016718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:59.030102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:59.031275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:59.034736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:59.476190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:59.491475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:59.492946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:59.502566 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6167725a-4904-46e9-a3c3-72bca7cd77c5 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.498256 Jun 16 18:57:59.503260 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2612/5124] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:57:58 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:00.526578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.529446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:00.547624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:00.548574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:00.550152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:00.551890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:00.763815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:00.778412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:00.784500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:00.788457 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-09579604-4492-4b45-82f4-adede289dc1a tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.268892 Jun 16 18:58:00.791031 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2513/5125] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:01.811879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:01.812549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:01.831077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.832493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.836203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.836784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.962256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:01.982888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:01.984967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:01.987066 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-92aaf1c3-b981-473d-b545-81cf2f5dcd74 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.181027 Jun 16 18:58:01.988761 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2613/5126] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:01 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:03.009142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:03.010507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:03.044642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:03.044642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:03.048511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:03.053775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:03.350244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:03.368355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:03.377270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:03.378806 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b8c4ecca-7be5-4c95-9137-d7788b15d871 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.374821 Jun 16 18:58:03.379171 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2514/5127] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:03 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:04.398295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:04.399551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:04.413798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:04.417226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:04.422408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:04.423599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:04.795591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:04.829555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:04.835915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:04.841640 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-45cf586d-1d16-4c17-beda-256ebcccc859 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.444662 Jun 16 18:58:04.841640 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2614/5128] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:04 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:05.862776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:05.864147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:05.879914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.882072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.883912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.886258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.255095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:06.288553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:06.294463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:06.295727 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d50272dd-cd6d-49ae-af76-31455c3b6ae0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.440832 Jun 16 18:58:06.296305 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2515/5129] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:05 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:06.935696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7c338d32-634f-4b38-9562-b9327d1711cf req-720d21c6-f42b-47c9-ab40-c3e206202590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5065e4a5-2e2d-4219-bd43-4da8525f7831", "name": "network-vif-plugged", "status": "completed", "tag": "e4fed56d-c781-4a26-84e2-3095590ab3c8"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:06.957122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7c338d32-634f-4b38-9562-b9327d1711cf req-720d21c6-f42b-47c9-ab40-c3e206202590 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:06.959522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7c338d32-634f-4b38-9562-b9327d1711cf req-720d21c6-f42b-47c9-ab40-c3e206202590 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.997865 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7c338d32-634f-4b38-9562-b9327d1711cf req-720d21c6-f42b-47c9-ab40-c3e206202590 service nova] Creating event network-vif-plugged:e4fed56d-c781-4a26-84e2-3095590ab3c8 for instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 on n-h2-846209-2 Jun 16 18:58:07.013314 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7c338d32-634f-4b38-9562-b9327d1711cf req-720d21c6-f42b-47c9-ab40-c3e206202590 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403857 Jun 16 18:58:07.015460 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2615/5130] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:07.326182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:07.326182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:07.334260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:07.342669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:07.343955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:07.344595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:07.575372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:07.592824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:07.600133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:07.601619 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-82dff2e7-0bfd-42c6-a04f-1bfc99c387d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.289118 Jun 16 18:58:07.602481 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2516/5131] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:07 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:08.623527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:08.624110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:08.646035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:08.646566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:08.647593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:08.648052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:09.012466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:09.024943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:09.026930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:09.029162 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fff9dfce-4669-448f-a458-de02b5f4c907 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.410969 Jun 16 18:58:09.030005 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2616/5132] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:08 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:10.050260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:10.051731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:10.059881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.060615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.061763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.062437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.172163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:10.187890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:10.189396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:10.195923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ea529383-095a-46bc-8ea8-e6fc48602fd4 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.150090 Jun 16 18:58:10.200661 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2517/5133] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:10 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:11.215998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:11.216701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:11.237052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:11.238786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:11.241280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:11.243255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:11.376396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.388717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.390435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.391782 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-32e3955a-8c5c-4956-ade3-8b1e6b90b1c9 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.180695 Jun 16 18:58:11.392590 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2617/5134] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:11 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:12.411611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:12.412220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:12.422547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:12.425670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:12.428244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:12.429548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:12.557151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:12.571749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:12.573933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:12.577429 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32343d25-d0a3-4d13-a8ed-fb2a328bd441 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.169207 Jun 16 18:58:12.578358 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2518/5135] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:12 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:13.597157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:13.598513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:13.611240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:13.614172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:13.615058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:13.617490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:13.800197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.812564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.814217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.815425 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-98e7d1ed-162f-4b1b-ba29-de47df0d0429 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.222432 Jun 16 18:58:13.828319 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2618/5136] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:13 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:14.834490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:14.836131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:14.864066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.866639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:14.869021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.874575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.039702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:15.061634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:15.064612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:15.066658 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8b5b6d28-9671-4265-be13-5738943ee3b0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.235669 Jun 16 18:58:15.072243 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2519/5137] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:14 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:16.095404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:16.096110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:16.111794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:16.112289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:16.113137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:16.113851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:16.413705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.428652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.432697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.435071 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e8e3368e-7447-4d43-b360-2dcc41477ac1 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1407 microversion: 2.54 time: 0.344509 Jun 16 18:58:16.437624 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2619/5138] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:16 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:17.454940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:17.456092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:17.474953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.475412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.476201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.476643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.264733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.288109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.289797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.291097 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-01824ee6-a1ab-48cb-8c1e-7719e70389f0 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1413 microversion: 2.54 time: 0.840244 Jun 16 18:58:18.306188 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2520/5139] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:17 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1413 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:19.313673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:19.314591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:19.326371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.326846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.327724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.328116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.641427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.653099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.659869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.661298 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15efdce9-baf2-4b59-8fc3-f21ba7614e27 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1413 microversion: 2.54 time: 0.351809 Jun 16 18:58:19.666985 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2620/5140] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:19 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1413 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:20.685601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:20.686259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:20.690593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=24 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:20.724232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.727075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.728113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.731384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.743591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=72 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:21.034594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.056697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.059668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.064273 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-143c0e75-18e8-42de-94f6-980fcb50bfad tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1398 microversion: 2.54 time: 0.383444 Jun 16 18:58:21.085928 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2521/5141] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:20 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1398 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:21.088392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d699fffb-ea16-47c8-8e0a-1f46ef8eb13d tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '.version_select at 0x7f866ec47670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:21.125113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=26 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:21.134630 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d699fffb-ea16-47c8-8e0a-1f46ef8eb13d tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-243461716" status: 204 len: 0 microversion: 2.54 time: 0.050952 Jun 16 18:58:21.135255 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2621/5142] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jun 16 18:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-243461716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 18:58:21.148288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:21.148960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:21.156576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.157138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.158333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.158860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.189289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:58:21.332392 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ae56daf-8da8-4ec4-a32a-72023adf7796 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 204 len: 0 microversion: 2.54 time: 0.188609 Jun 16 18:58:21.334140 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2522/5143] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jun 16 18:58:21 2022] DELETE /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:58:21.343580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:21.344495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:21.358232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.358771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.359621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.360072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.365211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=68 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:21.489405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.520230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.521679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.522970 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-52a2c08c-b41c-4562-9ce8-62a98ccc9a6b tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1404 microversion: 2.54 time: 0.184535 Jun 16 18:58:21.526351 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2622/5144] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:21 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:22.544870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:22.546529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:22.560370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.560878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.561633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.570588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.824413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:22.837030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:22.843247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:22.845987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5fbb1704-d660-4e49-9c10-c7af47f75130 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1404 microversion: 2.54 time: 0.306097 Jun 16 18:58:22.847219 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2523/5145] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:22 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1404 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:23.867262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:23.868486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:23.880774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.882936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.883927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.884547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.963832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.965330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.978744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lazy-loading 'fault' on Instance uuid ab316e35-6d92-45d6-8873-062d1300478e {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:58:24.182484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.198395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.200643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '593e59ec9892459da7be7f9afe17ac77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f85c003ad4ab5a0f9ab5019ebd915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.201945 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-607b668d-a981-4e0e-b6d4-bfd2179b20d7 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 200 len: 1409 microversion: 2.54 time: 0.338718 Jun 16 18:58:24.202533 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2623/5146] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:23 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 1409 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:25.228296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:25.235004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] [instance: ab316e35-6d92-45d6-8873-062d1300478e] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:25.246634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.248183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.249298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.249902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.275376 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] HTTP exception thrown: Instance ab316e35-6d92-45d6-8873-062d1300478e could not be found. Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Request method failure captured: Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e HTTP/1.1 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq30hUcq5p3X4vWpqso0o4Fk3I9euepZ9c20iYSPyWEQMLAp2kZ5YMYs6X2RoCGaAwIFzi4pFPyf0xfoHc_Smb4zyfcTAyM1wgyy4bYPQ45UCS5mF71EnWBwh2IpwvLmsP4yt_BcZQygMlkRtlyRy-EtiUeCHALP74OcWbfSZG6hpnOo Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Openstack-Nova-Api-Version: 2.54 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 121f85c003ad4ab5a0f9ab5019ebd915 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerShowV254Test-1205584662 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/121f85c003ad4ab5a0f9ab5019ebd915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/121f85c003ad4ab5a0f9ab5019ebd915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_121f85c003ad4ab5a0f9ab5019ebd915", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/121f85c003ad4ab5a0f9ab5019ebd915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerShowV254Test-1205584662 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 121f85c003ad4ab5a0f9ab5019ebd915 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerShowV254Test-1205584662 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerShowV254Test-1205584662-project Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 593e59ec9892459da7be7f9afe17ac77 Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerShowV254Test-1205584662-project Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance ab316e35-6d92-45d6-8873-062d1300478e could not be found. Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ab316e35-6d92-45d6-8873-062d1300478e'} Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab316e35-6d92-45d6-8873-062d1300478e could not be found. Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab316e35-6d92-45d6-8873-062d1300478e could not be found. Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:25.283284 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:25.288546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:25.288546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:25.288546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:25.288546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:58:25.288546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:58:25.288546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab316e35-6d92-45d6-8873-062d1300478e could not be found. Jun 16 18:58:25.288546 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:25.293508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] Returning 404 to user: Instance ab316e35-6d92-45d6-8873-062d1300478e could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:25.294576 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-29428cf6-bc65-48f6-8fe2-ca471bdede94 tempest-ServerShowV254Test-1205584662 tempest-ServerShowV254Test-1205584662-project] 10.222.0.27 "GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e" status: 404 len: 111 microversion: 2.54 time: 0.076949 Jun 16 18:58:25.295759 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2524/5147] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:25 2022] GET /compute/v2.1/servers/ab316e35-6d92-45d6-8873-062d1300478e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:58:29.952470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0843069-20b3-4b18-a57d-9e2434afa3b0 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Action: 'create', calling method: .version_select at 0x7f867813bd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-586146673", "metadata": {"Type": "work"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:30.601228 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0843069-20b3-4b18-a57d-9e2434afa3b0 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.108153 Jun 16 18:58:30.606024 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2624/5148] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jun 16 18:58:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1112 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:58:30.653697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afd0c4d9-db94-4d33-ad5f-76a20fe83379 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f866d9be8b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:30.763999 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afd0c4d9-db94-4d33-ad5f-76a20fe83379 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 200 len: 352 microversion: 2.1 time: 0.140585 Jun 16 18:58:30.764927 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2525/5149] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:30 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:31.780898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-376eeb22-04cb-4926-b73e-1552a7318376 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f866f31c5e0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:31.926919 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-376eeb22-04cb-4926-b73e-1552a7318376 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 200 len: 352 microversion: 2.1 time: 0.153276 Jun 16 18:58:31.927746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2625/5150] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:31 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:32.941673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eaa5988-8b65-4769-b45e-445357a4aa74 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f866de63dc0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.001339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0eaa5988-8b65-4769-b45e-445357a4aa74 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 200 len: 353 microversion: 2.1 time: 0.064897 Jun 16 18:58:33.002160 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2526/5151] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:32 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:33.014751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a8fa10c4-1374-4a97-8934-0b48e54e52bc tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f867813bca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.081756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a8fa10c4-1374-4a97-8934-0b48e54e52bc tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 200 len: 353 microversion: 2.1 time: 0.072178 Jun 16 18:58:33.082364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2626/5152] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:33 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:33.094739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6576f661-3017-4867-bc70-96875e701bc6 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f8674158430>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.209496 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6576f661-3017-4867-bc70-96875e701bc6 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 202 len: 0 microversion: 2.1 time: 0.119276 Jun 16 18:58:33.210310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2527/5153] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:58:33 2022] DELETE /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:58:33.219917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-156c456b-3403-465a-8ad8-4000c8708735 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f866f3b6280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.286014 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-156c456b-3403-465a-8ad8-4000c8708735 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 200 len: 352 microversion: 2.1 time: 0.070492 Jun 16 18:58:33.286853 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2627/5154] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:33 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:34.299326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85905ebf-7de1-4473-a8da-069903550902 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f866deba700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:34.402540 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-85905ebf-7de1-4473-a8da-069903550902 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 200 len: 352 microversion: 2.1 time: 0.106949 Jun 16 18:58:34.403332 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2528/5155] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:34 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:35.412464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:35.414680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=13 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:35.420246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e66ac474-8510-4b77-9e64-8e29441cfbf2 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f866f3b6790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:35.555925 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e66ac474-8510-4b77-9e64-8e29441cfbf2 tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 200 len: 352 microversion: 2.1 time: 0.144679 Jun 16 18:58:35.556961 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2628/5156] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:35 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:36.576506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ea6847e-3eb9-46ad-8fc9-33691f20e62c tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Calling method '.version_select at 0x7f866de7f670>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:36.605945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:36.607060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:36.652998 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-1ea6847e-3eb9-46ad-8fc9-33691f20e62c tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] HTTP exception thrown: Volume 93bb3249-7542-4c88-b84c-b837a27e2f1d could not be found. Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ea6847e-3eb9-46ad-8fc9-33691f20e62c tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Request method failure captured: Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d HTTP/1.1 Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq31V0JYKk8PvyLCSbl5nfv3ufSxQqRHs3iF_COCRT9kS86FPHSzDF5cb56I2uh8rqHI60r4BRmk8XDH4VGkuAA6k9TkzD-2zlOTY2obV31Z7YoeAZtcRVfphgUwMGbcLYd6vMdMUFZa9AA7MtrxSoXn-nqgligClmfjzcWjA-ooK5tI Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: a8dee12353b84bb2b214ff579834491b Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesGetTestJSON-1690905647 Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8dee12353b84bb2b214ff579834491b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8dee12353b84bb2b214ff579834491b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8dee12353b84bb2b214ff579834491b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8dee12353b84bb2b214ff579834491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesGetTestJSON-1690905647 Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: a8dee12353b84bb2b214ff579834491b Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesGetTestJSON-1690905647 Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesGetTestJSON-1690905647-project Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 905e2803e6a44c32a8c2a479c14d0a6c Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesGetTestJSON-1690905647-project Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: exception: Volume 93bb3249-7542-4c88-b84c-b837a27e2f1d could not be found. Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '93bb3249-7542-4c88-b84c-b837a27e2f1d'} Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93bb3249-7542-4c88-b84c-b837a27e2f1d could not be found. (HTTP 404) (Request-ID: req-deecdc2f-03dd-4e30-9442-0bb6e15d65ff) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:58:36.657595 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93bb3249-7542-4c88-b84c-b837a27e2f1d could not be found. Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93bb3249-7542-4c88-b84c-b837a27e2f1d could not be found. Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93bb3249-7542-4c88-b84c-b837a27e2f1d could not be found. Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ea6847e-3eb9-46ad-8fc9-33691f20e62c tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] Returning 404 to user: Volume 93bb3249-7542-4c88-b84c-b837a27e2f1d could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ea6847e-3eb9-46ad-8fc9-33691f20e62c tempest-VolumesGetTestJSON-1690905647 tempest-VolumesGetTestJSON-1690905647-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d" status: 404 len: 109 microversion: 2.1 time: 0.088782 Jun 16 18:58:36.661422 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2529/5157] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:36 2022] GET /compute/v2.1/os-volumes/93bb3249-7542-4c88-b84c-b837a27e2f1d => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:58:41.122153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eaf701af-6ecf-41ea-bea0-fdddd4e7c0e5 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Action: 'create', calling method: .version_select at 0x7f866ed30160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-431460482", "metadata": {"Type": "work"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eaf701af-6ecf-41ea-bea0-fdddd4e7c0e5 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Request method failure captured: Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 121 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq31gtuHtYmpFsKVTFKL6LJWj4pdkL8UqDlbyD-4imWtl-wRlu28kom_sKbD2MmhzE0XMNGEwLaZn1iJBPvMDYWQdPkENjnva9I1zTYry_ZLO4Bc8t_rpW6V6ti7lWUhtnGx5N8s-uJBp7RCI8wwa3Csaws7QFc55xJA7N32vQiwK4nA Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11ca86ce109d4ab1bebb00f3d0620a3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 95f340e50b1d46fb8bb92d1219e4d840 Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-431460482", "metadata": {"Type": "work"}}} Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-431460482', 'metadata': {'Type': 'work'}}}} Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:58:41.128018 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:58:41.133126 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.135992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eaf701af-6ecf-41ea-bea0-fdddd4e7c0e5 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:41.140286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eaf701af-6ecf-41ea-bea0-fdddd4e7c0e5 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.389993 Jun 16 18:58:41.147567 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2629/5158] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jun 16 18:58:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:58:41.153653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40c53912-6abc-43b3-804a-f62ae4e8bf83 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Action: 'create', calling method: .version_select at 0x7f866de6c670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633326742", "metadata": {"Type": "work"}}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40c53912-6abc-43b3-804a-f62ae4e8bf83 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Request method failure captured: Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 120 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq31gtuHtYmpFsKVTFKL6LJWj4pdkL8UqDlbyD-4imWtl-wRlu28kom_sKbD2MmhzE0XMNGEwLaZn1iJBPvMDYWQdPkENjnva9I1zTYry_ZLO4Bc8t_rpW6V6ti7lWUhtnGx5N8s-uJBp7RCI8wwa3Csaws7QFc55xJA7N32vQiwK4nA Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11ca86ce109d4ab1bebb00f3d0620a3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 95f340e50b1d46fb8bb92d1219e4d840 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633326742", "metadata": {"Type": "work"}}} Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1633326742', 'metadata': {'Type': 'work'}}}} Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi '0' Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:58:41.156371 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:58:41.161927 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.170316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40c53912-6abc-43b3-804a-f62ae4e8bf83 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:41.174166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-40c53912-6abc-43b3-804a-f62ae4e8bf83 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027187 Jun 16 18:58:41.175301 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2530/5159] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jun 16 18:58:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:58:41.185749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb775a47-bff1-43e6-88ab-7c2781152b97 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Action: 'create', calling method: .version_select at 0x7f866e352ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-816134669", "metadata": {"Type": "work"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb775a47-bff1-43e6-88ab-7c2781152b97 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Request method failure captured: Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 118 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq31gtuHtYmpFsKVTFKL6LJWj4pdkL8UqDlbyD-4imWtl-wRlu28kom_sKbD2MmhzE0XMNGEwLaZn1iJBPvMDYWQdPkENjnva9I1zTYry_ZLO4Bc8t_rpW6V6ti7lWUhtnGx5N8s-uJBp7RCI8wwa3Csaws7QFc55xJA7N32vQiwK4nA Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11ca86ce109d4ab1bebb00f3d0620a3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 95f340e50b1d46fb8bb92d1219e4d840 Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-816134669", "metadata": {"Type": "work"}}} Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-816134669', 'metadata': {'Type': 'work'}}}} Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi '' Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:58:41.189972 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:58:41.194575 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.195422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb775a47-bff1-43e6-88ab-7c2781152b97 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:41.197580 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb775a47-bff1-43e6-88ab-7c2781152b97 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016482 Jun 16 18:58:41.200061 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2630/5160] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jun 16 18:58:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:58:41.211162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41e0e328-1d68-408e-b6d0-6f8cdd699602 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Calling method '.version_select at 0x7f866deab8b0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:41.294668 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-41e0e328-1d68-408e-b6d0-6f8cdd699602 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] HTTP exception thrown: Volume tempest-invalid-663022425 could not be found. Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41e0e328-1d68-408e-b6d0-6f8cdd699602 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Request method failure captured: Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-663022425 HTTP/1.1 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq31gtuHtYmpFsKVTFKL6LJWj4pdkL8UqDlbyD-4imWtl-wRlu28kom_sKbD2MmhzE0XMNGEwLaZn1iJBPvMDYWQdPkENjnva9I1zTYry_ZLO4Bc8t_rpW6V6ti7lWUhtnGx5N8s-uJBp7RCI8wwa3Csaws7QFc55xJA7N32vQiwK4nA Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11ca86ce109d4ab1bebb00f3d0620a3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 95f340e50b1d46fb8bb92d1219e4d840 Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: exception: Volume tempest-invalid-663022425 could not be found. Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'tempest-invalid-663022425'} Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-663022425 could not be found. (HTTP 404) (Request-ID: req-f8e6cadc-d2a0-471e-9553-97622cedc75a) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:41.297383 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-663022425 could not be found. Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-663022425 could not be found. Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-663022425 could not be found. Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41e0e328-1d68-408e-b6d0-6f8cdd699602 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Returning 404 to user: Volume tempest-invalid-663022425 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-41e0e328-1d68-408e-b6d0-6f8cdd699602 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-663022425" status: 404 len: 98 microversion: 2.1 time: 0.093631 Jun 16 18:58:41.305311 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2531/5161] 10.222.0.27 () {58 vars in 1214 bytes} [Thu Jun 16 18:58:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-663022425 => generated 98 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:58:41.315084 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b6eeb45c-16d7-4267-8877-fba58f48be63 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003925 Jun 16 18:58:41.315918 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2631/5162] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jun 16 18:58:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:58:41.326467 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c0b5dc25-03a0-4dd3-93d0-59eccb2f2eab tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004612 Jun 16 18:58:41.327001 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2532/5163] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jun 16 18:58:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:58:41.336101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890420d6-8815-4ca8-ae46-a2a488aaf646 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Calling method '.version_select at 0x7f866e178ca0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:41.386981 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-890420d6-8815-4ca8-ae46-a2a488aaf646 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] HTTP exception thrown: Volume d08281c4-bc66-4d5a-b60d-9389e37ff695 could not be found. Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890420d6-8815-4ca8-ae46-a2a488aaf646 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Request method failure captured: Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/os-volumes/d08281c4-bc66-4d5a-b60d-9389e37ff695 HTTP/1.1 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq31gtuHtYmpFsKVTFKL6LJWj4pdkL8UqDlbyD-4imWtl-wRlu28kom_sKbD2MmhzE0XMNGEwLaZn1iJBPvMDYWQdPkENjnva9I1zTYry_ZLO4Bc8t_rpW6V6ti7lWUhtnGx5N8s-uJBp7RCI8wwa3Csaws7QFc55xJA7N32vQiwK4nA Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11ca86ce109d4ab1bebb00f3d0620a3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 95f340e50b1d46fb8bb92d1219e4d840 Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: method: Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: exception: Volume d08281c4-bc66-4d5a-b60d-9389e37ff695 could not be found. Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'd08281c4-bc66-4d5a-b60d-9389e37ff695'} Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d08281c4-bc66-4d5a-b60d-9389e37ff695 could not be found. (HTTP 404) (Request-ID: req-88057132-c7d3-4313-8eb3-a02a180c91d6) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:58:41.389038 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d08281c4-bc66-4d5a-b60d-9389e37ff695 could not be found. Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d08281c4-bc66-4d5a-b60d-9389e37ff695 could not be found. Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d08281c4-bc66-4d5a-b60d-9389e37ff695 could not be found. Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890420d6-8815-4ca8-ae46-a2a488aaf646 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Returning 404 to user: Volume d08281c4-bc66-4d5a-b60d-9389e37ff695 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-890420d6-8815-4ca8-ae46-a2a488aaf646 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d08281c4-bc66-4d5a-b60d-9389e37ff695" status: 404 len: 109 microversion: 2.1 time: 0.058375 Jun 16 18:58:41.392812 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2632/5164] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jun 16 18:58:41 2022] DELETE /compute/v2.1/os-volumes/d08281c4-bc66-4d5a-b60d-9389e37ff695 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:58:41.400878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72f96f4f-9e13-4c91-afaa-a2b99ec1cd82 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Calling method '.version_select at 0x7f866dea0700>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:41.449549 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-72f96f4f-9e13-4c91-afaa-a2b99ec1cd82 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] HTTP exception thrown: Volume 2deccc2c-199b-49ac-88f1-bf01b4acb23c could not be found. Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72f96f4f-9e13-4c91-afaa-a2b99ec1cd82 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Request method failure captured: Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/os-volumes/2deccc2c-199b-49ac-88f1-bf01b4acb23c HTTP/1.1 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq31gtuHtYmpFsKVTFKL6LJWj4pdkL8UqDlbyD-4imWtl-wRlu28kom_sKbD2MmhzE0XMNGEwLaZn1iJBPvMDYWQdPkENjnva9I1zTYry_ZLO4Bc8t_rpW6V6ti7lWUhtnGx5N8s-uJBp7RCI8wwa3Csaws7QFc55xJA7N32vQiwK4nA Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11ca86ce109d4ab1bebb00f3d0620a3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11ca86ce109d4ab1bebb00f3d0620a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 11ca86ce109d4ab1bebb00f3d0620a3b Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesNegativeTest-400707307 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 95f340e50b1d46fb8bb92d1219e4d840 Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesNegativeTest-400707307-project Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: method: Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: exception: Volume 2deccc2c-199b-49ac-88f1-bf01b4acb23c could not be found. Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2deccc2c-199b-49ac-88f1-bf01b4acb23c'} Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2deccc2c-199b-49ac-88f1-bf01b4acb23c could not be found. (HTTP 404) (Request-ID: req-cce67b9d-7bae-4101-9ec5-bfc376ea0a97) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:58:41.451577 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2deccc2c-199b-49ac-88f1-bf01b4acb23c could not be found. Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2deccc2c-199b-49ac-88f1-bf01b4acb23c could not be found. Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2deccc2c-199b-49ac-88f1-bf01b4acb23c could not be found. Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72f96f4f-9e13-4c91-afaa-a2b99ec1cd82 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] Returning 404 to user: Volume 2deccc2c-199b-49ac-88f1-bf01b4acb23c could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72f96f4f-9e13-4c91-afaa-a2b99ec1cd82 tempest-VolumesNegativeTest-400707307 tempest-VolumesNegativeTest-400707307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2deccc2c-199b-49ac-88f1-bf01b4acb23c" status: 404 len: 109 microversion: 2.1 time: 0.056101 Jun 16 18:58:41.455121 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2533/5165] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jun 16 18:58:41 2022] GET /compute/v2.1/os-volumes/2deccc2c-199b-49ac-88f1-bf01b4acb23c => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:19.139551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] Calling method '.version_select at 0x7f866f3b6280>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:19.140520 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:59:19.140520 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 18:59:19.141833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:19.142521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:19.182300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:19.187825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:19.226828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:19.227557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:19.242864 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1a28349c-9a2b-4262-9e97-202eb848ae8f tempest-PortsAdminExtendedAttrsTestJSON-618633136 tempest-PortsAdminExtendedAttrsTestJSON-618633136-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.754136 Jun 16 18:59:19.244039 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2633/5166] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 18:59:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:24.461751 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:00:24.462854 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:00:26.058690 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:00:26.059196 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:00:26.211985 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:00:26.212737 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:00:26.768283 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54c4e0c1-6f36-4d70-8e14-cbf0f70863b9] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:00:27.517705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1a2150b-9929-454b-b5b5-d8ab8d44c812 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Action: 'create', calling method: .version_select at 0x7f866dcd03a0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-247393980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNO840tlRN9Fz4VxlTtEi/5SNwfc7pZiGnTsqwOzL+eAfXZcPmZMrIoOSxbjthnCrR2xnt71135nMJDylnEK+llF0KsrwPb9AAYhtO5EejP+7euC42rZ2ggTcl/+lNaSGw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:27.557078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b1a2150b-9929-454b-b5b5-d8ab8d44c812 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Getting quotas for project f208e93647784ae5852556a9ad5dc998. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:00:27.578498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b1a2150b-9929-454b-b5b5-d8ab8d44c812 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Getting quotas for user bd4dee9635fd444288993a8846d42d75 and project f208e93647784ae5852556a9ad5dc998. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:00:27.638569 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1a2150b-9929-454b-b5b5-d8ab8d44c812 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.875836 Jun 16 19:00:27.649420 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2534/5167] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:00:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:34.804391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:34.805479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:34.809993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1625948323", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-247393980", "security_groups": [{"name": "tempest-secgroup-smoke-1619918113"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b98deb38-8cc4-4a0b-9d93-11106e105384"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:35.096282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] validate_networks() for [('b98deb38-8cc4-4a0b-9d93-11106e105384', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:00:36.778561 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:00:36.779170 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:00:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Jun 16 19:00:37.697307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Getting quotas for project f208e93647784ae5852556a9ad5dc998. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:00:37.717246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Getting quotas for user bd4dee9635fd444288993a8846d42d75 and project f208e93647784ae5852556a9ad5dc998. Resources: dict_keys(['metadata_items']) {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:00:37.745114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:00:37.746687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:00:37.747989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:00:37.748570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:00:37.749006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:00:37.761926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:37.762618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:37.763614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:37.764238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:37.792898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Getting quotas for project f208e93647784ae5852556a9ad5dc998. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:00:37.799331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Getting quotas for user bd4dee9635fd444288993a8846d42d75 and project f208e93647784ae5852556a9ad5dc998. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:00:37.832324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:00:37.834890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:00:37.967053 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1b6d16e-138f-4fb2-948a-e6018d0085ca tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.161878 Jun 16 19:00:37.972458 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2634/5168] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:00:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 3171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:00:37.981286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:37.983106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:37.990461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-deeafa46-3983-4763-a405-d53ce508180d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:37.992531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-deeafa46-3983-4763-a405-d53ce508180d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:38.051617 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] [54c4e0c1-6f36-4d70-8e14-cbf0f70863b9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42408. Jun 16 19:00:38.221521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-deeafa46-3983-4763-a405-d53ce508180d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:38.233928 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-deeafa46-3983-4763-a405-d53ce508180d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1302 microversion: 2.1 time: 0.255067 Jun 16 19:00:38.238464 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2535/5169] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:37 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:39.256292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-84709d2e-66c2-49dc-b2ae-d1c7ec2c81a0 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:39.256987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-84709d2e-66c2-49dc-b2ae-d1c7ec2c81a0 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:39.425918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-84709d2e-66c2-49dc-b2ae-d1c7ec2c81a0 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:39.459588 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-84709d2e-66c2-49dc-b2ae-d1c7ec2c81a0 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1302 microversion: 2.1 time: 0.207884 Jun 16 19:00:39.460218 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2635/5170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:39 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1302 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:40.477156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:40.477968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:40.494305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:40.499190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:40.513084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:40.514121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:41.145998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:41.162140 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-41360856-9046-4b15-b8c8-03bb1949b405 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1372 microversion: 2.1 time: 0.689562 Jun 16 19:00:41.163219 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2536/5171] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:40 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1372 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:42.192218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:42.194117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:42.205206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:42.211866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:42.213204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:42.213865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:42.509859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:42.536660 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ed0b5242-b3d3-4e5a-9eb6-1db5dc46706f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1360 microversion: 2.1 time: 0.348285 Jun 16 19:00:42.537290 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2636/5172] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:42 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1360 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:43.553763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:43.555257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:43.574725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.575015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:43.575810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.592509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.053326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:44.067789 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e000c3fc-3a5f-4960-8554-4573a28d4542 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1360 microversion: 2.1 time: 0.518188 Jun 16 19:00:44.069127 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2537/5173] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:43 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1360 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:45.094917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:45.097822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:45.127049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:45.127942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:45.129260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:45.129860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:45.743339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:45.754916 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7162cf4d-5463-4f31-a0b4-68760bd0493f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.672211 Jun 16 19:00:45.770067 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2637/5174] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:45 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:46.782381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:46.783266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:46.801705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.802497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:46.804105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.804796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:47.740523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:47.749718 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-79a6b689-f2eb-4ecd-bf5f-57a8d2f8dad1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.977667 Jun 16 19:00:47.754898 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2538/5175] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:46 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:48.540066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:48.774668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:48.775919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:48.786538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:48.795555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:48.802487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:48.804969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:48.807561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.066955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-444fab03-a2c6-402c-a87c-da0eb66ef9ac req-fff62d8e-8b56-4d61-8550-b5fcb90560c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa02b11b-4240-493b-bd1c-8244c1fcd464", "tag": "6104b4f0-d730-4ecc-bd1a-4a45713a1758"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:49.084386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-444fab03-a2c6-402c-a87c-da0eb66ef9ac req-fff62d8e-8b56-4d61-8550-b5fcb90560c8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.085559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-444fab03-a2c6-402c-a87c-da0eb66ef9ac req-fff62d8e-8b56-4d61-8550-b5fcb90560c8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.149160 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-444fab03-a2c6-402c-a87c-da0eb66ef9ac req-fff62d8e-8b56-4d61-8550-b5fcb90560c8 service nova] Creating event network-changed:6104b4f0-d730-4ecc-bd1a-4a45713a1758 for instance aa02b11b-4240-493b-bd1c-8244c1fcd464 on n-h1-846209-2 Jun 16 19:00:49.156564 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-444fab03-a2c6-402c-a87c-da0eb66ef9ac req-fff62d8e-8b56-4d61-8550-b5fcb90560c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.622419 Jun 16 19:00:49.157947 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2638/5176] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:49.638953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:49.648374 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b2be0654-e7bd-4d08-8dd3-25963feda9c8 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.877194 Jun 16 19:00:49.649035 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2539/5177] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:48 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:50.667624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:50.668326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:50.684920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:50.688280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.688917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.690116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.690542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:51.141084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:51.153664 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6b8bb738-ff3c-4545-bb3b-3704eeef4d4c tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.490885 Jun 16 19:00:51.166594 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2639/5178] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:50 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:52.183491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:52.192981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:52.210230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.210798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.211689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.220295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.808928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:52.819908 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bb2d3127-2455-4e93-aede-180788de7dce tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.639821 Jun 16 19:00:52.820527 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2540/5179] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:52 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:53.843161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:53.843784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:53.853744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:53.854206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:53.863668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:53.864134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:54.727868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:54.747385 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0daa8ed-d0a9-4a34-bae1-ea37760822a1 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.907865 Jun 16 19:00:54.753497 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2640/5180] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:53 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:55.769218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:55.769806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:55.784903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:55.785362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:55.786177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:55.794623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:56.384213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:56.394568 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-634db367-2415-4956-814b-fcd05e36c14e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.629260 Jun 16 19:00:56.395153 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2541/5181] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:55 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:57.410803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:57.411427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:57.424376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:57.424826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:57.431560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:57.434490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:57.492155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4c1c141d-2ff4-4a3d-b1be-1eb6fb1ed548 req-88e13604-a7cd-469f-8ade-d961c661950b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa02b11b-4240-493b-bd1c-8244c1fcd464", "name": "network-vif-plugged", "status": "completed", "tag": "6104b4f0-d730-4ecc-bd1a-4a45713a1758"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:57.509704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4c1c141d-2ff4-4a3d-b1be-1eb6fb1ed548 req-88e13604-a7cd-469f-8ade-d961c661950b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:57.510191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4c1c141d-2ff4-4a3d-b1be-1eb6fb1ed548 req-88e13604-a7cd-469f-8ade-d961c661950b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:57.543184 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4c1c141d-2ff4-4a3d-b1be-1eb6fb1ed548 req-88e13604-a7cd-469f-8ade-d961c661950b service nova] Creating event network-vif-plugged:6104b4f0-d730-4ecc-bd1a-4a45713a1758 for instance aa02b11b-4240-493b-bd1c-8244c1fcd464 on n-h1-846209-2 Jun 16 19:00:57.556834 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4c1c141d-2ff4-4a3d-b1be-1eb6fb1ed548 req-88e13604-a7cd-469f-8ade-d961c661950b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068124 Jun 16 19:00:57.557517 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2542/5182] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:58.042540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:58.051258 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da586b95-b65b-4adf-9c4a-9dfc9f42763a tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.644544 Jun 16 19:00:58.052443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2641/5183] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:57 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:59.071367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:59.072228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:59.092691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.093523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.094569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.095199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.548815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:59.559605 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27e19a4c-16ec-4b57-993e-f1feec05609d tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1428 microversion: 2.1 time: 0.494000 Jun 16 19:00:59.564951 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2543/5184] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:59 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1428 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:00.580946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:00.582173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:00.598191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:00.601934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:00.603816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:00.604525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.527596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:01.545198 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d5ea3ee-9b2d-4c53-adc2-b23c340c7336 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1607 microversion: 2.1 time: 0.968824 Jun 16 19:01:01.552525 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2642/5185] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:00 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1607 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:01.574716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:01.575452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:01.595342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.596254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.608704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.613799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.148531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:02.170991 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f79aecfb-94c5-46b1-9b61-08c8061b08ff tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1607 microversion: 2.1 time: 0.600290 Jun 16 19:01:02.173426 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2544/5186] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:01 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1607 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:02.191291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:02.193182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:02.224621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.226409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.231281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.234000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.969650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:02.989766 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9f39ad2f-f77e-46e2-bccf-205de4e1c07e tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1607 microversion: 2.1 time: 0.801043 Jun 16 19:01:02.991321 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2643/5187] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:02 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1607 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:10.514020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ca08960d-001e-4351-81c1-661d6fb06336 req-4fb6cd23-f643-46db-8e00-0e7e6dc857be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa02b11b-4240-493b-bd1c-8244c1fcd464", "tag": "6104b4f0-d730-4ecc-bd1a-4a45713a1758"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:10.529413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=23 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:10.531601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ca08960d-001e-4351-81c1-661d6fb06336 req-4fb6cd23-f643-46db-8e00-0e7e6dc857be service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:10.540093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ca08960d-001e-4351-81c1-661d6fb06336 req-4fb6cd23-f643-46db-8e00-0e7e6dc857be service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:10.560132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=51 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:10.562469 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ca08960d-001e-4351-81c1-661d6fb06336 req-4fb6cd23-f643-46db-8e00-0e7e6dc857be service nova] Creating event network-changed:6104b4f0-d730-4ecc-bd1a-4a45713a1758 for instance aa02b11b-4240-493b-bd1c-8244c1fcd464 on n-h1-846209-2 Jun 16 19:01:10.580608 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ca08960d-001e-4351-81c1-661d6fb06336 req-4fb6cd23-f643-46db-8e00-0e7e6dc857be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.395147 Jun 16 19:01:10.581949 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2545/5188] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:41.874677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4488a60c-cc6e-4044-a831-c302b078fbf3 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:41.875529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4488a60c-cc6e-4044-a831-c302b078fbf3 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:41.889805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:41.892240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=46 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:41.896767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4488a60c-cc6e-4044-a831-c302b078fbf3 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.907166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4488a60c-cc6e-4044-a831-c302b078fbf3 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.908534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4488a60c-cc6e-4044-a831-c302b078fbf3 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.909215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4488a60c-cc6e-4044-a831-c302b078fbf3 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:42.028717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4488a60c-cc6e-4044-a831-c302b078fbf3 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.156859 Jun 16 19:01:42.030750 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2644/5189] 10.222.0.27 () {58 vars in 1292 bytes} [Thu Jun 16 19:01:41 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464/os-server-password => generated 116 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:45.457296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:45.464279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a33cef3-3a6d-4991-854b-d93459e3bd4f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'create', calling method: .version_select at 0x7f866def6940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-574557703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/MhN4wJl2VlNIwB8Dv7CqH5U5SNNJxk4o2WtPWf6eSSTL0Lubv5x1XIBAEC0wommVKs2XB7tEBs30JF4Txw6tDYtGmpx/4sPsVwKwQEpGGQJnN7Ot7Ya2d0x3kxmxRJA=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:45.525620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0a33cef3-3a6d-4991-854b-d93459e3bd4f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:02:45.551190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0a33cef3-3a6d-4991-854b-d93459e3bd4f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for user 179a7e07841645718902076a28fd34cd and project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:02:45.605338 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a33cef3-3a6d-4991-854b-d93459e3bd4f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.151005 Jun 16 19:02:45.606316 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2546/5190] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:02:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:47.377283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:47.378630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:47.383412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:47.383914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:47.406528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.410588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.411521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.411973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.512331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:02:47.742355 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab12628a-fbe3-4b4d-a759-616499143d63 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 204 len: 0 microversion: 2.1 time: 0.367056 Jun 16 19:02:47.757765 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2645/5191] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:02:47 2022] DELETE /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:02:47.764523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:47.774841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:47.790704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.793734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.796560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.797402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:49.629509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.649202 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-07d18716-2059-46b3-924f-2a03c2b46ced tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1515 microversion: 2.1 time: 1.889781 Jun 16 19:02:49.649819 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2547/5192] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:47 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1515 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:50.668876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:50.669620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:50.692284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.695865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.697187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.698533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.437048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-00729547-699f-4795-bb97-62a621f76d84 req-0126710d-7301-4809-b3e4-8e49909886f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5065e4a5-2e2d-4219-bd43-4da8525f7831", "name": "network-vif-deleted", "tag": "e4fed56d-c781-4a26-84e2-3095590ab3c8"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:51.452358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-00729547-699f-4795-bb97-62a621f76d84 req-0126710d-7301-4809-b3e4-8e49909886f8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.453276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-00729547-699f-4795-bb97-62a621f76d84 req-0126710d-7301-4809-b3e4-8e49909886f8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.507137 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-00729547-699f-4795-bb97-62a621f76d84 req-0126710d-7301-4809-b3e4-8e49909886f8 service nova] Creating event network-vif-deleted:e4fed56d-c781-4a26-84e2-3095590ab3c8 for instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 on n-h2-846209-2 Jun 16 19:02:51.517402 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-00729547-699f-4795-bb97-62a621f76d84 req-0126710d-7301-4809-b3e4-8e49909886f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085905 Jun 16 19:02:51.519731 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2548/5193] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:02:52.462886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:52.489035 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f40dea71-225f-4688-b8b1-cf409d82996a tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1473 microversion: 2.1 time: 1.825049 Jun 16 19:02:52.490019 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2646/5194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:50 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1473 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:53.516152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.516972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.542622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.543459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.544616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.545019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.801332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.813937 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f074ed89-9fcc-4248-80b7-8d9dafbd4b81 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1344 microversion: 2.1 time: 0.310860 Jun 16 19:02:53.815638 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2549/5195] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:53 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1344 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:54.831695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:54.833039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:54.842145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.845810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.848637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.854532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.198127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:55.224368 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-edf4a02d-3643-4e9f-8b67-906612f1100c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1344 microversion: 2.1 time: 0.395416 Jun 16 19:02:55.224980 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2647/5196] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:54 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1344 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:55.449940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-170747823", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "f0933c71-f9af-44fa-800c-4155b250731f"}], "key_name": "tempest-TestNetworkBasicOps-574557703", "security_groups": [{"name": "tempest-secgroup-smoke-1378535141"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:55.570121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:55.896162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] validate_networks() for [('f0933c71-f9af-44fa-800c-4155b250731f', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:02:56.245842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:56.246704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:56.266246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.269054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.273332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.274197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.037606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.058335 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4548fe6b-dad0-4711-aa47-f4a12172249c tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1344 microversion: 2.1 time: 0.813538 Jun 16 19:02:57.060014 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2648/5197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:56 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1344 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:58.077646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:58.079239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:58.090471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.105780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.108866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.111413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.464423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf825487ce340068541ebfa73ab24f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9f046fe52643848b37f1096f4bd733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.483494 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9f586c83-9e49-4f5a-87f7-dfc4deb67091 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 200 len: 1344 microversion: 2.1 time: 0.409854 Jun 16 19:02:58.484478 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2649/5198] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:58 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 1344 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:59.048617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:02:59.049033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:02:59.050409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:02:59.050914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:02:59.051467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:02:59.072640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.073103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.077474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.077993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.134203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:02:59.166460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for user 179a7e07841645718902076a28fd34cd and project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:02:59.209355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:02:59.227512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:02:59.352024 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:02:59.501566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:59.503723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] [instance: 5065e4a5-2e2d-4219-bd43-4da8525f7831] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:59.516576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.517522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.519232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.520424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.554021 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] HTTP exception thrown: Instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 could not be found. Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Request method failure captured: Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 HTTP/1.1 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq3xAZnd8r8usL3fd0y1vn_EnGroopvpPQfICpbwKKnEQotNol32mbRIUTPJ5VXVOQFuqBWtXKwpNc8wRC-dBwckini-86zr-lP7l2-Nj5WuagUd1tvQ6Sxcshc06NGedOznae3Mm2HoceeIpie_RKuvS9KkVa_BKQwwZmxwwHhIb7oo Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 5e9f046fe52643848b37f1096f4bd733 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesBackupsTest-1821545819 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e9f046fe52643848b37f1096f4bd733"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e9f046fe52643848b37f1096f4bd733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e9f046fe52643848b37f1096f4bd733", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e9f046fe52643848b37f1096f4bd733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesBackupsTest-1821545819 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 5e9f046fe52643848b37f1096f4bd733 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesBackupsTest-1821545819 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesBackupsTest-1821545819-project Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: adf825487ce340068541ebfa73ab24f0 Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesBackupsTest-1821545819-project Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 could not be found. Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5065e4a5-2e2d-4219-bd43-4da8525f7831'} Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 could not be found. Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 could not be found. Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:02:59.556319 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.560625 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:59.560625 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:02:59.560625 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:02:59.560625 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:02:59.560625 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:02:59.560625 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 could not be found. Jun 16 19:02:59.560625 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.566658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] Returning 404 to user: Instance 5065e4a5-2e2d-4219-bd43-4da8525f7831 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:02:59.567920 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-890e4076-347b-4bac-8a36-581c41c4daa0 tempest-VolumesBackupsTest-1821545819 tempest-VolumesBackupsTest-1821545819-project] 10.222.0.27 "GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831" status: 404 len: 111 microversion: 2.1 time: 0.070603 Jun 16 19:02:59.571203 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2650/5199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:59 2022] GET /compute/v2.1/servers/5065e4a5-2e2d-4219-bd43-4da8525f7831 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:03:00.369881 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45186. Jun 16 19:03:00.375692 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-18870042-9bcc-41a7-a975-6401d1c867b6 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.930818 Jun 16 19:03:00.376884 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2550/5200] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:02:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 4933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:03:00.387656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ff67d658-ec29-450d-95f6-3b8196ad9eee tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:00.388619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ff67d658-ec29-450d-95f6-3b8196ad9eee tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:01.006328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ff67d658-ec29-450d-95f6-3b8196ad9eee tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:01.022282 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ff67d658-ec29-450d-95f6-3b8196ad9eee tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1247 microversion: 2.1 time: 0.637507 Jun 16 19:03:01.024837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2651/5201] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:00 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1247 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:02.040412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:02.041892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:02.057651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:02.058553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:02.059819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:02.060478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:02.687229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:02.703058 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c0cb8d36-2bda-486a-97c3-48a7afda8929 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1299 microversion: 2.1 time: 0.666398 Jun 16 19:03:02.708341 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2551/5202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:02 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1299 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:03.726508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:03.728390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:03.745310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:03.748929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:03.753281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:03.756293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:04.026543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:04.040622 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3682c91b-43db-4205-ba2f-63f721c9ecc9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1305 microversion: 2.1 time: 0.319875 Jun 16 19:03:04.046246 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2652/5203] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:03 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:05.061754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:05.063486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:05.082370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.083575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.085297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.086469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.453530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:05.484132 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a2b2615-295b-4367-b8d7-0739e0fe052f tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1305 microversion: 2.1 time: 0.426759 Jun 16 19:03:05.489077 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2552/5204] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:05 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1305 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:06.323129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1977725166", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "f6622837-e4e3-458b-ad11-8cd224b2ac62"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:06.416202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] validate_networks() for [('f6622837-e4e3-458b-ad11-8cd224b2ac62', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:03:06.512992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:06.513620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:06.523508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.525661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.526502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.526945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:07.471888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:07.481926 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e7c7801-ef07-4c47-942d-f279c67c3eba tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 0.974803 Jun 16 19:03:07.498616 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2553/5205] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:06 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:08.381537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:03:08.382000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:03:08.382622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:03:08.383033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:03:08.383602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:03:08.406469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:08.406469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:08.406469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:08.406931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:08.456383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Getting quotas for project e03a90eddbf54168810817a59ee6ee28. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:03:08.472357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Getting quotas for user 18fbe3f22b984d598fa4c29677c36e36 and project e03a90eddbf54168810817a59ee6ee28. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:03:08.506977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:03:08.509881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:03:08.517004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:08.517622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:08.537733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:08.538559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:08.539656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:08.544102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:08.638425 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d4b4d5b4-3def-4681-b4ab-66dc61b71929 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.190418 Jun 16 19:03:08.639958 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2653/5206] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:03:08.650639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a0db82a6-5545-4c9d-abaa-40f38b5f2c17 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:08.651774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a0db82a6-5545-4c9d-abaa-40f38b5f2c17 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:08.973750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a0db82a6-5545-4c9d-abaa-40f38b5f2c17 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:08.989060 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a0db82a6-5545-4c9d-abaa-40f38b5f2c17 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1214 microversion: 2.1 time: 0.342408 Jun 16 19:03:08.991282 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2654/5207] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:08 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1214 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:09.117355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:09.194766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:09.515508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:09.533153 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-68ddb003-28a2-467d-bfcc-cdd38d251a82 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 1.020079 Jun 16 19:03:09.545151 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2554/5208] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:08 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:10.010070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:10.011646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:10.041574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.041799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:10.042621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.043180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:10.115099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-38217545-5a22-48f2-86e3-30d0f98a4e4f req-4d824023-fdf3-4ba5-81ae-876420a8aece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc43b44-7ede-400a-9355-6ad676a768e4", "tag": "6b9d84b8-ed86-4c31-baa8-0d450f54b672"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:10.128520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-38217545-5a22-48f2-86e3-30d0f98a4e4f req-4d824023-fdf3-4ba5-81ae-876420a8aece service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.128973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-38217545-5a22-48f2-86e3-30d0f98a4e4f req-4d824023-fdf3-4ba5-81ae-876420a8aece service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:10.164413 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-38217545-5a22-48f2-86e3-30d0f98a4e4f req-4d824023-fdf3-4ba5-81ae-876420a8aece service nova] Creating event network-changed:6b9d84b8-ed86-4c31-baa8-0d450f54b672 for instance 3fc43b44-7ede-400a-9355-6ad676a768e4 on n-h1-846209-2 Jun 16 19:03:10.176600 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-38217545-5a22-48f2-86e3-30d0f98a4e4f req-4d824023-fdf3-4ba5-81ae-876420a8aece service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065539 Jun 16 19:03:10.177680 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2555/5209] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:10.258485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:10.268492 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f933a14b-9708-4a2e-b0d7-61f415e12525 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1266 microversion: 2.1 time: 0.264704 Jun 16 19:03:10.279594 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2655/5210] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:10 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:10.554763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:10.556212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:10.578302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.579084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:10.581817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.582883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:11.299986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:11.301511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:11.312582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:11.313597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:11.315292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:11.316058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:11.729708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:11.747027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-589487aa-32c5-4282-8f66-ca2c272e435b tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1272 microversion: 2.1 time: 0.453627 Jun 16 19:03:11.747635 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2656/5211] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:11 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1272 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:11.757902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:11.777352 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94062780-5b86-4092-b814-f9c70bc8da6b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 1.229006 Jun 16 19:03:11.779778 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2556/5212] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:10 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:12.764435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:12.765076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:12.781030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:12.781791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:12.783361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:12.789349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:12.797723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:12.799043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:12.813814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:12.816528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:12.818655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:12.820521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:13.156802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:13.169297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:13.172540 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1523d6ba-7391-4dee-bcde-541525cb81f4 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1314 microversion: 2.1 time: 0.412104 Jun 16 19:03:13.184920 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a403fc1-84c5-49a3-b279-a77e1dc48a03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 0.390178 Jun 16 19:03:13.185143 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2657/5213] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:12 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:13.185857 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2557/5214] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:12 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:14.194247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:14.195325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:14.203556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:14.204234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:14.260183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:14.270026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:14.270881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:14.271462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:14.274732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:14.275444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:14.276903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:14.277435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:14.844709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:14.861175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c1f4299-75ad-4b97-af80-245e05d48f6e tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1314 microversion: 2.1 time: 0.668884 Jun 16 19:03:14.862437 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2658/5215] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:14 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:14.933537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:14.953358 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d2c45768-bc7e-4cca-ae65-f3b1597086a5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 0.753527 Jun 16 19:03:14.955807 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2558/5216] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:14 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:15.334320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9ea52956-887b-43c1-b21b-52350698e149 req-1d6e3578-cf05-475c-989d-410db4dfc55b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf019df-7f81-43e7-981e-e40bb7a37fd3", "tag": "9a9f3350-ed0a-4109-b473-9ee52e3555df"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:15.355152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9ea52956-887b-43c1-b21b-52350698e149 req-1d6e3578-cf05-475c-989d-410db4dfc55b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.356747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9ea52956-887b-43c1-b21b-52350698e149 req-1d6e3578-cf05-475c-989d-410db4dfc55b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.396771 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9ea52956-887b-43c1-b21b-52350698e149 req-1d6e3578-cf05-475c-989d-410db4dfc55b service nova] Creating event network-changed:9a9f3350-ed0a-4109-b473-9ee52e3555df for instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 on n-h1-846209-2 Jun 16 19:03:15.408898 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9ea52956-887b-43c1-b21b-52350698e149 req-1d6e3578-cf05-475c-989d-410db4dfc55b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076534 Jun 16 19:03:15.414667 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2659/5217] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:15.882234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:15.882953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:15.897898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:15.899742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.904494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.907901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.909029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.973435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=61 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:15.974705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:15.975686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:15.994548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.995289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.996336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.997968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:16.552859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:16.556497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:16.568958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-98030393-1f70-4b84-85f7-0c90b7d3d531 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 0.600133 Jun 16 19:03:16.570981 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2660/5218] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:15 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:16.589939 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-030b7ecd-c596-4bf6-bb06-8e43370b0146 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1314 microversion: 2.1 time: 0.714298 Jun 16 19:03:16.592707 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2559/5219] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:15 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:17.589603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:17.589603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:17.598688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:17.605626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:17.608186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:17.608626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:17.609116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:17.609254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:17.609484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:17.629624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:17.630465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:17.631720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:17.632583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:17.634276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:18.183652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:18.198310 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-130528ea-8d04-4377-a0a4-cac7967948c3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 0.614352 Jun 16 19:03:18.198984 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2661/5220] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:17 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:18.248848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:18.263080 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e8aea04-e6fc-417a-9166-9a702e1df952 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1314 microversion: 2.1 time: 0.656776 Jun 16 19:03:18.264936 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2560/5221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:17 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:18.432376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:18.468822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bbb866c5-9428-406b-acf6-cbf0173db772 req-cf9d25b2-a6d7-42ab-8058-38456530063d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc43b44-7ede-400a-9355-6ad676a768e4", "name": "network-vif-plugged", "status": "completed", "tag": "6b9d84b8-ed86-4c31-baa8-0d450f54b672"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:18.490194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bbb866c5-9428-406b-acf6-cbf0173db772 req-cf9d25b2-a6d7-42ab-8058-38456530063d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:18.495403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bbb866c5-9428-406b-acf6-cbf0173db772 req-cf9d25b2-a6d7-42ab-8058-38456530063d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:18.525242 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bbb866c5-9428-406b-acf6-cbf0173db772 req-cf9d25b2-a6d7-42ab-8058-38456530063d service nova] Creating event network-vif-plugged:6b9d84b8-ed86-4c31-baa8-0d450f54b672 for instance 3fc43b44-7ede-400a-9355-6ad676a768e4 on n-h1-846209-2 Jun 16 19:03:18.532735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bbb866c5-9428-406b-acf6-cbf0173db772 req-cf9d25b2-a6d7-42ab-8058-38456530063d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332271 Jun 16 19:03:18.533699 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2662/5222] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:19.217794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:19.219731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:19.231866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.232699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.235394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.236147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.286406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:19.288683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:19.303494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:19.306576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.307422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.308635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.309248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.478324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:19.488510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10ad8129-de7f-4551-bfbd-07b687d8d4cc tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1373 microversion: 2.1 time: 0.275754 Jun 16 19:03:19.489152 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2561/5223] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:19 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1373 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:19.673150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:19.693298 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fde76b6c-582e-4f05-b5d6-9c5878526463 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1314 microversion: 2.1 time: 0.413239 Jun 16 19:03:19.702774 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2663/5224] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:19 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:20.506808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:20.509590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:20.523367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.524014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.525177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.525784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.712778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:20.713761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:20.739075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.741203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.742235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.747419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.867275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:20.877453 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d46978ce-eadb-4852-b346-8e20cc0dd8aa tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1545 microversion: 2.1 time: 0.375882 Jun 16 19:03:20.878273 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2562/5225] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:20 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1545 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:20.895279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:20.895901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:20.911297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.911869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.912722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.913165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:21.351029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:21.384797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0dcf85ff-b4bd-45d0-9853-b6dbde6f4d9c tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1314 microversion: 2.1 time: 0.663434 Jun 16 19:03:21.402531 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2664/5226] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:20 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:21.494866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:21.510728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-41f69fb7-3722-436c-8a96-8997b2a0dc86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1545 microversion: 2.1 time: 0.619206 Jun 16 19:03:21.511774 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2563/5227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:20 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1545 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:22.163448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8517dadf-acbd-4ffd-9642-a341e650c274 req-e948e765-beff-43d8-bf17-d6f2be335a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf019df-7f81-43e7-981e-e40bb7a37fd3", "name": "network-vif-plugged", "status": "completed", "tag": "9a9f3350-ed0a-4109-b473-9ee52e3555df"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:22.195949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8517dadf-acbd-4ffd-9642-a341e650c274 req-e948e765-beff-43d8-bf17-d6f2be335a70 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:22.197467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8517dadf-acbd-4ffd-9642-a341e650c274 req-e948e765-beff-43d8-bf17-d6f2be335a70 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:22.240851 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8517dadf-acbd-4ffd-9642-a341e650c274 req-e948e765-beff-43d8-bf17-d6f2be335a70 service nova] Creating event network-vif-plugged:9a9f3350-ed0a-4109-b473-9ee52e3555df for instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 on n-h1-846209-2 Jun 16 19:03:22.258416 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8517dadf-acbd-4ffd-9642-a341e650c274 req-e948e765-beff-43d8-bf17-d6f2be335a70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103110 Jun 16 19:03:22.260619 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2665/5228] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:22.412733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:22.414423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:22.430543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:22.437563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:22.438873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:22.440322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:23.187220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:23.204551 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5204ff02-d789-4063-9b45-06ffc1e41e70 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1314 microversion: 2.1 time: 0.795806 Jun 16 19:03:23.209184 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2564/5229] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:22 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:24.229664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:24.231059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:24.252864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:24.253638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:24.254661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:24.255706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:24.918244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:24.930038 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cb77cf4c-d7ab-42ec-b6ff-572261997153 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1499 microversion: 2.1 time: 0.707720 Jun 16 19:03:24.931954 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2666/5230] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:24 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1499 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:28.080559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b7ec3527-0464-4a43-a8b7-66ccfea72bb5 req-494183f4-7412-4887-ae37-b2259351c8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc43b44-7ede-400a-9355-6ad676a768e4", "tag": "6b9d84b8-ed86-4c31-baa8-0d450f54b672"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:28.094669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b7ec3527-0464-4a43-a8b7-66ccfea72bb5 req-494183f4-7412-4887-ae37-b2259351c8ec service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:28.100247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b7ec3527-0464-4a43-a8b7-66ccfea72bb5 req-494183f4-7412-4887-ae37-b2259351c8ec service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:28.136252 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b7ec3527-0464-4a43-a8b7-66ccfea72bb5 req-494183f4-7412-4887-ae37-b2259351c8ec service nova] Creating event network-changed:6b9d84b8-ed86-4c31-baa8-0d450f54b672 for instance 3fc43b44-7ede-400a-9355-6ad676a768e4 on n-h1-846209-2 Jun 16 19:03:28.150144 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b7ec3527-0464-4a43-a8b7-66ccfea72bb5 req-494183f4-7412-4887-ae37-b2259351c8ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077602 Jun 16 19:03:28.151612 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2565/5231] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:29.732464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:29.733067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:29.750731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:29.751216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:29.752893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:29.755792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:29.830383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:03:29.983661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fafae297-7524-4c3f-ac99-68bfea95cb72 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 204 len: 0 microversion: 2.1 time: 0.254947 Jun 16 19:03:29.986776 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2667/5232] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:03:29 2022] DELETE /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:03:29.996936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:29.998575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:30.017274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:30.018321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:30.020542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:30.022542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:30.315382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:30.330417 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f96df40d-8286-4b36-be7f-c1cf880453c6 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1505 microversion: 2.1 time: 0.338260 Jun 16 19:03:30.337310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2566/5233] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:29 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:31.359800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:31.361737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:31.371019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:31.371789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:31.374133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:31.374827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:31.785474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:31.800153 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3fe4cfb2-4bc7-4d9c-ab7f-44f9277af2c1 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1505 microversion: 2.1 time: 0.447844 Jun 16 19:03:31.801472 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2668/5234] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:31 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:32.704652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-42c4765f-757d-4395-8b78-fe5dc5b63a04 req-f8558164-1b6e-4773-b769-6483a464db97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf019df-7f81-43e7-981e-e40bb7a37fd3", "name": "network-vif-deleted", "tag": "9a9f3350-ed0a-4109-b473-9ee52e3555df"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:32.720506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-42c4765f-757d-4395-8b78-fe5dc5b63a04 req-f8558164-1b6e-4773-b769-6483a464db97 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:32.721178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-42c4765f-757d-4395-8b78-fe5dc5b63a04 req-f8558164-1b6e-4773-b769-6483a464db97 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:32.753221 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-42c4765f-757d-4395-8b78-fe5dc5b63a04 req-f8558164-1b6e-4773-b769-6483a464db97 service nova] Creating event network-vif-deleted:9a9f3350-ed0a-4109-b473-9ee52e3555df for instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 on n-h1-846209-2 Jun 16 19:03:32.763741 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-42c4765f-757d-4395-8b78-fe5dc5b63a04 req-f8558164-1b6e-4773-b769-6483a464db97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063633 Jun 16 19:03:32.764635 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2567/5235] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:32.824379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:32.825752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:32.839732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:32.840575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:32.841670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:32.842365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:33.080426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18fbe3f22b984d598fa4c29677c36e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a90eddbf54168810817a59ee6ee28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:33.106384 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7542c215-671c-42a3-90bf-0c62aaa98b51 tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 200 len: 1463 microversion: 2.1 time: 0.287701 Jun 16 19:03:33.107723 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2669/5236] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:32 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 1463 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:34.142981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:34.147279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] [instance: fbf019df-7f81-43e7-981e-e40bb7a37fd3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:34.170044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:34.171655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:34.172699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:34.174698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:34.203898 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] HTTP exception thrown: Instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 could not be found. Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Request method failure captured: Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 HTTP/1.1 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq35j3kuIgWZ5-pq7TV_x_eh4K3n5RmKANY4VVVUUolUWLsGzCzuWm5gXelN6yfn8IHKaVjcM9whnmPBEu1uo2kR1hXVGuZZDuTT3Ey1U6r3NNANHRK6FSXbch_cQPzJnu7lA65uEgO9-sgHFJL3ZQD9z9NTd7XhjeCz5U4FbWOJyb3Q Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e03a90eddbf54168810817a59ee6ee28 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesActionsTest-1955443248 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e03a90eddbf54168810817a59ee6ee28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e03a90eddbf54168810817a59ee6ee28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e03a90eddbf54168810817a59ee6ee28", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e03a90eddbf54168810817a59ee6ee28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesActionsTest-1955443248 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e03a90eddbf54168810817a59ee6ee28 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesActionsTest-1955443248 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesActionsTest-1955443248-project Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 18fbe3f22b984d598fa4c29677c36e36 Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesActionsTest-1955443248-project Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 could not be found. Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'fbf019df-7f81-43e7-981e-e40bb7a37fd3'} Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 could not be found. Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 could not be found. Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:34.225568 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 could not be found. Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] Returning 404 to user: Instance fbf019df-7f81-43e7-981e-e40bb7a37fd3 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2ee966bf-e145-49f3-bd84-74f1c1c1fa3f tempest-VolumesActionsTest-1955443248 tempest-VolumesActionsTest-1955443248-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3" status: 404 len: 111 microversion: 2.1 time: 0.098686 Jun 16 19:03:34.231336 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2568/5237] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:34 2022] GET /compute/v2.1/servers/fbf019df-7f81-43e7-981e-e40bb7a37fd3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:46.224652 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:03:46.225943 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:03:47.147597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-056f2c4b-3f5a-405f-9031-73113126f1a9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:47.149139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-056f2c4b-3f5a-405f-9031-73113126f1a9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:47.152346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:47.154991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:47.183106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056f2c4b-3f5a-405f-9031-73113126f1a9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:47.184391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056f2c4b-3f5a-405f-9031-73113126f1a9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:47.187162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056f2c4b-3f5a-405f-9031-73113126f1a9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:47.187877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056f2c4b-3f5a-405f-9031-73113126f1a9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:47.276576 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-056f2c4b-3f5a-405f-9031-73113126f1a9 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4/action" status: 200 len: 24559 microversion: 2.1 time: 0.133502 Jun 16 19:03:47.285987 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2670/5238] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:03:47 2022] POST /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4/action => generated 24559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:04:05.123995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-28ed65ad-5f4a-4516-9fb0-b8ca1934c712 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'create', calling method: .version_select at 0x7f866dd485e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-482781042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHZW5tlDPJgdShqcEzuBFgArEtuMb330Uh00iFKrCmaK8ULWe+dR7PHjijYypkGapUC5YY+9Yli6QpvoE+a909YAPwUN2G+kwZn6esmzCdYRSlpIo521xP4Rq92GVbUbw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:05.133687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=19 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:05.134755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=47 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:05.154732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-28ed65ad-5f4a-4516-9fb0-b8ca1934c712 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:05.164412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-28ed65ad-5f4a-4516-9fb0-b8ca1934c712 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for user 179a7e07841645718902076a28fd34cd and project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:05.199794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-28ed65ad-5f4a-4516-9fb0-b8ca1934c712 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.081829 Jun 16 19:04:05.201219 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2569/5239] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:04:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:08.183958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-911024497", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "611c7f5c-38dd-4210-a78c-736765671a1a"}], "key_name": "tempest-TestNetworkBasicOps-482781042", "security_groups": [{"name": "tempest-secgroup-smoke-263152026"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:08.217960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:08.223363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:08.639512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] validate_networks() for [('611c7f5c-38dd-4210-a78c-736765671a1a', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:04:10.662371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:04:10.662950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:04:10.664588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:04:10.665027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:04:10.665592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:04:10.685990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.686454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.687260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.688364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.736973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:10.751466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for user 179a7e07841645718902076a28fd34cd and project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:10.785854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:04:10.792417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:04:10.901648 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4329fdea-0992-4ac3-acfb-62353a8fac46 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.721560 Jun 16 19:04:10.903017 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2671/5240] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:04:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 2725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:04:10.914493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53f97feb-1cbb-4d10-a48e-843054d951a8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:10.916447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53f97feb-1cbb-4d10-a48e-843054d951a8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:11.426093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53f97feb-1cbb-4d10-a48e-843054d951a8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:11.433534 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53f97feb-1cbb-4d10-a48e-843054d951a8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1247 microversion: 2.1 time: 0.524226 Jun 16 19:04:11.437946 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2570/5241] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:10 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1247 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:12.456698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:12.458495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:12.481577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:12.483435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.485544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:12.486029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.718201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:12.735669 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-08931580-b261-4949-89d4-cf33b2923db0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1243 microversion: 2.1 time: 0.283907 Jun 16 19:04:12.756795 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2672/5242] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:12 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1243 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:13.761196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:13.762425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:13.783766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.785850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.788109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.792054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:14.134734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:14.144013 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-735e2a74-e9c5-4869-9ceb-a012020ca715 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1305 microversion: 2.1 time: 0.388251 Jun 16 19:04:14.148014 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2571/5243] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:13 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1305 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:15.168572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:15.173575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:15.181265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.205181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.206444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.211351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.429191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:15.442912 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59c1bb6d-4a87-4eb5-ba46-f236c941b614 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1305 microversion: 2.1 time: 0.281760 Jun 16 19:04:15.463266 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2673/5244] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:15 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1305 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:16.462795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:16.463792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:16.494743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:16.495680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:16.496772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:16.503892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.128990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:17.148238 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4b0c5020-a21f-4125-a5c8-81039cdf7ef8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1372 microversion: 2.1 time: 0.691259 Jun 16 19:04:17.151169 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2572/5245] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:16 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1372 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:17.525967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-36a0e44f-2db3-4c42-aab6-b17ddce6aeb3 req-27386a45-680e-481c-9311-99820ebd88de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db70af8-e6c8-4cc5-86b8-765c52bfbc39", "tag": "c12e2d80-48bf-40a4-90d1-a5240fa3246f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:17.567602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-36a0e44f-2db3-4c42-aab6-b17ddce6aeb3 req-27386a45-680e-481c-9311-99820ebd88de service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.568263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-36a0e44f-2db3-4c42-aab6-b17ddce6aeb3 req-27386a45-680e-481c-9311-99820ebd88de service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.606417 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-36a0e44f-2db3-4c42-aab6-b17ddce6aeb3 req-27386a45-680e-481c-9311-99820ebd88de service nova] Creating event network-changed:c12e2d80-48bf-40a4-90d1-a5240fa3246f for instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 on n-h1-846209-2 Jun 16 19:04:17.621456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-36a0e44f-2db3-4c42-aab6-b17ddce6aeb3 req-27386a45-680e-481c-9311-99820ebd88de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100367 Jun 16 19:04:17.623087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2674/5246] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:18.168545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:18.169174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:18.183844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.185283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.186308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.190513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.654712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:19.697052 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f6832cbe-b52a-4089-9c1a-b0b94b79766b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1372 microversion: 2.1 time: 1.519095 Jun 16 19:04:19.698348 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2573/5247] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:18 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1372 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:20.736589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.737326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.764868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:20.779427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:20.785515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.787286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.788318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.788937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.598113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:21.615574 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0212dd20-fb70-4f50-8dfa-b58bdfb04ad4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1372 microversion: 2.1 time: 0.903528 Jun 16 19:04:21.620759 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2675/5248] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:20 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1372 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:22.636038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:22.637493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:22.641714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:22.683292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.683832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.684667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.690078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.110507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:23.126557 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1072f0f5-0297-46cd-be12-aa8eedabee10 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1372 microversion: 2.1 time: 0.488931 Jun 16 19:04:23.128430 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2574/5249] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:22 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1372 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:24.148461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:24.149259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:24.175467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.180806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.181748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.186938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.673628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.694542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3760e228-3d59-48b2-8d1a-c312a0c45842 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1372 microversion: 2.1 time: 0.545229 Jun 16 19:04:24.698099 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2676/5250] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:24 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1372 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:24.773702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1c4929a4-fa1d-4313-8436-861cb43f9068 req-0447a036-d5b0-481b-83f3-0d57b087ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db70af8-e6c8-4cc5-86b8-765c52bfbc39", "name": "network-vif-plugged", "status": "completed", "tag": "c12e2d80-48bf-40a4-90d1-a5240fa3246f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:24.804009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1c4929a4-fa1d-4313-8436-861cb43f9068 req-0447a036-d5b0-481b-83f3-0d57b087ce1f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.807062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1c4929a4-fa1d-4313-8436-861cb43f9068 req-0447a036-d5b0-481b-83f3-0d57b087ce1f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.847953 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1c4929a4-fa1d-4313-8436-861cb43f9068 req-0447a036-d5b0-481b-83f3-0d57b087ce1f service nova] Creating event network-vif-plugged:c12e2d80-48bf-40a4-90d1-a5240fa3246f for instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 on n-h1-846209-2 Jun 16 19:04:24.876960 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1c4929a4-fa1d-4313-8436-861cb43f9068 req-0447a036-d5b0-481b-83f3-0d57b087ce1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107490 Jun 16 19:04:24.881086 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2575/5251] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:25.718772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:25.720086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:25.746359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.747114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.748969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.751125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.229115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:26.291431 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d4865db4-1eba-4048-bd47-470f82cad253 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1372 microversion: 2.1 time: 0.577904 Jun 16 19:04:26.300062 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2677/5252] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:25 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1372 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:27.312093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:27.314958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:27.333269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:27.333746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:27.343230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:27.360871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:27.991745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:28.005170 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2601eb03-6690-444b-8e80-6c27a16c7d03 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1543 microversion: 2.1 time: 0.696706 Jun 16 19:04:28.016584 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2576/5253] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:27 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1543 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:28.023368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:28.024644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:28.049181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:28.057441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:28.059102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:28.063286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:28.818805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:28.828952 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f7e5468e-e925-40a3-ac7c-b5b9841852f8 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1543 microversion: 2.1 time: 0.809150 Jun 16 19:04:28.836041 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2678/5254] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:28 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1543 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:46.336940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-261890639", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "947343a3-4cb3-45a8-a1a3-b5473c227e1f"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:46.363155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:46.364326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=32 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:46.457428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] validate_networks() for [('947343a3-4cb3-45a8-a1a3-b5473c227e1f', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:04:47.956612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:04:47.957702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:04:47.958526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:04:47.959314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:04:47.960055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:04:47.980153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.985502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.986603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.987313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.064785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Getting quotas for project 61055ab8cb474986b82a768b873117a5. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:48.076003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Getting quotas for user 6d02520d88e44fb3a111d3b618465f60 and project 61055ab8cb474986b82a768b873117a5. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:48.127161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:04:48.129899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:04:48.384711 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-033c7fef-7c88-48f3-b3dd-a7b4c4e175b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051826 Jun 16 19:04:48.386250 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2577/5255] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:04:48.396612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35c4ab68-2075-42c3-8e6c-223859ea93e4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:48.397882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-35c4ab68-2075-42c3-8e6c-223859ea93e4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:48.400492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:48.401535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=40 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:48.563084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-35c4ab68-2075-42c3-8e6c-223859ea93e4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:48.570479 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-35c4ab68-2075-42c3-8e6c-223859ea93e4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1213 microversion: 2.1 time: 0.177701 Jun 16 19:04:48.571063 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2679/5256] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:48 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:49.589934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:49.590550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:49.626108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:49.628281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:49.631730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:49.633950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:49.855042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:49.877251 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91828de5-54cb-4d5c-82d2-04ff696af9a6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1217 microversion: 2.1 time: 0.293512 Jun 16 19:04:49.884703 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2578/5257] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:49 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1217 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:50.909741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:50.910650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:50.940322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.942340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:50.944037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.946195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.111631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:51.153572 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dbe04fb6-c06f-41c1-a99d-bcebe899fd00 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1283 microversion: 2.1 time: 0.250160 Jun 16 19:04:51.164667 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2680/5258] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:50 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1283 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:52.187998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:52.190742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:52.220259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.221382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.228320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.232132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.809457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:52.835788 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d402aaeb-097c-4b71-9ec2-bf3629c7dee2 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1313 microversion: 2.1 time: 0.658863 Jun 16 19:04:52.840937 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2579/5259] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:52 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:53.896713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:53.897349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:53.931287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:53.931767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:53.936660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:53.937133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.683443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2d51613a-2910-46aa-8fdb-e68e29d4282d req-9d1ea649-bf80-4693-913a-0a57af0ad566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a59357-91c0-479a-aae2-ec84b534c365", "tag": "6bdf2c75-f51e-4609-8d61-4937ac16e09d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:54.701624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2d51613a-2910-46aa-8fdb-e68e29d4282d req-9d1ea649-bf80-4693-913a-0a57af0ad566 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:54.720640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2d51613a-2910-46aa-8fdb-e68e29d4282d req-9d1ea649-bf80-4693-913a-0a57af0ad566 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.767689 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2d51613a-2910-46aa-8fdb-e68e29d4282d req-9d1ea649-bf80-4693-913a-0a57af0ad566 service nova] Creating event network-changed:6bdf2c75-f51e-4609-8d61-4937ac16e09d for instance 50a59357-91c0-479a-aae2-ec84b534c365 on n-h1-846209-2 Jun 16 19:04:54.785422 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2d51613a-2910-46aa-8fdb-e68e29d4282d req-9d1ea649-bf80-4693-913a-0a57af0ad566 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105573 Jun 16 19:04:54.792577 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2580/5260] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:04:54.873325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:54.882281 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-68da53b9-e86a-4427-a595-e7d2185edeec tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1313 microversion: 2.1 time: 0.989552 Jun 16 19:04:54.884450 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2681/5261] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:53 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1313 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:55.901239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:55.902025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:55.927393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.927393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.928275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.928275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.198545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:56.217873 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-57c5db8a-7207-4b97-900f-1d7c338b7830 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1313 microversion: 2.1 time: 0.321362 Jun 16 19:04:56.232962 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2581/5262] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:55 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:57.241187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:57.244516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:57.258778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:57.259249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:57.276575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:57.277052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:58.040806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:58.053319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-76843df2-59f8-4bd8-959b-374a96ec910b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1313 microversion: 2.1 time: 0.817328 Jun 16 19:04:58.055694 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2682/5263] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:57 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:58.394709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:58.396639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:58.404115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:58.406062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:58.418134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:58.418784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:58.419868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:58.426038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:58.469687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:04:58.659742 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c67325da-a717-4333-a42d-3bb467684770 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 204 len: 0 microversion: 2.1 time: 0.276385 Jun 16 19:04:58.663748 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2582/5264] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:04:58 2022] DELETE /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:04:58.671500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:58.672594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:58.701788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:58.710762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:58.713385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:58.718835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:58.725701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:58.973134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:58.988618 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e89dc1cd-b112-4d7d-83c3-792b50d1cd00 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1549 microversion: 2.1 time: 0.323177 Jun 16 19:04:58.989423 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2683/5265] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:58 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1549 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:59.071678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:59.072390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:59.087049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:59.087512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:59.088321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:59.088762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:59.486844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:59.512752 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87d6e198-a380-4623-b9b1-312d552eee73 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1313 microversion: 2.1 time: 0.445631 Jun 16 19:04:59.513403 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2583/5266] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:59 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:00.010497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:00.011747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:00.032487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:00.036442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:00.039171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:00.042893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:00.531445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:00.532544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:00.550423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:00.552046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:00.554104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:00.556383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:00.808384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:00.821322 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6c2db792-f267-40f6-a193-f1f55f8bf293 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1549 microversion: 2.1 time: 0.814233 Jun 16 19:05:00.838586 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2684/5267] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:00 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1549 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:00.848839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-97b180c4-ff78-40d3-84be-73b62f24ba22 req-798896b0-84be-4072-b849-8bdf6626d950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a59357-91c0-479a-aae2-ec84b534c365", "name": "network-vif-plugged", "status": "completed", "tag": "6bdf2c75-f51e-4609-8d61-4937ac16e09d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:00.881949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-97b180c4-ff78-40d3-84be-73b62f24ba22 req-798896b0-84be-4072-b849-8bdf6626d950 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:00.883899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-97b180c4-ff78-40d3-84be-73b62f24ba22 req-798896b0-84be-4072-b849-8bdf6626d950 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:00.929862 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-97b180c4-ff78-40d3-84be-73b62f24ba22 req-798896b0-84be-4072-b849-8bdf6626d950 service nova] Creating event network-vif-plugged:6bdf2c75-f51e-4609-8d61-4937ac16e09d for instance 50a59357-91c0-479a-aae2-ec84b534c365 on n-h1-846209-2 Jun 16 19:05:00.935819 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-97b180c4-ff78-40d3-84be-73b62f24ba22 req-798896b0-84be-4072-b849-8bdf6626d950 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097720 Jun 16 19:05:00.937881 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2685/5268] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:01.228237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:01.241502 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-111d9c7a-dffe-4da3-a416-6cf7c219be21 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1313 microversion: 2.1 time: 0.715264 Jun 16 19:05:01.256798 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2584/5269] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:00 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:01.844072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:01.844789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:01.856149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:01.856601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:01.860657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:01.861293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:01.897411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-764a0861-2c7c-4ed6-95d2-737d624c05a0 req-e374da24-519e-4a31-bd82-18fdb500a462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db70af8-e6c8-4cc5-86b8-765c52bfbc39", "name": "network-vif-deleted", "tag": "c12e2d80-48bf-40a4-90d1-a5240fa3246f"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:01.915754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-764a0861-2c7c-4ed6-95d2-737d624c05a0 req-e374da24-519e-4a31-bd82-18fdb500a462 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:01.917321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-764a0861-2c7c-4ed6-95d2-737d624c05a0 req-e374da24-519e-4a31-bd82-18fdb500a462 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:01.945456 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-764a0861-2c7c-4ed6-95d2-737d624c05a0 req-e374da24-519e-4a31-bd82-18fdb500a462 service nova] Creating event network-vif-deleted:c12e2d80-48bf-40a4-90d1-a5240fa3246f for instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 on n-h1-846209-2 Jun 16 19:05:01.952067 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-764a0861-2c7c-4ed6-95d2-737d624c05a0 req-e374da24-519e-4a31-bd82-18fdb500a462 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058600 Jun 16 19:05:01.953967 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2585/5270] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:02.039325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:02.050513 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-21b86b95-5553-4717-8de3-68ee4d4f1664 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1482 microversion: 2.1 time: 0.212126 Jun 16 19:05:02.051498 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2686/5271] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:01 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1482 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:02.265431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:02.266488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:02.280038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.282749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.287047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.289320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.697061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:02.708562 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6787303e-2663-45e3-a835-e0dc95a2522c tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1313 microversion: 2.1 time: 0.448231 Jun 16 19:05:02.712669 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2586/5272] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:02 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:03.068138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:03.069350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:03.084331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.094132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.095459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.096082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.200171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.200880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.201391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lazy-loading 'fault' on Instance uuid 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:05:03.288160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:03.300326 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2fd629cf-dcb4-4c83-a39d-22e7a7d347da tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 200 len: 1337 microversion: 2.1 time: 0.235632 Jun 16 19:05:03.303479 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2687/5273] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:03 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 1337 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:03.729381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:03.730587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:03.745287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.745875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.752083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.752679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:04.060556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:04.068907 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10957868-0b82-4bbe-b69d-2d93498cca66 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1498 microversion: 2.1 time: 0.343990 Jun 16 19:05:04.081006 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2587/5274] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:03 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1498 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:04.325301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:04.331079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3db70af8-e6c8-4cc5-86b8-765c52bfbc39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:04.351763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:04.354579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:04.356216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:04.357369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:04.418955 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] HTTP exception thrown: Instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 could not be found. Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Request method failure captured: Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 HTTP/1.1 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq347vDmCN0SXe7bh6BlTiVgY1wzWG3duzDG7LMxiTaVKdDbIGC1wUuq6VLXhTRMLoAvkeffmHskFVsZw--yFcvJ8YjRU1hkSgebk8IfgyhIOENbdUK1MCUFAXyLE7B6n4NKx29VnFyCQWBnm2aafJHuJiF5HKtlz_gdtZQlOMw4UizM Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 833a5d53ee7d4c29a69f7a8cdf47db05 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_833a5d53ee7d4c29a69f7a8cdf47db05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 833a5d53ee7d4c29a69f7a8cdf47db05 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestNetworkBasicOps-2003087479-project Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 179a7e07841645718902076a28fd34cd Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestNetworkBasicOps-2003087479-project Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 could not be found. Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3db70af8-e6c8-4cc5-86b8-765c52bfbc39'} Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 could not be found. Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 could not be found. Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:04.420977 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 could not be found. Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Returning 404 to user: Instance 3db70af8-e6c8-4cc5-86b8-765c52bfbc39 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3d6381fb-06e1-42f9-8ddb-e4359060077e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39" status: 404 len: 111 microversion: 2.1 time: 0.101323 Jun 16 19:05:04.426050 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2688/5275] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:04 2022] GET /compute/v2.1/servers/3db70af8-e6c8-4cc5-86b8-765c52bfbc39 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:04.923070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ae12633-1d03-4813-8b78-6adc2f4dcc17 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '.version_select at 0x7f866dcc91f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:04.996474 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0ae12633-1d03-4813-8b78-6adc2f4dcc17 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-482781042" status: 202 len: 0 microversion: 2.1 time: 0.086077 Jun 16 19:05:04.997141 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2588/5276] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jun 16 19:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-482781042 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:05:05.094946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:05.095838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:05.113157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.114013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.115756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.117172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.154117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:05.332201 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a033bca6-86dd-4eee-952a-5812546511ee tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "DELETE /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 204 len: 0 microversion: 2.1 time: 0.242698 Jun 16 19:05:05.334107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2689/5277] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:05 2022] DELETE /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:05.345378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:05.346375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:05.362884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.364616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.365624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.366317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.736247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:05.747828 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7fbdfcc5-e8a9-4b3a-b8eb-e02393034c7f tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1504 microversion: 2.1 time: 0.405576 Jun 16 19:05:05.749020 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2589/5278] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:05 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:06.769331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:06.770087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:06.797003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:06.800181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:06.807486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:06.808583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:07.575258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:07.594155 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-49c141a9-a162-4454-afd6-ad506c7770b6 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1504 microversion: 2.1 time: 0.828868 Jun 16 19:05:07.605547 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2690/5279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:06 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1504 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:08.138601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-14fea391-b041-4048-a834-4b02c4ef153e req-608e90c3-cf07-42c3-ab5c-4e20e5f74828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a59357-91c0-479a-aae2-ec84b534c365", "name": "network-vif-deleted", "tag": "6bdf2c75-f51e-4609-8d61-4937ac16e09d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:08.181480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-14fea391-b041-4048-a834-4b02c4ef153e req-608e90c3-cf07-42c3-ab5c-4e20e5f74828 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.181959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-14fea391-b041-4048-a834-4b02c4ef153e req-608e90c3-cf07-42c3-ab5c-4e20e5f74828 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.215484 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-14fea391-b041-4048-a834-4b02c4ef153e req-608e90c3-cf07-42c3-ab5c-4e20e5f74828 service nova] Creating event network-vif-deleted:6bdf2c75-f51e-4609-8d61-4937ac16e09d for instance 50a59357-91c0-479a-aae2-ec84b534c365 on n-h1-846209-2 Jun 16 19:05:08.225856 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-14fea391-b041-4048-a834-4b02c4ef153e req-608e90c3-cf07-42c3-ab5c-4e20e5f74828 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090836 Jun 16 19:05:08.232257 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2590/5280] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:08.615673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:08.616931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:08.636959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.639417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.640247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.640749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.713117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.713513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.714043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lazy-loading 'fault' on Instance uuid 50a59357-91c0-479a-aae2-ec84b534c365 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:05:08.940309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:08.957438 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7ac49c8f-3abc-4864-b45b-1c5ca82e114e tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 200 len: 1303 microversion: 2.1 time: 0.344611 Jun 16 19:05:08.959721 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2691/5281] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:08 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 1303 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:09.664657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:09.665827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:09.674803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-897d0cd7-9f66-4d20-b15d-b55c8d4a9dd4 req-024d187b-27c9-4fae-a86b-082103a0b96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc43b44-7ede-400a-9355-6ad676a768e4", "tag": "6b9d84b8-ed86-4c31-baa8-0d450f54b672"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:09.711856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:09.715408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-897d0cd7-9f66-4d20-b15d-b55c8d4a9dd4 req-024d187b-27c9-4fae-a86b-082103a0b96a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:09.721887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:09.725514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:09.727945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:09.728761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-897d0cd7-9f66-4d20-b15d-b55c8d4a9dd4 req-024d187b-27c9-4fae-a86b-082103a0b96a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:09.770548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-897d0cd7-9f66-4d20-b15d-b55c8d4a9dd4 req-024d187b-27c9-4fae-a86b-082103a0b96a service nova] Creating event network-changed:6b9d84b8-ed86-4c31-baa8-0d450f54b672 for instance 3fc43b44-7ede-400a-9355-6ad676a768e4 on n-h1-846209-2 Jun 16 19:05:09.787402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-897d0cd7-9f66-4d20-b15d-b55c8d4a9dd4 req-024d187b-27c9-4fae-a86b-082103a0b96a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117325 Jun 16 19:05:09.789162 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2692/5282] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:09.801545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:09.956211 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c6f77cd6-dad2-482f-b3dd-5c22ec784014 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 204 len: 0 microversion: 2.1 time: 0.295483 Jun 16 19:05:09.959929 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2591/5283] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:09 2022] DELETE /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:09.966101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:09.967061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:09.976784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:09.977872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 50a59357-91c0-479a-aae2-ec84b534c365] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:10.016210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.017771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.018667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.027527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.027991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.028787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.029229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.033000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.089217 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] HTTP exception thrown: Instance 50a59357-91c0-479a-aae2-ec84b534c365 could not be found. Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Request method failure captured: Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 HTTP/1.1 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq37LaFm6jYN_cJ-Ai5FnyCN7G0ZJRShwnWN5WqAyQwC_wZDs9w62XjyKbmRUFcUKj7ANDSPL9mpVy594Y8I_HlNR6R5K0Iyjsmcm-iMHvIFEA-AsjfxVWdDtaD6XeNOts-Y9VKrQ6wUbTEBFMNgOAMuzkxtEYmZkmYhS8HH7bK9CFtk Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 61055ab8cb474986b82a768b873117a5 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesActionsTest-2015034402 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61055ab8cb474986b82a768b873117a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61055ab8cb474986b82a768b873117a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61055ab8cb474986b82a768b873117a5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61055ab8cb474986b82a768b873117a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesActionsTest-2015034402 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 61055ab8cb474986b82a768b873117a5 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesActionsTest-2015034402 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesActionsTest-2015034402-project Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6d02520d88e44fb3a111d3b618465f60 Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesActionsTest-2015034402-project Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 50a59357-91c0-479a-aae2-ec84b534c365 could not be found. Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '50a59357-91c0-479a-aae2-ec84b534c365'} Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a59357-91c0-479a-aae2-ec84b534c365 could not be found. Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a59357-91c0-479a-aae2-ec84b534c365 could not be found. Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:10.090939 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a59357-91c0-479a-aae2-ec84b534c365 could not be found. Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Returning 404 to user: Instance 50a59357-91c0-479a-aae2-ec84b534c365 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:10.098057 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f449eeec-46cf-4aeb-93e0-b6291572c732 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365" status: 404 len: 111 microversion: 2.1 time: 0.121572 Jun 16 19:05:10.108971 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2592/5284] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:09 2022] GET /compute/v2.1/servers/50a59357-91c0-479a-aae2-ec84b534c365 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:10.439921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:10.459977 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1604691a-4532-4ee0-92ab-083a6d77a683 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1670 microversion: 2.1 time: 0.498318 Jun 16 19:05:10.470943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-937848943", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "947343a3-4cb3-45a8-a1a3-b5473c227e1f"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:10.493872 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2693/5285] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:09 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:10.658945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] validate_networks() for [('947343a3-4cb3-45a8-a1a3-b5473c227e1f', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:05:11.515054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:11.515890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:11.533301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.534148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:11.537394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.538614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:12.449381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:12.472607 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2793a68d-13f5-4426-8cd1-69cca8863ff0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1670 microversion: 2.1 time: 0.964055 Jun 16 19:05:12.481260 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2694/5286] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:11 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1670 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:13.499607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:13.502198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:13.541157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.541623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.542784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.543232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.771857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:05:13.772404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:05:13.772744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:05:13.773155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:05:13.773571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:05:13.793222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.793681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.794532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.795558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.844591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Getting quotas for project 61055ab8cb474986b82a768b873117a5. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:13.851577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Getting quotas for user 6d02520d88e44fb3a111d3b618465f60 and project 61055ab8cb474986b82a768b873117a5. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:13.870023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:05:13.872834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:05:13.944506 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9fb94356-4b8c-42c8-86c2-7fb0620d45e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.478773 Jun 16 19:05:13.957973 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2593/5287] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:05:13.958377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:13.963942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f324573f-db48-4675-8306-3e22912ae266 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:13.964831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f324573f-db48-4675-8306-3e22912ae266 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:13.966469 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0f194a96-75d1-46ad-8fa4-9eeea955ab86 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1551 microversion: 2.1 time: 0.475763 Jun 16 19:05:13.968865 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2695/5288] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:13 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1551 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:14.062880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f324573f-db48-4675-8306-3e22912ae266 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:14.073366 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f324573f-db48-4675-8306-3e22912ae266 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1213 microversion: 2.1 time: 0.113356 Jun 16 19:05:14.075167 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2594/5289] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:13 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:14.318095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-eef2fe4d-cf93-4624-89d2-f299f17ec4d5 req-572328dc-e36a-4110-a584-557aed13cc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc43b44-7ede-400a-9355-6ad676a768e4", "name": "network-vif-deleted", "tag": "6b9d84b8-ed86-4c31-baa8-0d450f54b672"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:14.333672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-eef2fe4d-cf93-4624-89d2-f299f17ec4d5 req-572328dc-e36a-4110-a584-557aed13cc9e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:14.335220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-eef2fe4d-cf93-4624-89d2-f299f17ec4d5 req-572328dc-e36a-4110-a584-557aed13cc9e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:14.362234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:14.369107 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-eef2fe4d-cf93-4624-89d2-f299f17ec4d5 req-572328dc-e36a-4110-a584-557aed13cc9e service nova] Creating event network-vif-deleted:6b9d84b8-ed86-4c31-baa8-0d450f54b672 for instance 3fc43b44-7ede-400a-9355-6ad676a768e4 on n-h1-846209-2 Jun 16 19:05:14.384577 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-eef2fe4d-cf93-4624-89d2-f299f17ec4d5 req-572328dc-e36a-4110-a584-557aed13cc9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068472 Jun 16 19:05:14.390473 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2696/5290] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:14.985453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:14.986175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:15.005890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.008865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.009669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.017266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.093672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:15.095019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:15.127797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.132828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.134175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.136463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.167295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.167754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.168223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lazy-loading 'fault' on Instance uuid 3fc43b44-7ede-400a-9355-6ad676a768e4 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:05:15.277043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:15.281897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:15.289479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35b98213-0949-445f-aebd-81d918878971 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 200 len: 1337 microversion: 2.1 time: 0.308435 Jun 16 19:05:15.296598 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2595/5291] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:14 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 1337 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:15.400752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:15.411225 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-add3724e-0429-4cec-a44b-863cde047bb9 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1217 microversion: 2.1 time: 0.322826 Jun 16 19:05:15.422273 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2697/5292] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:15 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1217 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:16.308062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.308745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 3fc43b44-7ede-400a-9355-6ad676a768e4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:16.325111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.325936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.331904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.332711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.367381 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] HTTP exception thrown: Instance 3fc43b44-7ede-400a-9355-6ad676a768e4 could not be found. Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Request method failure captured: Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 HTTP/1.1 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq347vDmCN0SXe7bh6BlTiVgY1wzWG3duzDG7LMxiTaVKdDbIGC1wUuq6VLXhTRMLoAvkeffmHskFVsZw--yFcvJ8YjRU1hkSgebk8IfgyhIOENbdUK1MCUFAXyLE7B6n4NKx29VnFyCQWBnm2aafJHuJiF5HKtlz_gdtZQlOMw4UizM Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 833a5d53ee7d4c29a69f7a8cdf47db05 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_833a5d53ee7d4c29a69f7a8cdf47db05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 833a5d53ee7d4c29a69f7a8cdf47db05 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestNetworkBasicOps-2003087479-project Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 179a7e07841645718902076a28fd34cd Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestNetworkBasicOps-2003087479-project Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 3fc43b44-7ede-400a-9355-6ad676a768e4 could not be found. Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '3fc43b44-7ede-400a-9355-6ad676a768e4'} Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc43b44-7ede-400a-9355-6ad676a768e4 could not be found. Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc43b44-7ede-400a-9355-6ad676a768e4 could not be found. Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:16.369405 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.374755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:16.374755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:16.374755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:16.374755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:16.374755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:16.374755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc43b44-7ede-400a-9355-6ad676a768e4 could not be found. Jun 16 19:05:16.374755 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.377545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Returning 404 to user: Instance 3fc43b44-7ede-400a-9355-6ad676a768e4 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:16.378877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d7583ff8-494e-41fa-9598-4f18e59cb799 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4" status: 404 len: 111 microversion: 2.1 time: 0.074773 Jun 16 19:05:16.380033 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2596/5293] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:16 2022] GET /compute/v2.1/servers/3fc43b44-7ede-400a-9355-6ad676a768e4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:16.439839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.441319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:16.449403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.450212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.451343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.452171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.581832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:16.594556 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fbf61c23-fef1-4b32-83fe-c9627f36f00b tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1283 microversion: 2.1 time: 0.159309 Jun 16 19:05:16.606020 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2698/5294] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:16 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:16.733007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-897ee9aa-7996-414a-b4d7-2b5b07f6a1cb tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '.version_select at 0x7f866ddff280>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.747355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:16.806990 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-897ee9aa-7996-414a-b4d7-2b5b07f6a1cb tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-574557703" status: 202 len: 0 microversion: 2.1 time: 0.080113 Jun 16 19:05:16.811705 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2597/5295] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jun 16 19:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-574557703 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:05:17.630352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:17.630352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:17.636902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:17.641226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:17.642157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:17.642673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:17.989310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:17.996972 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b78dc52-b914-45da-9f94-a4b99a99a2e5 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1271 microversion: 2.1 time: 0.378058 Jun 16 19:05:17.999871 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2699/5296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:17 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:19.023283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:19.024599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:19.079188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.079915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.080941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.083424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.005153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:20.028254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-20c3a213-c963-4506-8b9a-4ee5a6b2b6cf tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 1.002393 Jun 16 19:05:20.028918 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2598/5297] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:19 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:21.045781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:21.047216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:21.065437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:21.073165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.074809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:21.075897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.077751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:21.739876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:21.756581 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0ce3dd27-10ac-46c3-9534-e5c7761f17b0 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.715755 Jun 16 19:05:21.759978 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2700/5298] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:21 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:22.777825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:22.778577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:22.807790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:22.811202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:22.814790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:22.815599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:23.141708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c469a5a7-d6f7-4100-b2cc-114c7e448f1d req-62ee1fc5-1ccc-4df6-8e9a-955532698126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706b4228-9e7b-45e0-8e2a-e29708e5cf63", "tag": "3e135755-3cc3-4946-b790-80d50d18e302"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:23.195903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c469a5a7-d6f7-4100-b2cc-114c7e448f1d req-62ee1fc5-1ccc-4df6-8e9a-955532698126 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:23.199577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c469a5a7-d6f7-4100-b2cc-114c7e448f1d req-62ee1fc5-1ccc-4df6-8e9a-955532698126 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:23.249439 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c469a5a7-d6f7-4100-b2cc-114c7e448f1d req-62ee1fc5-1ccc-4df6-8e9a-955532698126 service nova] Creating event network-changed:3e135755-3cc3-4946-b790-80d50d18e302 for instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 on n-h1-846209-2 Jun 16 19:05:23.268298 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c469a5a7-d6f7-4100-b2cc-114c7e448f1d req-62ee1fc5-1ccc-4df6-8e9a-955532698126 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138829 Jun 16 19:05:23.277256 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2701/5299] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:23.582041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:23.595353 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-75f16685-e221-41f8-83f2-23ebb7dbd5ac tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.823100 Jun 16 19:05:23.596109 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2599/5300] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:22 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:24.615158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:24.615979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:24.636827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.640169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.640994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.641441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:25.280900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:25.299042 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f16ebc70-119e-4b42-b964-116c4af1ee26 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.681421 Jun 16 19:05:25.300910 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2702/5301] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:24 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:26.330970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:26.333821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:26.357763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:26.359051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:26.382413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.393146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.394342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.396233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.874144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:26.892732 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1957146-a9e2-4ff4-8c50-0b9d7491cc62 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.579161 Jun 16 19:05:26.910836 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2600/5302] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:26 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:27.911569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:27.912202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:27.938067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:27.938531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:27.949194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:27.950026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:28.605559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:28.617709 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cdd112d7-5010-4f26-861c-662897543470 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.710573 Jun 16 19:05:28.628205 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2703/5303] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:27 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:29.635565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:29.637551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:29.667327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:29.670209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:29.671211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:29.674764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:30.176584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:30.185990 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a5008ced-064b-4db3-9d35-095db5d87848 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.553985 Jun 16 19:05:30.195537 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2601/5304] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:29 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:31.144769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0a1f70b8-96b1-48d5-9340-23dfd95ee737 req-5fd96531-0321-444d-8c3b-b1953c5e7e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706b4228-9e7b-45e0-8e2a-e29708e5cf63", "name": "network-vif-plugged", "status": "completed", "tag": "3e135755-3cc3-4946-b790-80d50d18e302"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:31.166965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0a1f70b8-96b1-48d5-9340-23dfd95ee737 req-5fd96531-0321-444d-8c3b-b1953c5e7e7b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:31.176316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0a1f70b8-96b1-48d5-9340-23dfd95ee737 req-5fd96531-0321-444d-8c3b-b1953c5e7e7b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:31.213031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:31.213657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:31.241939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:31.242721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:31.243275 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0a1f70b8-96b1-48d5-9340-23dfd95ee737 req-5fd96531-0321-444d-8c3b-b1953c5e7e7b service nova] Creating event network-vif-plugged:3e135755-3cc3-4946-b790-80d50d18e302 for instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 on n-h1-846209-2 Jun 16 19:05:31.245964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:31.246431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:31.259742 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0a1f70b8-96b1-48d5-9340-23dfd95ee737 req-5fd96531-0321-444d-8c3b-b1953c5e7e7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118468 Jun 16 19:05:31.263004 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2704/5305] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:31.908730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:31.922923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7cf8d96-54ec-4e4c-bd46-10b5044d3879 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.714477 Jun 16 19:05:31.932185 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2602/5306] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:31 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:32.970239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:32.972038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:32.987237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:32.990637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:32.991866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:32.995857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:33.470059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:33.479175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d7da5d14-adcc-411d-a439-2f1044f70eab tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1313 microversion: 2.1 time: 0.520217 Jun 16 19:05:33.485208 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2705/5307] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:32 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:34.501951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:34.503342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:34.535117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:34.536518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:34.542780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:34.543074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:35.132884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:35.144342 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9dbcf087-41b0-429c-8494-82c82a6d3287 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1497 microversion: 2.1 time: 0.647850 Jun 16 19:05:35.149383 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2603/5308] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:34 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1497 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:36.704606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:36.705415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:36.727659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:36.728284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:36.741952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:36.742690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:36.875190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:37.178958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b5a161a-a837-4b2a-a47a-9c7baa12f080 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "DELETE /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 204 len: 0 microversion: 2.1 time: 0.478374 Jun 16 19:05:37.180488 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2706/5309] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:36 2022] DELETE /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:37.188881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:37.190293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:37.204933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:37.205398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:37.218797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:37.219495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:38.182347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:38.192060 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e5d95dab-ce8b-4acb-b0a9-3d55b69f1009 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1503 microversion: 2.1 time: 1.007254 Jun 16 19:05:38.208818 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2604/5310] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:37 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1503 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:39.209248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:39.210147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:39.254090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:39.255282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:39.256368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:39.257052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:40.204565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:40.262323 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b74f5bcf-e028-4e53-8841-61ec4321b170 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1503 microversion: 2.1 time: 1.053331 Jun 16 19:05:40.270182 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2707/5311] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:39 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1503 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:41.284658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:41.288073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:41.299829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:41.304873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.305718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:41.306205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.351530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-8a69f68b-50dc-417f-ae8f-64c60354f4fd req-c3df2efe-b58a-41f9-859c-bb57ce16fe4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706b4228-9e7b-45e0-8e2a-e29708e5cf63", "name": "network-vif-deleted", "tag": "3e135755-3cc3-4946-b790-80d50d18e302"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:41.377164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8a69f68b-50dc-417f-ae8f-64c60354f4fd req-c3df2efe-b58a-41f9-859c-bb57ce16fe4f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:41.382216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-8a69f68b-50dc-417f-ae8f-64c60354f4fd req-c3df2efe-b58a-41f9-859c-bb57ce16fe4f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.418515 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-8a69f68b-50dc-417f-ae8f-64c60354f4fd req-c3df2efe-b58a-41f9-859c-bb57ce16fe4f service nova] Creating event network-vif-deleted:3e135755-3cc3-4946-b790-80d50d18e302 for instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 on n-h1-846209-2 Jun 16 19:05:41.426783 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-8a69f68b-50dc-417f-ae8f-64c60354f4fd req-c3df2efe-b58a-41f9-859c-bb57ce16fe4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080093 Jun 16 19:05:41.428957 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2708/5312] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:41.584883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d02520d88e44fb3a111d3b618465f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61055ab8cb474986b82a768b873117a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:41.594176 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ae228ff-ed24-4c8f-ac9b-fb875bdce8b4 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 200 len: 1461 microversion: 2.1 time: 0.313600 Jun 16 19:05:41.614344 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2605/5313] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:41 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 1461 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:42.613590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:42.614375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] [instance: 706b4228-9e7b-45e0-8e2a-e29708e5cf63] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:42.635910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:42.638914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:42.641946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:42.642995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:42.729007 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] HTTP exception thrown: Instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 could not be found. Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Request method failure captured: Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 HTTP/1.1 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq37LaFm6jYN_cJ-Ai5FnyCN7G0ZJRShwnWN5WqAyQwC_wZDs9w62XjyKbmRUFcUKj7ANDSPL9mpVy594Y8I_HlNR6R5K0Iyjsmcm-iMHvIFEA-AsjfxVWdDtaD6XeNOts-Y9VKrQ6wUbTEBFMNgOAMuzkxtEYmZkmYhS8HH7bK9CFtk Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 61055ab8cb474986b82a768b873117a5 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesActionsTest-2015034402 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61055ab8cb474986b82a768b873117a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61055ab8cb474986b82a768b873117a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61055ab8cb474986b82a768b873117a5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61055ab8cb474986b82a768b873117a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesActionsTest-2015034402 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 61055ab8cb474986b82a768b873117a5 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesActionsTest-2015034402 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesActionsTest-2015034402-project Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d02520d88e44fb3a111d3b618465f60 Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesActionsTest-2015034402-project Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 could not be found. Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '706b4228-9e7b-45e0-8e2a-e29708e5cf63'} Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 could not be found. Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 could not be found. Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:42.730822 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 could not be found. Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] Returning 404 to user: Instance 706b4228-9e7b-45e0-8e2a-e29708e5cf63 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:42.739269 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4e75df0c-3c6e-4248-9a33-4dfa86dbee23 tempest-VolumesActionsTest-2015034402 tempest-VolumesActionsTest-2015034402-project] 10.222.0.27 "GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63" status: 404 len: 111 microversion: 2.1 time: 0.125250 Jun 16 19:05:42.759382 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2709/5314] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:42 2022] GET /compute/v2.1/servers/706b4228-9e7b-45e0-8e2a-e29708e5cf63 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:45.168532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16589e54-9803-4b3f-980a-7e62d6e5fc2b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'create', calling method: .version_select at 0x7f867802ee50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-200523221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzSfcAKHd9YCnU+MRIN1yUxF+HaEyP156Skpjal3w6+Yh1gjnyXh5IH6belwHstRnGoc3BBIvC0NWOGyrK2GVresR9QoJv0w6ybioQ7G6p8gAoKG536ucGaX+Wkcwc6sg=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:45.230761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-16589e54-9803-4b3f-980a-7e62d6e5fc2b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:45.255564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-16589e54-9803-4b3f-980a-7e62d6e5fc2b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for user 179a7e07841645718902076a28fd34cd and project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:45.312076 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16589e54-9803-4b3f-980a-7e62d6e5fc2b tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.150033 Jun 16 19:05:45.319293 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2606/5315] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:05:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:46.321094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:46.321707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:46.340078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:46.341471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:46.348644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:46.349877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:46.469946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:46.503195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:46.840535 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d7d8ef92-873e-4b33-b785-10a9b1978091 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 204 len: 0 microversion: 2.1 time: 1.033884 Jun 16 19:05:46.846107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2710/5316] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:45 2022] DELETE /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:46.851983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:46.853327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:46.861010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:46.863607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:46.864344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:46.867224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:46.868029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:46.903429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=51 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:47.394179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:47.404939 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-674e8846-e202-42bb-b81e-a20fb1333c3f tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1732 microversion: 2.1 time: 0.557464 Jun 16 19:05:47.409763 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2607/5317] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:46 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1732 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:48.432059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:48.433455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:48.449433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:48.450490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:48.452693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:48.455754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:49.256232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:49.274734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-759139709", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "c9012869-c5c6-4c3d-8bd4-5e9d0ddda104"}], "key_name": "tempest-TestNetworkBasicOps-200523221", "security_groups": [{"name": "tempest-secgroup-smoke-618525802"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:49.300449 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8fda0eae-8a5b-471a-b5b2-63ad38d396fd tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1732 microversion: 2.1 time: 0.876614 Jun 16 19:05:49.314782 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2711/5318] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:48 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1732 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:49.526662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] validate_networks() for [('c9012869-c5c6-4c3d-8bd4-5e9d0ddda104', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:05:50.342955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:50.343706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:50.383292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:50.388442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:50.389451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:50.389947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:51.670113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:51.679816 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-17f5ece7-40f7-4582-ac59-74a97c5f194b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1732 microversion: 2.1 time: 1.349714 Jun 16 19:05:51.679816 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2712/5319] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:50 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1732 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:52.027854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:05:52.029051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:05:52.029635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:05:52.030678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:05:52.031122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:05:52.044389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:52.044820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:52.045695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:52.046969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:52.071925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:52.080729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Getting quotas for user 179a7e07841645718902076a28fd34cd and project 833a5d53ee7d4c29a69f7a8cdf47db05. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:52.121026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:05:52.127879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:05:52.478374 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c9aff130-6f5f-417f-9e07-2bedaaa3ffb0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.225199 Jun 16 19:05:52.491629 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2608/5320] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:05:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 3239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:05:52.498259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6be48a1-20d0-47f8-8d0c-72daff02c49d tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:52.499216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6be48a1-20d0-47f8-8d0c-72daff02c49d tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:52.507895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:52.703586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:52.706033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:52.744720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:52.745185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:52.746012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:52.755677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:52.832710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6be48a1-20d0-47f8-8d0c-72daff02c49d tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:52.840127 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6be48a1-20d0-47f8-8d0c-72daff02c49d tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1247 microversion: 2.1 time: 0.346438 Jun 16 19:05:52.841442 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2713/5321] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:52 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1247 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:53.547381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4dee9635fd444288993a8846d42d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f208e93647784ae5852556a9ad5dc998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:53.636409 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-46af4e4a-9601-4251-9d47-ef54c3c11f17 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 200 len: 1664 microversion: 2.1 time: 0.936425 Jun 16 19:05:53.673683 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2609/5322] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:52 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 1664 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:53.870363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-310d3d95-ad61-4908-b4d6-aad470e19e6e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:53.874812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b78bf3b6-221a-4840-99e9-1905af0157bf req-5e4acfae-b0ed-4e59-aeb0-07e5cce3b8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa02b11b-4240-493b-bd1c-8244c1fcd464", "name": "network-vif-deleted", "tag": "6104b4f0-d730-4ecc-bd1a-4a45713a1758"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:53.875368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-310d3d95-ad61-4908-b4d6-aad470e19e6e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:53.919113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b78bf3b6-221a-4840-99e9-1905af0157bf req-5e4acfae-b0ed-4e59-aeb0-07e5cce3b8d6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:53.919926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b78bf3b6-221a-4840-99e9-1905af0157bf req-5e4acfae-b0ed-4e59-aeb0-07e5cce3b8d6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:53.965053 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b78bf3b6-221a-4840-99e9-1905af0157bf req-5e4acfae-b0ed-4e59-aeb0-07e5cce3b8d6 service nova] Creating event network-vif-deleted:6104b4f0-d730-4ecc-bd1a-4a45713a1758 for instance aa02b11b-4240-493b-bd1c-8244c1fcd464 on n-h1-846209-2 Jun 16 19:05:54.000370 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b78bf3b6-221a-4840-99e9-1905af0157bf req-5e4acfae-b0ed-4e59-aeb0-07e5cce3b8d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422159 Jun 16 19:05:54.010925 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2714/5323] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:54.056148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-310d3d95-ad61-4908-b4d6-aad470e19e6e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:54.064960 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-310d3d95-ad61-4908-b4d6-aad470e19e6e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1247 microversion: 2.1 time: 0.210324 Jun 16 19:05:54.081034 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2610/5324] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:53 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1247 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:54.664291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:54.665407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:54.681072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:54.699622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:54.700601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:54.701128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:54.800577 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] HTTP exception thrown: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Request method failure captured: Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 HTTP/1.1 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq32386ZqRjU2eyUgs8ix_X9foU73RfRByIvTZo0v6-s_gY7pxFdG0_OHomBuIEbc00vQ565v8ASD7Hm01ZgiSLfRLa9iN4GAFhw00HPdQon11VWlN-X0sFfGOgVsnzehqb_EywCL9z4TjCQIs2jma7Pi6Kq6Oag_tetxAkDxA710wqc Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f208e93647784ae5852556a9ad5dc998 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f208e93647784ae5852556a9ad5dc998", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f208e93647784ae5852556a9ad5dc998 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestServerBasicOps-1946082884-project Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: bd4dee9635fd444288993a8846d42d75 Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestServerBasicOps-1946082884-project Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'aa02b11b-4240-493b-bd1c-8244c1fcd464'} Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:54.824533 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:54.830945 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:54.830945 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:54.830945 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:54.830945 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:54.830945 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:54.830945 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:54.830945 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:54.835328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Returning 404 to user: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:54.835328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b3218a4-a2e5-48d9-a4c8-9de934b3fa71 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 404 len: 111 microversion: 2.1 time: 0.176318 Jun 16 19:05:54.835328 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2715/5325] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:54 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:55.089006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:55.090336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:55.115831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:55.120236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:55.124488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:55.125333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:55.560712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:55.575583 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc3d871a-8fbb-41c7-a9a2-0f05b8e9571e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1299 microversion: 2.1 time: 0.489450 Jun 16 19:05:55.578660 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2611/5326] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:55 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1299 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:56.595703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:56.596542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:56.610100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:56.613652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:56.621425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:56.622113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:57.833505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:57.878818 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-251607ff-3d52-4ad9-8e3a-008cf0c701c2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1305 microversion: 2.1 time: 1.285354 Jun 16 19:05:57.886732 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2716/5327] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:56 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1305 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:58.620348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:58.620973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:58.647123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.647708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.648570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.649016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.767399 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] HTTP exception thrown: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Request method failure captured: Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 HTTP/1.1 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq32386ZqRjU2eyUgs8ix_X9foU73RfRByIvTZo0v6-s_gY7pxFdG0_OHomBuIEbc00vQ565v8ASD7Hm01ZgiSLfRLa9iN4GAFhw00HPdQon11VWlN-X0sFfGOgVsnzehqb_EywCL9z4TjCQIs2jma7Pi6Kq6Oag_tetxAkDxA710wqc Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: f208e93647784ae5852556a9ad5dc998 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f208e93647784ae5852556a9ad5dc998", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: f208e93647784ae5852556a9ad5dc998 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestServerBasicOps-1946082884-project Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: bd4dee9635fd444288993a8846d42d75 Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestServerBasicOps-1946082884-project Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'aa02b11b-4240-493b-bd1c-8244c1fcd464'} Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:58.769007 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.774677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Returning 404 to user: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:58.781792 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d72f9f1b-eabf-4e29-8aaa-0d887236bb50 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 404 len: 111 microversion: 2.1 time: 0.167020 Jun 16 19:05:58.782687 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2612/5328] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:58 2022] DELETE /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:05:58.791498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:58.792207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] [instance: aa02b11b-4240-493b-bd1c-8244c1fcd464] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:58.826637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.827113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.827922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.828368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.890501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] HTTP exception thrown: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Request method failure captured: Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 HTTP/1.1 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq32386ZqRjU2eyUgs8ix_X9foU73RfRByIvTZo0v6-s_gY7pxFdG0_OHomBuIEbc00vQ565v8ASD7Hm01ZgiSLfRLa9iN4GAFhw00HPdQon11VWlN-X0sFfGOgVsnzehqb_EywCL9z4TjCQIs2jma7Pi6Kq6Oag_tetxAkDxA710wqc Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: f208e93647784ae5852556a9ad5dc998 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f208e93647784ae5852556a9ad5dc998", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f208e93647784ae5852556a9ad5dc998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: f208e93647784ae5852556a9ad5dc998 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestServerBasicOps-1946082884 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestServerBasicOps-1946082884-project Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: bd4dee9635fd444288993a8846d42d75 Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestServerBasicOps-1946082884-project Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'aa02b11b-4240-493b-bd1c-8244c1fcd464'} Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:58.895773 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Returning 404 to user: Instance aa02b11b-4240-493b-bd1c-8244c1fcd464 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:58.901235 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a323d1d-1231-472c-a81d-42b1edee9c57 tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464" status: 404 len: 111 microversion: 2.1 time: 0.112077 Jun 16 19:05:58.902868 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2717/5329] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:58 2022] GET /compute/v2.1/servers/aa02b11b-4240-493b-bd1c-8244c1fcd464 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:58.904158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:58.904791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:58.947263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.947775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.948612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.949058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:59.307222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:59.316228 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1525d312-d58f-4598-9637-88515a2b09e0 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1305 microversion: 2.1 time: 0.416352 Jun 16 19:05:59.327912 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2613/5330] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:58 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1305 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:59.415812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd06d5df-72e2-4b1e-bfaf-ef5eb4f8463b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] Calling method '.version_select at 0x7f866ebbe8b0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:59.482666 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd06d5df-72e2-4b1e-bfaf-ef5eb4f8463b tempest-TestServerBasicOps-1946082884 tempest-TestServerBasicOps-1946082884-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-247393980" status: 202 len: 0 microversion: 2.1 time: 0.070391 Jun 16 19:05:59.506132 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2718/5331] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jun 16 19:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-247393980 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:06:00.347348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:00.348727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:00.370935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:00.372703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:00.373973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:00.376450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:00.710107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:00.733736 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-de04ff14-90f5-4573-98ca-a03cb81f9789 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1305 microversion: 2.1 time: 0.385994 Jun 16 19:06:00.738242 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2614/5332] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:00 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1305 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:01.752883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:01.753457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:01.766836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:01.786579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:01.791529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:01.792126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.658084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:02.667427 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15a25e94-a86a-4105-a49d-a1d197c9bbab tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 0.918653 Jun 16 19:06:02.670213 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2719/5333] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:01 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:03.683784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:03.689026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:03.689674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:03.711668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ffbf55cc-7cbe-475e-8155-1e40c30b867a req-b82d39f9-a553-4cce-b01b-76764f3d537c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f865bf1-1262-4ffe-8a33-fe472b5ac0c8", "tag": "f2ffacba-220a-4ec1-9623-df54cae9ec9a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:03.717562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:03.723239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.723239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.723239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.723639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.745447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ffbf55cc-7cbe-475e-8155-1e40c30b867a req-b82d39f9-a553-4cce-b01b-76764f3d537c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.747096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ffbf55cc-7cbe-475e-8155-1e40c30b867a req-b82d39f9-a553-4cce-b01b-76764f3d537c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.815606 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ffbf55cc-7cbe-475e-8155-1e40c30b867a req-b82d39f9-a553-4cce-b01b-76764f3d537c service nova] Creating event network-changed:f2ffacba-220a-4ec1-9623-df54cae9ec9a for instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 on n-h1-846209-2 Jun 16 19:06:03.855820 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ffbf55cc-7cbe-475e-8155-1e40c30b867a req-b82d39f9-a553-4cce-b01b-76764f3d537c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147850 Jun 16 19:06:03.856482 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2720/5334] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:06:04.061450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:04.694439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:04.708665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-86f96d31-9394-489f-9855-b0b6af819dd7 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 1.026152 Jun 16 19:06:04.717969 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2615/5335] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:03 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:05.730572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:05.731826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:05.754043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.755294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:05.756264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.757211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.290705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:06.300961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24a5da5e-a077-4398-8ea1-fd0ea54aa67c tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 0.575979 Jun 16 19:06:06.317574 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2721/5336] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:05 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:07.326352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:07.326985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:07.360731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.361516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.362562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.374820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.860893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:07.869215 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff26c407-bc89-4f0c-ab6f-d4f16274cba4 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 0.548168 Jun 16 19:06:07.885409 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2616/5337] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:07 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:08.890496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:08.891120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:08.916942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:08.917406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:08.930382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:08.930851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:09.650760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:09.665518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5d74328e-9ee4-4847-9b87-27dc757732f1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 0.778904 Jun 16 19:06:09.679614 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2722/5338] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:08 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:10.687767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:10.689303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:10.706894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.719240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:10.722859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.726410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:11.944772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:11.953295 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-76af0dee-2716-4a8b-a1ed-8bdf6f2d7aac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 1.270508 Jun 16 19:06:11.954524 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2617/5339] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:10 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:12.982219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:12.982925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:13.020132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:13.020597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.021432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:13.021858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.419976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5f2f003f-429c-497e-8dac-f7e655c0f0a9 req-95e7cc86-45f1-41dc-aa7c-c86b9439f3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f865bf1-1262-4ffe-8a33-fe472b5ac0c8", "name": "network-vif-plugged", "status": "completed", "tag": "f2ffacba-220a-4ec1-9623-df54cae9ec9a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:13.462538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5f2f003f-429c-497e-8dac-f7e655c0f0a9 req-95e7cc86-45f1-41dc-aa7c-c86b9439f3fa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:13.485214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5f2f003f-429c-497e-8dac-f7e655c0f0a9 req-95e7cc86-45f1-41dc-aa7c-c86b9439f3fa service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.517533 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5f2f003f-429c-497e-8dac-f7e655c0f0a9 req-95e7cc86-45f1-41dc-aa7c-c86b9439f3fa service nova] Creating event network-vif-plugged:f2ffacba-220a-4ec1-9623-df54cae9ec9a for instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 on n-h1-846209-2 Jun 16 19:06:13.528683 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5f2f003f-429c-497e-8dac-f7e655c0f0a9 req-95e7cc86-45f1-41dc-aa7c-c86b9439f3fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112270 Jun 16 19:06:13.529950 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2618/5340] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:14.202480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:14.220250 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5baf0061-5cf1-4332-b229-e1c4ed0d30f2 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 1.252960 Jun 16 19:06:14.230040 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2723/5341] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:12 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:15.240441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:15.241158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:15.263560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.264020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.264841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.265261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.832255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:15.840987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-096b06b6-60d6-40fe-a0f3-2114f5892589 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1372 microversion: 2.1 time: 0.607356 Jun 16 19:06:15.841697 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2619/5342] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:15 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1372 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:16.861399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:16.862270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:16.884751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:16.891684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:16.894576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:16.899879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:16.987537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:17.706886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:17.736500 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-129aeb0a-6872-4adf-a426-79c1099994f5 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1544 microversion: 2.1 time: 0.881485 Jun 16 19:06:17.744020 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2724/5343] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:16 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1544 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:17.762703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:17.764134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:17.777367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:17.784751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.785661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.803155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.812263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.863736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=60 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:18.480070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:18.503165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98875dcf-7020-4cd2-bfdf-51432cea806a tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1544 microversion: 2.1 time: 0.747092 Jun 16 19:06:18.515832 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2620/5344] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:17 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1544 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:26.885359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:27.172057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-02193dbc-7f0b-4f83-a846-834be0e38db0 req-5ce20af9-bd79-46ea-9804-963cb6df89cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f865bf1-1262-4ffe-8a33-fe472b5ac0c8", "tag": "f2ffacba-220a-4ec1-9623-df54cae9ec9a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:27.192183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-02193dbc-7f0b-4f83-a846-834be0e38db0 req-5ce20af9-bd79-46ea-9804-963cb6df89cc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:27.192642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-02193dbc-7f0b-4f83-a846-834be0e38db0 req-5ce20af9-bd79-46ea-9804-963cb6df89cc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:27.243175 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-02193dbc-7f0b-4f83-a846-834be0e38db0 req-5ce20af9-bd79-46ea-9804-963cb6df89cc service nova] Creating event network-changed:f2ffacba-220a-4ec1-9623-df54cae9ec9a for instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 on n-h1-846209-2 Jun 16 19:06:27.264326 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-02193dbc-7f0b-4f83-a846-834be0e38db0 req-5ce20af9-bd79-46ea-9804-963cb6df89cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.829350 Jun 16 19:06:27.281240 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2725/5345] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:28.681384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1204187026", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "a54d773e-db02-4085-9d4e-a50d22e99ccc"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:28.696845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:28.697506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=5 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:28.902703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] validate_networks() for [('a54d773e-db02-4085-9d4e-a50d22e99ccc', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:06:30.642159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:06:30.642790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:06:30.643096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:06:30.644106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:06:30.644548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:06:30.670422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:30.670891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:30.671717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:30.672164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:30.779379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Getting quotas for project e1cc7de4264b46bb8e056a6258989c62. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:06:30.796250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Getting quotas for user 8a0e4e318982415eae2d2cd2f0d98a35 and project e1cc7de4264b46bb8e056a6258989c62. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:06:30.860429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:06:30.872121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:06:31.091597 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c6b89d10-39a9-405a-8888-4da776ea7ff6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414046 Jun 16 19:06:31.094984 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2621/5346] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:06:31.103841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2918bee-781b-4d02-a321-f40fbf6367db tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:31.104571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a2918bee-781b-4d02-a321-f40fbf6367db tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:31.511296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2918bee-781b-4d02-a321-f40fbf6367db tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:31.519073 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2918bee-781b-4d02-a321-f40fbf6367db tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1219 microversion: 2.1 time: 0.420341 Jun 16 19:06:31.534273 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2726/5347] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:31 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1219 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:32.541405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2dcbf21a-c39b-478d-8152-e67e7324beae tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:32.542912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2dcbf21a-c39b-478d-8152-e67e7324beae tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:33.168279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2dcbf21a-c39b-478d-8152-e67e7324beae tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:33.175820 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2dcbf21a-c39b-478d-8152-e67e7324beae tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1219 microversion: 2.1 time: 0.638610 Jun 16 19:06:33.178578 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2622/5348] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:32 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1219 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:34.195917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:34.196555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:34.220927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:34.221490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:34.236847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:34.237337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:34.470979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:34.493377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2d5fd054-9071-44e8-9ddc-ffdab4ee2118 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1277 microversion: 2.1 time: 0.301387 Jun 16 19:06:34.499787 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2727/5349] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:34 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:35.515077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:35.515831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:35.547266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.547739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:35.548532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.548982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:36.075564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:36.088981 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f02062ff-826f-472d-b2f9-ca946b0f3f75 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1319 microversion: 2.1 time: 0.578984 Jun 16 19:06:36.090100 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2623/5350] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:35 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:37.107044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:37.107678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:37.116181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:37.124244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:37.125344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:37.126142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:37.678832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-05b6e3d4-fa48-457f-8ba9-0d68dec025b1 req-9fb7d770-1ddb-4bd6-a07f-5b885bbe95d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b2c51f-33f4-4602-b0ae-4a33b56ddbbd", "tag": "87ff5177-6ee8-447c-9f61-973b2dbd5be4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:37.707008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-05b6e3d4-fa48-457f-8ba9-0d68dec025b1 req-9fb7d770-1ddb-4bd6-a07f-5b885bbe95d6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:37.715392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-05b6e3d4-fa48-457f-8ba9-0d68dec025b1 req-9fb7d770-1ddb-4bd6-a07f-5b885bbe95d6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:37.779312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-05b6e3d4-fa48-457f-8ba9-0d68dec025b1 req-9fb7d770-1ddb-4bd6-a07f-5b885bbe95d6 service nova] Creating event network-changed:87ff5177-6ee8-447c-9f61-973b2dbd5be4 for instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd on n-h1-846209-2 Jun 16 19:06:37.805387 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-05b6e3d4-fa48-457f-8ba9-0d68dec025b1 req-9fb7d770-1ddb-4bd6-a07f-5b885bbe95d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129877 Jun 16 19:06:37.806566 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2624/5351] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:38.166831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:38.176548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-80f97f2c-63ee-415f-8b89-156234b921e4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1319 microversion: 2.1 time: 1.074373 Jun 16 19:06:38.178519 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2728/5352] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:37 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1319 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:39.196626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:39.207827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:39.241094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.244850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.249408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.250355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.640649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:39.671125 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-30026cbf-eb24-417b-8bb3-ebad31571862 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1319 microversion: 2.1 time: 0.480198 Jun 16 19:06:39.674966 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2625/5353] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:39 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:40.693594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:40.694907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:40.710157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:40.713562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:40.718053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:40.723275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:41.254312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:41.268854 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-168df420-1374-4c82-bc45-7ceb09a0edc6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1319 microversion: 2.1 time: 0.576561 Jun 16 19:06:41.270135 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2729/5354] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:40 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:42.137524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-46b60b3f-5ca3-4c24-80e1-778ce311f26e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:42.138554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-46b60b3f-5ca3-4c24-80e1-778ce311f26e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:42.164524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:42.166559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46b60b3f-5ca3-4c24-80e1-778ce311f26e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:42.167305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46b60b3f-5ca3-4c24-80e1-778ce311f26e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:42.168038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46b60b3f-5ca3-4c24-80e1-778ce311f26e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:42.175856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-46b60b3f-5ca3-4c24-80e1-778ce311f26e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:42.277452 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-46b60b3f-5ca3-4c24-80e1-778ce311f26e tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8/action" status: 200 len: 24549 microversion: 2.1 time: 0.142597 Jun 16 19:06:42.286847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:42.288312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:42.290675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:42.305418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2626/5355] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:06:42 2022] POST /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8/action => generated 24549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:06:42.333128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:42.336511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:42.337652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:42.338560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:42.817756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:42.828190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-21efc6db-9e7c-4e13-b728-59e4bef14598 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1319 microversion: 2.1 time: 0.545405 Jun 16 19:06:42.839349 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2730/5356] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:42 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:43.381388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f330738b-e2ef-4eb1-a8cf-a17aed2ec39b req-3c0a8912-d934-49c6-a3ef-e748ee5d6d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b2c51f-33f4-4602-b0ae-4a33b56ddbbd", "name": "network-vif-plugged", "status": "completed", "tag": "87ff5177-6ee8-447c-9f61-973b2dbd5be4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:43.409342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=8 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:43.419083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f330738b-e2ef-4eb1-a8cf-a17aed2ec39b req-3c0a8912-d934-49c6-a3ef-e748ee5d6d96 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:43.428107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f330738b-e2ef-4eb1-a8cf-a17aed2ec39b req-3c0a8912-d934-49c6-a3ef-e748ee5d6d96 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:43.468017 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f330738b-e2ef-4eb1-a8cf-a17aed2ec39b req-3c0a8912-d934-49c6-a3ef-e748ee5d6d96 service nova] Creating event network-vif-plugged:87ff5177-6ee8-447c-9f61-973b2dbd5be4 for instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd on n-h1-846209-2 Jun 16 19:06:43.491606 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f330738b-e2ef-4eb1-a8cf-a17aed2ec39b req-3c0a8912-d934-49c6-a3ef-e748ee5d6d96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115598 Jun 16 19:06:43.492977 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2627/5357] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:43.855630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:43.856861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:43.865448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:43.866105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:43.867031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:43.868100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:44.273245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:44.283541 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6defe144-7a21-4356-82c9-84d44ba15f34 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1319 microversion: 2.1 time: 0.431855 Jun 16 19:06:44.287962 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2731/5358] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:43 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:45.305821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:45.307104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:45.332354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:45.334913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:45.335750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:45.336196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:45.603135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:45.616556 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d0dba03d-e892-4f36-a8de-2a0ed0f21e45 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1319 microversion: 2.1 time: 0.313173 Jun 16 19:06:45.618490 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2628/5359] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:45 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:46.649221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:46.649860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:46.667491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:46.671904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:46.673007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:46.673471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:46.972400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:46.981566 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4f8c8541-350d-416d-b6ac-665ee7c3f833 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1508 microversion: 2.1 time: 0.350763 Jun 16 19:06:46.988173 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2732/5360] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:46 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:53.192701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-20d25631-6212-43a0-a21e-c127dfff5ba3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:53.193938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-20d25631-6212-43a0-a21e-c127dfff5ba3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:53.210409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d25631-6212-43a0-a21e-c127dfff5ba3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:53.214685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d25631-6212-43a0-a21e-c127dfff5ba3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:53.215840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d25631-6212-43a0-a21e-c127dfff5ba3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:53.221077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20d25631-6212-43a0-a21e-c127dfff5ba3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:53.375776 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-20d25631-6212-43a0-a21e-c127dfff5ba3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "POST /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8/action" status: 200 len: 32630 microversion: 2.1 time: 0.183400 Jun 16 19:06:53.383618 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2629/5361] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:06:53 2022] POST /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8/action => generated 32630 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:06:55.807413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:55.807952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:55.819739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:55.820293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:55.821013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:55.821469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:55.837565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b86e1c99-3de0-4574-aef0-311b53eb3ca3 req-0f3f7825-8806-450d-b212-03577069f37c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f865bf1-1262-4ffe-8a33-fe472b5ac0c8", "tag": "f2ffacba-220a-4ec1-9623-df54cae9ec9a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:55.858919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b86e1c99-3de0-4574-aef0-311b53eb3ca3 req-0f3f7825-8806-450d-b212-03577069f37c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:55.861641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b86e1c99-3de0-4574-aef0-311b53eb3ca3 req-0f3f7825-8806-450d-b212-03577069f37c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:55.892643 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b86e1c99-3de0-4574-aef0-311b53eb3ca3 req-0f3f7825-8806-450d-b212-03577069f37c service nova] Creating event network-changed:f2ffacba-220a-4ec1-9623-df54cae9ec9a for instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 on n-h1-846209-2 Jun 16 19:06:55.911187 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b86e1c99-3de0-4574-aef0-311b53eb3ca3 req-0f3f7825-8806-450d-b212-03577069f37c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078542 Jun 16 19:06:55.919637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=44 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:55.921474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2630/5362] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:55.939169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:06:56.188714 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f895a745-454c-40d0-8a1e-06e9d9863eac tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 204 len: 0 microversion: 2.1 time: 0.385224 Jun 16 19:06:56.190247 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2733/5363] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:55 2022] DELETE /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:56.201655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:56.202411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:56.225418 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:56.225869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:56.235245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:56.235917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:56.563851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:56.575734 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5004dfc2-91a4-46b5-8a1b-ca5e697cb516 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1668 microversion: 2.1 time: 0.380522 Jun 16 19:06:56.588588 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2631/5364] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:56 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:57.599528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:57.601448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:57.611531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:57.613620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:57.615109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:57.616141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:57.628622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:58.113659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:58.132958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-65879fe6-9688-4a1c-8844-2e65e4182185 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1668 microversion: 2.1 time: 0.543415 Jun 16 19:06:58.134292 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2734/5365] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:57 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1668 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:58.703885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-329e1ca8-2882-4096-ad30-f41ea91214b4 req-e2b04eb7-ad90-4472-8d87-30d186000c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f865bf1-1262-4ffe-8a33-fe472b5ac0c8", "name": "network-vif-deleted", "tag": "f2ffacba-220a-4ec1-9623-df54cae9ec9a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:58.720435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-329e1ca8-2882-4096-ad30-f41ea91214b4 req-e2b04eb7-ad90-4472-8d87-30d186000c15 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:58.720897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-329e1ca8-2882-4096-ad30-f41ea91214b4 req-e2b04eb7-ad90-4472-8d87-30d186000c15 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:58.735708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=42 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:58.740238 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-329e1ca8-2882-4096-ad30-f41ea91214b4 req-e2b04eb7-ad90-4472-8d87-30d186000c15 service nova] Creating event network-vif-deleted:f2ffacba-220a-4ec1-9623-df54cae9ec9a for instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 on n-h1-846209-2 Jun 16 19:06:58.748894 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-329e1ca8-2882-4096-ad30-f41ea91214b4 req-e2b04eb7-ad90-4472-8d87-30d186000c15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048604 Jun 16 19:06:58.752651 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2632/5366] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:59.155812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:59.157263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:59.165178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:59.165983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:59.169445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:59.171855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:59.285731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:59.287911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:59.288387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lazy-loading 'fault' on Instance uuid 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:59.433422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179a7e07841645718902076a28fd34cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833a5d53ee7d4c29a69f7a8cdf47db05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:59.448857 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-63a2b165-eb2c-4051-b2f1-25449f6b88e3 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 200 len: 1337 microversion: 2.1 time: 0.299050 Jun 16 19:06:59.450384 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2735/5367] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:59 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 1337 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:00.468364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:00.469369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] [instance: 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:00.473232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:00.482546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:00.483324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:00.484333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:00.484776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:00.506640 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] HTTP exception thrown: Instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 could not be found. Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Request method failure captured: Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 HTTP/1.1 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq347vDmCN0SXe7bh6BlTiVgY1wzWG3duzDG7LMxiTaVKdDbIGC1wUuq6VLXhTRMLoAvkeffmHskFVsZw--yFcvJ8YjRU1hkSgebk8IfgyhIOENbdUK1MCUFAXyLE7B6n4NKx29VnFyCQWBnm2aafJHuJiF5HKtlz_gdtZQlOMw4UizM Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 833a5d53ee7d4c29a69f7a8cdf47db05 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_833a5d53ee7d4c29a69f7a8cdf47db05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/833a5d53ee7d4c29a69f7a8cdf47db05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 833a5d53ee7d4c29a69f7a8cdf47db05 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestNetworkBasicOps-2003087479 Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestNetworkBasicOps-2003087479-project Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 179a7e07841645718902076a28fd34cd Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestNetworkBasicOps-2003087479-project Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 could not be found. Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '1f865bf1-1262-4ffe-8a33-fe472b5ac0c8'} Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 could not be found. Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 could not be found. Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:00.508968 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.512877 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.512877 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:00.512877 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:00.512877 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:00.512877 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:00.512877 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 could not be found. Jun 16 19:07:00.512877 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.514725 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Returning 404 to user: Instance 1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:00.516152 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-64ed4f7f-f6c8-46c0-8ce1-2392d01bd395 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8" status: 404 len: 111 microversion: 2.1 time: 0.052883 Jun 16 19:07:00.517400 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2633/5368] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:00 2022] GET /compute/v2.1/servers/1f865bf1-1262-4ffe-8a33-fe472b5ac0c8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:00.767722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-331e5d22-770c-4810-82e9-0af91ce1a4d1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] Calling method '.version_select at 0x7f8678178670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:00.796780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-331e5d22-770c-4810-82e9-0af91ce1a4d1 tempest-TestNetworkBasicOps-2003087479 tempest-TestNetworkBasicOps-2003087479-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-200523221" status: 202 len: 0 microversion: 2.1 time: 0.033882 Jun 16 19:07:00.799672 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2736/5369] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jun 16 19:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-200523221 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:07:06.074153 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:07:06.074153 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:07:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:07:10.621259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:10.623296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:10.880835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-58c7546f-1f15-4f36-907f-636878cd003a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Action: 'create', calling method: .version_select at 0x7f866de6c670>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-387819499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuHk6Z7OTM5SJG61bkVhkJ1vHkIqfJQ35KN913ytNvCKVMkyg1aUc5p41erhD/rylTPNn3zWpiWtnyVT2LZiPBvPu0PCyrWV4i6pz+kuOX1rLRi9WrUZeI24f3/JL1uLA=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:10.898394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-58c7546f-1f15-4f36-907f-636878cd003a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Getting quotas for project 92f67ad598e946e9addd1e51e3388262. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:10.907142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-58c7546f-1f15-4f36-907f-636878cd003a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Getting quotas for user c5ee1f41ae174f30aed066d3623c12a6 and project 92f67ad598e946e9addd1e51e3388262. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:10.936860 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-58c7546f-1f15-4f36-907f-636878cd003a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.324352 Jun 16 19:07:10.937803 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2634/5370] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:07:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:21.815183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:21.815937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:21.821386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1571610142-access_point-1663068562", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "5b69e414-cd47-4515-afb0-5a3bb33c4570"}], "key_name": "tempest-TestSecurityGroupsBasicOps-387819499", "security_groups": [{"name": "tempest-secgroup_access--579769420"}, {"name": "tempest-secgroup_general--1745389100"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:22.112902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] validate_networks() for [('5b69e414-cd47-4515-afb0-5a3bb33c4570', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:07:23.671703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:07:23.673588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:07:23.674577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:07:23.675179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:07:23.676142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:07:23.712029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.713438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.716079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.716541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.769977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Getting quotas for project 92f67ad598e946e9addd1e51e3388262. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:23.777767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Getting quotas for user c5ee1f41ae174f30aed066d3623c12a6 and project 92f67ad598e946e9addd1e51e3388262. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:23.799363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:07:23.807196 n-d-846209-2 devstack@n-api.service[119206]: WARNING nova.utils [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1571610142-access_point-1663068562 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1571610142-ac Jun 16 19:07:23.809202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:07:23.904743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d3a5e74-02d5-49a9-8d14-60d8c4e30d96 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.091554 Jun 16 19:07:23.918460 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2737/5371] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:07:21 2022] POST /compute/v2.1/servers => generated 457 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:07:23.958470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b394c51c-c18d-41e6-b755-09a57a8cf8f6 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:23.959270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b394c51c-c18d-41e6-b755-09a57a8cf8f6 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:23.966018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:23.968410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:24.159022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b394c51c-c18d-41e6-b755-09a57a8cf8f6 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:24.169674 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b394c51c-c18d-41e6-b755-09a57a8cf8f6 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1294 microversion: 2.1 time: 0.239709 Jun 16 19:07:24.181037 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2635/5372] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:23 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1294 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:25.193057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:25.201279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:25.218820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.219443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.220209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.221686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.391712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:25.404028 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bcfe307e-9968-4090-88f9-a5fecc9f7456 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1298 microversion: 2.1 time: 0.217952 Jun 16 19:07:25.414565 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2738/5373] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:25 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:26.422503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:26.423769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:26.436022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:26.436698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:26.440136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:26.440136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:26.555977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:26.565265 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8a1791d-367c-425f-82a8-872ffc903d2a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1352 microversion: 2.1 time: 0.146548 Jun 16 19:07:26.576029 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2636/5374] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:26 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:27.583145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:27.584525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:27.594827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:27.596183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:27.597684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:27.598310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:27.899127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f99df7c7-401c-4a53-a825-c3130b64c717 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fbd4d7b-8548-4c89-9203-9aa63947490e", "device": "/dev/sdb"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:27.900862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f99df7c7-401c-4a53-a825-c3130b64c717 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:27.909464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f99df7c7-401c-4a53-a825-c3130b64c717 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:27.910291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f99df7c7-401c-4a53-a825-c3130b64c717 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:27.911324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f99df7c7-401c-4a53-a825-c3130b64c717 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:27.912583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f99df7c7-401c-4a53-a825-c3130b64c717 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:27.952683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:27.960740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d884de3-db37-4840-a32d-aac1bf0a32af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1471 microversion: 2.1 time: 0.382282 Jun 16 19:07:27.961332 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2739/5375] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:27 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:28.419165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f99df7c7-401c-4a53-a825-c3130b64c717 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "POST /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522835 Jun 16 19:07:28.423382 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2637/5376] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 19:07:27 2022] POST /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:07:28.740430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5516ffc7-d811-4647-843b-1c9a0d20c991 req-d7ddb061-1ce7-4aff-8d9f-d7a40a34e284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f62d23-3b03-4f4c-abf6-3b61ab5447d9", "tag": "ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:28.766742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5516ffc7-d811-4647-843b-1c9a0d20c991 req-d7ddb061-1ce7-4aff-8d9f-d7a40a34e284 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:28.767228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5516ffc7-d811-4647-843b-1c9a0d20c991 req-d7ddb061-1ce7-4aff-8d9f-d7a40a34e284 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:28.805328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5516ffc7-d811-4647-843b-1c9a0d20c991 req-d7ddb061-1ce7-4aff-8d9f-d7a40a34e284 service nova] Creating event network-changed:ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c for instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 on n-h1-846209-2 Jun 16 19:07:28.817335 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5516ffc7-d811-4647-843b-1c9a0d20c991 req-d7ddb061-1ce7-4aff-8d9f-d7a40a34e284 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079402 Jun 16 19:07:28.818003 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2740/5377] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:28.980978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:28.981738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:29.005771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:29.010477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:29.013802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:29.014308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:29.653110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:29.664939 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-483041b5-f501-488f-bd6d-221d1a3aab3b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1471 microversion: 2.1 time: 0.690722 Jun 16 19:07:29.675958 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2638/5378] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:28 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1471 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:30.694342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:30.695773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:30.705106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.705713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.707510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.707939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.924118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:30.932994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef7c65c6-b5f3-4f63-baa1-91772d12c9cd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1471 microversion: 2.1 time: 0.243525 Jun 16 19:07:30.943265 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2741/5379] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:30 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:31.951423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:31.952623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:31.971689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:31.972166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:31.973116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:31.973451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:32.220726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:32.232134 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f473e37e-cbbc-4c43-ace0-c74aeef50173 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1471 microversion: 2.1 time: 0.285612 Jun 16 19:07:32.233362 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2639/5380] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:31 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:33.251459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:33.252829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:33.261450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:33.262359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:33.263368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:33.264102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:33.477319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:33.486303 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d82cf475-8dfd-4e1c-8fed-5c217b20fa57 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1471 microversion: 2.1 time: 0.241305 Jun 16 19:07:33.496793 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2742/5381] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:33 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:34.504578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:34.505117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:34.513862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:34.516405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:34.517081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:34.518078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:34.519389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:34.811279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:34.821124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad8446fa-0d26-4c70-be52-bb4784224ff1 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1471 microversion: 2.1 time: 0.321070 Jun 16 19:07:34.822193 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2640/5382] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:34 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:35.423456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c27cbed0-7ce7-4929-88b7-ee5011a2c15e req-ee75c0a0-a0fa-4b37-bbd1-c863edbbeb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f62d23-3b03-4f4c-abf6-3b61ab5447d9", "name": "network-vif-plugged", "status": "completed", "tag": "ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:35.431114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:35.440802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:35.456782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c27cbed0-7ce7-4929-88b7-ee5011a2c15e req-ee75c0a0-a0fa-4b37-bbd1-c863edbbeb87 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:35.460036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c27cbed0-7ce7-4929-88b7-ee5011a2c15e req-ee75c0a0-a0fa-4b37-bbd1-c863edbbeb87 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:35.483662 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c27cbed0-7ce7-4929-88b7-ee5011a2c15e req-ee75c0a0-a0fa-4b37-bbd1-c863edbbeb87 service nova] Creating event network-vif-plugged:ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c for instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 on n-h1-846209-2 Jun 16 19:07:35.490551 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c27cbed0-7ce7-4929-88b7-ee5011a2c15e req-ee75c0a0-a0fa-4b37-bbd1-c863edbbeb87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075334 Jun 16 19:07:35.491521 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2743/5383] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:35.840355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:35.841140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:35.856417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:35.856892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:35.857703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:35.858169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:36.026794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:36.035385 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-33fa91d0-111b-491d-b552-d2a2a0155f7a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1471 microversion: 2.1 time: 0.199761 Jun 16 19:07:36.036302 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2641/5384] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:35 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:37.059763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:37.061383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:37.073890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.074577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.075524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.076147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.273990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:37.288586 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28a2084b-b8d3-4fee-9f1e-67721e8a6505 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1643 microversion: 2.1 time: 0.238985 Jun 16 19:07:37.301812 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2744/5385] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:37 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1643 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:37.308335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:37.309509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:37.318299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.319602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.320538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.321128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.549861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:37.561755 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-336320fe-e455-4a54-9498-c66414465376 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1643 microversion: 2.1 time: 0.257256 Jun 16 19:07:37.562910 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2642/5386] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:37 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1643 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:37.581303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb9766e0-be40-4ef7-95b5-6ab54d22840b tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:37.582369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb9766e0-be40-4ef7-95b5-6ab54d22840b tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:37.590387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb9766e0-be40-4ef7-95b5-6ab54d22840b tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.591037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb9766e0-be40-4ef7-95b5-6ab54d22840b tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.591954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb9766e0-be40-4ef7-95b5-6ab54d22840b tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.592526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb9766e0-be40-4ef7-95b5-6ab54d22840b tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.950908 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb9766e0-be40-4ef7-95b5-6ab54d22840b tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1794 microversion: 2.1 time: 0.374562 Jun 16 19:07:37.954808 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2745/5387] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:37 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1794 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:40.302720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d9e3b41b-de11-4c90-95e4-9c6b77a6a88e req-25cd6d3d-2240-47c6-9766-ab09871a4284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f62d23-3b03-4f4c-abf6-3b61ab5447d9", "tag": "ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:40.315514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d9e3b41b-de11-4c90-95e4-9c6b77a6a88e req-25cd6d3d-2240-47c6-9766-ab09871a4284 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:40.316433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d9e3b41b-de11-4c90-95e4-9c6b77a6a88e req-25cd6d3d-2240-47c6-9766-ab09871a4284 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:40.334383 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d9e3b41b-de11-4c90-95e4-9c6b77a6a88e req-25cd6d3d-2240-47c6-9766-ab09871a4284 service nova] Creating event network-changed:ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c for instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 on n-h1-846209-2 Jun 16 19:07:40.369966 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d9e3b41b-de11-4c90-95e4-9c6b77a6a88e req-25cd6d3d-2240-47c6-9766-ab09871a4284 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071141 Jun 16 19:07:40.379237 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2643/5388] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:00.424894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:00.426042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:00.428894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:00.430530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=42 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:00.449523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:00.451914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:00.452788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:00.453296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:01.118476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lazy-loading 'services' on Instance uuid 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:08:01.267061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36392532-f985-4d1d-a61f-63a3a7685af4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd/os-volume_attachments/7fbd4d7b-8548-4c89-9203-9aa63947490e" status: 202 len: 0 microversion: 2.1 time: 0.847049 Jun 16 19:08:01.270727 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2746/5389] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:08:00 2022] DELETE /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd/os-volume_attachments/7fbd4d7b-8548-4c89-9203-9aa63947490e => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:08:07.753438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=20 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:07.754232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:07.881411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-66f32f98-48cf-4347-9785-c04a31940fe0 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1366218564", "availability_zone": "foo_zone"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:07.912116 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:07.912116 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:08:07.913214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.aggregate [None req-66f32f98-48cf-4347-9785-c04a31940fe0 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Generated uuid 8bae5108-ce13-4e4d-b7ec-607e82220cf9 for aggregate {{(pid=119207) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 19:08:07.970529 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-66f32f98-48cf-4347-9785-c04a31940fe0 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.218960 Jun 16 19:08:07.971173 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2644/5390] 10.222.0.27 () {60 vars in 1163 bytes} [Thu Jun 16 19:08:07 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:07.983822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-32b9975d-ecfb-4076-a706-79572c456bce tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:07.985252 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:07.985252 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 19:08:08.017118 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-32b9975d-ecfb-4076-a706-79572c456bce tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.038461 Jun 16 19:08:08.018084 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2747/5391] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 19:08:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:08.030016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-168a00df-a134-4484-8af7-e632553a3d90 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:08.032260 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:08.032260 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:08:08.033892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-168a00df-a134-4484-8af7-e632553a3d90 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:08.034554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-168a00df-a134-4484-8af7-e632553a3d90 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.053167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-168a00df-a134-4484-8af7-e632553a3d90 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:08.053715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-168a00df-a134-4484-8af7-e632553a3d90 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.124924 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-168a00df-a134-4484-8af7-e632553a3d90 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.099915 Jun 16 19:08:08.125566 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2645/5392] 10.222.0.27 () {58 vars in 1175 bytes} [Thu Jun 16 19:08:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:08.136006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a654cc4-abfc-4540-a1d2-0685bf4ac805 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:08.137348 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:08.137348 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 19:08:08.145673 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a654cc4-abfc-4540-a1d2-0685bf4ac805 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013603 Jun 16 19:08:08.146979 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2748/5393] 10.222.0.27 () {58 vars in 1142 bytes} [Thu Jun 16 19:08:08 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:08.164803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16703d2c-dee5-4153-8088-34fd638f968b tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846209-2"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:08.166264 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:08.166264 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:08:08.176301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16703d2c-dee5-4153-8088-34fd638f968b tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:08.177113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16703d2c-dee5-4153-8088-34fd638f968b tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.753502 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16703d2c-dee5-4153-8088-34fd638f968b tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.599740 Jun 16 19:08:08.755335 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2646/5394] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 19:08:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:08.765088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1505b87-a03b-4d0b-b275-f2e12352ac2e tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:08.765868 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:08.765868 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 19:08:08.777711 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1505b87-a03b-4d0b-b275-f2e12352ac2e tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.014845 Jun 16 19:08:08.785701 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2749/5395] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 19:08:08 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:08.790320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f884fbac-b9df-466a-aec7-eaaaa64c2892 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-690555799", "availability_zone": "foo_zone"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:08.909277 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:08.909277 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:08:08.998389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f884fbac-b9df-466a-aec7-eaaaa64c2892 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.213030 Jun 16 19:08:08.999559 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2647/5396] 10.222.0.27 () {60 vars in 1172 bytes} [Thu Jun 16 19:08:08 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:09.011514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23cbc224-e77b-407d-ae0c-e43182d0c23a tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:09.012925 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:09.012925 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 19:08:09.064610 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-23cbc224-e77b-407d-ae0c-e43182d0c23a tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.058833 Jun 16 19:08:09.065233 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2750/5397] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 19:08:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:09.081621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e2de28a5-5f5e-4c20-8926-eb95559e5a2d tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:09.082701 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:09.082701 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:08:09.093468 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e2de28a5-5f5e-4c20-8926-eb95559e5a2d tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.019349 Jun 16 19:08:09.094898 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2648/5398] 10.222.0.27 () {58 vars in 1151 bytes} [Thu Jun 16 19:08:09 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:08:09.109731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1275871-f1ed-45f2-8295-4309cd63b3fe tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846209-2"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:09.112070 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:09.112070 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 19:08:09.135791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1275871-f1ed-45f2-8295-4309cd63b3fe tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:09.136601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1275871-f1ed-45f2-8295-4309cd63b3fe tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:09.459818 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1275871-f1ed-45f2-8295-4309cd63b3fe tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.355190 Jun 16 19:08:09.461246 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2751/5399] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jun 16 19:08:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:09.471934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d834b495-16a2-4094-94a4-414caaea9d52 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:09.472935 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:08:09.472935 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:08:09.536777 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d834b495-16a2-4094-94a4-414caaea9d52 tempest-TestAggregatesBasicOps-847101698 tempest-TestAggregatesBasicOps-847101698-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.069106 Jun 16 19:08:09.537824 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2649/5400] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jun 16 19:08:09 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 16 19:08:10.348607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:10.349241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:10.357809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.358333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:10.359127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.359576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:10.430751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:08:10.580203 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-82a90b2d-b1ee-4c6b-82fa-bece13369ed5 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 204 len: 0 microversion: 2.1 time: 0.234684 Jun 16 19:08:10.586258 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2752/5401] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:10 2022] DELETE /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:08:10.591269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:10.592018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:10.598815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.599788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:10.600999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.601588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:11.221180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:11.232358 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8a1a5e74-c6a6-4fe7-9ffc-77a6abd41657 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1514 microversion: 2.1 time: 0.646162 Jun 16 19:08:11.234101 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2650/5402] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:10 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1514 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:12.254080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:12.256083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:12.271583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:12.272488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:12.273446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:12.274308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:13.054165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:13.063459 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bf49114a-8292-468f-824f-1443c61816c9 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1514 microversion: 2.1 time: 0.814509 Jun 16 19:08:13.067923 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2753/5403] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:12 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1514 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:13.645495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d1f72d49-f44d-4ec8-a7e7-a5f06ce8e59b req-dd438027-bed7-4026-a893-a6ab8247d4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b2c51f-33f4-4602-b0ae-4a33b56ddbbd", "name": "network-vif-deleted", "tag": "87ff5177-6ee8-447c-9f61-973b2dbd5be4"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:13.684917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d1f72d49-f44d-4ec8-a7e7-a5f06ce8e59b req-dd438027-bed7-4026-a893-a6ab8247d4f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:13.689038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d1f72d49-f44d-4ec8-a7e7-a5f06ce8e59b req-dd438027-bed7-4026-a893-a6ab8247d4f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:13.704062 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d1f72d49-f44d-4ec8-a7e7-a5f06ce8e59b req-dd438027-bed7-4026-a893-a6ab8247d4f7 service nova] Creating event network-vif-deleted:87ff5177-6ee8-447c-9f61-973b2dbd5be4 for instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd on n-h1-846209-2 Jun 16 19:08:13.719573 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d1f72d49-f44d-4ec8-a7e7-a5f06ce8e59b req-dd438027-bed7-4026-a893-a6ab8247d4f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080759 Jun 16 19:08:13.727721 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2651/5404] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:08:14.085230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:14.086795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:14.098505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:14.102155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:14.104917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:14.106888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:14.179277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:14.182200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:14.182880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lazy-loading 'fault' on Instance uuid 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:08:14.279355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:14.287512 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-625d7f7b-bcb6-4826-a58e-e8928b9c248c tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 200 len: 1309 microversion: 2.1 time: 0.206465 Jun 16 19:08:14.298920 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2754/5405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:14 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 1309 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:15.318252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:15.319321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:15.328557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:15.329609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:15.330656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:15.331569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:15.350920 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] HTTP exception thrown: Instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd could not be found. Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Request method failure captured: Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd HTTP/1.1 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq36yKKSuNnP556GMg5lRZatxXVVdN9Yxd0K23NqPWNYdzgdBe6kTaeNOwIq-7an_Hs2QRXrYjRNwziP7GSJEHjo3roB7DGs8tm5TNSi8mQ3q2BwkLkF3gOW1qP6mW3lcMSQ21prWCs1_rcwWA_nmbMl71X3G2obn6bAaCLlO0OXwVhk Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: e1cc7de4264b46bb8e056a6258989c62 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1315634170 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1cc7de4264b46bb8e056a6258989c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1cc7de4264b46bb8e056a6258989c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1cc7de4264b46bb8e056a6258989c62", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1cc7de4264b46bb8e056a6258989c62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-VolumesSnapshotTestJSON-1315634170 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: e1cc7de4264b46bb8e056a6258989c62 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1315634170 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-VolumesSnapshotTestJSON-1315634170-project Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 8a0e4e318982415eae2d2cd2f0d98a35 Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-VolumesSnapshotTestJSON-1315634170-project Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd could not be found. Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '67b2c51f-33f4-4602-b0ae-4a33b56ddbbd'} Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd could not be found. Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd could not be found. Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:15.359448 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:08:15.363023 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:15.363023 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:15.363023 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:15.363023 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:15.363023 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:15.363023 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd could not be found. Jun 16 19:08:15.363023 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:08:15.365480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Returning 404 to user: Instance 67b2c51f-33f4-4602-b0ae-4a33b56ddbbd could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:15.368138 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d159cfd-d691-429c-af14-2d9bea5be054 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd" status: 404 len: 111 microversion: 2.1 time: 0.055031 Jun 16 19:08:15.373868 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2652/5406] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:15 2022] GET /compute/v2.1/servers/67b2c51f-33f4-4602-b0ae-4a33b56ddbbd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:26.423507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1011934118", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "a54d773e-db02-4085-9d4e-a50d22e99ccc"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:26.444813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:26.445498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:26.619218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] validate_networks() for [('a54d773e-db02-4085-9d4e-a50d22e99ccc', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:08:27.753274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1943122688", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "af18a546-7312-4d45-9e2c-94124763c588"}], "key_name": "tempest-TestSecurityGroupsBasicOps-387819499", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c9f62d23-3b03-4f4c-abf6-3b61ab5447d9"]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:27.802265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:27.803482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:27.805690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=16 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:27.951677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] validate_networks() for [('af18a546-7312-4d45-9e2c-94124763c588', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:08:28.620497 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:08:28.621060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:08:28.621398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:08:28.621821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:08:28.622431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:08:28.649388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:28.649865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:28.655248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:28.655635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:28.749106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Getting quotas for project e1cc7de4264b46bb8e056a6258989c62. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:08:28.762801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Getting quotas for user 8a0e4e318982415eae2d2cd2f0d98a35 and project e1cc7de4264b46bb8e056a6258989c62. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:08:28.810620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:08:28.819306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:08:28.968128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-75477b73-e5a5-4f50-8cd8-7c3541bc3731 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.549207 Jun 16 19:08:28.972279 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2755/5407] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:08:28.982609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fbbb1843-001a-4b4c-aa44-20411c8d9ee2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:28.983349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fbbb1843-001a-4b4c-aa44-20411c8d9ee2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:29.121685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fbbb1843-001a-4b4c-aa44-20411c8d9ee2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:29.126233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:08:29.126841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:08:29.127150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:08:29.127576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:08:29.127999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:08:29.138695 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fbbb1843-001a-4b4c-aa44-20411c8d9ee2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1219 microversion: 2.1 time: 0.160088 Jun 16 19:08:29.142396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:29.142861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:29.143690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:29.144006 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2756/5408] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:28 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:29.155287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:29.194885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Getting quotas for project 92f67ad598e946e9addd1e51e3388262. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:08:29.232696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Getting quotas for user c5ee1f41ae174f30aed066d3623c12a6 and project 92f67ad598e946e9addd1e51e3388262. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:08:29.258056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:08:29.261538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:08:29.412538 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a62d500c-c872-4854-9873-989b1c9eae35 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.664829 Jun 16 19:08:29.419221 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2653/5409] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:08:27 2022] POST /compute/v2.1/servers => generated 361 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:08:29.425716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9037c7ec-621e-4574-b983-a08910c2a790 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:29.430943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9037c7ec-621e-4574-b983-a08910c2a790 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:29.605399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9037c7ec-621e-4574-b983-a08910c2a790 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:29.628746 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9037c7ec-621e-4574-b983-a08910c2a790 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1241 microversion: 2.1 time: 0.206620 Jun 16 19:08:29.637344 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2757/5410] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:29 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:30.162743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:30.163372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:30.179385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:30.179656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:30.181016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:30.189943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:30.444606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:30.459401 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7efd0cb7-8597-47a3-a398-83c58f45a2bf tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1223 microversion: 2.1 time: 0.302054 Jun 16 19:08:30.476440 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2654/5411] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:30 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1223 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:30.650546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:30.660418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:30.691574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:30.692121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:30.692908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:30.693351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:30.853791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:30.865565 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-35927cd6-01ef-4a92-8969-af74c13c7716 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1237 microversion: 2.1 time: 0.221246 Jun 16 19:08:30.866228 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2758/5412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:30 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1237 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:31.481536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:31.483638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:31.496004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.497335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:31.498744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.501533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:31.668582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:31.682432 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-841bfdb1-023f-465e-bdf8-887341340e28 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1277 microversion: 2.1 time: 0.206999 Jun 16 19:08:31.694716 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2655/5413] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:31 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:31.884751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:31.886280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:31.900457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.903588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:31.904693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.905321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:32.289668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:32.302490 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5cf25005-7d7e-4dcd-9c06-97cdeb5fe143 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.421668 Jun 16 19:08:32.334021 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2759/5414] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:31 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:32.700785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:32.701630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:32.725607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.726180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:32.729821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.730334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:33.272829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:33.282962 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-018f8c7f-c2a7-42fb-b99a-26649b03b78f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.586685 Jun 16 19:08:33.293870 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2656/5415] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:32 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:33.358050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:33.359357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:33.376487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:33.378341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:33.379796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:33.385841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:33.941758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:33.962575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b8e9ebc0-9f65-49c6-9eeb-27c60cd1fed8 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.613534 Jun 16 19:08:33.965632 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2760/5416] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:33 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:34.309505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:34.310317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:34.327146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:34.329489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:34.330513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:34.333743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:34.757828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:34.768971 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a650b2dd-ae74-4054-901b-8cd9b998d59e tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.465191 Jun 16 19:08:34.771771 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2657/5417] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:34 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:34.982956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:34.984402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:35.003688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.004453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.007340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.009935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.230750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:35.239143 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a48053cc-2618-446f-a912-315d5bcae7bd tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.260732 Jun 16 19:08:35.243677 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2761/5418] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:34 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:35.300663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1151b24e-c0e7-4fb9-8996-6790a8f83c43 req-85345e93-06e8-425b-b5de-6a73d0d24831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687154df-01e6-4e2a-8824-67709ea6867f", "tag": "22b47eb3-1f31-46c2-84ef-2f49c7f4bab6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:35.335128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1151b24e-c0e7-4fb9-8996-6790a8f83c43 req-85345e93-06e8-425b-b5de-6a73d0d24831 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.335832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1151b24e-c0e7-4fb9-8996-6790a8f83c43 req-85345e93-06e8-425b-b5de-6a73d0d24831 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.377869 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1151b24e-c0e7-4fb9-8996-6790a8f83c43 req-85345e93-06e8-425b-b5de-6a73d0d24831 service nova] Creating event network-changed:22b47eb3-1f31-46c2-84ef-2f49c7f4bab6 for instance 687154df-01e6-4e2a-8824-67709ea6867f on n-h2-846209-2 Jun 16 19:08:35.388378 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1151b24e-c0e7-4fb9-8996-6790a8f83c43 req-85345e93-06e8-425b-b5de-6a73d0d24831 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091558 Jun 16 19:08:35.392549 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2658/5419] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:35.788743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:35.790154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:35.802283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.802814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.804854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.806328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.975214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-bd6c3eac-dee5-4d14-bec0-5bce8ecf21de req-43d28dde-6d12-41d7-9d08-878d8a9ae63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9afb4e-42f1-4dad-85f8-df7eda0c74b4", "tag": "9efbf8a7-7f60-454c-ac59-48510d9d69b5"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:35.994473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bd6c3eac-dee5-4d14-bec0-5bce8ecf21de req-43d28dde-6d12-41d7-9d08-878d8a9ae63d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.997674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-bd6c3eac-dee5-4d14-bec0-5bce8ecf21de req-43d28dde-6d12-41d7-9d08-878d8a9ae63d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:36.013715 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-bd6c3eac-dee5-4d14-bec0-5bce8ecf21de req-43d28dde-6d12-41d7-9d08-878d8a9ae63d service nova] Creating event network-changed:9efbf8a7-7f60-454c-ac59-48510d9d69b5 for instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 on n-h1-846209-2 Jun 16 19:08:36.018856 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-bd6c3eac-dee5-4d14-bec0-5bce8ecf21de req-43d28dde-6d12-41d7-9d08-878d8a9ae63d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054271 Jun 16 19:08:36.020141 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2659/5420] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:36.251710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:36.263275 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4247a303-7506-4742-9c8a-9c5db7d057e8 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.479188 Jun 16 19:08:36.264748 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2762/5421] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:35 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:36.266933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:36.268825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:36.284192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:36.284676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:36.285622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:36.286103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:36.504710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:36.515653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab14d74e-1b30-45e7-9d7d-7e741f8ec1af tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.258516 Jun 16 19:08:36.517569 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2660/5422] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:36 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:37.281626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:37.282443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:37.298175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:37.303691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:37.308040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:37.311521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:37.534226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:37.534852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:37.548517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:37.550170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:37.551000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:37.551463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:38.021561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:38.030820 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-667dd5ac-a2f1-4aa7-ade8-1da5e461e87c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.501410 Jun 16 19:08:38.031793 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2661/5423] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:37 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:38.094014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:38.106383 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d968b30-d74a-4cb2-b202-49ca5a512230 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.829180 Jun 16 19:08:38.107749 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2763/5424] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:37 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:39.051639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:39.061863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:39.075695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.076333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.078240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.086875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.125555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:39.126791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:39.144411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:39.146157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.146623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.157787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.158535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.197838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:39.248174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:39.319286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:39.334551 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf075a0b-b6ae-4ce1-9961-938f2bb8fb81 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.286897 Jun 16 19:08:39.335177 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2662/5425] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:39 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:39.614642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:39.676642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:39.688209 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e5342057-554b-44e6-abce-4d68ac057e18 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.564667 Jun 16 19:08:39.689722 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2764/5426] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:39 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:40.352600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:40.354604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:40.366799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:40.372019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:40.373073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:40.373770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:40.608315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:40.632082 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-708e8b2d-6e3e-4708-a02f-edb921fbc639 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.283936 Jun 16 19:08:40.639861 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2663/5427] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:40 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:40.705028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:40.706544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:40.720455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:40.722982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:40.724077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:40.726459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.061136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:41.077515 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d05e80e5-1ed4-454c-96c5-6e0fd88ca468 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.375790 Jun 16 19:08:41.078904 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2765/5428] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:40 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:41.459098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0cafe261-4f5d-4110-a3ca-73ca2a80fd80 req-c629ed3e-f304-4536-9cbd-801a8915e79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687154df-01e6-4e2a-8824-67709ea6867f", "name": "network-vif-plugged", "status": "completed", "tag": "22b47eb3-1f31-46c2-84ef-2f49c7f4bab6"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:41.477559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0cafe261-4f5d-4110-a3ca-73ca2a80fd80 req-c629ed3e-f304-4536-9cbd-801a8915e79d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:41.481319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0cafe261-4f5d-4110-a3ca-73ca2a80fd80 req-c629ed3e-f304-4536-9cbd-801a8915e79d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.517435 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0cafe261-4f5d-4110-a3ca-73ca2a80fd80 req-c629ed3e-f304-4536-9cbd-801a8915e79d service nova] Creating event network-vif-plugged:22b47eb3-1f31-46c2-84ef-2f49c7f4bab6 for instance 687154df-01e6-4e2a-8824-67709ea6867f on n-h2-846209-2 Jun 16 19:08:41.534485 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0cafe261-4f5d-4110-a3ca-73ca2a80fd80 req-c629ed3e-f304-4536-9cbd-801a8915e79d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391474 Jun 16 19:08:41.537782 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2664/5429] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:41.657643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:41.658887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:41.709666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:41.712582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.721301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:41.727552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.989216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:42.009687 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bdd5fd8c-cb87-47f1-a092-c155e2faf72b tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.354333 Jun 16 19:08:42.010828 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2766/5430] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:41 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:42.096938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:42.097969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:42.112036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:42.112625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:42.120671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:42.121140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:42.509472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:42.520151 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5fe926e-2318-4926-b2d3-2b8f42d5f628 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.427663 Jun 16 19:08:42.522193 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2665/5431] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:42 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:43.028111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:43.030280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:43.040616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:43.041374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:43.042399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:43.043212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:43.194559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:43.204582 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a590594-fa38-4b09-81db-06e923b9b4ee tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1299 microversion: 2.1 time: 0.181275 Jun 16 19:08:43.205630 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2767/5432] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:43 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1299 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:43.544915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:43.545967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:43.556364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:43.571989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:43.576419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:43.576893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:43.813987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2ba053ff-d2dd-442e-b82c-77275977fbaa req-146f4e89-f89c-4fe2-81f0-bba9b3668694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9afb4e-42f1-4dad-85f8-df7eda0c74b4", "name": "network-vif-plugged", "status": "completed", "tag": "9efbf8a7-7f60-454c-ac59-48510d9d69b5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:43.853805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2ba053ff-d2dd-442e-b82c-77275977fbaa req-146f4e89-f89c-4fe2-81f0-bba9b3668694 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:43.854445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2ba053ff-d2dd-442e-b82c-77275977fbaa req-146f4e89-f89c-4fe2-81f0-bba9b3668694 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:43.884062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2ba053ff-d2dd-442e-b82c-77275977fbaa req-146f4e89-f89c-4fe2-81f0-bba9b3668694 service nova] Creating event network-vif-plugged:9efbf8a7-7f60-454c-ac59-48510d9d69b5 for instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 on n-h1-846209-2 Jun 16 19:08:43.897048 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2ba053ff-d2dd-442e-b82c-77275977fbaa req-146f4e89-f89c-4fe2-81f0-bba9b3668694 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087701 Jun 16 19:08:43.898390 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2768/5433] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:08:43.915819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:43.942161 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9753072d-f04b-42ae-977e-45143a47797f tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.408977 Jun 16 19:08:43.948248 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2666/5434] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:43 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:44.224028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:44.225467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:44.241472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.243876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.245757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.246869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.402799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:44.411645 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-61d6a780-7802-4a96-9d75-3ddb7dda8f0e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1471 microversion: 2.1 time: 0.193011 Jun 16 19:08:44.417883 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2769/5435] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:44 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:44.434863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:44.435523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:44.442530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.443189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.444079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.444619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.595986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:44.608368 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cb2e8819-9d5e-49cf-af25-b49c516ee547 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1471 microversion: 2.1 time: 0.178099 Jun 16 19:08:44.612249 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2667/5436] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:44 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:44.628261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b3be0320-c1ff-4516-bd4e-db6d9f75bab5 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:44.628882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b3be0320-c1ff-4516-bd4e-db6d9f75bab5 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:44.640299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3be0320-c1ff-4516-bd4e-db6d9f75bab5 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.646608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3be0320-c1ff-4516-bd4e-db6d9f75bab5 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.647655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3be0320-c1ff-4516-bd4e-db6d9f75bab5 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.648410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3be0320-c1ff-4516-bd4e-db6d9f75bab5 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.917484 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b3be0320-c1ff-4516-bd4e-db6d9f75bab5 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1622 microversion: 2.1 time: 0.291457 Jun 16 19:08:44.924046 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2770/5437] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:44 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1622 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:44.940282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7730cfce-04b4-48b0-a56b-4408c7a6ca55 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:44.941249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7730cfce-04b4-48b0-a56b-4408c7a6ca55 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:44.952114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7730cfce-04b4-48b0-a56b-4408c7a6ca55 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.966297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7730cfce-04b4-48b0-a56b-4408c7a6ca55 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.968450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7730cfce-04b4-48b0-a56b-4408c7a6ca55 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.969260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:44.970158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:44.970846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7730cfce-04b4-48b0-a56b-4408c7a6ca55 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.992226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:44.995574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:44.997607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:45.000871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:45.909566 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7730cfce-04b4-48b0-a56b-4408c7a6ca55 tempest-TestSecurityGroupsBasicOps-50275397 tempest-TestSecurityGroupsBasicOps-50275397-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1912 microversion: 2.1 time: 0.972825 Jun 16 19:08:45.918749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:45.926361 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2668/5438] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:44 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1912 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:45.948407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0779f0eb-9ba9-46cf-94a0-c4a72a8c6d69 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1319 microversion: 2.1 time: 0.990342 Jun 16 19:08:45.953724 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2771/5439] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:44 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1319 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:46.043383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:46.044129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:46.052300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:46.053039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:46.054657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:46.055404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:46.094953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:08:46.236394 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90a1d015-5548-40a8-b2dd-61c74c00ee6c tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "DELETE /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 204 len: 0 microversion: 2.1 time: 0.197554 Jun 16 19:08:46.242101 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2669/5440] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:46 2022] DELETE /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:08:46.248628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:46.250717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:46.260675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:46.261416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:46.262397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:46.263004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:46.524870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:46.533663 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55c9ec47-aaa4-491d-9e48-b946eb025f31 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1477 microversion: 2.1 time: 0.289519 Jun 16 19:08:46.534290 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2772/5441] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:46 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1477 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:46.973887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:46.974898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:46.996745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:46.997638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:47.013949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:47.016201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:47.068987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:47.552106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:47.553468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:47.570373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:47.571028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:47.571854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:47.572304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:47.817210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:47.829147 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-991907fa-2136-4074-9f27-80dbf25b7d07 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1508 microversion: 2.1 time: 0.861207 Jun 16 19:08:47.830401 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2670/5442] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:46 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1508 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:47.850728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6725e9af-99d4-43d6-88a8-6349aa9f6bb6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "672a8654-5f90-4dee-9a8a-afd550c68b95", "device": "/dev/sdb"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:47.854642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6725e9af-99d4-43d6-88a8-6349aa9f6bb6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:47.877734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6725e9af-99d4-43d6-88a8-6349aa9f6bb6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:47.879714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6725e9af-99d4-43d6-88a8-6349aa9f6bb6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:47.880784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6725e9af-99d4-43d6-88a8-6349aa9f6bb6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:47.884813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6725e9af-99d4-43d6-88a8-6349aa9f6bb6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:48.048000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:48.066726 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aae9cfc4-86a4-48a6-aa33-54899c30fb6a tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1477 microversion: 2.1 time: 0.512354 Jun 16 19:08:48.078335 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2773/5443] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:47 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1477 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:48.418038 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6725e9af-99d4-43d6-88a8-6349aa9f6bb6 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "POST /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559272 Jun 16 19:08:48.460484 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2671/5444] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 19:08:47 2022] POST /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4/os-volume_attachments => generated 194 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:08:48.645358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6deea321-ba75-406d-b74a-14cb95b60dca req-01b17c28-7b29-48c9-b4e8-dce7716e591f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687154df-01e6-4e2a-8824-67709ea6867f", "name": "network-vif-deleted", "tag": "22b47eb3-1f31-46c2-84ef-2f49c7f4bab6"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:48.656945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6deea321-ba75-406d-b74a-14cb95b60dca req-01b17c28-7b29-48c9-b4e8-dce7716e591f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:48.657711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6deea321-ba75-406d-b74a-14cb95b60dca req-01b17c28-7b29-48c9-b4e8-dce7716e591f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:48.670944 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6deea321-ba75-406d-b74a-14cb95b60dca req-01b17c28-7b29-48c9-b4e8-dce7716e591f service nova] Creating event network-vif-deleted:22b47eb3-1f31-46c2-84ef-2f49c7f4bab6 for instance 687154df-01e6-4e2a-8824-67709ea6867f on n-h2-846209-2 Jun 16 19:08:48.676806 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6deea321-ba75-406d-b74a-14cb95b60dca req-01b17c28-7b29-48c9-b4e8-dce7716e591f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035574 Jun 16 19:08:48.682780 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2774/5445] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:49.087045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:49.093713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:49.112530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:49.118358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:49.125380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:49.126724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:49.230983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:49.268137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:49.269025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lazy-loading 'fault' on Instance uuid 687154df-01e6-4e2a-8824-67709ea6867f {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:08:49.472236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:49.483633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8608363-2297-4a2a-9172-e516f79d59dc tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 200 len: 1331 microversion: 2.1 time: 0.401278 Jun 16 19:08:49.484234 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2672/5446] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:49 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 1331 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:50.502429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:50.503156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: 687154df-01e6-4e2a-8824-67709ea6867f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:50.516943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:50.517416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:50.522654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:50.523115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:50.552043 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] HTTP exception thrown: Instance 687154df-01e6-4e2a-8824-67709ea6867f could not be found. Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Request method failure captured: Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f HTTP/1.1 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq39ctJd6VXL4i3iNFv3q3wlynO4nm0ty7C1z3k5l9CBRCPHs2te7Of0Mc_gz0sMmcoD7ady6IDEfW2c2fBHVrZuUmOisLLzx8QApkfg_xH34va3-aFK5X1fp8gm_Iga2JK0nJJV0CQNl3wzO4SeGQbUnkq2x1Alci6e_5fDwceMfr2M Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 92f67ad598e946e9addd1e51e3388262 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1571610142 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92f67ad598e946e9addd1e51e3388262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92f67ad598e946e9addd1e51e3388262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92f67ad598e946e9addd1e51e3388262", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92f67ad598e946e9addd1e51e3388262"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1571610142 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 92f67ad598e946e9addd1e51e3388262 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1571610142 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestSecurityGroupsBasicOps-1571610142-project Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c5ee1f41ae174f30aed066d3623c12a6 Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1571610142-project Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 687154df-01e6-4e2a-8824-67709ea6867f could not be found. Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '687154df-01e6-4e2a-8824-67709ea6867f'} Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687154df-01e6-4e2a-8824-67709ea6867f could not be found. Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687154df-01e6-4e2a-8824-67709ea6867f could not be found. Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:50.554031 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:08:50.560111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:50.560111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:50.560111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:50.560111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:50.560111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:50.560111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687154df-01e6-4e2a-8824-67709ea6867f could not be found. Jun 16 19:08:50.560111 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:08:50.562366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Returning 404 to user: Instance 687154df-01e6-4e2a-8824-67709ea6867f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:50.563514 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-047bd20f-c58e-4976-94b7-239f6e1bf9b0 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f" status: 404 len: 111 microversion: 2.1 time: 0.065626 Jun 16 19:08:50.564338 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2775/5447] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:50 2022] GET /compute/v2.1/servers/687154df-01e6-4e2a-8824-67709ea6867f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:58.486003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:58.486560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:58.494224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-df3b5003-f5f5-4c63-962b-21232d210c45 req-16d77237-f208-44a0-92bf-8b0006e69061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f62d23-3b03-4f4c-abf6-3b61ab5447d9", "tag": "ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:58.503436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:58.507743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:58.522541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:58.544809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-df3b5003-f5f5-4c63-962b-21232d210c45 req-16d77237-f208-44a0-92bf-8b0006e69061 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:58.546837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:58.550428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:58.551433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:58.552746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-df3b5003-f5f5-4c63-962b-21232d210c45 req-16d77237-f208-44a0-92bf-8b0006e69061 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:58.581874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:58.603407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-df3b5003-f5f5-4c63-962b-21232d210c45 req-16d77237-f208-44a0-92bf-8b0006e69061 service nova] Creating event network-changed:ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c for instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 on n-h1-846209-2 Jun 16 19:08:58.617388 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-df3b5003-f5f5-4c63-962b-21232d210c45 req-16d77237-f208-44a0-92bf-8b0006e69061 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126163 Jun 16 19:08:58.621089 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2776/5448] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:58.638205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:08:58.876182 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f11f0bc-2403-424b-b874-7080420deb17 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 204 len: 0 microversion: 2.1 time: 0.393317 Jun 16 19:08:58.877713 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2673/5449] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:58 2022] DELETE /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:08:58.890308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:58.891617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:58.918071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:58.920381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:58.921378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:58.923471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:59.268488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:59.280181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be0f1835-bdeb-44c8-aa38-67cb7e2a4eae tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1767 microversion: 2.1 time: 0.397784 Jun 16 19:08:59.285520 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2777/5450] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:58 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1767 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:00.306032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:00.307013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:00.326634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:00.333643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:00.335046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:00.335788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:01.309224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:01.322309 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d4fe830b-ed44-40ad-943f-21d42cfe5056 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1767 microversion: 2.1 time: 1.018744 Jun 16 19:09:01.324223 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2674/5451] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:00 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1767 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:02.001299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f169de43-cc0c-46d0-8c99-96df8dbb4fd8 req-a0bc95e0-2cf5-440b-bb67-190e5eaf0ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f62d23-3b03-4f4c-abf6-3b61ab5447d9", "name": "network-vif-deleted", "tag": "ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:02.017295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f169de43-cc0c-46d0-8c99-96df8dbb4fd8 req-a0bc95e0-2cf5-440b-bb67-190e5eaf0ff6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:02.017894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f169de43-cc0c-46d0-8c99-96df8dbb4fd8 req-a0bc95e0-2cf5-440b-bb67-190e5eaf0ff6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:02.031956 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f169de43-cc0c-46d0-8c99-96df8dbb4fd8 req-a0bc95e0-2cf5-440b-bb67-190e5eaf0ff6 service nova] Creating event network-vif-deleted:ee62bb57-47e7-4a9d-b1e1-2cd09e05dd0c for instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 on n-h1-846209-2 Jun 16 19:09:02.038861 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f169de43-cc0c-46d0-8c99-96df8dbb4fd8 req-a0bc95e0-2cf5-440b-bb67-190e5eaf0ff6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041612 Jun 16 19:09:02.040842 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2778/5452] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:02.345307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:02.355252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:02.367480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:02.368206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:02.372295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:02.372983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:02.423759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:02.424204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:02.424677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lazy-loading 'fault' on Instance uuid c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:09:02.493500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ee1f41ae174f30aed066d3623c12a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f67ad598e946e9addd1e51e3388262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:02.514154 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-748b0701-1b40-4a89-a357-1ead182f4b63 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 200 len: 1384 microversion: 2.1 time: 0.176578 Jun 16 19:09:02.526894 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2675/5453] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:02 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 1384 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:03.534683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:03.535396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] [instance: c9f62d23-3b03-4f4c-abf6-3b61ab5447d9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:03.554330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:03.557364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:03.558577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:03.559691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:03.611506 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] HTTP exception thrown: Instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 could not be found. Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Request method failure captured: Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 HTTP/1.1 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq39ctJd6VXL4i3iNFv3q3wlynO4nm0ty7C1z3k5l9CBRCPHs2te7Of0Mc_gz0sMmcoD7ady6IDEfW2c2fBHVrZuUmOisLLzx8QApkfg_xH34va3-aFK5X1fp8gm_Iga2JK0nJJV0CQNl3wzO4SeGQbUnkq2x1Alci6e_5fDwceMfr2M Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 92f67ad598e946e9addd1e51e3388262 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1571610142 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92f67ad598e946e9addd1e51e3388262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92f67ad598e946e9addd1e51e3388262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92f67ad598e946e9addd1e51e3388262", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92f67ad598e946e9addd1e51e3388262"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1571610142 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 92f67ad598e946e9addd1e51e3388262 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1571610142 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestSecurityGroupsBasicOps-1571610142-project Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: c5ee1f41ae174f30aed066d3623c12a6 Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1571610142-project Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 could not be found. Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c9f62d23-3b03-4f4c-abf6-3b61ab5447d9'} Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 could not be found. Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 could not be found. Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:03.613675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:03.618875 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:03.618875 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:03.618875 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:03.618875 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:09:03.618875 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:09:03.618875 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 could not be found. Jun 16 19:09:03.618875 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:03.620515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Returning 404 to user: Instance c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:09:03.621730 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a7a54e7-6ba3-495d-b8c7-a9fb5444101e tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9" status: 404 len: 111 microversion: 2.1 time: 0.093493 Jun 16 19:09:03.626878 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2779/5454] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:03 2022] GET /compute/v2.1/servers/c9f62d23-3b03-4f4c-abf6-3b61ab5447d9 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:09:08.752424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3aaf538d-3e8f-40a7-94ad-f3c5da2f9940 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] Calling method '.version_select at 0x7f866d9a5430>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:08.790598 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3aaf538d-3e8f-40a7-94ad-f3c5da2f9940 tempest-TestSecurityGroupsBasicOps-1571610142 tempest-TestSecurityGroupsBasicOps-1571610142-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-387819499" status: 202 len: 0 microversion: 2.1 time: 0.036806 Jun 16 19:09:08.794590 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2676/5455] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 19:09:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-387819499 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:09:30.191073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:30.191633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:30.193816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:30.194498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=11 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:30.202538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:30.203583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:30.204667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:30.205643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:30.337504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lazy-loading 'services' on Instance uuid 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:09:30.483357 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-691f11e9-bd57-4746-920f-1c6c177fd2f2 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4/os-volume_attachments/672a8654-5f90-4dee-9a8a-afd550c68b95" status: 202 len: 0 microversion: 2.1 time: 0.295987 Jun 16 19:09:30.484762 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2780/5456] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:09:30 2022] DELETE /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4/os-volume_attachments/672a8654-5f90-4dee-9a8a-afd550c68b95 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:09:39.112722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:39.113605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:39.118542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:39.119397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:39.135759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:39.136228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:39.137038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:39.137485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:39.168992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:09:39.248446 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4b58a3eb-37f3-4dc7-b785-cd7614bef13a tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 204 len: 0 microversion: 2.1 time: 0.139794 Jun 16 19:09:39.249802 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2677/5457] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:09:39 2022] DELETE /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:09:39.260951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:39.261676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:39.268286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:39.268750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:39.269572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:39.270057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:39.412782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:39.420662 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-55f81575-2020-44a5-b69e-bab2b0fd31d4 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1514 microversion: 2.1 time: 0.166527 Jun 16 19:09:39.421332 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2781/5458] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:39 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:40.438935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:40.439646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:40.447744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:40.448210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:40.448987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:40.449426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:40.593517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:40.603874 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f69122c-8125-44dc-b3a7-855b29b703fe tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1514 microversion: 2.1 time: 0.169154 Jun 16 19:09:40.604481 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2678/5459] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:40 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:09:41.416724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9602b828-9574-4aa7-9410-ab16e72300c4 req-19e84455-39a4-4274-be10-6140e8febb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9afb4e-42f1-4dad-85f8-df7eda0c74b4", "name": "network-vif-deleted", "tag": "9efbf8a7-7f60-454c-ac59-48510d9d69b5"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:41.426419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9602b828-9574-4aa7-9410-ab16e72300c4 req-19e84455-39a4-4274-be10-6140e8febb93 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:41.426928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9602b828-9574-4aa7-9410-ab16e72300c4 req-19e84455-39a4-4274-be10-6140e8febb93 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:41.439480 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9602b828-9574-4aa7-9410-ab16e72300c4 req-19e84455-39a4-4274-be10-6140e8febb93 service nova] Creating event network-vif-deleted:9efbf8a7-7f60-454c-ac59-48510d9d69b5 for instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 on n-h1-846209-2 Jun 16 19:09:41.445276 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9602b828-9574-4aa7-9410-ab16e72300c4 req-19e84455-39a4-4274-be10-6140e8febb93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Jun 16 19:09:41.449397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2782/5460] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:41.620931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:41.621733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:41.629019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:41.629501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:41.630305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:41.630765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:41.668085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:41.668528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:41.668978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lazy-loading 'fault' on Instance uuid 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:09:41.709791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0e4e318982415eae2d2cd2f0d98a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1cc7de4264b46bb8e056a6258989c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:41.719930 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-027ebcf2-1caf-46c3-8dfa-0c614b43c303 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 200 len: 1309 microversion: 2.1 time: 0.103054 Jun 16 19:09:41.720719 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2679/5461] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:41 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:42.742418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:42.744355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] [instance: 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:42.751470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:42.752206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:42.753179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:42.753780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:42.771454 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] HTTP exception thrown: Instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 could not be found. Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Request method failure captured: Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 HTTP/1.1 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq36yKKSuNnP556GMg5lRZatxXVVdN9Yxd0K23NqPWNYdzgdBe6kTaeNOwIq-7an_Hs2QRXrYjRNwziP7GSJEHjo3roB7DGs8tm5TNSi8mQ3q2BwkLkF3gOW1qP6mW3lcMSQ21prWCs1_rcwWA_nmbMl71X3G2obn6bAaCLlO0OXwVhk Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: e1cc7de4264b46bb8e056a6258989c62 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1315634170 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1cc7de4264b46bb8e056a6258989c62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1cc7de4264b46bb8e056a6258989c62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1cc7de4264b46bb8e056a6258989c62", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1cc7de4264b46bb8e056a6258989c62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesSnapshotTestJSON-1315634170 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: e1cc7de4264b46bb8e056a6258989c62 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1315634170 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesSnapshotTestJSON-1315634170-project Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 8a0e4e318982415eae2d2cd2f0d98a35 Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesSnapshotTestJSON-1315634170-project Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 could not be found. Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3d9afb4e-42f1-4dad-85f8-df7eda0c74b4'} Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 could not be found. Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 could not be found. Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:42.773428 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:42.779675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:42.779675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:42.779675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:42.779675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:09:42.779675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:09:42.779675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 could not be found. Jun 16 19:09:42.779675 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:09:42.781461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] Returning 404 to user: Instance 3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:09:42.782909 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3618b4bb-e0f0-46f5-a92b-e46ea9714491 tempest-VolumesSnapshotTestJSON-1315634170 tempest-VolumesSnapshotTestJSON-1315634170-project] 10.222.0.27 "GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4" status: 404 len: 111 microversion: 2.1 time: 0.049816 Jun 16 19:09:42.783692 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2783/5462] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:42 2022] GET /compute/v2.1/servers/3d9afb4e-42f1-4dad-85f8-df7eda0c74b4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:10:45.240145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:45.240878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:45.679430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b86571dd-1e68-4506-87ac-a404f18f2d23 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: .version_select at 0x7f866dd489d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-645347472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDTO2WQJ0Q/clYbCIf/avAinCj52V5WhKat0QMTK3UnepeVNd2Q2hcKwuSHaAO/omCeSwCsKLudSSE5mniGeR6OSox2GtqPYJkHJS8B3Yw/O7jgHCZOTnaBMY8M+L+xIQ=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:45.696798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b86571dd-1e68-4506-87ac-a404f18f2d23 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:10:45.703846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-b86571dd-1e68-4506-87ac-a404f18f2d23 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:10:45.772053 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b86571dd-1e68-4506-87ac-a404f18f2d23 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.533973 Jun 16 19:10:45.773322 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2680/5463] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:10:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:55.288304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:55.290062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:55.295437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-222357245", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "500ee2e5-fa73-46da-a31b-46518333e659"}], "key_name": "tempest-TestNetworkAdvancedServerOps-645347472", "security_groups": [{"name": "tempest-secgroup-smoke-952349531"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:55.483115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] validate_networks() for [('500ee2e5-fa73-46da-a31b-46518333e659', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:10:56.181876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:10:56.182343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:10:56.182832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:10:56.183252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:10:56.183683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:10:56.198162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:56.200947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:56.202177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:56.219483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:56.239913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:10:56.247916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:10:56.302376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:10:56.306911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:10:56.428022 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46cefa0f-a971-43aa-ac4a-fb74730f79db tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.142158 Jun 16 19:10:56.428686 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2784/5464] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:10:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:10:56.444152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23b22e00-6414-4065-a044-0b478b2b1264 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:56.448021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23b22e00-6414-4065-a044-0b478b2b1264 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:56.465872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:56.467749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:56.578615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-23b22e00-6414-4065-a044-0b478b2b1264 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:56.591154 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-23b22e00-6414-4065-a044-0b478b2b1264 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1265 microversion: 2.1 time: 0.150950 Jun 16 19:10:56.592805 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2681/5465] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:56 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:57.611282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:57.616547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:57.639952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:57.643393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:57.645295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:57.648227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:57.850803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:57.869008 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f3be1a77-d4f8-43ed-8750-0aea10aab262 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1261 microversion: 2.1 time: 0.257426 Jun 16 19:10:57.870216 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2785/5466] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:57 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1261 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:58.886730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:58.887244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:58.898539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:58.899089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:58.906178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:58.906875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:59.088561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:59.105275 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e68d43f-7425-4fde-a9f5-23e8f628dab2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1323 microversion: 2.1 time: 0.222734 Jun 16 19:10:59.109773 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2682/5467] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:58 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:00.126421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:00.126976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:00.148665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:00.149760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:00.165124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:00.165752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:00.621965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:00.632149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c744b62-7985-49e2-9308-9033960dd2b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1390 microversion: 2.1 time: 0.509593 Jun 16 19:11:00.638292 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2786/5468] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:00 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1390 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:01.420107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d4ae43ee-dd73-4ce2-be9b-813eda0e4987 req-a0f55145-828c-4d26-9618-f1d1a5584730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:01.431321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d4ae43ee-dd73-4ce2-be9b-813eda0e4987 req-a0f55145-828c-4d26-9618-f1d1a5584730 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.431774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d4ae43ee-dd73-4ce2-be9b-813eda0e4987 req-a0f55145-828c-4d26-9618-f1d1a5584730 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.461093 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d4ae43ee-dd73-4ce2-be9b-813eda0e4987 req-a0f55145-828c-4d26-9618-f1d1a5584730 service nova] Creating event network-changed:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h1-846209-2 Jun 16 19:11:01.471630 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d4ae43ee-dd73-4ce2-be9b-813eda0e4987 req-a0f55145-828c-4d26-9618-f1d1a5584730 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.364844 Jun 16 19:11:01.472639 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2683/5469] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:01.654114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:01.655406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:01.663767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.664520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.665873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.666513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.902936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:01.911315 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d3a61764-590e-43b2-97ac-89b1d196bd59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1390 microversion: 2.1 time: 0.262015 Jun 16 19:11:01.912567 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2787/5470] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:01 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:02.941394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:02.942120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:02.968633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:02.970855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:02.972628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:02.976146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:03.231163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:03.248758 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f616a497-c4ff-4fb6-9055-6543f8272197 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1390 microversion: 2.1 time: 0.318778 Jun 16 19:11:03.254827 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2684/5471] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:02 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1390 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:04.270388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:04.270935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:04.279393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:04.279849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:04.280668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:04.281110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:04.582096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:04.592410 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d82f60e-d865-4875-9d4f-4e73a8238cd6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1390 microversion: 2.1 time: 0.329179 Jun 16 19:11:04.595676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2788/5472] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:04 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1390 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:05.613440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:05.614057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:05.623131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:05.623773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:05.625680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:05.626321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:05.820116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:05.828522 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4d56eb6b-192c-422c-92b7-223ac89cf626 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1390 microversion: 2.1 time: 0.219381 Jun 16 19:11:05.829633 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2685/5473] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:05 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:06.745897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1d45f23a-40a5-4806-af42-a4b046e53eb3 req-d3f1d8a6-d482-48ae-95fd-705c374c527c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "name": "network-vif-plugged", "status": "completed", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:06.751520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:06.752353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:06.764943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1d45f23a-40a5-4806-af42-a4b046e53eb3 req-d3f1d8a6-d482-48ae-95fd-705c374c527c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:06.765397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1d45f23a-40a5-4806-af42-a4b046e53eb3 req-d3f1d8a6-d482-48ae-95fd-705c374c527c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:06.788462 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1d45f23a-40a5-4806-af42-a4b046e53eb3 req-d3f1d8a6-d482-48ae-95fd-705c374c527c service nova] Creating event network-vif-plugged:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h1-846209-2 Jun 16 19:11:06.811926 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1d45f23a-40a5-4806-af42-a4b046e53eb3 req-d3f1d8a6-d482-48ae-95fd-705c374c527c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070164 Jun 16 19:11:06.813174 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2789/5474] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:06.843639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:06.849291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:06.849940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:06.871066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:06.871760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:06.872764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:06.873383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:07.127675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:07.137898 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0157f5bc-8750-4b62-856a-3bd989b2cbc3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1390 microversion: 2.1 time: 0.295201 Jun 16 19:11:07.138848 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2686/5475] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:06 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1390 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:08.157758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:08.159077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:08.169458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:08.170280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:08.171774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:08.172436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:08.339926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:08.356188 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e7afc1e-5e89-4dfe-b43f-eca357bb138c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1390 microversion: 2.1 time: 0.203414 Jun 16 19:11:08.356829 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2790/5476] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:08 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:09.372675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:09.375046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:09.391526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:09.392324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:09.393318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:09.394684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:09.587720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:09.596076 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c36bb306-c327-4e1a-aaad-b0d1f04c6d13 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1563 microversion: 2.1 time: 0.227133 Jun 16 19:11:09.600869 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2687/5477] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:09 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:09.619991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:09.621452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:09.631030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:09.631491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:09.632288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:09.633300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:09.844136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:09.853342 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25205da0-5edc-46f1-b0e8-be7eb378ad0e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1563 microversion: 2.1 time: 0.237939 Jun 16 19:11:09.854387 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2791/5478] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:09 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:12.943102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:12.944562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:12.950164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1308c44d-fbef-4fd3-b0ae-ceb018f1cb2d req-44f670e7-7d34-4ef8-8377-3fc3db4f6619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:12.960642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:12.962289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:12.964997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:12.968375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:12.969602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1308c44d-fbef-4fd3-b0ae-ceb018f1cb2d req-44f670e7-7d34-4ef8-8377-3fc3db4f6619 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:12.971599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1308c44d-fbef-4fd3-b0ae-ceb018f1cb2d req-44f670e7-7d34-4ef8-8377-3fc3db4f6619 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:13.001808 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1308c44d-fbef-4fd3-b0ae-ceb018f1cb2d req-44f670e7-7d34-4ef8-8377-3fc3db4f6619 service nova] Creating event network-changed:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h1-846209-2 Jun 16 19:11:13.016205 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1308c44d-fbef-4fd3-b0ae-ceb018f1cb2d req-44f670e7-7d34-4ef8-8377-3fc3db4f6619 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069024 Jun 16 19:11:13.017646 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2792/5479] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:13.387407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:13.404391 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d5283e90-db93-4bb3-8fb0-d33084f233b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1563 microversion: 2.1 time: 0.467316 Jun 16 19:11:13.408585 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2688/5480] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:12 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1563 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:21.612918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1752378382", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:21.705495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:11:22.264521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:11:22.264955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:11:22.265438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:11:22.265852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:11:22.266318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:11:22.300057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:22.300809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:22.302615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:22.303076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:22.354068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Getting quotas for project 92fdf289f5aa4397a4b9c7ef54330c7f. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:11:22.363714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Getting quotas for user 96e4c43c008a4e93a0ed8ebf7477fe68 and project 92fdf289f5aa4397a4b9c7ef54330c7f. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:11:22.381007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:11:22.385291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:11:22.498703 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5651eaf2-4ec9-4bd3-bc80-7e8c7780bf2d tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891353 Jun 16 19:11:22.501457 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2793/5481] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:11:22.510164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f2c1cb8e-19e5-4d10-b6ae-64f5a057f225 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:22.511692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f2c1cb8e-19e5-4d10-b6ae-64f5a057f225 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:22.671623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f2c1cb8e-19e5-4d10-b6ae-64f5a057f225 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:22.684945 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f2c1cb8e-19e5-4d10-b6ae-64f5a057f225 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1215 microversion: 2.1 time: 0.179162 Jun 16 19:11:22.686260 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2689/5482] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:22 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:23.706477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:23.707270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:23.744877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:23.746133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:23.747268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:23.748832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:23.925414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:23.934210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5baa8fed-ee47-4631-838c-449d9b925133 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1211 microversion: 2.1 time: 0.233928 Jun 16 19:11:23.944078 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2794/5483] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:23 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1211 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:24.954375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:24.956060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:24.971414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=38 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:24.979658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:24.981870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:24.988696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:24.989360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:25.122205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:25.141045 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-35e6ba82-52f2-445b-aa5b-05a8ab962627 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1273 microversion: 2.1 time: 0.191779 Jun 16 19:11:25.141656 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2690/5484] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:24 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:26.166662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:26.168004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:26.182826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:26.184487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:26.190559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:26.191645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:26.192052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:26.227053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=51 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:26.301899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:26.318321 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1c7151a-798b-4c8f-8908-e8af0b8fb237 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1273 microversion: 2.1 time: 0.162170 Jun 16 19:11:26.318929 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2795/5485] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:26 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:27.340422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:27.341889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:27.347509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=25 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:27.351287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:27.352564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:27.355277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:27.356239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:27.583339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:27.593143 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa8f8b87-48bc-478e-ac77-5600cab54f4e tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1315 microversion: 2.1 time: 0.260358 Jun 16 19:11:27.594297 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2691/5486] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:27 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:28.611990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:28.615041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:28.628167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:28.629289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:28.630352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:28.631180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:28.757398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b2fb5080-2807-40fe-b8e1-b55856857352 req-a4985920-44a1-4d75-a8ff-feb8cd397385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd92fc70-2ded-4000-b9a9-2f1bd07822b5", "tag": "d867de7f-5c3f-4edb-8b14-dab36abff607"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:28.774894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b2fb5080-2807-40fe-b8e1-b55856857352 req-a4985920-44a1-4d75-a8ff-feb8cd397385 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:28.775795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b2fb5080-2807-40fe-b8e1-b55856857352 req-a4985920-44a1-4d75-a8ff-feb8cd397385 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:28.796717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b2fb5080-2807-40fe-b8e1-b55856857352 req-a4985920-44a1-4d75-a8ff-feb8cd397385 service nova] Creating event network-changed:d867de7f-5c3f-4edb-8b14-dab36abff607 for instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 on n-h2-846209-2 Jun 16 19:11:28.804205 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b2fb5080-2807-40fe-b8e1-b55856857352 req-a4985920-44a1-4d75-a8ff-feb8cd397385 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384414 Jun 16 19:11:28.806069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2796/5487] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:28.865726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:28.876253 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4e0b0c36-4a9f-4c42-ae49-8e0174161204 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1315 microversion: 2.1 time: 0.269037 Jun 16 19:11:28.877317 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2692/5488] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:28 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:29.896365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:29.898795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:29.905997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:29.906708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:29.907710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:29.908357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:30.099316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:30.108215 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a80f7dae-fc7e-43eb-8186-03721f462739 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1315 microversion: 2.1 time: 0.216716 Jun 16 19:11:30.118314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2797/5489] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:29 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:31.127875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:31.130637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:31.140490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:31.141736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:31.142222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:31.142673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:31.369723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:31.392187 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94065356-8bca-4422-bf49-c9dd2ba78b71 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1315 microversion: 2.1 time: 0.270296 Jun 16 19:11:31.406367 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2693/5490] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:31 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:31.703684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1207891598", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "88550d56-daa1-4b22-851f-5cb95c26c38d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b0a-381d-4be1-a4a0-bfd044486ffa"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:31.796728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] validate_networks() for [('06296b0a-381d-4be1-a4a0-bfd044486ffa', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:11:32.251482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:11:32.252339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:11:32.253002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:11:32.253851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:11:32.254480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:11:32.264842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:32.265545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:32.266569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:32.267044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:32.287950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:11:32.295086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:11:32.375878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:11:32.377886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88550d56-daa1-4b22-851f-5cb95c26c38d',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:11:32.411397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:32.413585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:32.422062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:32.422783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:32.423652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:32.424320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:32.561405 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-584cb1a7-02fc-43d2-9177-bce0dec1c7ba tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861494 Jun 16 19:11:32.562106 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2798/5491] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:11:32.576110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ed4ba1e7-4204-4ed1-83e7-e971ae9cceff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:32.576844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ed4ba1e7-4204-4ed1-83e7-e971ae9cceff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:32.613171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:32.622258 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-11cd8f1f-4179-4f79-9fa9-aab2046bf661 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1315 microversion: 2.1 time: 0.215673 Jun 16 19:11:32.624142 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2694/5492] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:32 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:32.674762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed4ba1e7-4204-4ed1-83e7-e971ae9cceff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:32.692647 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ed4ba1e7-4204-4ed1-83e7-e971ae9cceff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1057 microversion: 2.1 time: 0.123484 Jun 16 19:11:32.693237 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2799/5493] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:32 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1057 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:33.335014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-47e3e229-30e1-4ff5-8025-877d2ee4d096 req-25f727fa-d0c2-4e32-b00e-4917e21d6e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd92fc70-2ded-4000-b9a9-2f1bd07822b5", "name": "network-vif-plugged", "status": "completed", "tag": "d867de7f-5c3f-4edb-8b14-dab36abff607"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:33.340201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:33.358720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-47e3e229-30e1-4ff5-8025-877d2ee4d096 req-25f727fa-d0c2-4e32-b00e-4917e21d6e93 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:33.359466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-47e3e229-30e1-4ff5-8025-877d2ee4d096 req-25f727fa-d0c2-4e32-b00e-4917e21d6e93 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:33.385131 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-47e3e229-30e1-4ff5-8025-877d2ee4d096 req-25f727fa-d0c2-4e32-b00e-4917e21d6e93 service nova] Creating event network-vif-plugged:d867de7f-5c3f-4edb-8b14-dab36abff607 for instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 on n-h2-846209-2 Jun 16 19:11:33.392044 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-47e3e229-30e1-4ff5-8025-877d2ee4d096 req-25f727fa-d0c2-4e32-b00e-4917e21d6e93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061790 Jun 16 19:11:33.392664 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2695/5494] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:33.642722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:33.643408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:33.652015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:33.652738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:33.653550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:33.654045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:33.711012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:33.713381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:33.721533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:33.722184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:33.723955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:33.724510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:33.845794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:33.853958 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-022a9139-3376-4fc8-8d37-86632c6b6eea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1163 microversion: 2.1 time: 0.147393 Jun 16 19:11:33.863323 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2696/5495] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:33 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1163 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:33.923424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:33.931857 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-42400f20-bf71-43a9-9507-14a5d8d31118 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1315 microversion: 2.1 time: 0.293283 Jun 16 19:11:33.934556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2800/5496] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:33 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:34.873659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:34.874337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:34.886852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:34.887620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:34.888639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:34.889441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:34.951879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:34.952513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:34.963560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:34.964027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:34.964822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:34.965271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:35.156947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:35.169129 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4f7024ef-8c35-455d-bbe4-8d89b9b0cc40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1173 microversion: 2.1 time: 0.300908 Jun 16 19:11:35.170375 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2697/5497] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:34 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1173 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:35.460182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:35.469806 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-99e638f5-91d7-4530-a33d-ece8f8d5acf2 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1464 microversion: 2.1 time: 0.522000 Jun 16 19:11:35.471070 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2801/5498] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:34 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1464 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:35.537056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:35.537575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:35.557805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:35.558455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:35.559498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:35.560051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:35.621202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:11:35.768258 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1f91a2d-8782-4acd-a84e-15ebfafe1a61 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 204 len: 0 microversion: 2.1 time: 0.235276 Jun 16 19:11:35.769725 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2698/5499] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:11:35 2022] DELETE /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:11:35.777366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:35.778372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:35.787992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:35.789070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:35.790854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:35.791483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:36.174255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:36.183749 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-83838c58-560e-4237-b0ac-835758ef3c7b tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1470 microversion: 2.1 time: 0.410367 Jun 16 19:11:36.183947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e16b30e0-8183-4670-8a03-781413ad6fca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:36.185138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e16b30e0-8183-4670-8a03-781413ad6fca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:36.185490 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2802/5500] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:35 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:36.190350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:36.191263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:36.198747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:36.199577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:36.200934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:36.201636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:36.211986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e16b30e0-8183-4670-8a03-781413ad6fca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:36.212226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e16b30e0-8183-4670-8a03-781413ad6fca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:36.216757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e16b30e0-8183-4670-8a03-781413ad6fca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:36.217308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e16b30e0-8183-4670-8a03-781413ad6fca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:36.300227 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e16b30e0-8183-4670-8a03-781413ad6fca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action" status: 200 len: 24565 microversion: 2.1 time: 0.125755 Jun 16 19:11:36.301703 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2699/5501] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:11:36 2022] POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action => generated 24565 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:11:36.479882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:36.489394 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3b93f20d-16c9-494d-94c1-737affe479dc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1215 microversion: 2.1 time: 0.302175 Jun 16 19:11:36.497537 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2803/5502] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:36 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:36.873951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4d699f85-52a6-4689-b071-da8c63c6bf9f req-47b5d218-0769-431e-9f7a-baf48f338058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0896eae-67e9-445b-8490-21caa6919fe5", "tag": "7fb807e2-3222-4d2f-8421-d9e4bd2e45ee"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:36.890059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4d699f85-52a6-4689-b071-da8c63c6bf9f req-47b5d218-0769-431e-9f7a-baf48f338058 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:36.890789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4d699f85-52a6-4689-b071-da8c63c6bf9f req-47b5d218-0769-431e-9f7a-baf48f338058 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:36.934755 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4d699f85-52a6-4689-b071-da8c63c6bf9f req-47b5d218-0769-431e-9f7a-baf48f338058 service nova] Creating event network-changed:7fb807e2-3222-4d2f-8421-d9e4bd2e45ee for instance a0896eae-67e9-445b-8490-21caa6919fe5 on n-h1-846209-2 Jun 16 19:11:36.947041 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4d699f85-52a6-4689-b071-da8c63c6bf9f req-47b5d218-0769-431e-9f7a-baf48f338058 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076765 Jun 16 19:11:36.949846 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2700/5503] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:37.209057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:37.209686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:37.218879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:37.219530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:37.220549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:37.221163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:37.515977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:37.517289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:37.534661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:37.535683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:37.536709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:37.537319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:37.600629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96e4c43c008a4e93a0ed8ebf7477fe68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fdf289f5aa4397a4b9c7ef54330c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:37.615740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54658a33-7b6d-4c1a-9b21-4308bd2e5c00 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 200 len: 1470 microversion: 2.1 time: 0.410408 Jun 16 19:11:37.616430 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2804/5504] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:37 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 1470 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:37.795199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-808d7b7b-4570-43c7-aa99-8d35df8b31ab req-e367c624-8073-4315-a286-1db31eb79294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd92fc70-2ded-4000-b9a9-2f1bd07822b5", "name": "network-vif-deleted", "tag": "d867de7f-5c3f-4edb-8b14-dab36abff607"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:37.815778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-808d7b7b-4570-43c7-aa99-8d35df8b31ab req-e367c624-8073-4315-a286-1db31eb79294 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:37.816235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-808d7b7b-4570-43c7-aa99-8d35df8b31ab req-e367c624-8073-4315-a286-1db31eb79294 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:37.836778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-808d7b7b-4570-43c7-aa99-8d35df8b31ab req-e367c624-8073-4315-a286-1db31eb79294 service nova] Creating event network-vif-deleted:d867de7f-5c3f-4edb-8b14-dab36abff607 for instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 on n-h2-846209-2 Jun 16 19:11:37.842677 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-808d7b7b-4570-43c7-aa99-8d35df8b31ab req-e367c624-8073-4315-a286-1db31eb79294 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055108 Jun 16 19:11:37.847515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2805/5505] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:37.967159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:37.979543 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff2d4ef7-502b-4194-9c5e-6adaf5ea83ca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1215 microversion: 2.1 time: 0.468419 Jun 16 19:11:37.982844 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2701/5506] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:37 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1215 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:38.634333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:38.635127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] [instance: fd92fc70-2ded-4000-b9a9-2f1bd07822b5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:38.642374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:38.642906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:38.643752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:38.644256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:38.658900 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] HTTP exception thrown: Instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 could not be found. Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Request method failure captured: Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 HTTP/1.1 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWhmHoHaI_h1Br9Vc-xl-XcUExe8UApgFpwQUdBps5pVpJn3LCOSr39s2HrBQuXOpOLJvWPumQkWxrCZviEHvVvcBpDgHO2R8JKxPoYqXu-1Xu6fPnetvfxziFnoaY8j3IWzFQvV82Vx4D0-4oCv1IfGnksl3Kmp_yv0vfQBC8q-o Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 92fdf289f5aa4397a4b9c7ef54330c7f Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-VolumesNegativeTest-2092035395 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92fdf289f5aa4397a4b9c7ef54330c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/92fdf289f5aa4397a4b9c7ef54330c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_92fdf289f5aa4397a4b9c7ef54330c7f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/92fdf289f5aa4397a4b9c7ef54330c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-VolumesNegativeTest-2092035395 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 92fdf289f5aa4397a4b9c7ef54330c7f Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-VolumesNegativeTest-2092035395 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-VolumesNegativeTest-2092035395-project Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 96e4c43c008a4e93a0ed8ebf7477fe68 Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-VolumesNegativeTest-2092035395-project Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 could not be found. Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'fd92fc70-2ded-4000-b9a9-2f1bd07822b5'} Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 could not be found. Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 could not be found. Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:11:38.660919 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 could not be found. Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] Returning 404 to user: Instance fd92fc70-2ded-4000-b9a9-2f1bd07822b5 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:11:38.668951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2aab9166-c74e-447b-80f4-892b2e4c8032 tempest-VolumesNegativeTest-2092035395 tempest-VolumesNegativeTest-2092035395-project] 10.222.0.27 "GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5" status: 404 len: 111 microversion: 2.1 time: 0.033363 Jun 16 19:11:38.670608 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2806/5507] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:38 2022] GET /compute/v2.1/servers/fd92fc70-2ded-4000-b9a9-2f1bd07822b5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:11:39.002966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:39.003762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:39.015426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:39.015982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:39.017477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:39.018303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:39.253163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:39.277496 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd1be35e-9b57-49d1-b4a5-b442ad0938fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1215 microversion: 2.1 time: 0.269592 Jun 16 19:11:39.277496 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2702/5508] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:38 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:40.286305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:40.287090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:40.306430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:40.306902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:40.307910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:40.308523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:40.550864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:40.564689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9030ad9a-db07-46af-9d8b-0e2749c858e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1215 microversion: 2.1 time: 0.284488 Jun 16 19:11:40.569950 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2807/5509] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:40 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:41.581404 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:41.582098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:41.590128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:41.590745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:41.591535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:41.591979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:41.745880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:41.759997 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bb590212-9339-4354-9227-f382b2cb6ae4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.182279 Jun 16 19:11:41.761531 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2703/5510] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:41 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:42.779038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:42.779667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:42.782785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:42.783627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=14 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:42.790254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:42.790784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:42.791641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:42.792140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:42.940675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:42.952235 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb4572b1-49aa-4159-8db0-3cae8587e9a6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.177097 Jun 16 19:11:42.953636 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2808/5511] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:42 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:43.968891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:43.969518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:43.977754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:43.978203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:43.979124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:43.979890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:44.133830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:44.143427 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16d3b91c-542c-4da6-91f7-eb569967568c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.178403 Jun 16 19:11:44.144024 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2704/5512] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:43 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:45.162532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:45.163737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:45.171915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:45.172675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:45.173581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:45.174158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:45.319776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:45.327874 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2d2e741b-4fc0-49f1-a0ab-4dc804fe37ae tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.169558 Jun 16 19:11:45.328583 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2809/5513] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:45 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:45.458447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0bd755b2-d3df-4a5d-92a6-45b87c39f1a2 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Action: 'create', calling method: .version_select at 0x7f866dcc9f70>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-318874397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfohMuUP+sMHGUrBMI0P3ktUijckvgAdbU2LMnsZlEdo2ouLC1jlA03GfiFhjidwldaiGae047TqcSlVe267hGlXxdO1lxx3LVWTi9lcnbjoYeT0FzB2fxIAIZnsC97Ag=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:45.474518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0bd755b2-d3df-4a5d-92a6-45b87c39f1a2 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Getting quotas for project 42601299f9f84359aece09f814b6997f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:11:45.480337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-0bd755b2-d3df-4a5d-92a6-45b87c39f1a2 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Getting quotas for user 3a2640e1b8824def845d75a2ecf664b3 and project 42601299f9f84359aece09f814b6997f. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:11:45.506157 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0bd755b2-d3df-4a5d-92a6-45b87c39f1a2 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.051412 Jun 16 19:11:45.506920 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2705/5514] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:11:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:46.346465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:46.347680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:46.355942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:46.356409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:46.357209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:46.357653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:46.496159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:46.504395 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e7acc505-33f7-46ae-8f61-7bd733ac4c41 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.162323 Jun 16 19:11:46.504983 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2810/5515] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:46 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:46.533303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-170919978", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0093215a-a638-4b63-98d6-499de5ed53ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-318874397", "security_groups": [{"name": "tempest-secgroup-smoke-489029572"}], "networks": [{"uuid": "0445d1e5-0b52-440b-b685-7e74d63f77af"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:46.644375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] validate_networks() for [('0445d1e5-0b52-440b-b685-7e74d63f77af', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:11:47.025338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:11:47.025761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:11:47.026277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:11:47.026692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:11:47.027108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:11:47.036274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.036735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.037537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.038007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.056335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Getting quotas for project 42601299f9f84359aece09f814b6997f. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:11:47.061677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Getting quotas for user 3a2640e1b8824def845d75a2ecf664b3 and project 42601299f9f84359aece09f814b6997f. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:11:47.121598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:11:47.123746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0093215a-a638-4b63-98d6-499de5ed53ea',volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:11:47.255005 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-12a9e3cb-f4e4-42df-b64e-26213b5fe528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725723 Jun 16 19:11:47.255651 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2706/5516] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:11:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:11:47.266491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f31bba6-4778-4ab6-a3f8-bbbd722a6463 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:47.267341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f31bba6-4778-4ab6-a3f8-bbbd722a6463 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:47.326015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8f31bba6-4778-4ab6-a3f8-bbbd722a6463 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:47.332745 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f31bba6-4778-4ab6-a3f8-bbbd722a6463 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1097 microversion: 2.1 time: 0.070289 Jun 16 19:11:47.333537 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2811/5517] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:47 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1097 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:47.385831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c06befa-f854-4b08-a8a6-bc16c2b14559 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:47.386630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c06befa-f854-4b08-a8a6-bc16c2b14559 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:47.392811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c06befa-f854-4b08-a8a6-bc16c2b14559 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.393264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c06befa-f854-4b08-a8a6-bc16c2b14559 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.394058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c06befa-f854-4b08-a8a6-bc16c2b14559 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.394507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c06befa-f854-4b08-a8a6-bc16c2b14559 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.522337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:47.523111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:47.531295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.531675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.532652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.533388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.689589 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c06befa-f854-4b08-a8a6-bc16c2b14559 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1833 microversion: 2.1 time: 0.307938 Jun 16 19:11:47.690720 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2707/5518] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:47 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1833 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:47.708463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:47.709617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:47.717901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.718541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.719428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.719969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.724564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:47.728960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:47.741604 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fa458b14-5b72-47f8-beb3-08a66187b952 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.223149 Jun 16 19:11:47.742282 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2812/5519] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:47 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:47.868844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:47.876653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9b65ea43-9177-4f37-bb5d-8f65b4add924 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1682 microversion: 2.1 time: 0.172829 Jun 16 19:11:47.877243 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2708/5520] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:47 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:47.971220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b69f39a8-6610-446f-a0b1-67a822604795 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:47.972190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b69f39a8-6610-446f-a0b1-67a822604795 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:47.979178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69f39a8-6610-446f-a0b1-67a822604795 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.979635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69f39a8-6610-446f-a0b1-67a822604795 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:47.980409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69f39a8-6610-446f-a0b1-67a822604795 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:47.980859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b69f39a8-6610-446f-a0b1-67a822604795 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.029813 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b69f39a8-6610-446f-a0b1-67a822604795 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action" status: 200 len: 32639 microversion: 2.1 time: 0.062413 Jun 16 19:11:48.030631 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2813/5521] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:11:47 2022] POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action => generated 32639 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 19:11:48.190307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:48.190829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:48.199012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.199477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.200291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.200733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.244553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b003a305c0bd430c8fff24844b6df966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5273abd2b4798a27c4abcdbc9c32f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:48.245439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] flavor_id is None. Assuming migration. {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 16 19:11:48.245986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:11:48.350303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:48.351232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:48.360899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.361350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.362148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.362945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.449418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:48.463636 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cf80a1da-0c98-40bc-ae2f-1a499c7ecaaa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1213 microversion: 2.1 time: 0.117495 Jun 16 19:11:48.464228 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2814/5522] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:48 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:48.727369 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-126d6d38-475b-414a-be31-080d537886ea tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action" status: 202 len: 0 microversion: 2.1 time: 0.541596 Jun 16 19:11:48.729024 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2709/5523] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:11:48 2022] POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:11:48.737664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:48.739122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:48.748149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.748655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.749444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.750041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.763265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:48.764326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:48.779774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.782357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:48.785504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:48.786232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:49.227598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:49.239481 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-73a7725e-ffe8-4d45-af1b-880409e8c325 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1691 microversion: 2.1 time: 0.506145 Jun 16 19:11:49.242737 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2815/5524] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:48 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1691 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:49.247605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:49.256083 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f9f68da-81f2-4b4e-b6cc-91d06e6c7999 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.500315 Jun 16 19:11:49.268474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2710/5525] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:48 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:49.482282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:49.483662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:49.493252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:49.494192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:49.495545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:49.496498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:49.740392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:49.742979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:49.751356 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-193847d0-9b59-4ae0-9bf5-0acd76211288 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1280 microversion: 2.1 time: 0.274673 Jun 16 19:11:49.752607 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2816/5526] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:49 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:50.147089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-125cb9ff-c502-426f-bddd-0d0f3d249b0d req-e4f46e52-8936-48c9-827f-af70cf451355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3cba29-c052-436c-9c23-ccc0f17a3b17", "tag": "0ff67b4a-e234-48d5-af8b-3cac02f04ebf"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:50.163732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-125cb9ff-c502-426f-bddd-0d0f3d249b0d req-e4f46e52-8936-48c9-827f-af70cf451355 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:50.169900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-125cb9ff-c502-426f-bddd-0d0f3d249b0d req-e4f46e52-8936-48c9-827f-af70cf451355 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:50.189616 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-125cb9ff-c502-426f-bddd-0d0f3d249b0d req-e4f46e52-8936-48c9-827f-af70cf451355 service nova] Creating event network-changed:0ff67b4a-e234-48d5-af8b-3cac02f04ebf for instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 on n-h2-846209-2 Jun 16 19:11:50.199068 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-125cb9ff-c502-426f-bddd-0d0f3d249b0d req-e4f46e52-8936-48c9-827f-af70cf451355 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055681 Jun 16 19:11:50.200616 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2711/5527] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:50.277375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:50.277732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:50.285661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:50.287543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:50.291052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:50.294505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:50.295697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:50.296364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:50.299960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:50.300842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:50.302268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:50.305993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:51.030044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:51.039210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af4a910c-a9e9-4fb5-a49e-1d3c02f59b10 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1691 microversion: 2.1 time: 0.773866 Jun 16 19:11:51.041269 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2817/5528] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:50 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1691 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:51.046216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:51.047075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:51.058194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:51.058918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:51.059896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:51.060671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:51.068886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:51.082599 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b87e123f-d460-4ccc-a63c-878ff29a4207 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.806442 Jun 16 19:11:51.089990 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2712/5529] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:50 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:51.094011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ab9a0c09-b871-4931-bb92-0f64b654e1e5 req-7398c902-0f92-43ac-a62b-39ed0156b163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0896eae-67e9-445b-8490-21caa6919fe5", "name": "network-vif-plugged", "status": "completed", "tag": "7fb807e2-3222-4d2f-8421-d9e4bd2e45ee"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:51.118707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ab9a0c09-b871-4931-bb92-0f64b654e1e5 req-7398c902-0f92-43ac-a62b-39ed0156b163 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:51.119419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ab9a0c09-b871-4931-bb92-0f64b654e1e5 req-7398c902-0f92-43ac-a62b-39ed0156b163 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:51.139405 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ab9a0c09-b871-4931-bb92-0f64b654e1e5 req-7398c902-0f92-43ac-a62b-39ed0156b163 service nova] Creating event network-vif-plugged:7fb807e2-3222-4d2f-8421-d9e4bd2e45ee for instance a0896eae-67e9-445b-8490-21caa6919fe5 on n-h1-846209-2 Jun 16 19:11:51.144620 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ab9a0c09-b871-4931-bb92-0f64b654e1e5 req-7398c902-0f92-43ac-a62b-39ed0156b163 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060238 Jun 16 19:11:51.145445 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2713/5530] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:51.370690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:51.380267 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da3e99c1-242e-4d39-add1-4c614290dd7e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1280 microversion: 2.1 time: 0.337555 Jun 16 19:11:51.381152 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2818/5531] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:51 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:52.059175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:52.059805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:52.066238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:52.066702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:52.067479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:52.067925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:52.099806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:52.100614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:52.110757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:52.111266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:52.112232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:52.112692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:52.270058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:52.283495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa2a2977-9065-461a-8120-514f70cfd607 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1691 microversion: 2.1 time: 0.229034 Jun 16 19:11:52.294034 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2714/5532] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:52 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:52.319853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:52.329752 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1e905cc-b09e-497a-a63a-013c00379e28 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1203 microversion: 2.1 time: 0.234048 Jun 16 19:11:52.330367 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2819/5533] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:52 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:52.397935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:52.398774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:52.405493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:52.406081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:52.406857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:52.407301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:52.547495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:52.561707 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6639e837-52eb-412b-a997-b6aa443d7364 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1280 microversion: 2.1 time: 0.167393 Jun 16 19:11:52.573941 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2715/5534] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:52 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:53.301168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:53.301944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:53.310077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.310530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.311303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.311744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.355855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:53.356512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:53.363627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.371648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.372533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.373403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.500955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:53.509745 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c21c6a19-a241-45d9-b6fb-c7651cdf980a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.212628 Jun 16 19:11:53.510942 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2820/5535] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:53 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:53.547254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:53.555253 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1fc157c1-8559-42a5-99d6-b58c1f709876 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1390 microversion: 2.1 time: 0.212417 Jun 16 19:11:53.556098 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2716/5536] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:53 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1390 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:53.573242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:53.573867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:53.579819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:53.580526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:53.580755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.581237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.582048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.582626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.588524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.589056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.589922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.590432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.802713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:53.809368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:53.811452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-44b83dfc-df7b-4590-a51d-8c0b69158a27 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1390 microversion: 2.1 time: 0.242763 Jun 16 19:11:53.812043 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2821/5537] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:53 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:53.817298 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b6bda705-a476-4240-be7f-57522f4b51de tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1280 microversion: 2.1 time: 0.241536 Jun 16 19:11:53.818131 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2717/5538] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:53 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:53.828096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:53.828716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:53.835935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.836284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.837157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:53.837610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:53.982067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:53.990157 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cc618e30-1236-4320-be60-742643865e22 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1390 microversion: 2.1 time: 0.165896 Jun 16 19:11:53.990739 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2822/5539] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:53 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:54.007005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:54.007640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:54.015736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.016186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.016961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.017397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.047254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:11:54.142592 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f6260dde-ef02-419b-b1bc-7ec94ccc36c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 204 len: 0 microversion: 2.1 time: 0.138916 Jun 16 19:11:54.143355 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2718/5540] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:11:54 2022] DELETE /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:11:54.153230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:54.154108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:54.161231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.161691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.162540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.162996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.302079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:54.310437 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-16acf112-e9e7-4f9f-bf85-163603a60ab2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1396 microversion: 2.1 time: 0.162496 Jun 16 19:11:54.311023 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2823/5541] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:54 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:54.529060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:54.529771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:54.536703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.537156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.537941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.538387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.671693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:54.679302 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bacb04f9-5faf-47ab-9d21-83e931311993 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.155355 Jun 16 19:11:54.680402 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2719/5542] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:54 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:54.835116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:54.835649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:54.842092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.842546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.843369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:54.843803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:54.984814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:54.992790 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ed1cdd4-d95e-45b9-ab20-d876b354bb0e tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.161627 Jun 16 19:11:54.994219 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2824/5543] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:54 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:55.327478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:55.328099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:55.334203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.334656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.335457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.335925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.483926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:55.491700 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e9ff8b0-4f81-46d5-aff1-9af54be362e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1396 microversion: 2.1 time: 0.168161 Jun 16 19:11:55.492276 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2720/5544] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:55 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1396 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:55.698201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:55.698767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:55.705681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.706168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.706935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.707372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.938817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:55.947190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a8c2880-c198-43e9-af44-64d84956816b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.253505 Jun 16 19:11:55.956894 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2825/5545] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:55 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:56.011717 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:56.012450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:56.015362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:56.020905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.021439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:56.022242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.022682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:56.242987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:56.251358 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a005c153-aab2-4d43-801b-9c1dfd333484 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.244747 Jun 16 19:11:56.251941 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2721/5546] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:56 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:56.362383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d58ed405-0f5f-476f-9703-6a12bb33d68c req-eb636c87-4ecb-4180-8761-41af6e45377c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0896eae-67e9-445b-8490-21caa6919fe5", "name": "network-vif-deleted", "tag": "7fb807e2-3222-4d2f-8421-d9e4bd2e45ee"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:56.366438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:56.373988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d58ed405-0f5f-476f-9703-6a12bb33d68c req-eb636c87-4ecb-4180-8761-41af6e45377c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.374142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d58ed405-0f5f-476f-9703-6a12bb33d68c req-eb636c87-4ecb-4180-8761-41af6e45377c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:56.388408 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d58ed405-0f5f-476f-9703-6a12bb33d68c req-eb636c87-4ecb-4180-8761-41af6e45377c service nova] Creating event network-vif-deleted:7fb807e2-3222-4d2f-8421-d9e4bd2e45ee for instance a0896eae-67e9-445b-8490-21caa6919fe5 on n-h1-846209-2 Jun 16 19:11:56.395440 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d58ed405-0f5f-476f-9703-6a12bb33d68c req-eb636c87-4ecb-4180-8761-41af6e45377c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036793 Jun 16 19:11:56.396704 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2826/5547] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:56.511212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:56.512004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:56.518663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.519202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:56.520058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.520592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:56.589630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:56.593857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:56.598771 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-380590b9-d957-433d-ab6e-e38217260725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1188 microversion: 2.1 time: 0.093888 Jun 16 19:11:56.599625 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2722/5548] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:56 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:56.966619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:56.967249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:56.973647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.974141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:56.974914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.975358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.112399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:57.121251 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b42b68d-0d70-4947-a470-3f96137470f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.160498 Jun 16 19:11:57.121833 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2827/5549] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:56 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:57.269169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:57.269795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:57.273387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:57.274307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=10 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:57.281350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.281970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.282787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.283501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.430035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:57.438283 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4f5a8617-714f-4b4c-bd7d-899a69230528 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.172946 Jun 16 19:11:57.438875 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2723/5550] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:57 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:57.615871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:57.616495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:57.618643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:57.624385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.624846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.625627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.626105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.690123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:57.697881 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc28dbcd-2d15-4f22-bcf1-06260633c825 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1188 microversion: 2.1 time: 0.085994 Jun 16 19:11:57.698485 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2828/5551] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:57 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:58.139112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:58.139738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:58.145927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.146421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.147198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.147644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.283879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:58.293251 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9c4989e-f326-4f2e-a7c1-a34b1fe5292e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.157982 Jun 16 19:11:58.302755 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2724/5552] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:58 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:58.455413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:58.456033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:58.463378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.463836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.464610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.465052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.607027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:58.614859 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0bc56ade-b592-4f7f-b7ec-29f8fc1e1318 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.163481 Jun 16 19:11:58.615640 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2829/5553] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:58 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:58.714858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:58.715395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:58.721598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.722111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.722887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.723333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.787046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:58.796415 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90a3396e-5cd2-4511-b27b-30435ad36f01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1188 microversion: 2.1 time: 0.085563 Jun 16 19:11:58.797013 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2725/5554] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:58 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:59.310594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:59.311220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:59.317436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.317900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.318705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.319146 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.459122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:59.468025 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-df685b33-a618-424b-a038-c89a7a71e971 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.161968 Jun 16 19:11:59.468752 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2830/5555] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:59 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:59.632267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:59.632824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:59.640008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.640472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.641262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.641710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.787928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:59.798408 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fad6e298-bdd1-4b8a-8979-a3c18ea3c6e8 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.169960 Jun 16 19:11:59.799346 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2726/5556] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:59 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:59.813063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:59.814374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:59.820541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.821006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.822037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.822530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.886226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:59.894177 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e71d2a5-755a-450b-9b6c-2897fa7f4677 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1188 microversion: 2.1 time: 0.084927 Jun 16 19:11:59.894754 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2831/5557] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:59 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:00.485100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:00.485727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:00.492422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.492887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.494868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.495031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.638644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:00.647354 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-245b012b-8103-4787-b1db-344afcbcdd8f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.166221 Jun 16 19:12:00.647973 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2727/5558] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:00 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:00.815662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:00.816262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:00.824124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.824582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.825387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.825835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.914080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:00.914908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:00.923801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.924646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.925428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.925866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.963394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.963874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.964323 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lazy-loading 'fault' on Instance uuid a0896eae-67e9-445b-8490-21caa6919fe5 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:12:00.974227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:00.983256 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-685b8d8d-3cba-44f6-9ed9-ad194490b214 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.171653 Jun 16 19:12:00.983836 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2832/5559] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:00 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:01.018797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:01.026436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e2c8d68a-383c-447c-86d2-ab450543afca tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 200 len: 1193 microversion: 2.1 time: 0.118440 Jun 16 19:12:01.027010 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2728/5560] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:00 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 1193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:12:01.664955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:01.666117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:01.672903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:01.673361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:01.674179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:01.674626 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:01.810402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:01.818032 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6696985d-5bc8-4a8e-95df-06c3b811845c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.157215 Jun 16 19:12:01.818635 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2833/5561] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:01 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:02.000437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:02.001083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:02.007907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:02.008370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.009149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:02.010237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.043772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:02.044444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a0896eae-67e9-445b-8490-21caa6919fe5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:02.051668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:02.052129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.052911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:02.053360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.056756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:02.069061 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance a0896eae-67e9-445b-8490-21caa6919fe5 could not be found. Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 HTTP/1.1 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a0896eae-67e9-445b-8490-21caa6919fe5 could not be found. Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a0896eae-67e9-445b-8490-21caa6919fe5'} Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0896eae-67e9-445b-8490-21caa6919fe5 could not be found. Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0896eae-67e9-445b-8490-21caa6919fe5 could not be found. Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:02.070763 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0896eae-67e9-445b-8490-21caa6919fe5 could not be found. Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance a0896eae-67e9-445b-8490-21caa6919fe5 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-23c56461-9688-47c9-b502-f8a2bfb451c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5" status: 404 len: 111 microversion: 2.1 time: 0.032624 Jun 16 19:12:02.076260 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2834/5562] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:02 2022] GET /compute/v2.1/servers/a0896eae-67e9-445b-8490-21caa6919fe5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:12:02.157944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:02.167612 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5bb18765-80f4-4028-8e7a-6a4198e6138d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.171033 Jun 16 19:12:02.168688 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2729/5563] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:01 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:02.836616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:02.837231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:02.844169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:02.844619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.845450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:02.845889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.996897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:03.004938 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12461e9d-81fc-4d2d-9395-0948d49be4b5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.172145 Jun 16 19:12:03.005539 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2835/5564] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:02 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:03.185447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:03.185999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:03.193334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:03.193788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:03.194593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:03.195028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:03.360067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:03.373590 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-abdbc62e-c46f-46fe-bc5c-618b3f27683f tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.191878 Jun 16 19:12:03.374302 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2730/5565] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:03 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:04.027561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:04.028137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:04.035530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:04.035987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:04.036760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:04.037200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:04.177155 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:04.186355 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-637bbd0e-2929-4562-9f85-a30c13ee9ada tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1696 microversion: 2.1 time: 0.163467 Jun 16 19:12:04.195861 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2836/5566] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:04 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:04.390820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:04.391528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:04.398697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:04.399230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:04.400700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:04.401544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:04.549821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:04.557850 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d458b575-3548-4e42-a1f0-2004480915cd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.170914 Jun 16 19:12:04.558718 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2731/5567] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:04 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:05.204573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:05.205152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:05.212144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.212657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.213432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.214083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.383388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-acee3af4-e794-4651-ae0f-373f21415b22 req-16f744b5-4b9c-43ed-ba38-9b6840fcf9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "name": "network-vif-unplugged", "status": "completed", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:05.403613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-acee3af4-e794-4651-ae0f-373f21415b22 req-16f744b5-4b9c-43ed-ba38-9b6840fcf9b3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.405172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-acee3af4-e794-4651-ae0f-373f21415b22 req-16f744b5-4b9c-43ed-ba38-9b6840fcf9b3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.415251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:05.433713 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4c1ca1ab-68e1-4fbd-b0d3-3257c4d2978d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1695 microversion: 2.1 time: 0.230359 Jun 16 19:12:05.434443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2837/5568] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:05 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1695 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:05.450382 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-acee3af4-e794-4651-ae0f-373f21415b22 req-16f744b5-4b9c-43ed-ba38-9b6840fcf9b3 service nova] Creating event network-vif-unplugged:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h2-846209-2 Jun 16 19:12:05.465177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-acee3af4-e794-4651-ae0f-373f21415b22 req-16f744b5-4b9c-43ed-ba38-9b6840fcf9b3 service nova] Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:12:05.481786 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-acee3af4-e794-4651-ae0f-373f21415b22 req-16f744b5-4b9c-43ed-ba38-9b6840fcf9b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103027 Jun 16 19:12:05.482977 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2732/5569] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:12:05.553689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-954e67e2-7cb4-4b7c-a06c-03f85a6ddf67 req-38e43766-50ca-47f7-9be3-7a262444d9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3cba29-c052-436c-9c23-ccc0f17a3b17", "name": "network-vif-plugged", "status": "completed", "tag": "0ff67b4a-e234-48d5-af8b-3cac02f04ebf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:05.570107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-954e67e2-7cb4-4b7c-a06c-03f85a6ddf67 req-38e43766-50ca-47f7-9be3-7a262444d9af service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.571728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-954e67e2-7cb4-4b7c-a06c-03f85a6ddf67 req-38e43766-50ca-47f7-9be3-7a262444d9af service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.576881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:05.577724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:05.588375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.588885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.594051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.594526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.608841 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-954e67e2-7cb4-4b7c-a06c-03f85a6ddf67 req-38e43766-50ca-47f7-9be3-7a262444d9af service nova] Creating event network-vif-plugged:0ff67b4a-e234-48d5-af8b-3cac02f04ebf for instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 on n-h2-846209-2 Jun 16 19:12:05.621683 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-954e67e2-7cb4-4b7c-a06c-03f85a6ddf67 req-38e43766-50ca-47f7-9be3-7a262444d9af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074821 Jun 16 19:12:05.629223 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2838/5570] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:05.855380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:05.868335 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-defaea36-dc84-44f1-be8d-290901291e31 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.296200 Jun 16 19:12:05.880833 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2733/5571] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:05 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:06.460191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:06.463117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:06.501975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.507539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.508661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.510948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.709819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:06.719802 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-49fe5dac-1fad-4122-948a-3163a5b5116a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1695 microversion: 2.1 time: 0.270008 Jun 16 19:12:06.720749 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2839/5572] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:06 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1695 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:06.888240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:06.888862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:06.897497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.898273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.899085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.899534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:07.062960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:07.070989 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87288403-6037-4a01-922c-e0c52b403ba4 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1268 microversion: 2.1 time: 0.187949 Jun 16 19:12:07.071577 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2734/5573] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:06 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:07.508727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5edda194-6e83-4bab-9ec4-327cd0571e3f req-2c1fb5fc-5cb0-490b-9110-75b9ae96c086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:07.519020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5edda194-6e83-4bab-9ec4-327cd0571e3f req-2c1fb5fc-5cb0-490b-9110-75b9ae96c086 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:07.519468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5edda194-6e83-4bab-9ec4-327cd0571e3f req-2c1fb5fc-5cb0-490b-9110-75b9ae96c086 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:07.541290 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5edda194-6e83-4bab-9ec4-327cd0571e3f req-2c1fb5fc-5cb0-490b-9110-75b9ae96c086 service nova] Creating event network-changed:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h2-846209-2 Jun 16 19:12:07.548885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-5edda194-6e83-4bab-9ec4-327cd0571e3f req-2c1fb5fc-5cb0-490b-9110-75b9ae96c086 service nova] Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:12:07.559848 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5edda194-6e83-4bab-9ec4-327cd0571e3f req-2c1fb5fc-5cb0-490b-9110-75b9ae96c086 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055069 Jun 16 19:12:07.560464 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2840/5574] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:12:07.737737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:07.738387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:07.745625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:07.746379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:07.747201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:07.748352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:07.960025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:07.968688 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5e696248-129a-4785-b5f3-5ec396da3d00 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1693 microversion: 2.1 time: 0.235157 Jun 16 19:12:07.969388 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2735/5575] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:07 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:08.088622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:08.090215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:08.098455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:08.099016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:08.099880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:08.100634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:08.302381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:08.311180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3bb1408-bdb6-4b71-9cd0-e92a9bc0a338 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1458 microversion: 2.1 time: 0.226950 Jun 16 19:12:08.312255 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2841/5576] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:08 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1458 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:08.328750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:08.329372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:08.335932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:08.336394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:08.337179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:08.338287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:08.497398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:08.505260 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8fce7a91-91ee-4e56-b29f-9ac01ea03657 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1458 microversion: 2.1 time: 0.180527 Jun 16 19:12:08.506218 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2736/5577] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:08 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1458 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:08.988647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:08.989981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:09.008753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:09.009129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:09.010293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:09.010740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:09.232819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:09.250382 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb087672-7408-4b11-bb7d-b6a475e2a295 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1693 microversion: 2.1 time: 0.266778 Jun 16 19:12:09.261236 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2842/5578] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:08 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1693 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:10.267965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:10.269982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:10.278185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.278746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.280233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.280919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.706138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:10.713816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c16bc731-cb87-409c-b1d4-ab4be38baf21 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1690 microversion: 2.1 time: 0.449819 Jun 16 19:12:10.714546 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2737/5579] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:10 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1690 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:10.730646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e3e8074-5fc5-4211-8ae2-506da6a37fa5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:10.731234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e3e8074-5fc5-4211-8ae2-506da6a37fa5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:10.738773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e8074-5fc5-4211-8ae2-506da6a37fa5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.739228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e8074-5fc5-4211-8ae2-506da6a37fa5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.740209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e8074-5fc5-4211-8ae2-506da6a37fa5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.740656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e8074-5fc5-4211-8ae2-506da6a37fa5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.807260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e3e8074-5fc5-4211-8ae2-506da6a37fa5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action" status: 204 len: 0 microversion: 2.1 time: 0.079554 Jun 16 19:12:10.809978 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2843/5580] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:12:10 2022] POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:12:10.828905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:10.829719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:10.841792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.842647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.843909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.844553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.905835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-20d844bf-d539-400c-a616-1f09b6bce5ae req-9fdee58d-a50f-40bf-bcba-7956f793ca3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3cba29-c052-436c-9c23-ccc0f17a3b17", "tag": "0ff67b4a-e234-48d5-af8b-3cac02f04ebf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:10.920570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20d844bf-d539-400c-a616-1f09b6bce5ae req-9fdee58d-a50f-40bf-bcba-7956f793ca3f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.921411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20d844bf-d539-400c-a616-1f09b6bce5ae req-9fdee58d-a50f-40bf-bcba-7956f793ca3f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.938357 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-20d844bf-d539-400c-a616-1f09b6bce5ae req-9fdee58d-a50f-40bf-bcba-7956f793ca3f service nova] Creating event network-changed:0ff67b4a-e234-48d5-af8b-3cac02f04ebf for instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 on n-h2-846209-2 Jun 16 19:12:10.945343 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-20d844bf-d539-400c-a616-1f09b6bce5ae req-9fdee58d-a50f-40bf-bcba-7956f793ca3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047056 Jun 16 19:12:10.948817 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2844/5581] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:11.400996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:11.413260 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-746908b7-0a74-4c9b-860e-1546e17f84ae tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1690 microversion: 2.1 time: 0.600707 Jun 16 19:12:11.417231 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2738/5582] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:10 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1690 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:12.437768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:12.438518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:12.446467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:12.447859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:12.448720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:12.449345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:12.766620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:12.776368 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cdc89ea5-e4ee-4474-a21e-1d532b21a1d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1690 microversion: 2.1 time: 0.342248 Jun 16 19:12:12.776989 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2845/5583] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:12 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1690 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:12.973951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9589eb48-90c2-4fd4-a7ad-66996b27ec3b req-6acf9797-a676-41f7-bca7-350afd842eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3cba29-c052-436c-9c23-ccc0f17a3b17", "tag": "0ff67b4a-e234-48d5-af8b-3cac02f04ebf"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:12.984174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9589eb48-90c2-4fd4-a7ad-66996b27ec3b req-6acf9797-a676-41f7-bca7-350afd842eef service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:12.984738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9589eb48-90c2-4fd4-a7ad-66996b27ec3b req-6acf9797-a676-41f7-bca7-350afd842eef service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.001525 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9589eb48-90c2-4fd4-a7ad-66996b27ec3b req-6acf9797-a676-41f7-bca7-350afd842eef service nova] Creating event network-changed:0ff67b4a-e234-48d5-af8b-3cac02f04ebf for instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 on n-h2-846209-2 Jun 16 19:12:13.008325 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9589eb48-90c2-4fd4-a7ad-66996b27ec3b req-6acf9797-a676-41f7-bca7-350afd842eef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036684 Jun 16 19:12:13.009208 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2739/5584] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:13.539369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-61533668-0f84-438a-be03-ae0a84eebe89 req-3e412e78-34ef-4be5-ba86-1df0dddc3d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "name": "network-vif-plugged", "status": "completed", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:13.573082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-61533668-0f84-438a-be03-ae0a84eebe89 req-3e412e78-34ef-4be5-ba86-1df0dddc3d14 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.574244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-61533668-0f84-438a-be03-ae0a84eebe89 req-3e412e78-34ef-4be5-ba86-1df0dddc3d14 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.597368 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-61533668-0f84-438a-be03-ae0a84eebe89 req-3e412e78-34ef-4be5-ba86-1df0dddc3d14 service nova] Creating event network-vif-plugged:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h2-846209-2 Jun 16 19:12:13.603030 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-61533668-0f84-438a-be03-ae0a84eebe89 req-3e412e78-34ef-4be5-ba86-1df0dddc3d14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069513 Jun 16 19:12:13.604759 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2846/5585] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:13.796493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:13.797616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:13.808076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.809097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.810289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.810819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.816056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:13.966466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:13.978355 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a65bd3ea-7533-4d44-89f9-a43f8a079b90 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1682 microversion: 2.1 time: 0.187586 Jun 16 19:12:13.979640 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2740/5586] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:13 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:15.027801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-81337f01-e689-44ed-ac57-536f6e12d1ff req-d96560e8-0953-4dcf-9263-cf8ec16ca1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3cba29-c052-436c-9c23-ccc0f17a3b17", "tag": "0ff67b4a-e234-48d5-af8b-3cac02f04ebf"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:15.040596 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-81337f01-e689-44ed-ac57-536f6e12d1ff req-d96560e8-0953-4dcf-9263-cf8ec16ca1db service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:15.041578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-81337f01-e689-44ed-ac57-536f6e12d1ff req-d96560e8-0953-4dcf-9263-cf8ec16ca1db service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:15.055313 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-81337f01-e689-44ed-ac57-536f6e12d1ff req-d96560e8-0953-4dcf-9263-cf8ec16ca1db service nova] Creating event network-changed:0ff67b4a-e234-48d5-af8b-3cac02f04ebf for instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 on n-h2-846209-2 Jun 16 19:12:15.061646 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-81337f01-e689-44ed-ac57-536f6e12d1ff req-d96560e8-0953-4dcf-9263-cf8ec16ca1db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040839 Jun 16 19:12:15.063215 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2847/5587] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:25.536775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-46205523", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1dc0f3d0-8f40-49da-9a0b-12cccf168a58", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "06296b0a-381d-4be1-a4a0-bfd044486ffa"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:25.546236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=41 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:25.547069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:25.630261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] validate_networks() for [('06296b0a-381d-4be1-a4a0-bfd044486ffa', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:12:26.019571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:12:26.020004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:12:26.020486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:12:26.020906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:12:26.021396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:12:26.031356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:26.031851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:26.032672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:26.039019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:26.061237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:12:26.068033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:12:26.085045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:12:26.087411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1dc0f3d0-8f40-49da-9a0b-12cccf168a58',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:12:26.169421 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27f9e8f4-87a7-4129-9b2c-8b298725ba38 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636339 Jun 16 19:12:26.170309 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2741/5588] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:12:26.179071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=43 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:26.180454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:26.186011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7a8ef00-f535-47b9-bafa-f5b937e09250 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:26.186818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c7a8ef00-f535-47b9-bafa-f5b937e09250 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:26.247409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c7a8ef00-f535-47b9-bafa-f5b937e09250 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:26.256785 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7a8ef00-f535-47b9-bafa-f5b937e09250 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1055 microversion: 2.1 time: 0.079999 Jun 16 19:12:26.257391 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2848/5589] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:26 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1055 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:27.274537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:27.275996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:27.282745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:27.283259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:27.284121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:27.284559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:27.703562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:27.712150 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fb379dd8-cb46-4a95-b7a6-88572b6afb68 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1125 microversion: 2.1 time: 0.442259 Jun 16 19:12:27.727392 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2742/5590] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:27 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1125 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:28.733015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:28.733636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:28.743110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:28.744599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:28.745564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:28.746113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:28.972479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:28.982325 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88cd3d42-7c24-4aab-b870-6cb315f83349 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.253236 Jun 16 19:12:28.984712 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2849/5591] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:28 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:29.137260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8e538b2f-d630-4ebc-8e76-339af30eb12d req-59d76610-02be-4d7b-a829-544f2ae309f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45002551-b13c-45c7-b9bf-ba4ed73a76d4", "tag": "a447c3a2-b9ed-4845-945f-57ef84c81685"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:29.157433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8e538b2f-d630-4ebc-8e76-339af30eb12d req-59d76610-02be-4d7b-a829-544f2ae309f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:29.157875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8e538b2f-d630-4ebc-8e76-339af30eb12d req-59d76610-02be-4d7b-a829-544f2ae309f7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:29.176342 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8e538b2f-d630-4ebc-8e76-339af30eb12d req-59d76610-02be-4d7b-a829-544f2ae309f7 service nova] Creating event network-changed:a447c3a2-b9ed-4845-945f-57ef84c81685 for instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 on n-h1-846209-2 Jun 16 19:12:29.182657 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8e538b2f-d630-4ebc-8e76-339af30eb12d req-59d76610-02be-4d7b-a829-544f2ae309f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051161 Jun 16 19:12:29.183515 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2743/5592] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:30.000568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:30.001156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:30.008973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:30.010434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:30.011295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:30.011883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:30.231248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:30.240997 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b546a98a-d483-4705-bf32-1ed7932c85c0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.244309 Jun 16 19:12:30.241644 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2850/5593] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:29 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:31.272447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:31.273484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:31.283874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:31.284611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:31.285422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:31.286028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:31.496573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:31.505527 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f4bd0234-85e2-4d0c-ba0f-bdcf641178c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.245418 Jun 16 19:12:31.506538 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2744/5594] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:31 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:32.528727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:32.532064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:32.541029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:32.542069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:32.543364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:32.543911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:32.748956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:32.757451 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-076b669e-5876-4a50-9d92-f966cb3adf5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.236814 Jun 16 19:12:32.768650 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2851/5595] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:32 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:33.780998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:33.782071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:33.790047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:33.790890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:33.791762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:33.792293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:33.955766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:33.966921 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-95f397aa-dff9-45ea-98e0-12b8646e560d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.194726 Jun 16 19:12:33.968169 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2745/5596] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:33 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:34.203359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fc0e8eb1-9808-4090-81b3-e2f2d1386621 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:34.204199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fc0e8eb1-9808-4090-81b3-e2f2d1386621 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:34.213301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc0e8eb1-9808-4090-81b3-e2f2d1386621 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:34.214029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc0e8eb1-9808-4090-81b3-e2f2d1386621 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:34.214975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc0e8eb1-9808-4090-81b3-e2f2d1386621 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:34.215415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fc0e8eb1-9808-4090-81b3-e2f2d1386621 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:34.283431 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fc0e8eb1-9808-4090-81b3-e2f2d1386621 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action" status: 200 len: 24570 microversion: 2.1 time: 0.084051 Jun 16 19:12:34.284390 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2852/5597] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:12:34 2022] POST /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996/action => generated 24570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:12:34.985837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:34.987402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:34.996090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:34.996643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:34.997457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:34.998201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:35.172603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:35.180332 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c007abb-99f9-4185-a0fc-373b63710f97 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.198744 Jun 16 19:12:35.181151 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2746/5598] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:34 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:36.197684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:36.198458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:36.206027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:36.206469 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:36.207491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:36.208009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:36.251723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:36.348937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:36.357456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3eb3b48-a34e-4cbd-92cc-bdecfb45f9d7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.164168 Jun 16 19:12:36.358048 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2853/5599] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:36 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:37.375222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:37.375966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:37.379126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:37.383917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:37.385147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:37.385621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:37.386588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:37.387092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:37.556745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:37.566312 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-095b956e-dd5e-4a13-8ba9-227d95bee77b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.195250 Jun 16 19:12:37.566917 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2747/5600] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:37 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:38.583529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:38.584208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:38.591577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:38.592037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:38.592828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:38.593276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:38.737233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:38.746262 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f430e34c-89c2-4733-b772-bacb022b4815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.166595 Jun 16 19:12:38.746854 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2854/5601] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:38 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:39.764578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:39.765300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:39.773158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:39.773694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:39.774591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:39.775005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:39.936862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:39.945432 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ea89af55-420d-4957-aec0-d0fd225e39fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.185193 Jun 16 19:12:39.946040 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2748/5602] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:39 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:40.594566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a6113fd8-c490-4261-be46-49256e4edb13 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:40.595214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a6113fd8-c490-4261-be46-49256e4edb13 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:40.603048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6113fd8-c490-4261-be46-49256e4edb13 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:40.603543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6113fd8-c490-4261-be46-49256e4edb13 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:40.604577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6113fd8-c490-4261-be46-49256e4edb13 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:40.605206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a6113fd8-c490-4261-be46-49256e4edb13 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:40.775587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a6113fd8-c490-4261-be46-49256e4edb13 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1833 microversion: 2.1 time: 0.184685 Jun 16 19:12:40.777392 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2855/5603] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:40 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1833 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:40.963968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:40.966138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:40.974302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:40.975250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:40.976861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:40.978080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:41.146131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:41.155399 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-33bbf91d-0fda-4406-813e-c19910b38239 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.196679 Jun 16 19:12:41.165507 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2749/5604] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:40 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:41.732186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:41.733519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:41.739819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d6d49a30-8932-4cf5-8342-d94d5c2c05d1 req-274c938e-4e15-441f-bcfe-929d37ff848f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:41.752551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:41.756791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d6d49a30-8932-4cf5-8342-d94d5c2c05d1 req-274c938e-4e15-441f-bcfe-929d37ff848f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:41.757550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d6d49a30-8932-4cf5-8342-d94d5c2c05d1 req-274c938e-4e15-441f-bcfe-929d37ff848f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:41.761201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:41.762462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:41.763115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:41.785520 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d6d49a30-8932-4cf5-8342-d94d5c2c05d1 req-274c938e-4e15-441f-bcfe-929d37ff848f service nova] Creating event network-changed:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h2-846209-2 Jun 16 19:12:41.795361 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d6d49a30-8932-4cf5-8342-d94d5c2c05d1 req-274c938e-4e15-441f-bcfe-929d37ff848f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057902 Jun 16 19:12:41.803096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:12:41.803726 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2750/5605] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:12:41.914228 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd1a48bd-16a0-4681-bab2-943a96663a8c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 204 len: 0 microversion: 2.1 time: 0.184482 Jun 16 19:12:41.916918 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2856/5606] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:41 2022] DELETE /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:12:41.927159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:41.928229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:41.935936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:41.936722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:41.937893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:41.938608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:42.095330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:42.104243 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e711e62d-9582-4c0e-9f2e-065643b0a64f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1688 microversion: 2.1 time: 0.181370 Jun 16 19:12:42.106003 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2751/5607] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:41 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:42.173859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:42.174604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:42.180764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:42.181467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:42.182505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:42.183014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:42.332853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:42.342048 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7a09e251-406e-488e-97fb-ccaeaa14bbf0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1167 microversion: 2.1 time: 0.172270 Jun 16 19:12:42.342943 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2857/5608] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:42 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1167 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:43.123052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:43.123701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:43.130954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:43.131412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:43.132191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:43.132632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:43.276961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:43.284655 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-be9fb121-bab3-4b67-a6cd-d43b90b5b15f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1688 microversion: 2.1 time: 0.166404 Jun 16 19:12:43.285245 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2752/5609] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:43 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:43.359686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:43.360399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:43.367606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:43.368327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:43.369126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:43.370202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:43.519078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:43.527546 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-20637f1f-6e16-4ea1-9055-f8641e91b399 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.171679 Jun 16 19:12:43.528144 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2858/5610] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:43 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:44.134516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e31c2a9d-555c-4d6e-bb67-61b71fb0e581 req-60b0dde1-4cd9-4340-8081-874832690350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1f81cc-f2eb-45af-a0a5-50fb2062b996", "name": "network-vif-deleted", "tag": "373cb932-1524-4af6-a884-32b3b20541b1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:44.152029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e31c2a9d-555c-4d6e-bb67-61b71fb0e581 req-60b0dde1-4cd9-4340-8081-874832690350 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:44.153575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e31c2a9d-555c-4d6e-bb67-61b71fb0e581 req-60b0dde1-4cd9-4340-8081-874832690350 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:44.175820 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e31c2a9d-555c-4d6e-bb67-61b71fb0e581 req-60b0dde1-4cd9-4340-8081-874832690350 service nova] Creating event network-vif-deleted:373cb932-1524-4af6-a884-32b3b20541b1 for instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 on n-h2-846209-2 Jun 16 19:12:44.184960 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e31c2a9d-555c-4d6e-bb67-61b71fb0e581 req-60b0dde1-4cd9-4340-8081-874832690350 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058822 Jun 16 19:12:44.186291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2753/5611] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:44.302858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:44.303515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:44.310411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:44.310872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:44.311641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:44.312134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:44.343689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:44.344060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:44.344516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lazy-loading 'fault' on Instance uuid 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:12:44.387638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:44.395346 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-353c6309-2fbc-4867-8fd9-df807d906d69 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 200 len: 1355 microversion: 2.1 time: 0.096462 Jun 16 19:12:44.395955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2859/5612] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:44 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 1355 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:44.546264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:44.547658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:44.553928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:44.554397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:44.555168 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:44.555610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:44.693543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:44.702685 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-06b1ffee-0e16-432b-9da0-8d8f120464b3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.160757 Jun 16 19:12:44.702685 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2754/5613] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:44 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:45.413113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:45.413733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 8b1f81cc-f2eb-45af-a0a5-50fb2062b996] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:45.421191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:45.421643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:45.422519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:45.422954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:45.437263 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] HTTP exception thrown: Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 could not be found. Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Request method failure captured: Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 HTTP/1.1 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4A05u_-9AikOlX9ntKqQm7qzINM9v1WDOsB1gjwlQGL-f-UN3zhF3YTfYTacmIjY28BFrjHK7FTwa-n6EeUpZ8ZhKYC6v8hCA-h8AjiPNCdZeYVCohxsIvpEYwpRw-bBzpDlTd5KgMhh4AlAmmhCJtWd-8sTyC-ypUrYpg619ZDDRU Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba85d86fb7e44a10b9542fc1c0538a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 42fd96b15988445484a9fbb22fd7a6a7 Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 could not be found. Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '8b1f81cc-f2eb-45af-a0a5-50fb2062b996'} Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 could not be found. Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 could not be found. Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:45.438947 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 could not be found. Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Returning 404 to user: Instance 8b1f81cc-f2eb-45af-a0a5-50fb2062b996 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c0f0140-73e0-4117-bcba-f7c112778a1b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996" status: 404 len: 111 microversion: 2.1 time: 0.031247 Jun 16 19:12:45.443696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2860/5614] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:45 2022] GET /compute/v2.1/servers/8b1f81cc-f2eb-45af-a0a5-50fb2062b996 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:12:45.720467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:45.721201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:45.727420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:45.727906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:45.728687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:45.729129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:45.872560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:45.880580 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3e8bc854-5088-4102-99be-8acf73768a0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.165512 Jun 16 19:12:45.881171 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2755/5615] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:45 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:46.896756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:46.897473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:46.905094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:46.908101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:46.908101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:46.908101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:47.058037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:47.066775 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-064d67cb-2d54-4916-89ed-b6d84265101f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.173882 Jun 16 19:12:47.070556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2861/5616] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:46 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:48.084302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:48.084965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:48.093049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:48.093502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:48.094312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:48.094750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:48.329053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:48.337334 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2a637b7b-6590-4f0e-84f7-88d771e336d8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.257036 Jun 16 19:12:48.338296 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2756/5617] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:48 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:49.201724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36736a83-1647-4856-820d-a9e506a65a84 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '.version_select at 0x7f86740d3700>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:49.205546 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36736a83-1647-4856-820d-a9e506a65a84 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [f56d8058-c723-40bc-a4c2-cfb002f8a101] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:12:49.354764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:49.355841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:49.366512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:49.367385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:49.368338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:49.368933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:49.519918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:49.528839 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cb0cd8d4-5f4d-49ab-b924-fda3bc61404b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.178045 Jun 16 19:12:49.529418 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2757/5618] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:49 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:12:49.534201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:49.534784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:49.541994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:49.542524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:49.543781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:49.544227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:49.572689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:12:49.629140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:49.674179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2aea00ff-0461-455c-8ac9-6a5a01f59f03 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 204 len: 0 microversion: 2.1 time: 0.143095 Jun 16 19:12:49.676395 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2758/5619] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:49 2022] DELETE /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:12:49.682991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8264b9ce-8961-460f-8b66-7127d19a97da req-ccbc5719-ecc8-4ba6-b475-0dabdb6d968f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3cba29-c052-436c-9c23-ccc0f17a3b17", "tag": "0ff67b4a-e234-48d5-af8b-3cac02f04ebf"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:49.692265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8264b9ce-8961-460f-8b66-7127d19a97da req-ccbc5719-ecc8-4ba6-b475-0dabdb6d968f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:49.692763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8264b9ce-8961-460f-8b66-7127d19a97da req-ccbc5719-ecc8-4ba6-b475-0dabdb6d968f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:49.706221 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8264b9ce-8961-460f-8b66-7127d19a97da req-ccbc5719-ecc8-4ba6-b475-0dabdb6d968f service nova] Creating event network-changed:0ff67b4a-e234-48d5-af8b-3cac02f04ebf for instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 on n-h2-846209-2 Jun 16 19:12:49.711381 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8264b9ce-8961-460f-8b66-7127d19a97da req-ccbc5719-ecc8-4ba6-b475-0dabdb6d968f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032972 Jun 16 19:12:49.712006 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2759/5620] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:49.717641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:49.718392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:49.724957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:49.725419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:49.726247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:49.726721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:49.882690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:49.891661 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f85b13d3-07cd-4039-a2f4-a5aa1da164dd tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1582 microversion: 2.1 time: 0.178428 Jun 16 19:12:49.892225 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2760/5621] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:49 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1582 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:50.216359 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [None req-36736a83-1647-4856-820d-a9e506a65a84 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [f56d8058-c723-40bc-a4c2-cfb002f8a101] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34382. Jun 16 19:12:50.239925 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36736a83-1647-4856-820d-a9e506a65a84 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-645347472" status: 202 len: 0 microversion: 2.1 time: 1.042917 Jun 16 19:12:50.240513 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2862/5622] 10.222.0.27 () {58 vars in 1280 bytes} [Thu Jun 16 19:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-645347472 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:12:50.277793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f0b1af9-fa23-409e-8541-b0855471c54b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: .version_select at 0x7f866d8424c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1415618751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkwQ/Z/0p9liJ6njozMviTB+N3FgPqkT5x7NgyP2TXPSapP7RCkY6vX6LE1AxyrHqOIlKyglo2PWWZx16FQ88RAZ2B+K73J3a2bOaNs2D4EHoDvaQs8oHvod05yArL7lQ=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:50.293846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3f0b1af9-fa23-409e-8541-b0855471c54b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:12:50.299674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-3f0b1af9-fa23-409e-8541-b0855471c54b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:12:50.328316 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f0b1af9-fa23-409e-8541-b0855471c54b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055783 Jun 16 19:12:50.328902 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2761/5623] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:12:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:50.546692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:50.547731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:50.554213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:50.554768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:50.555656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:50.556211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:50.719881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:50.727915 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e636486c-574d-4a31-a2d7-db8ef99482fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.185967 Jun 16 19:12:50.728625 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2863/5624] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:50 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:12:50.913232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:50.913853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:50.921292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:50.921814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:50.922781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:50.923505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:51.101163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:51.109659 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94fe5214-c8cf-465f-89b2-8ffe002899fa tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1582 microversion: 2.1 time: 0.201231 Jun 16 19:12:51.110275 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2762/5625] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:50 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1582 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:51.746654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:51.748114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:51.755400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:51.756176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:51.757196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:51.757887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:51.892071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3d12525f-8c16-4386-8eea-35a0632e3144 req-e8bf88ad-1fbd-427d-b745-89fbc9da3156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3cba29-c052-436c-9c23-ccc0f17a3b17", "name": "network-vif-deleted", "tag": "0ff67b4a-e234-48d5-af8b-3cac02f04ebf"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:51.904076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3d12525f-8c16-4386-8eea-35a0632e3144 req-e8bf88ad-1fbd-427d-b745-89fbc9da3156 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:51.904907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3d12525f-8c16-4386-8eea-35a0632e3144 req-e8bf88ad-1fbd-427d-b745-89fbc9da3156 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:51.919324 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3d12525f-8c16-4386-8eea-35a0632e3144 req-e8bf88ad-1fbd-427d-b745-89fbc9da3156 service nova] Creating event network-vif-deleted:0ff67b4a-e234-48d5-af8b-3cac02f04ebf for instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 on n-h2-846209-2 Jun 16 19:12:51.925214 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3d12525f-8c16-4386-8eea-35a0632e3144 req-e8bf88ad-1fbd-427d-b745-89fbc9da3156 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036727 Jun 16 19:12:51.925842 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2763/5626] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:12:52.129885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:52.130852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:52.139421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:52.140433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:52.141775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:52.143911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:52.295903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:52.304499 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5717582-088e-437b-b6c9-7c888f190ba5 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1228 microversion: 2.1 time: 0.179959 Jun 16 19:12:52.305408 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2764/5627] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:52 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1228 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:52.350460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:52.375593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f84c3d84-c780-4c35-8c9b-1f333c597979 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.633147 Jun 16 19:12:52.376479 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2864/5628] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:51 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:53.185313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-387f9a2d-c8d4-4f43-b176-2c90f04fdc94 req-a69cc4df-976a-41bd-835d-b4cc7806db92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45002551-b13c-45c7-b9bf-ba4ed73a76d4", "name": "network-vif-plugged", "status": "completed", "tag": "a447c3a2-b9ed-4845-945f-57ef84c81685"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:53.195563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-387f9a2d-c8d4-4f43-b176-2c90f04fdc94 req-a69cc4df-976a-41bd-835d-b4cc7806db92 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:53.196542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-387f9a2d-c8d4-4f43-b176-2c90f04fdc94 req-a69cc4df-976a-41bd-835d-b4cc7806db92 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:53.222676 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-387f9a2d-c8d4-4f43-b176-2c90f04fdc94 req-a69cc4df-976a-41bd-835d-b4cc7806db92 service nova] Creating event network-vif-plugged:a447c3a2-b9ed-4845-945f-57ef84c81685 for instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 on n-h1-846209-2 Jun 16 19:12:53.228230 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-387f9a2d-c8d4-4f43-b176-2c90f04fdc94 req-a69cc4df-976a-41bd-835d-b4cc7806db92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Jun 16 19:12:53.229146 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2765/5629] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:53.322140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:53.323540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:53.332581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:53.333085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:53.333875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:53.334357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:53.356946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:53.394935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:53.395891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:53.404195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:53.405044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:53.406421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:53.406673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:53.490112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:53.498838 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bead6983-232b-41ab-b71f-179641400b9d tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1228 microversion: 2.1 time: 0.180991 Jun 16 19:12:53.502248 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2865/5630] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:53 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:53.721640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:53.731506 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-56a86e60-821c-455f-8033-896018a1048e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.341720 Jun 16 19:12:53.732198 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2766/5631] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:53 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:54.516417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:54.517144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:54.525409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:54.526025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:54.526913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:54.527573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:54.634039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:54.644363 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36c09edb-ffc6-459d-8b00-b1c1d9be37fb tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1228 microversion: 2.1 time: 0.131484 Jun 16 19:12:54.647829 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2866/5632] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:54 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1228 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:54.750949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:54.752276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:54.761645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:54.762306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:54.763187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:54.763981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:55.004147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:55.015575 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ccfa501c-6b97-4a80-901c-730bdbdc8681 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1201 microversion: 2.1 time: 0.270863 Jun 16 19:12:55.017256 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2767/5633] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:54 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1201 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:55.663659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:55.666343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:55.680402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:55.681162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:55.685090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:55.685790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:55.846264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:55.857539 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a305d59a-b95c-4c93-9c1e-6f77f47a219b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1228 microversion: 2.1 time: 0.198015 Jun 16 19:12:55.873824 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2867/5634] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:55 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1228 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:56.033452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:56.034188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:56.040652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:56.043778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.045452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.048065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.048814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.260524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:56.272832 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7240c506-2b55-4802-a58e-2fb831e47126 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1389 microversion: 2.1 time: 0.243380 Jun 16 19:12:56.273429 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2768/5635] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:56 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1389 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:56.293793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:56.294908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:56.301281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:12:56.303088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.303635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.304561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.305132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.488310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:56.497794 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c522aed2-8fbf-4e27-87e7-9814d1cd24c5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1389 microversion: 2.1 time: 0.209681 Jun 16 19:12:56.509243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2868/5636] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:56 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1389 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:56.515395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:56.516018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:56.524426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.524970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.525762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.526227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.718063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:56.726726 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8ca833f-5d6e-492e-a318-3e14c5d3e815 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1389 microversion: 2.1 time: 0.216423 Jun 16 19:12:56.728290 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2769/5637] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:56 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1389 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:56.813750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:56.814897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:56.823857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.824630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.825624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.826319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.875561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:56.876214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:56.889712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.890219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.891021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:56.891465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:56.898801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:12:57.007230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2640e1b8824def845d75a2ecf664b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42601299f9f84359aece09f814b6997f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:57.019709 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3e8c190-4e6a-424c-a94a-7d02050b140b tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 200 len: 1228 microversion: 2.1 time: 0.148710 Jun 16 19:12:57.020212 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2770/5638] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:56 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 1228 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:12:57.064808 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bf53299b-91d5-4b71-bab9-7f77a540253e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 204 len: 0 microversion: 2.1 time: 0.255153 Jun 16 19:12:57.065624 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2869/5639] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:56 2022] DELETE /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:12:57.073716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:57.074397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:57.081689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:57.082415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:57.083378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:57.083975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:57.255991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:57.266378 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf3190fd-152a-4d7a-92b8-464272997edf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1395 microversion: 2.1 time: 0.196639 Jun 16 19:12:57.267727 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2771/5640] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:57 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1395 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:57.650634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1420194388", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "114b169b-77d4-4c9f-8ad5-344e28b219dd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1415618751", "security_groups": [{"name": "tempest-secgroup-smoke-1542479173"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:57.785080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] validate_networks() for [('114b169b-77d4-4c9f-8ad5-344e28b219dd', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:12:58.037192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:58.038212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] [instance: dc3cba29-c052-436c-9c23-ccc0f17a3b17] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:58.047191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:58.047802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:58.048946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:58.049578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:58.067212 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] HTTP exception thrown: Instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 could not be found. Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Request method failure captured: Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 HTTP/1.1 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq3-6RCvkFMPkemLuqpFG8kYAQKoRG3L1E8kmWOqekS0FDRXvs4rVoc3iboNrx15-VOg2TeVcYyTpiM47M4-h3eEoiKE1cgHWnU5n4jgS92GkRr_xlZo_1YjPNxe8LLH5wAdY5aEQNWi-YWpe_03TofEEtbUJsVPO9lpO8HjJAS6RLu8 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 42601299f9f84359aece09f814b6997f Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestVolumeBackupRestore-2104286842 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42601299f9f84359aece09f814b6997f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42601299f9f84359aece09f814b6997f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42601299f9f84359aece09f814b6997f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42601299f9f84359aece09f814b6997f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestVolumeBackupRestore-2104286842 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 42601299f9f84359aece09f814b6997f Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2104286842 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestVolumeBackupRestore-2104286842-project Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 3a2640e1b8824def845d75a2ecf664b3 Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestVolumeBackupRestore-2104286842-project Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 could not be found. Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'dc3cba29-c052-436c-9c23-ccc0f17a3b17'} Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 could not be found. Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 could not be found. Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:58.069391 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:12:58.077818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:58.077818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:58.077818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:58.077818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:58.077818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:58.077818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 could not be found. Jun 16 19:12:58.077818 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:12:58.082075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Returning 404 to user: Instance dc3cba29-c052-436c-9c23-ccc0f17a3b17 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:58.085376 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8a6c7d22-4434-439f-a1ad-1248f64cdfd9 tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17" status: 404 len: 111 microversion: 2.1 time: 0.050390 Jun 16 19:12:58.089233 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2772/5641] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:58 2022] GET /compute/v2.1/servers/dc3cba29-c052-436c-9c23-ccc0f17a3b17 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:12:58.284615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:58.285249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:58.293349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:58.293564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:58.294343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:58.294793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:58.485018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:12:58.485565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:12:58.488867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:12:58.489854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:12:58.490877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:12:58.509425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:58.510201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:58.511266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:58.512400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:58.537290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:12:58.540771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:58.546019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:12:58.552302 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b694a14e-255f-49e4-93ab-a00ee3aa1467 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1395 microversion: 2.1 time: 0.271880 Jun 16 19:12:58.552983 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2773/5642] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:58 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1395 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:58.564014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:12:58.566594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:12:58.567668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-838d7142-f662-4433-9d4c-36ff747a7ebf tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] Calling method '.version_select at 0x7f866d903940>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:58.591110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-838d7142-f662-4433-9d4c-36ff747a7ebf tempest-TestVolumeBackupRestore-2104286842 tempest-TestVolumeBackupRestore-2104286842-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-318874397" status: 202 len: 0 microversion: 2.1 time: 0.027549 Jun 16 19:12:58.592025 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2774/5643] 10.222.0.27 () {58 vars in 1265 bytes} [Thu Jun 16 19:12:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-318874397 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:12:58.618172 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e705bc16-63e7-4dc4-86cb-111118cbed3b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.974114 Jun 16 19:12:58.619243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2870/5644] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:12:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:12:58.630833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5278b546-2c0d-4787-ad2d-f3e6dfc88a26 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:58.631496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5278b546-2c0d-4787-ad2d-f3e6dfc88a26 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:58.853509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5278b546-2c0d-4787-ad2d-f3e6dfc88a26 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:58.880935 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5278b546-2c0d-4787-ad2d-f3e6dfc88a26 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1267 microversion: 2.1 time: 0.237840 Jun 16 19:12:58.887489 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2775/5645] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:58 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:59.572040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:59.573212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:59.591301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:59.593511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:59.594788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:59.599658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:59.828912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:59.829293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2417a82f-66a9-494d-bb5b-1fd2d19ea40e req-7f34bd04-5682-4242-b515-4bc7f33d4e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45002551-b13c-45c7-b9bf-ba4ed73a76d4", "name": "network-vif-deleted", "tag": "a447c3a2-b9ed-4845-945f-57ef84c81685"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:59.838649 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3b9a075f-ecc2-4b87-b0bf-e16ea0ae2e64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1353 microversion: 2.1 time: 0.272485 Jun 16 19:12:59.851551 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2871/5646] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:59 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1353 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:59.863599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2417a82f-66a9-494d-bb5b-1fd2d19ea40e req-7f34bd04-5682-4242-b515-4bc7f33d4e19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:59.866891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2417a82f-66a9-494d-bb5b-1fd2d19ea40e req-7f34bd04-5682-4242-b515-4bc7f33d4e19 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:59.909719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:59.910548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:59.924814 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2417a82f-66a9-494d-bb5b-1fd2d19ea40e req-7f34bd04-5682-4242-b515-4bc7f33d4e19 service nova] Creating event network-vif-deleted:a447c3a2-b9ed-4845-945f-57ef84c81685 for instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 on n-h1-846209-2 Jun 16 19:12:59.931818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:59.932263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:59.933069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:59.933631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:59.944584 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2417a82f-66a9-494d-bb5b-1fd2d19ea40e req-7f34bd04-5682-4242-b515-4bc7f33d4e19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117985 Jun 16 19:12:59.958018 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2776/5647] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:13:00.088148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:00.112157 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2cd74cab-edbd-49d1-9746-d10dfa6d1180 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1263 microversion: 2.1 time: 0.211489 Jun 16 19:13:00.114614 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2872/5648] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:59 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:00.860005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:00.860836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:00.903074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:00.903562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:00.907072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:00.909627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:01.033208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:01.051872 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff456d1b-c118-4fac-bd4c-2fc6acf5702d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1186 microversion: 2.1 time: 0.190159 Jun 16 19:13:01.053748 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2777/5649] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:00 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1186 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:01.148669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:01.150343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:01.161946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:01.163198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:01.166115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:01.167859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:01.440767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:01.451207 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ba865dd3-094b-4770-8f09-110bfc95733f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1325 microversion: 2.1 time: 0.323400 Jun 16 19:13:01.455921 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2873/5650] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:01 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:02.075305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:02.076353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:02.101866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:02.102551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:02.103881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:02.105883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:02.313567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:02.330438 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-426b9a36-065a-47f1-a1ac-6f6786fe5395 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1186 microversion: 2.1 time: 0.262431 Jun 16 19:13:02.330985 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2778/5651] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:02 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1186 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:02.472580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:02.473198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:02.488921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:02.489674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:02.491073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:02.493458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:02.770872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:02.780268 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d6bf6682-a19f-447f-8c29-40c116a6e08a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1393 microversion: 2.1 time: 0.311395 Jun 16 19:13:02.780865 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2874/5652] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:02 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1393 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:03.357957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:03.359095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:03.385861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:03.405743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:03.406698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:03.407164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:03.561641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:03.574747 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c70c3974-ed21-411a-8272-7208964f39f4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1186 microversion: 2.1 time: 0.229861 Jun 16 19:13:03.581585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6d49e7ff-4b20-4fa1-96b7-dae1bf5a97ba req-109760ee-40f7-4974-a946-23bccb0f0b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:03.586567 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2779/5653] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:03 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1186 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:03.601535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6d49e7ff-4b20-4fa1-96b7-dae1bf5a97ba req-109760ee-40f7-4974-a946-23bccb0f0b4b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:03.610207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6d49e7ff-4b20-4fa1-96b7-dae1bf5a97ba req-109760ee-40f7-4974-a946-23bccb0f0b4b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:03.639160 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6d49e7ff-4b20-4fa1-96b7-dae1bf5a97ba req-109760ee-40f7-4974-a946-23bccb0f0b4b service nova] Creating event network-changed:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:13:03.645328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6d49e7ff-4b20-4fa1-96b7-dae1bf5a97ba req-109760ee-40f7-4974-a946-23bccb0f0b4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067570 Jun 16 19:13:03.647203 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2875/5654] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:13:03.797510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:03.798360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:03.810368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:03.812760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:03.816181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:03.816846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:04.067512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:04.080180 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-939fd83f-9a65-4219-afb6-d47dc03ca33b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1393 microversion: 2.1 time: 0.286086 Jun 16 19:13:04.089945 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2780/5655] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:03 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1393 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:04.593329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:04.594473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:04.614801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:04.615264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:04.616057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:04.616506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:04.687432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:04.696634 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85915bb6-6336-41db-8f56-8ff17d5d5b0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1186 microversion: 2.1 time: 0.108503 Jun 16 19:13:04.698132 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2876/5656] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:04 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:05.100606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:05.102528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:05.121778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:05.122796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:05.123897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:05.124637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:05.157628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:05.388243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:05.396181 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5897c7df-0075-40e4-894b-193fe03c8429 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1393 microversion: 2.1 time: 0.302156 Jun 16 19:13:05.407044 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2781/5657] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:05 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1393 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:05.714018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:05.715604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:05.727039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:05.730517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:05.734924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:05.735668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:06.232535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:06.246041 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e27527d6-c15a-480b-a035-7bf39b27cee6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1186 microversion: 2.1 time: 0.535493 Jun 16 19:13:06.247645 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2877/5658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:05 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1186 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:06.423929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:06.425133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:06.432382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:06.433032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:06.434118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:06.434720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:06.679502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:06.687639 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9243687-4f51-463b-871b-b2c0d780418c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1393 microversion: 2.1 time: 0.267460 Jun 16 19:13:06.688232 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2782/5659] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:06 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1393 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:07.264139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:07.266200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:07.274261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:07.275143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:07.276207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:07.276967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:07.373302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:07.382496 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b59bf904-6dd5-4036-8704-d9a28cd471ea tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1186 microversion: 2.1 time: 0.122686 Jun 16 19:13:07.390841 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2878/5660] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:07 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1186 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:07.709233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:07.710871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:07.721957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:07.723241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:07.724526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:07.725620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:07.972587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:07.986755 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7a0a0b9c-be4f-437f-b751-8f4107f77adf tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1393 microversion: 2.1 time: 0.285559 Jun 16 19:13:07.987413 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2783/5661] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:07 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1393 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:08.405695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:08.408615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:08.421876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:08.422554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:08.423831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:08.424543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:08.473936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:08.474695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:08.475829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lazy-loading 'fault' on Instance uuid 45002551-b13c-45c7-b9bf-ba4ed73a76d4 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:13:08.523762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:08.552487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:08.557962 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:08.564201 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-37058825-2713-4abf-b59b-c39836c921ad tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 200 len: 1145 microversion: 2.1 time: 0.168549 Jun 16 19:13:08.565066 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2879/5662] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:08 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 1145 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:09.004772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:09.005394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:09.009121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:09.016309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:09.016905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:09.018111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:09.018625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:09.195304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:09.207246 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-81c13714-252a-4a3a-ae7a-d4fd68377a2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1393 microversion: 2.1 time: 0.206789 Jun 16 19:13:09.222777 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2784/5663] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:08 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1393 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:09.583100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:09.583735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:09.599237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:09.599707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:09.600508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:09.600958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:09.629684 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 HTTP/1.1 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '45002551-b13c-45c7-b9bf-ba4ed73a76d4'} Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:13:09.631588 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d2d0aa96-e58d-4f2b-a2ea-13e545086afe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 404 len: 111 microversion: 2.1 time: 0.056421 Jun 16 19:13:09.635826 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2880/5664] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:09 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:13:09.812012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7d1113df-2d15-4cf5-a0ce-db72b695f6ac req-e268b5ac-dc05-4708-92db-5195c32cd7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "name": "network-vif-plugged", "status": "completed", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:09.830905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7d1113df-2d15-4cf5-a0ce-db72b695f6ac req-e268b5ac-dc05-4708-92db-5195c32cd7e1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:09.832596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7d1113df-2d15-4cf5-a0ce-db72b695f6ac req-e268b5ac-dc05-4708-92db-5195c32cd7e1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:09.878544 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7d1113df-2d15-4cf5-a0ce-db72b695f6ac req-e268b5ac-dc05-4708-92db-5195c32cd7e1 service nova] Creating event network-vif-plugged:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:13:09.893218 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7d1113df-2d15-4cf5-a0ce-db72b695f6ac req-e268b5ac-dc05-4708-92db-5195c32cd7e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091092 Jun 16 19:13:09.902645 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2785/5665] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:13:10.225050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:10.225869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:10.233679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:10.234177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:10.235519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:10.235519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:10.767775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:10.776479 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-78cc22c9-8936-4800-9f29-63ef90b4a97c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1393 microversion: 2.1 time: 0.555684 Jun 16 19:13:10.777426 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2881/5666] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:10 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1393 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:11.796076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:11.797304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:11.800599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:11.801618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:11.809140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:11.809606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:11.813702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:11.814186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:11.816070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:11.816540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:11.820640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:11.821127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:11.826137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:11.836617 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 HTTP/1.1 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '45002551-b13c-45c7-b9bf-ba4ed73a76d4'} Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:13:11.838446 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.845086 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.847179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:13:11.848262 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5a86b5f5-e7f1-499e-99db-ce0063533745 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 404 len: 111 microversion: 2.1 time: 0.051834 Jun 16 19:13:11.854000 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2882/5667] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:13:11 2022] DELETE /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:13:11.862600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:11.863708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 45002551-b13c-45c7-b9bf-ba4ed73a76d4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:11.874370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:11.875110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:11.876415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:11.877056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:11.901446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 HTTP/1.1 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '45002551-b13c-45c7-b9bf-ba4ed73a76d4'} Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:13:11.904844 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance 45002551-b13c-45c7-b9bf-ba4ed73a76d4 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:13:11.909204 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-334fcfa8-18c4-4a01-8376-29913d10ac16 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4" status: 404 len: 111 microversion: 2.1 time: 0.051315 Jun 16 19:13:11.911559 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2883/5668] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:11 2022] GET /compute/v2.1/servers/45002551-b13c-45c7-b9bf-ba4ed73a76d4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:13:12.184797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:12.193359 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-827ee621-b3a1-4f23-9643-8256919eb962 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1564 microversion: 2.1 time: 0.403079 Jun 16 19:13:12.193971 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2786/5669] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:11 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1564 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:12.213060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:12.214187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:12.227104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:12.229123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:12.230549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:12.233006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:12.456048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:12.466912 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-56b09a29-31e7-4961-b44e-2e91e6f3dd1d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1564 microversion: 2.1 time: 0.258788 Jun 16 19:13:12.479701 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2884/5670] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:12 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1564 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:15.391103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:15.392024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:15.397631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7385b8da-c089-4bd6-a557-87ec34c2db96 req-5d266cb3-bda2-45b9-ba17-03bb2ff56d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:15.416513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7385b8da-c089-4bd6-a557-87ec34c2db96 req-5d266cb3-bda2-45b9-ba17-03bb2ff56d82 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:15.418144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:15.420535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7385b8da-c089-4bd6-a557-87ec34c2db96 req-5d266cb3-bda2-45b9-ba17-03bb2ff56d82 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:15.420813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:15.424222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:15.425184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:15.454508 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7385b8da-c089-4bd6-a557-87ec34c2db96 req-5d266cb3-bda2-45b9-ba17-03bb2ff56d82 service nova] Creating event network-changed:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:13:15.468855 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7385b8da-c089-4bd6-a557-87ec34c2db96 req-5d266cb3-bda2-45b9-ba17-03bb2ff56d82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074804 Jun 16 19:13:15.492433 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2885/5671] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:13:15.699771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:15.718533 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ce51a10a-4eb0-4c34-8b0f-fd71c731ce66 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1564 microversion: 2.1 time: 0.330026 Jun 16 19:13:15.730192 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2787/5672] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:15 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1564 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:32.750547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1215798233", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1866cff1-56e5-4972-9336-9dd4161b8491", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "06296b0a-381d-4be1-a4a0-bfd044486ffa"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:32.759693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:32.760463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:32.815571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] validate_networks() for [('06296b0a-381d-4be1-a4a0-bfd044486ffa', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:13:33.185616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:13:33.186172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:13:33.186711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:13:33.187125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:13:33.187544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:13:33.196809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:33.197265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:33.198194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:33.198639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:33.217584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:13:33.223115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:13:33.282709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:13:33.284949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1866cff1-56e5-4972-9336-9dd4161b8491',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:13:33.427149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6b720ab4-88c4-4798-8329-f2dbef626795 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681736 Jun 16 19:13:33.427977 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2886/5673] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:13:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:13:33.437706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f34f1a0-08c4-483a-9417-668cad79adc7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:33.438295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f34f1a0-08c4-483a-9417-668cad79adc7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:33.441988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:33.442776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=34 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:33.495549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f34f1a0-08c4-483a-9417-668cad79adc7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:33.502481 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f34f1a0-08c4-483a-9417-668cad79adc7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1071 microversion: 2.1 time: 0.068593 Jun 16 19:13:33.503390 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2788/5674] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:33 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1071 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:34.520964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:34.521924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:34.529984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:34.530449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:34.531238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:34.531852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:34.605464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:34.614403 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9dba8314-7d13-4c3f-9895-74b347106127 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1187 microversion: 2.1 time: 0.098475 Jun 16 19:13:34.617751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2887/5675] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:34 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:35.041440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f05e821-a216-4e28-856a-4f58c591086f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:35.043586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f05e821-a216-4e28-856a-4f58c591086f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:35.052195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f05e821-a216-4e28-856a-4f58c591086f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:35.053184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f05e821-a216-4e28-856a-4f58c591086f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:35.055458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f05e821-a216-4e28-856a-4f58c591086f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:35.056141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f05e821-a216-4e28-856a-4f58c591086f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:35.123015 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f05e821-a216-4e28-856a-4f58c591086f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action" status: 200 len: 24572 microversion: 2.1 time: 0.086449 Jun 16 19:13:35.123760 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2789/5676] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:13:35 2022] POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action => generated 24572 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:13:35.642425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:35.643052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:35.652100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:35.653061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:35.654339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:35.654850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:35.895917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:35.911008 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e0e9899e-b1e4-41b1-9294-737fc17f91eb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1229 microversion: 2.1 time: 0.282518 Jun 16 19:13:35.912334 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2888/5677] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:35 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1229 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:36.041848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-cc5bc564-fdb7-4b4e-8b5b-24f241e112d8 req-0bd5247d-0b32-48fa-8f7b-4b62a7a909a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed307227-915e-42df-bc16-bc907f1ed2f3", "tag": "2381c1e4-f263-4508-954b-b6d7b1e18fc2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:36.064848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cc5bc564-fdb7-4b4e-8b5b-24f241e112d8 req-0bd5247d-0b32-48fa-8f7b-4b62a7a909a2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:36.065617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cc5bc564-fdb7-4b4e-8b5b-24f241e112d8 req-0bd5247d-0b32-48fa-8f7b-4b62a7a909a2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:36.088978 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-cc5bc564-fdb7-4b4e-8b5b-24f241e112d8 req-0bd5247d-0b32-48fa-8f7b-4b62a7a909a2 service nova] Creating event network-changed:2381c1e4-f263-4508-954b-b6d7b1e18fc2 for instance ed307227-915e-42df-bc16-bc907f1ed2f3 on n-h1-846209-2 Jun 16 19:13:36.099713 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-cc5bc564-fdb7-4b4e-8b5b-24f241e112d8 req-0bd5247d-0b32-48fa-8f7b-4b62a7a909a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064872 Jun 16 19:13:36.101003 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2790/5678] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:13:36.928822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:36.929612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:36.937566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:36.938222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:36.939134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:36.939695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:37.150943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:37.159959 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ae287324-a564-4525-a030-2e8a2970addd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1229 microversion: 2.1 time: 0.235003 Jun 16 19:13:37.160814 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2889/5679] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:36 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1229 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:38.179910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:38.180591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:38.187427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:38.187890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:38.188678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:38.189120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:38.326689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:38.334604 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4076cf59-d146-4264-9919-1327b8fc961d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1229 microversion: 2.1 time: 0.159800 Jun 16 19:13:38.335200 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2791/5680] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:38 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:39.351977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:39.352642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:39.361940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:39.362508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:39.363412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:39.363923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:39.521923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:39.533365 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9ab7b879-9f8c-4e93-a496-e7e009146d65 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1229 microversion: 2.1 time: 0.185413 Jun 16 19:13:39.534427 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2890/5681] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:39 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1229 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:40.552684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:40.553289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:40.561235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:40.561683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:40.562539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:40.562976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:40.700542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:40.708425 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10b8b214-1f59-4648-bb7c-8dcb2af59ca9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.159625 Jun 16 19:13:40.708998 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2792/5682] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:40 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:41.726341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:41.726995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:41.734654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:41.735113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:41.735879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:41.736317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:41.868737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:41.877276 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1b6708f-b175-493c-a790-7278d9a7a486 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.154849 Jun 16 19:13:41.878238 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2891/5683] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:41 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:42.894760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:42.895375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:42.902295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:42.902750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:42.904348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:42.904751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:43.036487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:43.044911 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e248c0cb-1a15-44bb-8e11-7baae1af5dc6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.153412 Jun 16 19:13:43.045665 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2793/5684] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:42 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:44.071228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:44.071820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:44.074548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:44.075905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:44.082428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:44.082888 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:44.083673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:44.084115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:44.226666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:44.235220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7dad76f6-3041-4172-9d46-85714e875725 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.177143 Jun 16 19:13:44.235798 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2892/5685] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:44 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:45.253413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:45.254102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:45.256597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:45.262853 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:45.263304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:45.264081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:45.264580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:45.724208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:45.731909 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa4cf4df-e4db-4513-9d3f-62387582bd57 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.483813 Jun 16 19:13:45.732485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2794/5686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:45 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:45.868944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-272417ef-3e59-4477-a2b8-abe1a52099af tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:45.869556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-272417ef-3e59-4477-a2b8-abe1a52099af tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:45.877161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272417ef-3e59-4477-a2b8-abe1a52099af tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:45.877613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272417ef-3e59-4477-a2b8-abe1a52099af tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:45.878406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272417ef-3e59-4477-a2b8-abe1a52099af tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:45.878840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-272417ef-3e59-4477-a2b8-abe1a52099af tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.006677 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-272417ef-3e59-4477-a2b8-abe1a52099af tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1833 microversion: 2.1 time: 0.141577 Jun 16 19:13:46.007265 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2893/5687] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:45 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1833 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:46.024171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:46.024785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:46.030930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.031377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.032146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.032585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.165851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:46.174374 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d6c05234-7622-4a8f-a73f-78dce857e2a5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1682 microversion: 2.1 time: 0.154011 Jun 16 19:13:46.174952 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2795/5688] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:46 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:46.265890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52e84494-06a4-4bc2-a4d8-a66c6ae0d653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:46.266887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-52e84494-06a4-4bc2-a4d8-a66c6ae0d653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:46.272908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52e84494-06a4-4bc2-a4d8-a66c6ae0d653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.273358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52e84494-06a4-4bc2-a4d8-a66c6ae0d653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.274151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52e84494-06a4-4bc2-a4d8-a66c6ae0d653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.274592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52e84494-06a4-4bc2-a4d8-a66c6ae0d653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.326428 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-52e84494-06a4-4bc2-a4d8-a66c6ae0d653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action" status: 200 len: 32636 microversion: 2.1 time: 0.064525 Jun 16 19:13:46.327068 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2894/5689] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:13:46 2022] POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action => generated 32636 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:13:46.481245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:46.481832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:46.489846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.490330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.491093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.491534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.519506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b003a305c0bd430c8fff24844b6df966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5273abd2b4798a27c4abcdbc9c32f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:46.520018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] flavor_id is None. Assuming migration. {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 16 19:13:46.520459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:13:46.633304 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad218536-1d2f-4c98-b7ab-f54febb7e209 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action" status: 202 len: 0 microversion: 2.1 time: 0.155841 Jun 16 19:13:46.634100 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2796/5690] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:13:46 2022] POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:13:46.643485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:46.644262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:46.652246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.652719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.653514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.653976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.748690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:46.749316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:46.756174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.756639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.757424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:46.757870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:46.850186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:46.859358 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7f1714da-4dc8-4d98-9045-574988f5d6da tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1691 microversion: 2.1 time: 0.220251 Jun 16 19:13:46.869757 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2895/5691] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:46 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:46.914903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:46.923739 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-817c63d9-359c-4924-b5d9-c444141ebc0c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.178942 Jun 16 19:13:46.924325 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2797/5692] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:46 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:47.878311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:47.878907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:47.885803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:47.886286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:47.887045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:47.887484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:47.941767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:47.942421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:47.950429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:47.950923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:47.951842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:47.952223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:48.097930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:48.106350 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-24e8d788-ccdc-4346-81ad-270fd7fb3ad7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1691 microversion: 2.1 time: 0.232819 Jun 16 19:13:48.107203 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2896/5693] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:47 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:48.124106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:48.132850 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d295dc8-7657-4bd6-ae63-a74921aa94c2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.195915 Jun 16 19:13:48.133447 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2798/5694] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:47 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:49.125067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:49.126616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:49.133704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:49.134202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:49.135000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:49.135485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:49.149766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:49.150419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:49.157620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:49.158126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:49.158907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:49.159351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:49.346532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:49.354959 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0d23fb5a-0561-4898-aba8-133785b8c53d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.233737 Jun 16 19:13:49.356230 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2897/5695] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:49 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:49.365985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:49.374068 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1547d91-b22d-4765-8c84-91e45b67d08d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.228019 Jun 16 19:13:49.374827 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2799/5696] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:49 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:50.373237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:50.373981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:50.381423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:50.381876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:50.382691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:50.383143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:50.392024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:50.392798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:50.399661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:50.400119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:50.400878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:50.401320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:50.591878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:50.596242 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:50.599882 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b124539-d585-459d-90e3-f45c749dd8f6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.230679 Jun 16 19:13:50.600467 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2898/5697] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:50 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:50.604004 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7234e3a1-400e-48d3-92cb-e3305850982a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.216276 Jun 16 19:13:50.604590 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2800/5698] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:50 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:51.514847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ef1ff536-e6a7-4cfd-b78f-f21a524786f3 req-a7ef704e-0310-406c-b255-32b564b764f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed307227-915e-42df-bc16-bc907f1ed2f3", "name": "network-vif-plugged", "status": "completed", "tag": "2381c1e4-f263-4508-954b-b6d7b1e18fc2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:51.523788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ef1ff536-e6a7-4cfd-b78f-f21a524786f3 req-a7ef704e-0310-406c-b255-32b564b764f3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:51.524250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ef1ff536-e6a7-4cfd-b78f-f21a524786f3 req-a7ef704e-0310-406c-b255-32b564b764f3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:51.535132 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ef1ff536-e6a7-4cfd-b78f-f21a524786f3 req-a7ef704e-0310-406c-b255-32b564b764f3 service nova] Creating event network-vif-plugged:2381c1e4-f263-4508-954b-b6d7b1e18fc2 for instance ed307227-915e-42df-bc16-bc907f1ed2f3 on n-h1-846209-2 Jun 16 19:13:51.540090 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ef1ff536-e6a7-4cfd-b78f-f21a524786f3 req-a7ef704e-0310-406c-b255-32b564b764f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166408 Jun 16 19:13:51.540675 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2899/5699] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:13:51.616651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:51.617534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:51.622073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:51.622884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:51.624947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:51.625410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:51.627309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:51.627770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:51.630601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:51.631139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:51.632006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:51.632526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:51.887888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:51.891201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:51.896633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d6f8d2a8-988b-4982-b3ac-5adc92eb4141 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.283785 Jun 16 19:13:51.897416 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2801/5700] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:51 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:51.899367 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ecf3578-1f44-4feb-b6c1-b66ec6050a60 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.281735 Jun 16 19:13:51.899964 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2900/5701] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:51 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:52.914532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:52.915798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:52.917989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:52.919271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:52.923781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:52.924257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:52.925125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:52.925598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:52.927819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:52.928747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:52.929521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:52.929983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:53.147026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:53.154078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:53.154560 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-855493e1-d1c3-4289-8846-fc195162ed47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.244288 Jun 16 19:13:53.155149 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2802/5702] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:52 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:53.162157 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8502e975-d64c-4cbe-935c-1233d401fa9d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1217 microversion: 2.1 time: 0.249581 Jun 16 19:13:53.162732 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2901/5703] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:52 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1217 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:54.172189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:54.172804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:54.179423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:54.180052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:54.180197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.180618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.181408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.181862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.187915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.188380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.189191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.189628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.386417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:54.394167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:54.394817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bcb664d2-4405-44b7-af42-0bc374433cb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.226589 Jun 16 19:13:54.395406 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2803/5704] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:54 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:54.401933 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-889cf5d0-f700-415b-9cd9-54a8152b98e7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1404 microversion: 2.1 time: 0.226470 Jun 16 19:13:54.402515 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2902/5705] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:54 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:54.418132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:54.418757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:54.424965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.425363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.426158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.426605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.563467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:54.567035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:54.571876 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e1c60172-6625-44f6-9723-e963d81e6dd1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1404 microversion: 2.1 time: 0.157900 Jun 16 19:13:54.572449 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2804/5706] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:54 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:13:54.587822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-551584633"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:54.588861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:54.595659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.596167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.596958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:54.597514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:54.632139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=100 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:13:54.695304 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Attempting to quiesce instance before volume snapshot. Jun 16 19:13:54.760560 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jun 16 19:13:54.830830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Creating snapshot from volume 1866cff1-56e5-4972-9336-9dd4161b8491. {{(pid=119206) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jun 16 19:13:55.413508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:55.414862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:55.426056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:55.426648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:55.427858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:55.428421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:55.589079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:55.598834 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-52679968-c2f4-4337-bd44-a8d5f2432f49 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.189982 Jun 16 19:13:55.608829 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2805/5707] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:55 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:55.725324 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-451d7970-4112-4fe7-998d-b6a81653f30e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3/action" status: 202 len: 0 microversion: 2.1 time: 1.141337 Jun 16 19:13:55.730855 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2903/5708] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:13:54 2022] POST /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3/action => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 19:13:56.616697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:56.617226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:56.624294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:56.624707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:56.625484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:56.626508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:56.764577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:56.772090 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-992707b4-52c1-432c-b07e-efad669521f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.159417 Jun 16 19:13:56.772662 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2806/5709] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:56 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:56.887165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1603939193", "imageRef": "9bf34a79-e2de-4316-96ed-6c7bc5e218ac", "flavorRef": "452", "networks": [{"uuid": "06296b0a-381d-4be1-a4a0-bfd044486ffa"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:56.940710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] validate_networks() for [('06296b0a-381d-4be1-a4a0-bfd044486ffa', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:13:57.319993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:13:57.320438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:13:57.320933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:13:57.321358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:13:57.321786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:13:57.331905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:57.332376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:57.333193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:57.333676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:57.351858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:13:57.357669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:13:57.370956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:13:57.373582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7a15506a-a116-4b73-b2b0-e889f2b266fe',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:13:57.448885 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1cfe5353-0f13-44db-aaa7-7c3358040700 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566821 Jun 16 19:13:57.449712 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2904/5710] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:13:57.461023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fbef4c82-7283-4b36-a9fb-f8456180f56a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:57.461827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fbef4c82-7283-4b36-a9fb-f8456180f56a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:57.519944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fbef4c82-7283-4b36-a9fb-f8456180f56a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:57.527733 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fbef4c82-7283-4b36-a9fb-f8456180f56a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1230 microversion: 2.1 time: 0.070587 Jun 16 19:13:57.528321 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2807/5711] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:57 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:57.789312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:57.789972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:57.796774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:57.797252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:57.798597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:57.799054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:57.947531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:57.955647 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c6c7c02-d4aa-4650-b48c-e9ebd3386ba6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.170285 Jun 16 19:13:57.956243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2905/5712] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:57 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:58.544890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:58.545938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:58.554138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:58.554596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:58.555383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:58.555830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:58.627439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:58.635731 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90cca801-96c6-4610-bf9d-b11245ad3a4a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1300 microversion: 2.1 time: 0.094797 Jun 16 19:13:58.646116 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2808/5713] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:58 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:58.975084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:58.976535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:58.988392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:58.988902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:58.989736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:58.990227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:59.194499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:59.203784 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be9f4703-c286-4cc3-a3f1-be815e494c33 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.234178 Jun 16 19:13:59.205272 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2906/5714] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:58 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:59.656248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:13:59.658043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:13:59.668094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:59.669000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:59.670281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:59.671077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:59.870299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:13:59.882125 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-06a09f6e-714e-4605-b5ab-923abd6b6d00 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.231857 Jun 16 19:13:59.883252 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2809/5715] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:13:59 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:13:59.894511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-36f9012c-4c5a-4af8-aa1d-e8c46a5e5354 req-6f0cd828-6a87-4d65-9222-f91ccc7806db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20a09bc-c4e2-475d-acde-1c699b70574b", "tag": "ca073847-7a30-42d0-8a86-1ae61727eb94"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:13:59.913148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-36f9012c-4c5a-4af8-aa1d-e8c46a5e5354 req-6f0cd828-6a87-4d65-9222-f91ccc7806db service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:13:59.913448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-36f9012c-4c5a-4af8-aa1d-e8c46a5e5354 req-6f0cd828-6a87-4d65-9222-f91ccc7806db service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:13:59.939406 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-36f9012c-4c5a-4af8-aa1d-e8c46a5e5354 req-6f0cd828-6a87-4d65-9222-f91ccc7806db service nova] Creating event network-changed:ca073847-7a30-42d0-8a86-1ae61727eb94 for instance c20a09bc-c4e2-475d-acde-1c699b70574b on n-h2-846209-2 Jun 16 19:13:59.948094 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-36f9012c-4c5a-4af8-aa1d-e8c46a5e5354 req-6f0cd828-6a87-4d65-9222-f91ccc7806db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064995 Jun 16 19:13:59.949037 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2907/5716] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:14:00.221498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:00.222158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:00.228357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:00.228819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:00.229599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:00.230076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:00.394633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:00.403256 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-850a4460-fdef-4f71-b117-ea4a53c39597 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.186512 Jun 16 19:14:00.403843 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2810/5717] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:00 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:00.901990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:00.902636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:00.910303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:00.911043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:00.912058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:00.912528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:01.057012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:01.066045 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c05fe09-4c7f-415e-a38a-6ce04fad0590 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.169456 Jun 16 19:14:01.066633 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2908/5718] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:00 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:01.420962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:01.421653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:01.429109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:01.429555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:01.430340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:01.430783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:01.570034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:01.577931 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-914c1ae4-0af3-4cf1-918e-c6cfc003a55f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.161230 Jun 16 19:14:01.578522 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2811/5719] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:01 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:02.083529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:02.084237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:02.091682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:02.092178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:02.093093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:02.093576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:02.249686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:02.257970 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cae2b2f0-4395-44cc-949d-4c5f6b2dada6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.178688 Jun 16 19:14:02.258756 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2909/5720] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:02 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:02.600874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:02.601818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:02.613206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:02.613885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:02.615093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:02.615770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:02.787749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:02.798619 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-76bb255b-aa1a-47d3-ac8c-d641797d90b2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.206146 Jun 16 19:14:02.809471 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2812/5721] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:02 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:03.277667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:03.278375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:03.281791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:03.288117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:03.288117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:03.290202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:03.290296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:03.485825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:03.492030 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54a353aa-672c-4853-be16-1a8da00f5c79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.219210 Jun 16 19:14:03.492636 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2910/5722] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:03 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:03.824349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:03.824989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:03.829350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=57 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:03.837546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:03.838365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:03.841411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:03.842268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:04.353820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:04.367723 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a4baab54-0920-4959-9ee1-f0643607a217 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.554388 Jun 16 19:14:04.368474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2813/5723] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:03 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:04.513337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:04.515936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:04.523128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:04.523746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:04.525241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:04.525874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:04.767461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:04.775596 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c38011fb-faf0-49b3-848b-246f663832bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.267866 Jun 16 19:14:04.787813 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2911/5724] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:04 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:05.387203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:05.388559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:05.397422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:05.397866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:05.399010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:05.399703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:05.590133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:05.601189 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa9ce374-5d76-4abd-9715-435f693c2a7f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1696 microversion: 2.1 time: 0.218080 Jun 16 19:14:05.611782 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2814/5725] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:05 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:05.796345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:05.796961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:05.805454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:05.806309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:05.806983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:05.807553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:05.998874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:06.010133 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-186a529c-be26-4acc-b136-f60c5d8e631a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.217648 Jun 16 19:14:06.010811 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2912/5726] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:05 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:06.296850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9534af5b-26f2-4aa8-a8fd-6acf3675cd32 req-1f4f459a-2f94-46f1-831b-03ee8ae8f75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "name": "network-vif-unplugged", "status": "completed", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:06.306768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9534af5b-26f2-4aa8-a8fd-6acf3675cd32 req-1f4f459a-2f94-46f1-831b-03ee8ae8f75f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:06.309443 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9534af5b-26f2-4aa8-a8fd-6acf3675cd32 req-1f4f459a-2f94-46f1-831b-03ee8ae8f75f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:06.320741 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9534af5b-26f2-4aa8-a8fd-6acf3675cd32 req-1f4f459a-2f94-46f1-831b-03ee8ae8f75f service nova] Creating event network-vif-unplugged:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h1-846209-2 Jun 16 19:14:06.345383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-9534af5b-26f2-4aa8-a8fd-6acf3675cd32 req-1f4f459a-2f94-46f1-831b-03ee8ae8f75f service nova] Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:14:06.362987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9534af5b-26f2-4aa8-a8fd-6acf3675cd32 req-1f4f459a-2f94-46f1-831b-03ee8ae8f75f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069917 Jun 16 19:14:06.364334 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2815/5727] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:06.621826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:06.623391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:06.631349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:06.632306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:06.633353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:06.634111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:06.888780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:06.899863 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fdfa9ec9-78fa-4bcf-83c5-935317001ffa tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1695 microversion: 2.1 time: 0.283297 Jun 16 19:14:06.910597 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2913/5728] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:06 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1695 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:07.034749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:07.036103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:07.047316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:07.048855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:07.055061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:07.055848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:07.308774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:07.317996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c7515b1-b6e6-46f3-b892-5826dc371a43 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.288329 Jun 16 19:14:07.327860 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2816/5729] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:07 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:07.921528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:07.922198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:07.925156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:07.926252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:07.933241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:07.933676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:07.934490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:07.934943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:08.077060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:08.085974 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b82c42d-394a-4c79-85be-46db76b00d16 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1693 microversion: 2.1 time: 0.169184 Jun 16 19:14:08.086556 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2914/5730] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:07 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:08.336086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:08.336655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:08.338758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:08.347386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:08.347844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:08.348634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:08.349086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:08.380853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-710215af-3863-45d7-a7de-59799e355406 req-738bd947-4844-40f2-9749-a76a5c109fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:08.389683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-710215af-3863-45d7-a7de-59799e355406 req-738bd947-4844-40f2-9749-a76a5c109fab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:08.390171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-710215af-3863-45d7-a7de-59799e355406 req-738bd947-4844-40f2-9749-a76a5c109fab service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:08.403869 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-710215af-3863-45d7-a7de-59799e355406 req-738bd947-4844-40f2-9749-a76a5c109fab service nova] Creating event network-changed:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h1-846209-2 Jun 16 19:14:08.410731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-710215af-3863-45d7-a7de-59799e355406 req-738bd947-4844-40f2-9749-a76a5c109fab service nova] Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:14:08.424316 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-710215af-3863-45d7-a7de-59799e355406 req-738bd947-4844-40f2-9749-a76a5c109fab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047444 Jun 16 19:14:08.424926 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2915/5731] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:08.500138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:08.509446 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-66482f9c-3c0b-4f39-a0b3-7a865d39ea08 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.177363 Jun 16 19:14:08.520012 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2817/5732] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:08 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:09.106778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:09.107735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:09.115191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:09.115960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:09.116950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:09.117581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:09.326574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:09.338024 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9320a44c-aff7-4559-a63c-2fad54e7fdb7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1693 microversion: 2.1 time: 0.237473 Jun 16 19:14:09.338832 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2916/5733] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:09 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1693 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:09.528502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:09.529347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:09.536710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:09.537489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:09.538378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:09.538921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:09.692987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:09.700504 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a8dfe30-64e8-4a85-a999-c481fa25a49f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.176698 Jun 16 19:14:09.701116 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2818/5734] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:09 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:10.358564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:10.359126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:10.367142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:10.367616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:10.368415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:10.368876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:10.718229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:10.719020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:10.726838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:10.727294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:10.728080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:10.728523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:10.839328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:10.847825 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-abfccc26-2702-415a-9bf3-3b6918226e77 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1690 microversion: 2.1 time: 0.493134 Jun 16 19:14:10.848423 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2917/5735] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:10 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1690 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:10.870092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f96abdb2-dd2d-4479-ac4d-0cb5be4b8892 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:10.870677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f96abdb2-dd2d-4479-ac4d-0cb5be4b8892 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:10.880745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f96abdb2-dd2d-4479-ac4d-0cb5be4b8892 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:10.881620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f96abdb2-dd2d-4479-ac4d-0cb5be4b8892 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:10.882480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f96abdb2-dd2d-4479-ac4d-0cb5be4b8892 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:10.882934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f96abdb2-dd2d-4479-ac4d-0cb5be4b8892 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:10.931973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:10.942285 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1c7dff31-615a-4664-9596-f6c9321741b8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.227715 Jun 16 19:14:10.942908 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2819/5736] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:10 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:14:10.991754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:11.014708 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f96abdb2-dd2d-4479-ac4d-0cb5be4b8892 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action" status: 202 len: 0 microversion: 2.1 time: 0.152147 Jun 16 19:14:11.015386 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2918/5737] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:14:10 2022] POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:14:11.024008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:11.024856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:11.031688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:11.031818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:11.034400 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:11.035029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:11.244777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:11.254987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d81b706-08ba-4a85-9b98-99aad26c5dea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1689 microversion: 2.1 time: 0.234822 Jun 16 19:14:11.257947 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2820/5738] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:11 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:11.962621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:11.963513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:11.970577 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:11.971174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:11.972070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:11.972652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:12.124235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:12.133191 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c029987-3631-4bee-b09b-2fdcc7522d21 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.175722 Jun 16 19:14:12.133755 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2919/5739] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:11 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:12.272706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:12.273438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:12.280701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:12.281154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:12.282151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:12.282506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:12.426010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:12.434615 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c7f1dae2-0edd-4da1-a168-f33b503b4a4f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1689 microversion: 2.1 time: 0.165661 Jun 16 19:14:12.435235 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2821/5740] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:12 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:13.151139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:13.151766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:13.159158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:13.159622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:13.160399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:13.160849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:13.320464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:13.328186 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-607a7b4a-5ef0-4f98-a656-9a8854b4dce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1342 microversion: 2.1 time: 0.181081 Jun 16 19:14:13.328769 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2920/5741] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:13 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1342 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:14:13.453434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:13.455879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:13.463996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:13.464563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:13.465439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:13.466107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:13.554058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b4b210ff-f949-4a0e-84ad-3eeaf1540af4 req-5249751c-5dc7-4ad8-aaba-335edd722fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "name": "network-vif-plugged", "status": "completed", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:13.582931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b4b210ff-f949-4a0e-84ad-3eeaf1540af4 req-5249751c-5dc7-4ad8-aaba-335edd722fca service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:13.582931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b4b210ff-f949-4a0e-84ad-3eeaf1540af4 req-5249751c-5dc7-4ad8-aaba-335edd722fca service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:13.599751 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b4b210ff-f949-4a0e-84ad-3eeaf1540af4 req-5249751c-5dc7-4ad8-aaba-335edd722fca service nova] Creating event network-vif-plugged:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h1-846209-2 Jun 16 19:14:13.607527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-b4b210ff-f949-4a0e-84ad-3eeaf1540af4 req-5249751c-5dc7-4ad8-aaba-335edd722fca service nova] Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:14:13.622836 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b4b210ff-f949-4a0e-84ad-3eeaf1540af4 req-5249751c-5dc7-4ad8-aaba-335edd722fca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073629 Jun 16 19:14:13.623922 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2921/5742] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:14:13.701208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:13.705544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=100 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:13.711272 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d370e63-5b0b-4861-830b-63f6cde591b1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1689 microversion: 2.1 time: 0.262966 Jun 16 19:14:13.722373 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2822/5743] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:13 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1689 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:14.347392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:14.348280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:14.354846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:14.355445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:14.356349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:14.356931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:14.493461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:14.501296 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ef0ed36e-7751-4a42-b511-b11cab786fd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.159428 Jun 16 19:14:14.501884 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2922/5744] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:14 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:14.689741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-19aeda89-749f-4514-b5f2-42568df5db1d req-a75d1645-2360-47eb-8bf7-e920af0e3795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "name": "network-vif-unplugged", "status": "completed", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:14.699580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-19aeda89-749f-4514-b5f2-42568df5db1d req-a75d1645-2360-47eb-8bf7-e920af0e3795 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:14.700129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-19aeda89-749f-4514-b5f2-42568df5db1d req-a75d1645-2360-47eb-8bf7-e920af0e3795 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:14.714519 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-19aeda89-749f-4514-b5f2-42568df5db1d req-a75d1645-2360-47eb-8bf7-e920af0e3795 service nova] Creating event network-vif-unplugged:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:14:14.720757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-19aeda89-749f-4514-b5f2-42568df5db1d req-a75d1645-2360-47eb-8bf7-e920af0e3795 service nova] Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:14:14.729001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:14.730009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:14.732626 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-19aeda89-749f-4514-b5f2-42568df5db1d req-a75d1645-2360-47eb-8bf7-e920af0e3795 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048068 Jun 16 19:14:14.733415 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2823/5745] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:14.745884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:14.746437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:14.747258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:14.747724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:14.927145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:14.935798 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd0c31f4-c775-4135-b090-c41da6fdf7f3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1689 microversion: 2.1 time: 0.210571 Jun 16 19:14:14.936372 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2923/5746] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:14 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:15.520385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:15.521100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:15.527861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:15.528297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:15.529250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:15.529935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:15.697570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:15.714446 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9c779dcc-7ad6-44e0-9cd7-cc7ad4829732 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.198530 Jun 16 19:14:15.715130 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2824/5747] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:15 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:15.953056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:15.953737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:15.961137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:15.961543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:15.962445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:15.962897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:16.115884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:16.123770 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-53385baa-77cf-4098-8d7e-cd9f9f1deb74 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1689 microversion: 2.1 time: 0.174707 Jun 16 19:14:16.124359 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2924/5748] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:15 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:16.732383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:16.733008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:16.740550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:16.741339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:16.741998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:16.742457 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:16.751693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-27e1e2f8-f04d-41fc-8086-05d95b39f8ac req-bdc24af4-08a6-43fb-a387-a7e3fc0f26e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:16.760058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-27e1e2f8-f04d-41fc-8086-05d95b39f8ac req-bdc24af4-08a6-43fb-a387-a7e3fc0f26e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:16.760521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-27e1e2f8-f04d-41fc-8086-05d95b39f8ac req-bdc24af4-08a6-43fb-a387-a7e3fc0f26e8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:16.772749 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-27e1e2f8-f04d-41fc-8086-05d95b39f8ac req-bdc24af4-08a6-43fb-a387-a7e3fc0f26e8 service nova] Creating event network-changed:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:14:16.778359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-27e1e2f8-f04d-41fc-8086-05d95b39f8ac req-bdc24af4-08a6-43fb-a387-a7e3fc0f26e8 service nova] Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:14:16.790287 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-27e1e2f8-f04d-41fc-8086-05d95b39f8ac req-bdc24af4-08a6-43fb-a387-a7e3fc0f26e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043422 Jun 16 19:14:16.790904 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2925/5749] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:14:16.983940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:16.993472 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4baadfdb-eec7-45c1-9687-ef267a532e8d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.264900 Jun 16 19:14:17.003590 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2825/5750] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:16 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:17.143142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:17.143864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:17.150734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:17.151489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:17.152471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:17.153093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:17.412310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:17.421968 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2c551312-5f0f-48a7-bc38-9da90038b616 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1689 microversion: 2.1 time: 0.284054 Jun 16 19:14:17.423218 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2926/5751] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:17 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:18.011343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:18.012145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:18.019839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:18.020306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:18.021096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:18.021541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:18.179262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:18.187498 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a39cf7c-91f6-4c10-b40a-1c40542fdc01 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.180209 Jun 16 19:14:18.189323 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2826/5752] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:18 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:18.441107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:18.441729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:18.449000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:18.449655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:18.450464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:18.450909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:18.600263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:18.608767 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-789bb7eb-98f0-449f-9b00-34f2944014e7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1682 microversion: 2.1 time: 0.171980 Jun 16 19:14:18.609483 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2927/5753] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:18 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:14:19.206362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:19.206972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:19.214483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:19.214900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:19.215746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:19.216183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:19.364648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:19.372614 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-637705e3-5688-4fa3-980e-3ac86f6a34e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.170988 Jun 16 19:14:19.373205 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2827/5754] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:19 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:20.101193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f677546f-2195-4731-80c8-6d071015d1b1 req-8f650722-7368-448a-aacd-5d809ab390fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "name": "network-vif-plugged", "status": "completed", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:20.111144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f677546f-2195-4731-80c8-6d071015d1b1 req-8f650722-7368-448a-aacd-5d809ab390fc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:20.111554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f677546f-2195-4731-80c8-6d071015d1b1 req-8f650722-7368-448a-aacd-5d809ab390fc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:20.125336 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f677546f-2195-4731-80c8-6d071015d1b1 req-8f650722-7368-448a-aacd-5d809ab390fc service nova] Creating event network-vif-plugged:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:14:20.131243 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f677546f-2195-4731-80c8-6d071015d1b1 req-8f650722-7368-448a-aacd-5d809ab390fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034036 Jun 16 19:14:20.131847 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2928/5755] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:20.390785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:20.391859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:20.399246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:20.399703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:20.400548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:20.400991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:20.544172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:20.552905 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0defa043-562d-4ae3-ae52-969e6727f5f8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.166111 Jun 16 19:14:20.553481 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2828/5756] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:20 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:14:21.572227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:21.572955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:21.580126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:21.580591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:21.581366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:21.581818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:21.713521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:21.721286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-425fcd5d-08c2-4a0f-90a5-c6f940a0d4ec tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.154282 Jun 16 19:14:21.721852 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2929/5757] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:21 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:22.738941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:22.739575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:22.746697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:22.747160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:22.747925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:22.748368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:22.896008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:22.904063 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c50015b9-a254-4c90-bbcd-29bc0b3811de tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.169745 Jun 16 19:14:22.904635 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2829/5758] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:22 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:23.922003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:23.923362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:23.931292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:23.931984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:23.932832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:23.933316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:24.088028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:24.096557 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5dd02856-9e3b-49f2-9381-6db468c5178e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.179508 Jun 16 19:14:24.097232 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2930/5759] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:23 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:24.138405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3f3ed716-c3d1-4e8e-8550-3d7423199027 req-ab57bce5-fbd7-4009-ae92-3f9f8ffa12b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20a09bc-c4e2-475d-acde-1c699b70574b", "name": "network-vif-plugged", "status": "completed", "tag": "ca073847-7a30-42d0-8a86-1ae61727eb94"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:24.149682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3f3ed716-c3d1-4e8e-8550-3d7423199027 req-ab57bce5-fbd7-4009-ae92-3f9f8ffa12b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:24.150241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3f3ed716-c3d1-4e8e-8550-3d7423199027 req-ab57bce5-fbd7-4009-ae92-3f9f8ffa12b9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:24.163495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3f3ed716-c3d1-4e8e-8550-3d7423199027 req-ab57bce5-fbd7-4009-ae92-3f9f8ffa12b9 service nova] Creating event network-vif-plugged:ca073847-7a30-42d0-8a86-1ae61727eb94 for instance c20a09bc-c4e2-475d-acde-1c699b70574b on n-h2-846209-2 Jun 16 19:14:24.169579 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3f3ed716-c3d1-4e8e-8550-3d7423199027 req-ab57bce5-fbd7-4009-ae92-3f9f8ffa12b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035226 Jun 16 19:14:24.170697 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2830/5760] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:25.115339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:25.115974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:25.124368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:25.125266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:25.126868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:25.127328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:25.271794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:25.280374 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04bd8ffe-0c74-4e0b-bbe2-4856404e8529 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1376 microversion: 2.1 time: 0.170210 Jun 16 19:14:25.281049 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2931/5761] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:25 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:26.300433 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:26.301138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:26.307870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.308326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:26.309098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.309542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:26.451826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:26.460302 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6276bdba-6edd-418e-b885-ec4fbefdbb9e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1564 microversion: 2.1 time: 0.165910 Jun 16 19:14:26.461058 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2831/5762] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:26 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:26.479088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:26.480336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:26.490445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.490922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:26.491766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.492247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:26.644278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:26.652916 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b3e1132-6bd7-4b35-8b19-dc30ec3ebf86 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1564 microversion: 2.1 time: 0.179518 Jun 16 19:14:26.653504 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2932/5763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:26 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:26.728385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:26.728909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:26.736981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.737469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:26.738659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.739159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:26.769264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:14:26.850848 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f184efa2-b86b-43fe-9064-1969ff7ba564 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 204 len: 0 microversion: 2.1 time: 0.126198 Jun 16 19:14:26.851362 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2832/5764] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:14:26 2022] DELETE /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:14:26.861011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:26.861800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:26.868414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.869137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:26.870010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:26.870516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:27.023981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:27.031872 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c3075801-38fb-4d11-8754-b95ad3a1aac8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1570 microversion: 2.1 time: 0.175942 Jun 16 19:14:27.033021 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2933/5765] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:26 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:28.052057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:28.052857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:28.059812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:28.060278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:28.061136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:28.061581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:28.196386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:28.204363 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e0fad7d2-cf1b-4d7f-82b5-5f832d64ebe4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1570 microversion: 2.1 time: 0.157159 Jun 16 19:14:28.205018 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2833/5766] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:28 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:28.931257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-59810a27-f7d8-4a94-86cf-0b428fef2345 req-e015156f-adfa-43a5-8a77-7459db9809a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20a09bc-c4e2-475d-acde-1c699b70574b", "name": "network-vif-deleted", "tag": "ca073847-7a30-42d0-8a86-1ae61727eb94"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:28.946980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-59810a27-f7d8-4a94-86cf-0b428fef2345 req-e015156f-adfa-43a5-8a77-7459db9809a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:28.947906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-59810a27-f7d8-4a94-86cf-0b428fef2345 req-e015156f-adfa-43a5-8a77-7459db9809a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:28.968075 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-59810a27-f7d8-4a94-86cf-0b428fef2345 req-e015156f-adfa-43a5-8a77-7459db9809a7 service nova] Creating event network-vif-deleted:ca073847-7a30-42d0-8a86-1ae61727eb94 for instance c20a09bc-c4e2-475d-acde-1c699b70574b on n-h2-846209-2 Jun 16 19:14:28.977102 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-59810a27-f7d8-4a94-86cf-0b428fef2345 req-e015156f-adfa-43a5-8a77-7459db9809a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053792 Jun 16 19:14:28.978321 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2934/5767] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:29.221230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:29.221878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:29.229310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:29.229769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:29.230576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:29.231018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:29.299499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:29.307225 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a3e4f6b0-f611-4d0f-bb66-de19bd117534 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1361 microversion: 2.1 time: 0.090123 Jun 16 19:14:29.307805 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2834/5768] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:29 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:30.326633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:30.327628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:30.334595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:30.335055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:30.335830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:30.336274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:30.402601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:30.410657 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-238d9990-cad7-4e73-86cb-76deff69e432 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1361 microversion: 2.1 time: 0.089130 Jun 16 19:14:30.411330 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2935/5769] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:30 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:31.430461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:31.431204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:31.439007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:31.439471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:31.440264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:31.440713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:31.512952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:31.521711 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a73b4168-8dc9-411a-9639-91c3c80c3743 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1361 microversion: 2.1 time: 0.096156 Jun 16 19:14:31.522334 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2835/5770] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:31 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1361 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:32.539208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:32.539858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:32.547163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:32.547783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:32.548573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:32.549023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:32.617115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:32.625034 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5249f142-0e8a-48a2-a6ac-046b2a51c5db tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 200 len: 1361 microversion: 2.1 time: 0.089794 Jun 16 19:14:32.626421 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2936/5771] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:32 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:33.643122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:33.643761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:33.651207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:33.652009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:33.653193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:33.654040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:33.669974 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b HTTP/1.1 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'c20a09bc-c4e2-475d-acde-1c699b70574b'} Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:33.672022 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:14:33.679118 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f6204a7c-cdf5-4d8b-983c-86b485045f47 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 404 len: 111 microversion: 2.1 time: 0.036890 Jun 16 19:14:33.683043 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2836/5772] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:33 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:14:39.040356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:39.040878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:39.044162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=58 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:39.049938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:39.050405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:39.051208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:39.051671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:39.055769 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:39.077350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:14:39.153975 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb14865c-147c-488c-90b6-f2f3df271c34 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 204 len: 0 microversion: 2.1 time: 0.117206 Jun 16 19:14:39.155232 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2937/5773] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:14:39 2022] DELETE /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:14:39.165452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:39.166332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:39.169461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:39.174840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:39.175299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:39.176078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:39.176552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:39.313300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:39.321142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-491886b5-0c22-4724-a2a4-fffa7684640f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1410 microversion: 2.1 time: 0.160796 Jun 16 19:14:39.321714 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2837/5774] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:39 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:40.339314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:40.339950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:40.347565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:40.348031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:40.348809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:40.349255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:40.491628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:40.499628 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-30499f82-c1fd-4124-826b-8a08a4d24e30 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1410 microversion: 2.1 time: 0.164700 Jun 16 19:14:40.500208 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2938/5775] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:40 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:41.354841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-904c2364-8fde-4abe-bf56-bc80256c34bf req-00e1aad2-75b0-4efc-8164-b52a3ed24ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed307227-915e-42df-bc16-bc907f1ed2f3", "name": "network-vif-deleted", "tag": "2381c1e4-f263-4508-954b-b6d7b1e18fc2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:41.364940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-904c2364-8fde-4abe-bf56-bc80256c34bf req-00e1aad2-75b0-4efc-8164-b52a3ed24ed3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:41.365395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-904c2364-8fde-4abe-bf56-bc80256c34bf req-00e1aad2-75b0-4efc-8164-b52a3ed24ed3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:41.377931 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-904c2364-8fde-4abe-bf56-bc80256c34bf req-00e1aad2-75b0-4efc-8164-b52a3ed24ed3 service nova] Creating event network-vif-deleted:2381c1e4-f263-4508-954b-b6d7b1e18fc2 for instance ed307227-915e-42df-bc16-bc907f1ed2f3 on n-h1-846209-2 Jun 16 19:14:41.383308 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-904c2364-8fde-4abe-bf56-bc80256c34bf req-00e1aad2-75b0-4efc-8164-b52a3ed24ed3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032206 Jun 16 19:14:41.383919 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2838/5776] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:41.517309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:41.518199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:41.528267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:41.529354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:41.530216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:41.530711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:41.628602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:41.639698 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-42f23727-1f14-4a68-bf49-7814f1c93f73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1202 microversion: 2.1 time: 0.125748 Jun 16 19:14:41.645443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2939/5777] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:41 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1202 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:42.657839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:42.658469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:42.664850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:42.665309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:42.666138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:42.666587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:42.733787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:42.742417 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-198a0ca1-46d5-4def-b4f7-aba41f4a2202 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1202 microversion: 2.1 time: 0.090371 Jun 16 19:14:42.743011 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2839/5778] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:42 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:42.823449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-62080679-0618-4dc8-a4a6-d0c991943b47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:42.824569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-62080679-0618-4dc8-a4a6-d0c991943b47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:42.832326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62080679-0618-4dc8-a4a6-d0c991943b47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:42.832794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62080679-0618-4dc8-a4a6-d0c991943b47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:42.833569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62080679-0618-4dc8-a4a6-d0c991943b47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:42.834098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62080679-0618-4dc8-a4a6-d0c991943b47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:42.886597 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-62080679-0618-4dc8-a4a6-d0c991943b47 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action" status: 200 len: 63090 microversion: 2.1 time: 0.067305 Jun 16 19:14:42.895076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2940/5779] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:14:42 2022] POST /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b/action => generated 63090 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:14:43.760109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:43.760792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:43.768730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:43.769213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:43.770025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:43.770498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:43.775652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:14:43.844897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:43.853702 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-393dec6d-0387-437f-84b1-363a73aa5d82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1202 microversion: 2.1 time: 0.097863 Jun 16 19:14:43.854434 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2840/5780] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:43 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:14:44.871682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:44.872581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:44.880580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:44.881051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:44.881845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:44.882476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:44.950075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:44.960987 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bc69072a-0077-4551-8d7d-b35c08caaffb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1202 microversion: 2.1 time: 0.093504 Jun 16 19:14:44.961862 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2941/5781] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:44 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:45.978438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:45.979062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:45.986263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:45.986718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:45.987492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:45.987927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:46.024477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:46.024928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:46.025389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lazy-loading 'fault' on Instance uuid ed307227-915e-42df-bc16-bc907f1ed2f3 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:14:46.070105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:46.079769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0374cc2c-e1c1-4e0c-a159-f0c4bf8d282f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 200 len: 1207 microversion: 2.1 time: 0.104482 Jun 16 19:14:46.080574 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2841/5782] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:45 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 1207 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:47.097745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:47.098440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:47.105088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:47.105553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:47.106366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:47.106818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:47.121546 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 HTTP/1.1 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ed307227-915e-42df-bc16-bc907f1ed2f3'} Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:47.123295 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85cb9404-e006-4c3b-bc5a-7276e120094f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 404 len: 111 microversion: 2.1 time: 0.031897 Jun 16 19:14:47.128627 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2942/5783] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:47 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:14:49.124569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f7918a7-249c-4b90-b010-ed64a543db56 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:49.125310 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f7918a7-249c-4b90-b010-ed64a543db56 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:49.133553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7918a7-249c-4b90-b010-ed64a543db56 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.134160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7918a7-249c-4b90-b010-ed64a543db56 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.134938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7918a7-249c-4b90-b010-ed64a543db56 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.135384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f7918a7-249c-4b90-b010-ed64a543db56 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.260706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:49.261226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:49.269800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.270303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.271104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.271558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.274471 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f7918a7-249c-4b90-b010-ed64a543db56 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1833 microversion: 2.1 time: 0.153674 Jun 16 19:14:49.275371 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2842/5784] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:49 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1833 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:49.288245 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b HTTP/1.1 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'c20a09bc-c4e2-475d-acde-1c699b70574b'} Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:14:49.289971 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8928d106-29d5-4bf4-8004-abef9ec2c549 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 404 len: 111 microversion: 2.1 time: 0.034610 Jun 16 19:14:49.294587 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2943/5785] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:14:49 2022] DELETE /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:14:49.300672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:49.301294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: c20a09bc-c4e2-475d-acde-1c699b70574b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:49.307503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.307954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.308722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.309159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.323441 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b HTTP/1.1 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'c20a09bc-c4e2-475d-acde-1c699b70574b'} Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.325163 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance c20a09bc-c4e2-475d-acde-1c699b70574b could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5dad1d3a-e9a5-47a3-9042-750663dd0e51 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b" status: 404 len: 111 microversion: 2.1 time: 0.030112 Jun 16 19:14:49.330634 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2843/5786] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:49 2022] GET /compute/v2.1/servers/c20a09bc-c4e2-475d-acde-1c699b70574b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:14:49.761466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:49.762016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:49.770491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.770857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.772272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.772790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.797172 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 HTTP/1.1 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'ed307227-915e-42df-bc16-bc907f1ed2f3'} Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:14:49.800116 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.805100 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.806827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:14:49.807749 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f900a6ec-3278-489d-bb81-502da68374aa tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 404 len: 111 microversion: 2.1 time: 0.050146 Jun 16 19:14:49.808443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2944/5787] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:14:49 2022] DELETE /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:14:49.818256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:49.818941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: ed307227-915e-42df-bc16-bc907f1ed2f3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:49.825834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.826401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.827195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:49.827976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:49.841988 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 HTTP/1.1 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ed307227-915e-42df-bc16-bc907f1ed2f3'} Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:49.843573 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance ed307227-915e-42df-bc16-bc907f1ed2f3 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a1b34f8-c7a8-4b72-b9a7-a3c9da5cbb79 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3" status: 404 len: 111 microversion: 2.1 time: 0.032400 Jun 16 19:14:49.849363 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2844/5788] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:49 2022] GET /compute/v2.1/servers/ed307227-915e-42df-bc16-bc907f1ed2f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:14:49.921822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-631ea6df-5e09-45f1-af26-0e150aa74a82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: .version_select at 0x7f866e3a4160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-998173704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAulzNBnV0pMaHSjbW09HaFUjrSaRQzr1nj2qQ5qGVQzE/OUzOn04/MpxOGUiRa8JjAXM41WvaLWpmo3ZMZRZE7fpQ8G3Q1ycooPZOw5Fm4zrBygMh8mFaqX2JUoPFpWqA=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:49.937421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-631ea6df-5e09-45f1-af26-0e150aa74a82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:14:49.942799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-631ea6df-5e09-45f1-af26-0e150aa74a82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:14:49.966856 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-631ea6df-5e09-45f1-af26-0e150aa74a82 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.049127 Jun 16 19:14:49.968137 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2945/5789] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:14:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:50.242887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:50.243609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:50.246851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d44e5a35-fe36-4a13-815f-a3a4a91845e5 req-9c8e8fbe-cb7a-4c18-a622-5fff72ec7f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:50.261389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d44e5a35-fe36-4a13-815f-a3a4a91845e5 req-9c8e8fbe-cb7a-4c18-a622-5fff72ec7f85 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:50.262545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d44e5a35-fe36-4a13-815f-a3a4a91845e5 req-9c8e8fbe-cb7a-4c18-a622-5fff72ec7f85 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:50.273355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:50.273925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:50.278368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:50.279648 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d44e5a35-fe36-4a13-815f-a3a4a91845e5 req-9c8e8fbe-cb7a-4c18-a622-5fff72ec7f85 service nova] Creating event network-changed:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:14:50.280165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:50.287460 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d44e5a35-fe36-4a13-815f-a3a4a91845e5 req-9c8e8fbe-cb7a-4c18-a622-5fff72ec7f85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045128 Jun 16 19:14:50.289290 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2946/5790] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:14:50.332583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:14:50.444513 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3875f28b-cbc5-447f-9092-6b9ff31ffb11 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 204 len: 0 microversion: 2.1 time: 0.205863 Jun 16 19:14:50.447593 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2845/5791] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:14:50 2022] DELETE /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:14:50.458202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:50.458970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:50.466300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:50.466811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:50.467677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:50.468193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:50.636001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:50.648732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ecc2a633-612b-41dd-bc5d-330ae15f390a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1688 microversion: 2.1 time: 0.195175 Jun 16 19:14:50.650100 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2947/5792] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:50 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:51.668489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:51.670511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:51.678001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:51.678647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:51.679429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:51.679866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:51.835261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:51.848250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-59713cc8-5c1b-4885-ae89-5df130c7c676 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1688 microversion: 2.1 time: 0.184348 Jun 16 19:14:51.849272 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2846/5793] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:51 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:14:52.610172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6549a54e-0a25-40c7-8787-66d1fc3897db req-6bc7ef3e-c72d-428a-9dff-a4aa34140717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab3bd2-4113-44c0-af6d-7eeb68a83e5b", "name": "network-vif-deleted", "tag": "8a6877b6-eedc-45db-934f-e84ad2a26774"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:52.631722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6549a54e-0a25-40c7-8787-66d1fc3897db req-6bc7ef3e-c72d-428a-9dff-a4aa34140717 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:52.632240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6549a54e-0a25-40c7-8787-66d1fc3897db req-6bc7ef3e-c72d-428a-9dff-a4aa34140717 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:52.648892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6549a54e-0a25-40c7-8787-66d1fc3897db req-6bc7ef3e-c72d-428a-9dff-a4aa34140717 service nova] Creating event network-vif-deleted:8a6877b6-eedc-45db-934f-e84ad2a26774 for instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b on n-h2-846209-2 Jun 16 19:14:52.654094 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6549a54e-0a25-40c7-8787-66d1fc3897db req-6bc7ef3e-c72d-428a-9dff-a4aa34140717 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049454 Jun 16 19:14:52.654830 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2948/5794] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:14:52.866965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:52.867508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:52.874802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:52.875260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:52.876848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:52.877295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:52.912466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:52.912928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:52.913589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lazy-loading 'fault' on Instance uuid 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:14:52.964852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:14:52.975624 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dceed1f4-2186-4f47-b022-e7e01f159a3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 200 len: 1357 microversion: 2.1 time: 0.112592 Jun 16 19:14:52.976224 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2847/5795] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:52 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 1357 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:14:53.995349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:53.996066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:14:54.003441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:54.003916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:54.004716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:14:54.005169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:14:54.020615 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] HTTP exception thrown: Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b could not be found. Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Request method failure captured: Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b HTTP/1.1 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4A05u_-9AikOlX9ntKqQm7qzINM9v1WDOsB1gjwlQGL-f-UN3zhF3YTfYTacmIjY28BFrjHK7FTwa-n6EeUpZ8ZhKYC6v8hCA-h8AjiPNCdZeYVCohxsIvpEYwpRw-bBzpDlTd5KgMhh4AlAmmhCJtWd-8sTyC-ypUrYpg619ZDDRU Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba85d86fb7e44a10b9542fc1c0538a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 42fd96b15988445484a9fbb22fd7a6a7 Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b could not be found. Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '75ab3bd2-4113-44c0-af6d-7eeb68a83e5b'} Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b could not be found. Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b could not be found. Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:54.022330 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b could not be found. Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Returning 404 to user: Instance 75ab3bd2-4113-44c0-af6d-7eeb68a83e5b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:14:54.027615 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d14535c9-0ad5-4edf-a0f0-9f6ac39c06ac tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b" status: 404 len: 111 microversion: 2.1 time: 0.033607 Jun 16 19:14:54.028536 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2949/5796] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:14:53 2022] GET /compute/v2.1/servers/75ab3bd2-4113-44c0-af6d-7eeb68a83e5b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:14:57.695764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ecce78b-af88-4417-a067-21681a57f022 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '.version_select at 0x7f866d86a4c0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:14:57.729958 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0ecce78b-af88-4417-a067-21681a57f022 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1415618751" status: 202 len: 0 microversion: 2.1 time: 0.037970 Jun 16 19:14:57.731475 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2848/5797] 10.222.0.27 () {58 vars in 1283 bytes} [Thu Jun 16 19:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1415618751 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:14:57.770586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3592817c-e3e5-4dcf-a640-e299fd9e3bed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: .version_select at 0x7f866de5e1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1745527837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUxCZCT+eopAs7sbLoJciAjVYbD2IALuezOei5mZJ+wUDLSUAFKa+2gAsA87VjpKYjIJSMLdzDOvK5pZTMseO/+fOGOjxFGYSm94OeXZ0VOCBL8bRppGRZz63Opw0uQhQ=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:14:57.788301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3592817c-e3e5-4dcf-a640-e299fd9e3bed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:14:57.796797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3592817c-e3e5-4dcf-a640-e299fd9e3bed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:14:57.832020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3592817c-e3e5-4dcf-a640-e299fd9e3bed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.065773 Jun 16 19:14:57.832812 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2950/5798] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:14:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:15:04.029406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-626447286", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "3d1541d9-1993-4e87-8ae6-d0e6b10903a3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1745527837", "security_groups": [{"name": "tempest-secgroup-smoke-308869607"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:04.045301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:04.168489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] validate_networks() for [('3d1541d9-1993-4e87-8ae6-d0e6b10903a3', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:15:05.266700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:15:05.267293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:15:05.267608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:15:05.268291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:15:05.268899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:15:05.279509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:05.279877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:05.280962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:05.281394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:05.301236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:15:05.310249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:15:05.324690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:15:05.327436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:15:05.398812 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-04389dca-b1db-4257-a52a-55364f6dd227 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.366567 Jun 16 19:15:05.400135 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2849/5799] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:15:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:15:05.409435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:05.413726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-241346dc-d501-4227-af55-cbdbbe547a97 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:05.414542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-241346dc-d501-4227-af55-cbdbbe547a97 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:05.538460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-241346dc-d501-4227-af55-cbdbbe547a97 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:05.558605 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-241346dc-d501-4227-af55-cbdbbe547a97 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1266 microversion: 2.1 time: 0.152675 Jun 16 19:15:05.559201 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2951/5800] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:05 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:06.580590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:06.581267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:06.590465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:06.591206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:06.592786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:06.593432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:06.671267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:06.690194 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-798db4a1-a355-44fd-9c51-b930148be93d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1318 microversion: 2.1 time: 0.112061 Jun 16 19:15:06.700633 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2850/5801] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:06 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:07.710356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:07.710992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:07.721117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:07.722028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:07.723112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:07.723934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:08.036428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:08.048392 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e37ebf31-a880-405b-bbcc-1253a4420162 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1391 microversion: 2.1 time: 0.342104 Jun 16 19:15:08.061019 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2952/5802] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:07 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1391 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:08.632377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b2210f2d-e528-4d4c-9078-0ce4ef0ef50c req-b81652eb-9440-4669-8d98-a3ecaf12c628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:08.656519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b2210f2d-e528-4d4c-9078-0ce4ef0ef50c req-b81652eb-9440-4669-8d98-a3ecaf12c628 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:08.669210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b2210f2d-e528-4d4c-9078-0ce4ef0ef50c req-b81652eb-9440-4669-8d98-a3ecaf12c628 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:08.691786 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b2210f2d-e528-4d4c-9078-0ce4ef0ef50c req-b81652eb-9440-4669-8d98-a3ecaf12c628 service nova] Creating event network-changed:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h1-846209-2 Jun 16 19:15:08.700840 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b2210f2d-e528-4d4c-9078-0ce4ef0ef50c req-b81652eb-9440-4669-8d98-a3ecaf12c628 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075481 Jun 16 19:15:08.705150 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2851/5803] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:15:09.068964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:09.069521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:09.072727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:09.079239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:09.079716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:09.081410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:09.081889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:09.237553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:09.245353 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1d8866c-87fb-4737-8763-7d37c5abb53c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1391 microversion: 2.1 time: 0.181032 Jun 16 19:15:09.245971 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2953/5804] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:09 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:09.882088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1133671192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-998173704", "security_groups": [{"name": "tempest-secgroup-smoke-209112256"}], "block_device_mapping_v2": [{"uuid": "8fa4e5c1-9d03-41d6-969d-9f3b57c27aba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b0a-381d-4be1-a4a0-bfd044486ffa"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:09.890115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:09.995474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] validate_networks() for [('06296b0a-381d-4be1-a4a0-bfd044486ffa', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:15:10.262800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:10.263368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:10.270711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:10.271186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:10.271989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:10.272448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:10.590045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:10.598879 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-684959ae-d6fa-46f9-a8b3-75da4136c1f5 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1391 microversion: 2.1 time: 0.340043 Jun 16 19:15:10.599477 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2954/5805] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:10 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:15:10.624213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:15:10.624808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:15:10.625298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:15:10.626399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:15:10.626829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:15:10.636325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:10.636945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:10.637848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:10.638420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:10.656345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:15:10.662622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:15:10.726718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:15:10.728927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fa4e5c1-9d03-41d6-969d-9f3b57c27aba',volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:15:10.865729 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e128b648-a2a5-496d-b198-d607f0a8fe0b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.989757 Jun 16 19:15:10.866491 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2852/5806] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:15:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:15:10.877063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7514dc9e-a3e5-4ca2-a62e-f441cba5eef9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:10.877742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7514dc9e-a3e5-4ca2-a62e-f441cba5eef9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:10.931675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7514dc9e-a3e5-4ca2-a62e-f441cba5eef9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:10.939968 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7514dc9e-a3e5-4ca2-a62e-f441cba5eef9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1094 microversion: 2.1 time: 0.067458 Jun 16 19:15:10.940625 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2955/5807] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:10 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:15:11.617709 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:11.618366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:11.624875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:11.625269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:11.626995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:11.627198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:11.806337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:11.819204 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ac05b863-e1c5-4144-bb31-4b9f843107c3 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1391 microversion: 2.1 time: 0.205080 Jun 16 19:15:11.821761 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2853/5808] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:11 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1391 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:11.958363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:11.958885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:11.967424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:11.967873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:11.968679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:11.969121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:12.035417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:12.048660 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85b580ff-b238-4af4-aa8e-dbbf348dfcf4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1210 microversion: 2.1 time: 0.095745 Jun 16 19:15:12.049260 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2956/5809] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:11 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:12.839807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:12.842057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:12.851245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:12.851951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:12.852819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:12.853335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:13.006574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:13.015432 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-acf21497-3b99-461f-96d6-7cee7e8093d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1391 microversion: 2.1 time: 0.180231 Jun 16 19:15:13.016518 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2854/5810] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:12 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:13.067408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:13.068049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:13.075597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:13.076492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:13.077359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:13.077887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:13.241867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:13.252320 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c08e592-a8c5-4081-9774-58c4ecfd7414 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1277 microversion: 2.1 time: 0.189840 Jun 16 19:15:13.254009 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2957/5811] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:13 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:13.561191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-64dd2a85-7238-4303-ab9f-682bff5455d7 req-2f5cb45d-e08c-4c4c-95ea-570629307095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a816db3b-f90d-445f-b0e6-9b0d73981b39", "tag": "9919dfea-599f-4003-8a0d-82315ef74246"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:13.600502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-64dd2a85-7238-4303-ab9f-682bff5455d7 req-2f5cb45d-e08c-4c4c-95ea-570629307095 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:13.600967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-64dd2a85-7238-4303-ab9f-682bff5455d7 req-2f5cb45d-e08c-4c4c-95ea-570629307095 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:13.621964 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-64dd2a85-7238-4303-ab9f-682bff5455d7 req-2f5cb45d-e08c-4c4c-95ea-570629307095 service nova] Creating event network-changed:9919dfea-599f-4003-8a0d-82315ef74246 for instance a816db3b-f90d-445f-b0e6-9b0d73981b39 on n-h2-846209-2 Jun 16 19:15:13.631187 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-64dd2a85-7238-4303-ab9f-682bff5455d7 req-2f5cb45d-e08c-4c4c-95ea-570629307095 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073478 Jun 16 19:15:13.642965 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2855/5812] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:15:13.844584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-67ef2db7-cbc1-4b64-a9df-341be1242555 req-dde0aec1-fc75-4fea-b633-62987a890761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "name": "network-vif-plugged", "status": "completed", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:13.859165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67ef2db7-cbc1-4b64-a9df-341be1242555 req-dde0aec1-fc75-4fea-b633-62987a890761 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:13.860609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67ef2db7-cbc1-4b64-a9df-341be1242555 req-dde0aec1-fc75-4fea-b633-62987a890761 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:13.876770 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-67ef2db7-cbc1-4b64-a9df-341be1242555 req-dde0aec1-fc75-4fea-b633-62987a890761 service nova] Creating event network-vif-plugged:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h1-846209-2 Jun 16 19:15:13.882894 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-67ef2db7-cbc1-4b64-a9df-341be1242555 req-dde0aec1-fc75-4fea-b633-62987a890761 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043522 Jun 16 19:15:13.884078 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2958/5813] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:15:14.034494 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:14.036043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:14.044732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:14.045546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:14.046644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:14.047086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:14.202011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:14.211873 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bb13c034-6138-4abf-9463-66ab7859420d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1391 microversion: 2.1 time: 0.182860 Jun 16 19:15:14.212459 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2856/5814] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:14 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:14.271724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:14.273382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:14.283344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:14.283921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:14.284791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:14.285309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:14.443171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:14.452364 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4540881-214c-4cf0-bd61-6d022c028c4f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1277 microversion: 2.1 time: 0.187369 Jun 16 19:15:14.453029 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2959/5815] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:14 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:15.232549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:15.233510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:15.241791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:15.243185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:15.244008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:15.244664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:15.412167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:15.420241 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bdf09f03-3325-4825-9d99-c52b184ba307 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1391 microversion: 2.1 time: 0.193332 Jun 16 19:15:15.420928 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2857/5816] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:15 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:15.472656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:15.473360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:15.480117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:15.480590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:15.481384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:15.481843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:15.620389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:15.628456 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d07a0d19-ddc5-4bb8-b0d6-906b561f4a39 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1277 microversion: 2.1 time: 0.161910 Jun 16 19:15:15.629032 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2960/5817] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:15 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:16.438412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:16.439518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:16.446600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:16.447064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:16.447849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:16.448301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:16.587508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:16.595967 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5823b143-bd38-48a8-84a7-c2f33d97f270 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1563 microversion: 2.1 time: 0.161768 Jun 16 19:15:16.596558 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2858/5818] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:16 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:16.612897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:16.613582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:16.620989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:16.621454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:16.622496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:16.622709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:16.646196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:16.647001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:16.653269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:16.654063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:16.655158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:16.655768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:16.839413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:16.848132 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e24be003-ed25-4efe-a3d7-b1cd601a620f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1563 microversion: 2.1 time: 0.239553 Jun 16 19:15:16.848299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:16.848913 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2961/5819] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:16 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:16.855949 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4abef0ad-156e-41e6-89eb-822a4d4e2dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1277 microversion: 2.1 time: 0.214712 Jun 16 19:15:16.856501 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2859/5820] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:16 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:17.879564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:17.880411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:17.888492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:17.889280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:17.890250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:17.890708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:18.035441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:18.043328 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4c7ca7c1-7b6d-4422-8aa7-abcd52c5e3c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.170263 Jun 16 19:15:18.044112 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2962/5821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:17 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:18.464683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:18.465339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:18.474134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-81061fd9-70d9-48e0-8df6-a7a8f97e83ba req-a8fbb2fd-53dc-42c9-9777-a3fd455bfb2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:18.476473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:18.477046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:18.477962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:18.478724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:18.482993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-81061fd9-70d9-48e0-8df6-a7a8f97e83ba req-a8fbb2fd-53dc-42c9-9777-a3fd455bfb2c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:18.483826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-81061fd9-70d9-48e0-8df6-a7a8f97e83ba req-a8fbb2fd-53dc-42c9-9777-a3fd455bfb2c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:18.495622 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-81061fd9-70d9-48e0-8df6-a7a8f97e83ba req-a8fbb2fd-53dc-42c9-9777-a3fd455bfb2c service nova] Creating event network-changed:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h1-846209-2 Jun 16 19:15:18.501489 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-81061fd9-70d9-48e0-8df6-a7a8f97e83ba req-a8fbb2fd-53dc-42c9-9777-a3fd455bfb2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030558 Jun 16 19:15:18.502778 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2963/5822] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:15:18.664110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:18.673849 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3feca5fb-2996-44bc-ab55-2215222d91ab tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1563 microversion: 2.1 time: 0.212392 Jun 16 19:15:18.674244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2860/5823] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:18 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1563 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:19.061198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:19.061943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:19.069398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:19.069873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:19.070695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:19.071345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:19.296416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:19.305468 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-195806ac-dc73-47a7-99fb-afe5995ff843 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.249286 Jun 16 19:15:19.306289 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2964/5824] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:19 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:20.322123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:20.322739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:20.330079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:20.330562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:20.331336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:20.331773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:20.467909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:20.475543 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e02fb7f0-cddf-4071-bfd4-d9add45a8c25 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.157436 Jun 16 19:15:20.476120 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2861/5825] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:20 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:21.491738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:21.492362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:21.495214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:21.501518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:21.502098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:21.502883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:21.503333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:21.634578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:21.643018 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dd527dac-28e9-4914-9174-58730488dddf tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.155156 Jun 16 19:15:21.643622 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2965/5826] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:21 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:22.659937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:22.660488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:22.662440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:22.663188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:22.670797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:22.671257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:22.672047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:22.672848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:22.806207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:22.814783 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0824fac0-232e-451d-913d-938a2274a8c6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.159187 Jun 16 19:15:22.815373 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2862/5827] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:22 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:23.832846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:23.833489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:23.840669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:23.841135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:23.841952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:23.842408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:23.980758 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:23.988641 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-955656a9-6ec9-4196-990a-0cb4224e9bd0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.160813 Jun 16 19:15:23.989227 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2966/5828] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:23 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:25.006030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:25.006660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:25.013665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:25.014166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:25.014945 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:25.015390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:25.146522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:25.154109 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-103860f1-03d1-4315-bcd9-529c89d1e71f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.152122 Jun 16 19:15:25.154679 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2863/5829] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:25 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:26.173435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:26.174140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:26.181516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:26.182289 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:26.182938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:26.183464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:26.342144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-13ec8fda-f8a3-42c4-b7cf-d21d77208452 req-b9cbaa80-da8b-4aee-8570-15ab0edb09dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a816db3b-f90d-445f-b0e6-9b0d73981b39", "name": "network-vif-plugged", "status": "completed", "tag": "9919dfea-599f-4003-8a0d-82315ef74246"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:26.360487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-13ec8fda-f8a3-42c4-b7cf-d21d77208452 req-b9cbaa80-da8b-4aee-8570-15ab0edb09dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:26.361171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-13ec8fda-f8a3-42c4-b7cf-d21d77208452 req-b9cbaa80-da8b-4aee-8570-15ab0edb09dc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:26.379953 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-13ec8fda-f8a3-42c4-b7cf-d21d77208452 req-b9cbaa80-da8b-4aee-8570-15ab0edb09dc service nova] Creating event network-vif-plugged:9919dfea-599f-4003-8a0d-82315ef74246 for instance a816db3b-f90d-445f-b0e6-9b0d73981b39 on n-h2-846209-2 Jun 16 19:15:26.386028 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-13ec8fda-f8a3-42c4-b7cf-d21d77208452 req-b9cbaa80-da8b-4aee-8570-15ab0edb09dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047319 Jun 16 19:15:26.386645 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2864/5830] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:15:26.673419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:26.681020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2931d0f-951c-4463-b405-5ac15bf948c7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1265 microversion: 2.1 time: 0.512409 Jun 16 19:15:26.681622 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2967/5831] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:26 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:27.700017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:27.700631 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:27.707595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:27.708057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:27.708979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:27.709434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:27.842642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:27.851133 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eae349d5-5936-4ec9-9d15-42f8df32118b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1453 microversion: 2.1 time: 0.156266 Jun 16 19:15:27.851957 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2865/5832] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:27 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:27.868315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:27.868946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:27.876161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:27.876630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:27.877419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:27.877874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:28.015540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:28.023634 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3255a990-7783-445f-a257-5bf5507d0695 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1453 microversion: 2.1 time: 0.159268 Jun 16 19:15:28.024200 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2968/5833] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:27 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:29.909441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e750206c-b20b-4840-a576-3d179ae61565 req-d88d4f30-3d59-4828-b281-4f664abc4006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a816db3b-f90d-445f-b0e6-9b0d73981b39", "tag": "9919dfea-599f-4003-8a0d-82315ef74246"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:29.919347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e750206c-b20b-4840-a576-3d179ae61565 req-d88d4f30-3d59-4828-b281-4f664abc4006 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:29.919801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e750206c-b20b-4840-a576-3d179ae61565 req-d88d4f30-3d59-4828-b281-4f664abc4006 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:29.934892 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e750206c-b20b-4840-a576-3d179ae61565 req-d88d4f30-3d59-4828-b281-4f664abc4006 service nova] Creating event network-changed:9919dfea-599f-4003-8a0d-82315ef74246 for instance a816db3b-f90d-445f-b0e6-9b0d73981b39 on n-h2-846209-2 Jun 16 19:15:29.941080 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e750206c-b20b-4840-a576-3d179ae61565 req-d88d4f30-3d59-4828-b281-4f664abc4006 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035600 Jun 16 19:15:29.941698 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2866/5834] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:15:41.927217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-06eedb0b-afb2-45ee-bb9b-935f2ba4cdd2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:41.928160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-06eedb0b-afb2-45ee-bb9b-935f2ba4cdd2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:41.931016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=33 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:41.931682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=88 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:41.939150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06eedb0b-afb2-45ee-bb9b-935f2ba4cdd2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:41.939618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06eedb0b-afb2-45ee-bb9b-935f2ba4cdd2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:41.940411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06eedb0b-afb2-45ee-bb9b-935f2ba4cdd2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:41.940864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06eedb0b-afb2-45ee-bb9b-935f2ba4cdd2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:42.002748 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-06eedb0b-afb2-45ee-bb9b-935f2ba4cdd2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action" status: 200 len: 24525 microversion: 2.1 time: 0.079406 Jun 16 19:15:42.003462 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2969/5835] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:15:41 2022] POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action => generated 24525 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:15:52.973096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:52.974204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=84 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:53.054207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:53.054925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:53.061638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.062129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.064108 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.064558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.222354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:53.230986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9aea34ff-bb32-47f2-b8d3-effc8474c458 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1682 microversion: 2.1 time: 0.260562 Jun 16 19:15:53.231507 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2867/5836] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:52 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:53.339764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51d2ffc5-2f3f-425f-b938-f7ef242749ea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:53.340853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51d2ffc5-2f3f-425f-b938-f7ef242749ea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:53.343484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:53.344705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:15:53.351191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51d2ffc5-2f3f-425f-b938-f7ef242749ea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.351670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51d2ffc5-2f3f-425f-b938-f7ef242749ea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.352492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51d2ffc5-2f3f-425f-b938-f7ef242749ea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.352944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51d2ffc5-2f3f-425f-b938-f7ef242749ea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.411995 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51d2ffc5-2f3f-425f-b938-f7ef242749ea tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action" status: 200 len: 32594 microversion: 2.1 time: 0.076710 Jun 16 19:15:53.413021 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2970/5837] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:15:53 2022] POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action => generated 32594 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 19:15:53.729539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-02888484-f05f-4e38-a100-0c36a5b33944 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:53.730192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-02888484-f05f-4e38-a100-0c36a5b33944 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:53.736636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02888484-f05f-4e38-a100-0c36a5b33944 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.737081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02888484-f05f-4e38-a100-0c36a5b33944 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.737848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02888484-f05f-4e38-a100-0c36a5b33944 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.738318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02888484-f05f-4e38-a100-0c36a5b33944 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.874017 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-02888484-f05f-4e38-a100-0c36a5b33944 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1833 microversion: 2.1 time: 0.267823 Jun 16 19:15:53.875085 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2868/5838] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:53 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1833 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:53.899472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:53.900775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:53.908859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.909329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.910176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:53.910608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:53.957012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lazy-loading 'flavor' on Instance uuid 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:15:53.970486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Going to try to live migrate instance to another host {{(pid=119206) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 19:15:55.408055 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f41a6b6b-b2c1-469e-ac25-624977290630 tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action" status: 202 len: 0 microversion: 2.1 time: 1.512627 Jun 16 19:15:55.409205 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2971/5839] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:15:53 2022] POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:15:55.421522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:55.422639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:55.431827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:55.432285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:55.433655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:55.434271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:55.592943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:55.605865 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bf0312fc-de55-4138-b3b2-e757fcf7d535 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1692 microversion: 2.1 time: 0.191452 Jun 16 19:15:55.606674 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2869/5840] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:55 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1692 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:56.505820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-87d9025b-6aa2-41b6-9d11-fa3ee4b0d0d5 req-0716f9ac-5b1e-4efd-b4b9-594815a7b116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "name": "network-vif-unplugged", "status": "completed", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:56.518315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-87d9025b-6aa2-41b6-9d11-fa3ee4b0d0d5 req-0716f9ac-5b1e-4efd-b4b9-594815a7b116 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:56.518772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-87d9025b-6aa2-41b6-9d11-fa3ee4b0d0d5 req-0716f9ac-5b1e-4efd-b4b9-594815a7b116 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:56.530074 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-87d9025b-6aa2-41b6-9d11-fa3ee4b0d0d5 req-0716f9ac-5b1e-4efd-b4b9-594815a7b116 service nova] Creating event network-vif-unplugged:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h1-846209-2 Jun 16 19:15:56.535046 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-87d9025b-6aa2-41b6-9d11-fa3ee4b0d0d5 req-0716f9ac-5b1e-4efd-b4b9-594815a7b116 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035022 Jun 16 19:15:56.535816 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2972/5841] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:15:56.625561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:56.626158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:56.633181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:56.633522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:56.634576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:56.635028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:56.789370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:56.804804 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-09974e81-61a5-4d01-80ea-b3dfed6bec53 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1692 microversion: 2.1 time: 0.183900 Jun 16 19:15:56.806587 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2870/5842] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:56 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:57.830041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:57.830750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:57.836988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:57.837446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:57.838246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:57.838695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:57.976657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:57.985093 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3da42ea1-d07e-4c6c-9b4b-f36c4dcaac7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1692 microversion: 2.1 time: 0.159383 Jun 16 19:15:57.985756 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2973/5843] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:57 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:15:58.553533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ad0ed51c-eb22-47c6-b59a-e695f7d5a229 req-d9c67549-4aa2-4eab-8caa-d314cd118e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:15:58.563202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ad0ed51c-eb22-47c6-b59a-e695f7d5a229 req-d9c67549-4aa2-4eab-8caa-d314cd118e52 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:58.563854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ad0ed51c-eb22-47c6-b59a-e695f7d5a229 req-d9c67549-4aa2-4eab-8caa-d314cd118e52 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:58.574603 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ad0ed51c-eb22-47c6-b59a-e695f7d5a229 req-d9c67549-4aa2-4eab-8caa-d314cd118e52 service nova] Creating event network-changed:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h1-846209-2 Jun 16 19:15:58.580601 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ad0ed51c-eb22-47c6-b59a-e695f7d5a229 req-d9c67549-4aa2-4eab-8caa-d314cd118e52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030890 Jun 16 19:15:58.581206 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2871/5844] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:15:59.004004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:15:59.004642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:15:59.011839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:59.012334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:59.013110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:15:59.013565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:15:59.218807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:15:59.227643 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b867735a-df2b-44e7-9b43-760d389d5d72 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1692 microversion: 2.1 time: 0.228345 Jun 16 19:15:59.228228 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2974/5845] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:15:58 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:00.246139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:00.246922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:00.253860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:00.254345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:00.255128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:00.255577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:00.393280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:00.401027 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-212eefc8-87cc-40f6-8cee-b520582a98ca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1692 microversion: 2.1 time: 0.160055 Jun 16 19:16:00.401638 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2872/5846] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:00 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:01.419010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:01.419642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:01.427223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:01.427698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:01.428883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:01.428992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:01.572238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:01.581132 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ac73b3e3-8b3e-447b-a18f-eece2f92c03d tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1692 microversion: 2.1 time: 0.166890 Jun 16 19:16:01.581714 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2975/5847] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:01 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:02.519296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-84117b86-d10c-4e66-92e8-8907ead271e4 req-870fc803-4cef-43f2-9802-16400eef532e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "name": "network-vif-unplugged", "status": "completed", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:02.527789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-84117b86-d10c-4e66-92e8-8907ead271e4 req-870fc803-4cef-43f2-9802-16400eef532e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:02.528247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-84117b86-d10c-4e66-92e8-8907ead271e4 req-870fc803-4cef-43f2-9802-16400eef532e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:02.542576 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-84117b86-d10c-4e66-92e8-8907ead271e4 req-870fc803-4cef-43f2-9802-16400eef532e service nova] Creating event network-vif-unplugged:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h1-846209-2 Jun 16 19:16:02.548120 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-84117b86-d10c-4e66-92e8-8907ead271e4 req-870fc803-4cef-43f2-9802-16400eef532e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101539 Jun 16 19:16:02.548786 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2873/5848] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:16:02.599855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:02.600488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:02.615125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:02.615884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:02.616870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:02.617360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:02.872395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:02.881174 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a04dbb5-45f6-4098-b45e-f0ab6e61b7a6 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1692 microversion: 2.1 time: 0.286254 Jun 16 19:16:02.882446 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2976/5849] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:02 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1692 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:03.902330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:03.902973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:03.909332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:03.909793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:03.910602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:03.911051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:04.059869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:04.070149 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-840fda8f-88e2-45db-9beb-feed95350653 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1682 microversion: 2.1 time: 0.173095 Jun 16 19:16:04.070728 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2874/5850] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:03 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:04.089240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-db27a536-a29c-4968-96e9-f4fc1aa7e36d tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:04.089969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-db27a536-a29c-4968-96e9-f4fc1aa7e36d tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:04.098041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db27a536-a29c-4968-96e9-f4fc1aa7e36d tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:04.098748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db27a536-a29c-4968-96e9-f4fc1aa7e36d tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:04.099820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db27a536-a29c-4968-96e9-f4fc1aa7e36d tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:04.100283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-db27a536-a29c-4968-96e9-f4fc1aa7e36d tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:04.231037 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-db27a536-a29c-4968-96e9-f4fc1aa7e36d tempest-TestNetworkAdvancedServerOps-245811080 tempest-TestNetworkAdvancedServerOps-245811080-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1833 microversion: 2.1 time: 0.146212 Jun 16 19:16:04.231642 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2977/5851] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:04 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1833 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:04.249614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:04.250931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:04.257389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:04.257823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:04.258644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:04.259147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:04.411675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:04.420723 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-98f57d6b-8c63-484a-853e-db7d671dd236 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1682 microversion: 2.1 time: 0.175081 Jun 16 19:16:04.421414 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2875/5852] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:04 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:04.521117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df91ed72-190d-4b08-9b1b-db3022faca99 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:04.522352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-df91ed72-190d-4b08-9b1b-db3022faca99 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:04.530097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df91ed72-190d-4b08-9b1b-db3022faca99 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:04.530714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df91ed72-190d-4b08-9b1b-db3022faca99 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:04.532110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df91ed72-190d-4b08-9b1b-db3022faca99 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:04.532690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df91ed72-190d-4b08-9b1b-db3022faca99 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:04.590152 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-df91ed72-190d-4b08-9b1b-db3022faca99 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action" status: 200 len: 38523 microversion: 2.1 time: 0.073615 Jun 16 19:16:04.591100 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2978/5853] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:16:04 2022] POST /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a/action => generated 38523 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:16:05.620419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:05.620934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:05.623680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0e11be83-2488-4e05-9f60-e5b1757db186 req-76193053-09df-472b-84b9-08893cbcbd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:05.628865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:05.629341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:05.630176 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:05.630624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:05.635276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0e11be83-2488-4e05-9f60-e5b1757db186 req-76193053-09df-472b-84b9-08893cbcbd81 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:05.636000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0e11be83-2488-4e05-9f60-e5b1757db186 req-76193053-09df-472b-84b9-08893cbcbd81 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:05.648572 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0e11be83-2488-4e05-9f60-e5b1757db186 req-76193053-09df-472b-84b9-08893cbcbd81 service nova] Creating event network-changed:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h2-846209-2 Jun 16 19:16:05.653979 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0e11be83-2488-4e05-9f60-e5b1757db186 req-76193053-09df-472b-84b9-08893cbcbd81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035141 Jun 16 19:16:05.654603 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2979/5854] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:16:05.660054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:16:05.750809 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0aa8cfcf-88ab-43a9-bfc6-58575862a3f8 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 204 len: 0 microversion: 2.1 time: 0.133857 Jun 16 19:16:05.754466 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2876/5855] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:16:05 2022] DELETE /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:16:05.760825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:05.761720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:05.770616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:05.771481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:05.773136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:05.773811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:05.922460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:05.930883 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-442dbf44-e052-4743-a6e0-c8ae2a580042 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1688 microversion: 2.1 time: 0.174856 Jun 16 19:16:05.931666 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2980/5856] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:05 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:06.805020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-766ee80f-377a-4d0c-99c4-44849927569b req-403126ba-73f1-40e9-81af-bf46160c909c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5521cbe8-544a-4ac9-a8d6-ece6bdf6165a", "name": "network-vif-deleted", "tag": "817496c7-6509-4b2e-ad32-f978ae01ac79"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:06.815985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-766ee80f-377a-4d0c-99c4-44849927569b req-403126ba-73f1-40e9-81af-bf46160c909c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:06.816757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-766ee80f-377a-4d0c-99c4-44849927569b req-403126ba-73f1-40e9-81af-bf46160c909c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:06.828177 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-766ee80f-377a-4d0c-99c4-44849927569b req-403126ba-73f1-40e9-81af-bf46160c909c service nova] Creating event network-vif-deleted:817496c7-6509-4b2e-ad32-f978ae01ac79 for instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a on n-h2-846209-2 Jun 16 19:16:06.833413 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-766ee80f-377a-4d0c-99c4-44849927569b req-403126ba-73f1-40e9-81af-bf46160c909c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Jun 16 19:16:06.834073 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2877/5857] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:16:06.949705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:06.950373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:06.959233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:06.959874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:06.960789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:06.961246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:06.998546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:06.999216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:06.999447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lazy-loading 'fault' on Instance uuid 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:16:07.049310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:07.056889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e36a374d-faa2-411f-9122-c2dbbce9324e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 200 len: 1356 microversion: 2.1 time: 0.111751 Jun 16 19:16:07.057502 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2981/5858] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:06 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:08.076322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:08.077033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:08.083894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:08.084355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:08.085123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:08.085564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:08.099876 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] HTTP exception thrown: Instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a could not be found. Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Request method failure captured: Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a HTTP/1.1 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4A05u_-9AikOlX9ntKqQm7qzINM9v1WDOsB1gjwlQGL-f-UN3zhF3YTfYTacmIjY28BFrjHK7FTwa-n6EeUpZ8ZhKYC6v8hCA-h8AjiPNCdZeYVCohxsIvpEYwpRw-bBzpDlTd5KgMhh4AlAmmhCJtWd-8sTyC-ypUrYpg619ZDDRU Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba85d86fb7e44a10b9542fc1c0538a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 42fd96b15988445484a9fbb22fd7a6a7 Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a could not be found. Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5521cbe8-544a-4ac9-a8d6-ece6bdf6165a'} Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a could not be found. Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a could not be found. Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:16:08.101509 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a could not be found. Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Returning 404 to user: Instance 5521cbe8-544a-4ac9-a8d6-ece6bdf6165a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a15a50a2-4f49-4a84-9bc4-b81e0c727cca tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a" status: 404 len: 111 microversion: 2.1 time: 0.031853 Jun 16 19:16:08.106782 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2878/5859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:08 2022] GET /compute/v2.1/servers/5521cbe8-544a-4ac9-a8d6-ece6bdf6165a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:16:11.792030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8153d2a3-3770-40bd-a9e6-d5c681d17b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '.version_select at 0x7f866c463160>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:11.814569 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8153d2a3-3770-40bd-a9e6-d5c681d17b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1745527837" status: 202 len: 0 microversion: 2.1 time: 0.025879 Jun 16 19:16:11.815945 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2982/5860] 10.222.0.27 () {58 vars in 1283 bytes} [Thu Jun 16 19:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1745527837 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:16:11.841185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8860431-716c-41cc-8876-5200408ce942 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: .version_select at 0x7f866dc8d8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-64510324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDys7tLMhTAc5t9YYLdPnP4j/Y8wthObHnyQOGVIPPzRpRDkUhD++CV+/ogu8YiIWbu9reV3DEiysNGaVfle/2BWrZz03rIN8Uuucn8JjZ/PXwNHi1sHhR5MfGW0EyFvFg=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:11.857884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d8860431-716c-41cc-8876-5200408ce942 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:16:11.863523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-d8860431-716c-41cc-8876-5200408ce942 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:16:11.889188 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8860431-716c-41cc-8876-5200408ce942 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051929 Jun 16 19:16:11.889817 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2879/5861] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:16:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:16:17.408763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:17.413060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1301881802", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "b7e940cb-9bd2-487b-8300-86d01fb503df"}], "key_name": "tempest-TestNetworkAdvancedServerOps-64510324", "security_groups": [{"name": "tempest-secgroup-smoke-677087510"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:17.559484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] validate_networks() for [('b7e940cb-9bd2-487b-8300-86d01fb503df', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:16:17.979397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:16:17.979840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:16:17.980354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:16:17.980787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:16:17.981272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:16:17.990995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:17.991478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:17.992299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:17.992754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:18.011594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:16:18.017415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Getting quotas for user 42fd96b15988445484a9fbb22fd7a6a7 and project ba85d86fb7e44a10b9542fc1c0538a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:16:18.032201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:16:18.034740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:16:18.083190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-751987c4-6e46-46d8-a919-f6fe4e3cb09e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.676183 Jun 16 19:16:18.084115 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2983/5862] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:16:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:16:18.095671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0db5196b-4235-4eae-9429-c01e76464f48 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:18.096960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0db5196b-4235-4eae-9429-c01e76464f48 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:18.100590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:18.176765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0db5196b-4235-4eae-9429-c01e76464f48 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:18.184107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0db5196b-4235-4eae-9429-c01e76464f48 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1265 microversion: 2.1 time: 0.093397 Jun 16 19:16:18.184687 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2880/5863] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:18 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:19.204015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:19.205341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:19.212142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:19.212702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:19.213700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:19.214322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:19.330425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:19.339752 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b0c8faf-6600-43f9-a04e-ce9dbb7c2d86 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1325 microversion: 2.1 time: 0.141611 Jun 16 19:16:19.351231 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2984/5864] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:19 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:20.357820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:20.358950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:20.367448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:20.367992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:20.368838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:20.369536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:20.584277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:20.592422 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9724b455-d441-4d85-a3db-b03bc6c52b2e tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1390 microversion: 2.1 time: 0.239263 Jun 16 19:16:20.593011 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2881/5865] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:20 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:20.910546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-dfa23e8c-67e3-4a6d-a9e9-2a9058294ceb req-d5a6aa91-e828-4ae8-a340-84ea8c53b61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8af121-0d25-48ed-a47e-58a09e402dce", "tag": "dab69ff0-97b3-44f7-8ce6-10f364225d10"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:20.922607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dfa23e8c-67e3-4a6d-a9e9-2a9058294ceb req-d5a6aa91-e828-4ae8-a340-84ea8c53b61c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:20.923337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dfa23e8c-67e3-4a6d-a9e9-2a9058294ceb req-d5a6aa91-e828-4ae8-a340-84ea8c53b61c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:20.943166 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-dfa23e8c-67e3-4a6d-a9e9-2a9058294ceb req-d5a6aa91-e828-4ae8-a340-84ea8c53b61c service nova] Creating event network-changed:dab69ff0-97b3-44f7-8ce6-10f364225d10 for instance 3d8af121-0d25-48ed-a47e-58a09e402dce on n-h1-846209-2 Jun 16 19:16:20.951482 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-dfa23e8c-67e3-4a6d-a9e9-2a9058294ceb req-d5a6aa91-e828-4ae8-a340-84ea8c53b61c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045246 Jun 16 19:16:20.952673 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2985/5866] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:16:21.611165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:21.611790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:21.618815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:21.619277 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:21.620095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:21.620542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:21.761351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:21.769010 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7fe1e37d-5531-45c5-80c3-3094395a40f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1390 microversion: 2.1 time: 0.162420 Jun 16 19:16:21.769603 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2882/5867] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:21 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:22.787871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:22.788507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:22.795080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:22.795550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:22.796364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:22.796885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:22.954199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:22.961763 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3ba24d6f-c805-4635-8367-3ea84988d940 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1390 microversion: 2.1 time: 0.179170 Jun 16 19:16:22.962363 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2986/5868] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:22 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:23.978962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:23.979603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:23.982357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:23.988054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:23.988516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:23.989302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:23.989744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:24.134505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:24.143556 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2f212405-a9b0-4d60-8e14-1e04bc01fe32 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1390 microversion: 2.1 time: 0.168507 Jun 16 19:16:24.144176 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2883/5869] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:23 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:25.161661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:25.162326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:25.165129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:25.172695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:25.173171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:25.173990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:25.174448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:25.312364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:25.320122 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85923c9c-5895-4cba-9455-1273583dc2b4 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1390 microversion: 2.1 time: 0.163513 Jun 16 19:16:25.320694 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2987/5870] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:25 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:26.079581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-49d512a6-cd64-400e-bc82-08841d3c04ee req-aa24f212-11dd-40d7-ab1e-3190e8444741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8af121-0d25-48ed-a47e-58a09e402dce", "name": "network-vif-plugged", "status": "completed", "tag": "dab69ff0-97b3-44f7-8ce6-10f364225d10"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:26.089214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-49d512a6-cd64-400e-bc82-08841d3c04ee req-aa24f212-11dd-40d7-ab1e-3190e8444741 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:26.089683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-49d512a6-cd64-400e-bc82-08841d3c04ee req-aa24f212-11dd-40d7-ab1e-3190e8444741 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:26.101352 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-49d512a6-cd64-400e-bc82-08841d3c04ee req-aa24f212-11dd-40d7-ab1e-3190e8444741 service nova] Creating event network-vif-plugged:dab69ff0-97b3-44f7-8ce6-10f364225d10 for instance 3d8af121-0d25-48ed-a47e-58a09e402dce on n-h1-846209-2 Jun 16 19:16:26.106510 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-49d512a6-cd64-400e-bc82-08841d3c04ee req-aa24f212-11dd-40d7-ab1e-3190e8444741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030929 Jun 16 19:16:26.107287 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2884/5871] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:16:26.336727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:26.337282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:26.344868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:26.345336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:26.346256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:26.346711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:26.489463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:26.496965 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c58ed2ef-2a7f-42d9-89c1-aa3036f7452b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1390 microversion: 2.1 time: 0.164241 Jun 16 19:16:26.497532 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2988/5872] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:26 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:27.514671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:27.515398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:27.523566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:27.524024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:27.524798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:27.525236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:27.665461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:27.673923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7711f15-3049-4aa6-833d-712cc73a90fd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1562 microversion: 2.1 time: 0.163473 Jun 16 19:16:27.674520 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2885/5873] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:27 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:27.690378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:27.691012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:27.698091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:27.698561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:27.699349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:27.699803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:27.833237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:27.840816 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0366521c-6a8a-4147-82d5-2f1d482caed1 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1562 microversion: 2.1 time: 0.154780 Jun 16 19:16:27.841402 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2989/5874] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:27 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:29.432332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:16:29.432966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:29.435993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:29.437038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:29.438788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:29.457328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:29.458021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:29.458880 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:29.459328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:29.505514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-37df695f-b924-43a5-8ec4-4ebc8d3243b4 req-d0172c42-3cb1-40d3-862d-46af1639f36d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8af121-0d25-48ed-a47e-58a09e402dce", "tag": "dab69ff0-97b3-44f7-8ce6-10f364225d10"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:29.514630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-37df695f-b924-43a5-8ec4-4ebc8d3243b4 req-d0172c42-3cb1-40d3-862d-46af1639f36d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:29.515387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-37df695f-b924-43a5-8ec4-4ebc8d3243b4 req-d0172c42-3cb1-40d3-862d-46af1639f36d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:29.528191 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-37df695f-b924-43a5-8ec4-4ebc8d3243b4 req-d0172c42-3cb1-40d3-862d-46af1639f36d service nova] Creating event network-changed:dab69ff0-97b3-44f7-8ce6-10f364225d10 for instance 3d8af121-0d25-48ed-a47e-58a09e402dce on n-h1-846209-2 Jun 16 19:16:29.533883 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-37df695f-b924-43a5-8ec4-4ebc8d3243b4 req-d0172c42-3cb1-40d3-862d-46af1639f36d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103112 Jun 16 19:16:29.535547 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2990/5875] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:16:29.661198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:16:29.669442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e667ab8-8058-4a8c-83cd-83ba87d071ed tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1562 microversion: 2.1 time: 0.240667 Jun 16 19:16:29.670329 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2886/5876] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:16:29 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:16:54.933206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:54.933986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=36 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:16:54.939393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3dfe20a2-4139-49c0-90d5-eb778472fc17 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:16:54.940449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3dfe20a2-4139-49c0-90d5-eb778472fc17 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:16:54.947452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3dfe20a2-4139-49c0-90d5-eb778472fc17 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:54.947921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3dfe20a2-4139-49c0-90d5-eb778472fc17 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:54.948699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3dfe20a2-4139-49c0-90d5-eb778472fc17 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:16:54.949152 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3dfe20a2-4139-49c0-90d5-eb778472fc17 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:16:55.006734 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3dfe20a2-4139-49c0-90d5-eb778472fc17 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce/action" status: 200 len: 24573 microversion: 2.1 time: 0.075266 Jun 16 19:16:55.007395 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2991/5877] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:16:54 2022] POST /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:17:06.056054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:06.057533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:06.059883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=7 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:06.060591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=32 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:06.067703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:06.068161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:06.068933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:06.069376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:06.146601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:17:06.147038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:17:06.147529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:17:06.147949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:17:06.148372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:17:06.207342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:06.213308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:06.213772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:06.214593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:06.215043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:06.244912 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-45dacc2e-25f4-4177-92a8-f9724a8aac4c tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce/action" status: 202 len: 1137 microversion: 2.1 time: 0.192815 Jun 16 19:17:06.255134 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2887/5878] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:17:06 2022] POST /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce/action => generated 1137 bytes in 194 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 16 19:17:06.261138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:06.262208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:06.265740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:06.266889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:06.274547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:06.275028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:06.275917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:06.276757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:06.700226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:06.708732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb93e377-c867-49e7-a42c-3b007ebb6f7b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.451945 Jun 16 19:17:06.709329 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2992/5879] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:06 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:07.725876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:07.726521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:07.733578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:07.734074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:07.734849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:07.736322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:07.874241 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:07.883337 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ab02494-8b77-4e00-8532-d7909bad809a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.161394 Jun 16 19:17:07.883920 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2888/5880] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:07 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:08.901386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:08.904124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:08.910950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:08.911423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:08.912203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:08.912654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:09.057180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:09.065991 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4cfb7d4f-8d63-4404-8853-f0857e716549 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.168287 Jun 16 19:17:09.066577 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2993/5881] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:08 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:10.082821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:10.083448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:10.090141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:10.090593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:10.091354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:10.091801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:10.224532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:10.232164 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d3c75e40-a633-4f39-afa8-9768dff7ffb2 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.153438 Jun 16 19:17:10.232736 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2889/5882] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:10 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:11.249605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:11.250265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:11.258686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:11.259158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:11.259942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:11.260403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:11.397336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:11.404920 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be9cb448-6ce8-4f6f-8479-61bb910b7a59 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.159259 Jun 16 19:17:11.405487 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2994/5883] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:11 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:12.423028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:12.423661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:12.430624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:12.431087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:12.431863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:12.432312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:12.892007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:12.899674 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f7e724b9-0f66-4a71-b7a6-17afe7e0001a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.480931 Jun 16 19:17:12.900254 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2890/5884] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:12 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:13.916786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:13.917610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:13.926257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:13.926727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:13.927511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:13.927969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:14.060858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:14.068672 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0daa639a-1c9e-4b7b-b5a2-117c6265acbd tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.155857 Jun 16 19:17:14.069170 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2995/5885] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:13 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:15.085799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:15.086476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:15.093422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:15.093959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:15.095300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:15.095744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:15.239375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:15.247474 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f5c3a066-67bf-4001-8749-3bed88192415 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.165598 Jun 16 19:17:15.248288 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2891/5886] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:15 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:16.265785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:16.266863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:16.274011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:16.274595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:16.275390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:16.275955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:16.410651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:16.418376 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04cfeb47-cca2-45eb-8dfc-081c5f6e0b60 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.156656 Jun 16 19:17:16.418955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2996/5887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:16 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:17.436222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:17.436849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:17.444081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:17.444543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:17.445326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:17.445779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:17.581298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:17.588979 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-586b1093-e190-4e83-94d4-7252080ab6d7 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1689 microversion: 2.1 time: 0.156721 Jun 16 19:17:17.589558 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2892/5888] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:17 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:18.607011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:18.607647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:18.615410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:18.615890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:18.616683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:18.617144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:18.750913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:18.758612 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31094a72-1533-429f-8403-e2692eeaa23a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1695 microversion: 2.1 time: 0.155573 Jun 16 19:17:18.759194 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2997/5889] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:18 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:19.776756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:19.777453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:19.784759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:19.785226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:19.786058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:19.786508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:19.921495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:19.929767 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c5a73f08-8e43-4121-ba55-abf2f27c8c6b tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1695 microversion: 2.1 time: 0.157035 Jun 16 19:17:19.930385 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2893/5890] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:19 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:20.948225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:20.948833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:20.956615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:20.957087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:20.957887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:20.958365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:21.092393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:21.100021 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e3058dbd-dc76-4a63-a040-044c087375f0 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1680 microversion: 2.1 time: 0.155812 Jun 16 19:17:21.100603 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2998/5891] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:20 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:22.429442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a99be0b1-5100-41b5-bdcb-6e8f82cc966a req-b805c293-1885-41af-970f-2405089e5ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8af121-0d25-48ed-a47e-58a09e402dce", "name": "network-vif-plugged", "status": "completed", "tag": "dab69ff0-97b3-44f7-8ce6-10f364225d10"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:22.439396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a99be0b1-5100-41b5-bdcb-6e8f82cc966a req-b805c293-1885-41af-970f-2405089e5ebe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:22.439819 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a99be0b1-5100-41b5-bdcb-6e8f82cc966a req-b805c293-1885-41af-970f-2405089e5ebe service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:22.452938 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a99be0b1-5100-41b5-bdcb-6e8f82cc966a req-b805c293-1885-41af-970f-2405089e5ebe service nova] Creating event network-vif-plugged:dab69ff0-97b3-44f7-8ce6-10f364225d10 for instance 3d8af121-0d25-48ed-a47e-58a09e402dce on n-h1-846209-2 Jun 16 19:17:22.459444 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a99be0b1-5100-41b5-bdcb-6e8f82cc966a req-b805c293-1885-41af-970f-2405089e5ebe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033680 Jun 16 19:17:22.460393 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2894/5892] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:17:27.577480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:27.578052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:27.585052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:27.585529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:27.586366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:27.586882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:27.613863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:17:27.691147 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7d410659-6c8b-479b-9252-03b232dd16bd tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 204 len: 0 microversion: 2.1 time: 0.172548 Jun 16 19:17:27.691722 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 2999/5893] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:17:27 2022] DELETE /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:17:27.702584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:27.703393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:27.709785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:27.710284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:27.711062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:27.711511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:27.847488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:27.855101 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ad5f736-5d6f-4ff1-a9e4-21e86ac43b67 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1577 microversion: 2.1 time: 0.158323 Jun 16 19:17:27.855662 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2895/5894] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:27 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:28.873259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:28.874009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:28.881546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:28.882047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:28.882843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:28.883295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:29.029532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:29.037981 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cfbc688f-b0c0-488d-b1ce-aae84a155e7a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1577 microversion: 2.1 time: 0.168977 Jun 16 19:17:29.038561 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3000/5895] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:28 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:30.055488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:30.056113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:30.063781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:30.066527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:30.066527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:30.066527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:30.122616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-93176b38-efa1-4db0-84ae-870cc8d485a0 req-4627de1b-864f-4414-9729-f556a2b421ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a816db3b-f90d-445f-b0e6-9b0d73981b39", "name": "network-vif-deleted", "tag": "9919dfea-599f-4003-8a0d-82315ef74246"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:30.137585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-93176b38-efa1-4db0-84ae-870cc8d485a0 req-4627de1b-864f-4414-9729-f556a2b421ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:30.138371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-93176b38-efa1-4db0-84ae-870cc8d485a0 req-4627de1b-864f-4414-9729-f556a2b421ee service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:30.152620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:30.153735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-93176b38-efa1-4db0-84ae-870cc8d485a0 req-4627de1b-864f-4414-9729-f556a2b421ee service nova] Creating event network-vif-deleted:9919dfea-599f-4003-8a0d-82315ef74246 for instance a816db3b-f90d-445f-b0e6-9b0d73981b39 on n-h2-846209-2 Jun 16 19:17:30.163341 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-93176b38-efa1-4db0-84ae-870cc8d485a0 req-4627de1b-864f-4414-9729-f556a2b421ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044073 Jun 16 19:17:30.167667 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f899bf2-2f08-4bc0-8fa4-bbdf91641ce4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1510 microversion: 2.1 time: 0.115170 Jun 16 19:17:30.167667 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2896/5896] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:30 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1510 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:30.169023 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3001/5897] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:17:31.186916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:31.187536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:31.195582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:31.196103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:31.196885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:31.197324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:31.261101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:31.270304 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-73cc9a6a-dc1f-4dc9-8764-8ff2b1e7cbb2 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1225 microversion: 2.1 time: 0.089149 Jun 16 19:17:31.270904 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2897/5898] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:31 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:32.289386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:32.290252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:32.296894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:32.297407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:32.298231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:32.298739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:32.362920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:32.371425 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-67b70578-5fa9-417a-81ec-04ce8afd26a1 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1225 microversion: 2.1 time: 0.087840 Jun 16 19:17:32.372024 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3002/5899] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:32 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:33.388735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:33.389648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:33.397467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:33.397967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:33.398753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:33.399202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:33.466879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:33.476235 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cade1dd0-40f2-4035-828f-4ef7c88745e9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1225 microversion: 2.1 time: 0.091483 Jun 16 19:17:33.477153 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2898/5900] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:33 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:34.493831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:34.494525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:34.501578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:34.503191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:34.504054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:34.504516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:34.538481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:34.538896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:34.539386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lazy-loading 'fault' on Instance uuid a816db3b-f90d-445f-b0e6-9b0d73981b39 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:17:34.581348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:34.589584 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc5f8ef0-2dea-4107-8755-483f38a4254a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 200 len: 1230 microversion: 2.1 time: 0.100113 Jun 16 19:17:34.590207 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3003/5901] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:34 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:35.606940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:35.607568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:35.615841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:35.616300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:35.617067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:35.617525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:35.631145 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 HTTP/1.1 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a816db3b-f90d-445f-b0e6-9b0d73981b39'} Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:17:35.632756 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-71ab9b4c-63be-4e20-b04d-bcfc72668c76 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 404 len: 111 microversion: 2.1 time: 0.031260 Jun 16 19:17:35.638399 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2899/5902] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:35 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:17:35.710366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2114260892", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-998173704", "security_groups": [{"name": "tempest-secgroup-smoke-209112256"}], "block_device_mapping_v2": [{"uuid": "8fa4e5c1-9d03-41d6-969d-9f3b57c27aba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b0a-381d-4be1-a4a0-bfd044486ffa"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:35.827249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] validate_networks() for [('06296b0a-381d-4be1-a4a0-bfd044486ffa', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:17:36.226081 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:17:36.226530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:17:36.227053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:17:36.227478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:17:36.227906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:17:36.237488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:36.237994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:36.238811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:36.239265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:36.256652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:17:36.261897 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:17:36.320734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:17:36.322906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fa4e5c1-9d03-41d6-969d-9f3b57c27aba',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:17:36.416937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:36.456343 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ce15045b-a030-46e3-832c-b3793cc2d3fe tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749867 Jun 16 19:17:36.457213 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3004/5903] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:17:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:17:36.467296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-df31191e-12f1-4ec4-9b1c-0e64a577d54c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:36.467918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-df31191e-12f1-4ec4-9b1c-0e64a577d54c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:36.469849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=31 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:36.525892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-df31191e-12f1-4ec4-9b1c-0e64a577d54c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:36.532743 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-df31191e-12f1-4ec4-9b1c-0e64a577d54c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1094 microversion: 2.1 time: 0.069411 Jun 16 19:17:36.533487 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2900/5904] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:36 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:37.551793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:37.552434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:37.559077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:37.559563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:37.560375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:37.560836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:37.566323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:37.642117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:37.653596 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b3faef37-e777-432b-b5b1-4080c5fe2652 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1210 microversion: 2.1 time: 0.107093 Jun 16 19:17:37.662435 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3005/5905] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:37 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:38.671254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:38.672465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:38.684304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:38.684769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:38.685787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:38.686267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:38.689063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:38.837025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:38.844886 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d54b4222-d174-4b32-913b-4de9941161e0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1277 microversion: 2.1 time: 0.177742 Jun 16 19:17:38.854901 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2901/5906] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:38 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:39.192283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bb677788-b354-4788-9104-ae541c1cbfb1 req-e85ecd30-3b37-44c1-a297-6a2d5f1e314e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b28848a-25ee-4e81-b08d-bf849255e0a5", "tag": "adb531ba-b9e1-480b-a00c-7e375e94467f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:39.217843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bb677788-b354-4788-9104-ae541c1cbfb1 req-e85ecd30-3b37-44c1-a297-6a2d5f1e314e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:39.218357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bb677788-b354-4788-9104-ae541c1cbfb1 req-e85ecd30-3b37-44c1-a297-6a2d5f1e314e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:39.235748 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bb677788-b354-4788-9104-ae541c1cbfb1 req-e85ecd30-3b37-44c1-a297-6a2d5f1e314e service nova] Creating event network-changed:adb531ba-b9e1-480b-a00c-7e375e94467f for instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 on n-h2-846209-2 Jun 16 19:17:39.246742 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bb677788-b354-4788-9104-ae541c1cbfb1 req-e85ecd30-3b37-44c1-a297-6a2d5f1e314e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058297 Jun 16 19:17:39.248172 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3006/5907] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:17:39.863487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:39.864121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:39.871674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:39.872136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:39.872933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:39.873373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:40.024825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:40.035030 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e5178e0-1a8b-40c3-b14c-6b0fd87e6b5d tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1277 microversion: 2.1 time: 0.176067 Jun 16 19:17:40.035990 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2902/5908] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:39 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:41.052603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:41.053644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:41.061371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:41.061940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:41.062812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:41.063382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:41.203793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:41.214336 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71db05d9-e71e-4f1b-9f50-97d8ad2f1271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1277 microversion: 2.1 time: 0.165900 Jun 16 19:17:41.215349 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3007/5909] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:41 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:42.232200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:42.232834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:42.240554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:42.241015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:42.241803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:42.242273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:42.389347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:42.397665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22f723af-062a-4121-ac3e-b944803c80b9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1277 microversion: 2.1 time: 0.169283 Jun 16 19:17:42.398349 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2903/5910] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:42 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:17:43.415562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:43.416231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:43.424308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:43.424788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:43.425610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:43.426106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:43.559967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:43.568082 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f92183a8-2b92-4733-b846-c48c12cc85b4 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.156481 Jun 16 19:17:43.568651 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3008/5911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:43 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:44.585891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:44.586497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:44.593485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:44.593983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:44.594772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:44.595218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:44.734157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:44.741926 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6534acab-6e21-4110-9d08-06ff647ebbb0 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.160434 Jun 16 19:17:44.742498 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2904/5912] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:44 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:45.759237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:45.759909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:45.766865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:45.767408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:45.768253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:45.768842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:45.912438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:45.920293 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-10a9af56-a389-49fb-a8fa-7e19e5ffaea9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.164826 Jun 16 19:17:45.920866 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3009/5913] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:45 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:46.936500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:46.937112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:46.939960 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:46.945544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:46.946029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:46.946794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:46.947231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:47.082545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:47.090272 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab32ee2b-d813-4cd4-b556-f2bbb6624f64 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.157638 Jun 16 19:17:47.090843 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2905/5914] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:46 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:47.305019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1df85e2d-d37c-4f70-b24b-59c103a56d0f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:47.305877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1df85e2d-d37c-4f70-b24b-59c103a56d0f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:47.307863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:47.308536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:17:47.315336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1df85e2d-d37c-4f70-b24b-59c103a56d0f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:47.315798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1df85e2d-d37c-4f70-b24b-59c103a56d0f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:47.316569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1df85e2d-d37c-4f70-b24b-59c103a56d0f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:47.317019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1df85e2d-d37c-4f70-b24b-59c103a56d0f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:47.370580 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1df85e2d-d37c-4f70-b24b-59c103a56d0f tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "POST /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce/action" status: 200 len: 24563 microversion: 2.1 time: 0.069430 Jun 16 19:17:47.371049 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3010/5915] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:17:47 2022] POST /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce/action => generated 24563 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:17:48.107589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:48.108196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:48.115381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:48.115839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:48.116612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:48.117053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:48.257020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:48.264668 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e4b3d9c8-3ac1-4758-8e7b-c8a2ab606dcb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.161013 Jun 16 19:17:48.265244 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2906/5916] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:48 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:49.282357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:49.283821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:49.291411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:49.291884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:49.292668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:49.293124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:49.429859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:49.438782 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b22dbae6-1867-44a9-bdf4-b8300d26ad04 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.160737 Jun 16 19:17:49.439630 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3011/5917] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:49 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:50.456671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:50.457327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:50.464337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:50.464800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:50.465577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:50.466049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:50.603382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:50.611323 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a5b81f8e-0333-4dc7-9bc7-6a899e9a037f tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.159362 Jun 16 19:17:50.611926 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2907/5918] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:50 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:51.018952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-20d835ef-626a-421e-955a-626d690397a1 req-4d0f9e0b-44b5-4a91-99d1-c12935cf9b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b28848a-25ee-4e81-b08d-bf849255e0a5", "name": "network-vif-plugged", "status": "completed", "tag": "adb531ba-b9e1-480b-a00c-7e375e94467f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:51.030500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20d835ef-626a-421e-955a-626d690397a1 req-4d0f9e0b-44b5-4a91-99d1-c12935cf9b0d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:51.030975 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-20d835ef-626a-421e-955a-626d690397a1 req-4d0f9e0b-44b5-4a91-99d1-c12935cf9b0d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:51.042706 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-20d835ef-626a-421e-955a-626d690397a1 req-4d0f9e0b-44b5-4a91-99d1-c12935cf9b0d service nova] Creating event network-vif-plugged:adb531ba-b9e1-480b-a00c-7e375e94467f for instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 on n-h2-846209-2 Jun 16 19:17:51.048079 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-20d835ef-626a-421e-955a-626d690397a1 req-4d0f9e0b-44b5-4a91-99d1-c12935cf9b0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033377 Jun 16 19:17:51.048844 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3012/5919] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:17:51.628263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:51.628883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:51.635864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:51.636326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:51.637105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:51.637554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:51.778493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:51.786415 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f8fcab09-4453-4b80-aba4-2e7c4294cdb9 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1265 microversion: 2.1 time: 0.162536 Jun 16 19:17:51.786989 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2908/5920] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:51 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:52.805870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:52.806525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:52.812808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:52.813273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:52.814714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:52.815194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:52.950050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:52.958318 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25410f63-40f1-4560-9b6f-10a9a3b76e40 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1453 microversion: 2.1 time: 0.157540 Jun 16 19:17:52.958912 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3013/5921] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:52 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:52.975279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:52.975902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:52.983015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:52.983472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:52.984246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:52.984688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:53.123326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:53.131265 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83b1a982-e96f-472c-be09-ddfbb7451271 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1453 microversion: 2.1 time: 0.160008 Jun 16 19:17:53.131847 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2909/5922] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:52 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:17:54.888201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-da86ecab-6770-40bb-9ef1-cf658778e2d8 req-ecb78ae3-4fe2-4269-960f-15041cfbc057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b28848a-25ee-4e81-b08d-bf849255e0a5", "tag": "adb531ba-b9e1-480b-a00c-7e375e94467f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:54.897740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-da86ecab-6770-40bb-9ef1-cf658778e2d8 req-ecb78ae3-4fe2-4269-960f-15041cfbc057 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:54.898393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-da86ecab-6770-40bb-9ef1-cf658778e2d8 req-ecb78ae3-4fe2-4269-960f-15041cfbc057 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:54.913013 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-da86ecab-6770-40bb-9ef1-cf658778e2d8 req-ecb78ae3-4fe2-4269-960f-15041cfbc057 service nova] Creating event network-changed:adb531ba-b9e1-480b-a00c-7e375e94467f for instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 on n-h2-846209-2 Jun 16 19:17:54.918119 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-da86ecab-6770-40bb-9ef1-cf658778e2d8 req-ecb78ae3-4fe2-4269-960f-15041cfbc057 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033776 Jun 16 19:17:54.918973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3014/5923] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:17:59.607697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:59.608256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:59.611466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6bf5003d-d738-4ce6-8f8e-5f73fac6d964 req-c4487c69-90a3-48f0-b7cf-56efe6805de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8af121-0d25-48ed-a47e-58a09e402dce", "tag": "dab69ff0-97b3-44f7-8ce6-10f364225d10"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:17:59.616331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:59.616794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:59.617790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:59.618479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:59.622138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6bf5003d-d738-4ce6-8f8e-5f73fac6d964 req-c4487c69-90a3-48f0-b7cf-56efe6805de7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:59.622621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6bf5003d-d738-4ce6-8f8e-5f73fac6d964 req-c4487c69-90a3-48f0-b7cf-56efe6805de7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:59.634853 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6bf5003d-d738-4ce6-8f8e-5f73fac6d964 req-c4487c69-90a3-48f0-b7cf-56efe6805de7 service nova] Creating event network-changed:dab69ff0-97b3-44f7-8ce6-10f364225d10 for instance 3d8af121-0d25-48ed-a47e-58a09e402dce on n-h1-846209-2 Jun 16 19:17:59.639954 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6bf5003d-d738-4ce6-8f8e-5f73fac6d964 req-c4487c69-90a3-48f0-b7cf-56efe6805de7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033360 Jun 16 19:17:59.640666 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3015/5924] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:17:59.645714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:17:59.733380 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7f20a58d-02fe-4480-a910-899fe9a3ace9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 204 len: 0 microversion: 2.1 time: 0.129187 Jun 16 19:17:59.738813 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2910/5925] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:17:59 2022] DELETE /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:17:59.746018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:17:59.747085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:17:59.754519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:59.755277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:59.756330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:17:59.757000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:17:59.924108 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:17:59.932028 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b24bb64-4d92-4393-90d5-b07252373470 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1686 microversion: 2.1 time: 0.191006 Jun 16 19:17:59.932616 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3016/5926] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:17:59 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:00.950940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:00.951787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:00.959359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:00.959843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:00.960640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:00.961089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:01.117023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:01.126192 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8ac71a0e-55a8-4e77-85f8-e1f326cf4f3a tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1686 microversion: 2.1 time: 0.179338 Jun 16 19:18:01.127217 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2911/5927] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:00 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:01.776878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d257c45c-fd5b-4224-b31d-160d25d9438b req-d9484d87-e2de-4f68-9209-d73238e490bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8af121-0d25-48ed-a47e-58a09e402dce", "name": "network-vif-deleted", "tag": "dab69ff0-97b3-44f7-8ce6-10f364225d10"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:01.786885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d257c45c-fd5b-4224-b31d-160d25d9438b req-d9484d87-e2de-4f68-9209-d73238e490bc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:01.787349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d257c45c-fd5b-4224-b31d-160d25d9438b req-d9484d87-e2de-4f68-9209-d73238e490bc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:01.799111 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d257c45c-fd5b-4224-b31d-160d25d9438b req-d9484d87-e2de-4f68-9209-d73238e490bc service nova] Creating event network-vif-deleted:dab69ff0-97b3-44f7-8ce6-10f364225d10 for instance 3d8af121-0d25-48ed-a47e-58a09e402dce on n-h1-846209-2 Jun 16 19:18:01.804409 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d257c45c-fd5b-4224-b31d-160d25d9438b req-d9484d87-e2de-4f68-9209-d73238e490bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Jun 16 19:18:01.805035 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3017/5928] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:02.148881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:02.150123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:02.160055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:02.160603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:02.161500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:02.161943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:02.201508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:02.202198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:02.202483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lazy-loading 'fault' on Instance uuid 3d8af121-0d25-48ed-a47e-58a09e402dce {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:18:02.252706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fd96b15988445484a9fbb22fd7a6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba85d86fb7e44a10b9542fc1c0538a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:02.260748 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0947c706-272d-4dd8-b431-1b7c1e7a3dc9 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 200 len: 1355 microversion: 2.1 time: 0.120624 Jun 16 19:18:02.261412 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2912/5929] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:02 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 1355 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:03.280393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:03.281159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] [instance: 3d8af121-0d25-48ed-a47e-58a09e402dce] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:03.288772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:03.289253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:03.290095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:03.290591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:03.307762 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] HTTP exception thrown: Instance 3d8af121-0d25-48ed-a47e-58a09e402dce could not be found. Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Request method failure captured: Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce HTTP/1.1 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4A05u_-9AikOlX9ntKqQm7qzINM9v1WDOsB1gjwlQGL-f-UN3zhF3YTfYTacmIjY28BFrjHK7FTwa-n6EeUpZ8ZhKYC6v8hCA-h8AjiPNCdZeYVCohxsIvpEYwpRw-bBzpDlTd5KgMhh4AlAmmhCJtWd-8sTyC-ypUrYpg619ZDDRU Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba85d86fb7e44a10b9542fc1c0538a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba85d86fb7e44a10b9542fc1c0538a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: ba85d86fb7e44a10b9542fc1c0538a8d Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1236703827 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 42fd96b15988445484a9fbb22fd7a6a7 Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1236703827-project Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 3d8af121-0d25-48ed-a47e-58a09e402dce could not be found. Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3d8af121-0d25-48ed-a47e-58a09e402dce'} Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8af121-0d25-48ed-a47e-58a09e402dce could not be found. Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8af121-0d25-48ed-a47e-58a09e402dce could not be found. Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:03.309464 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8af121-0d25-48ed-a47e-58a09e402dce could not be found. Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Returning 404 to user: Instance 3d8af121-0d25-48ed-a47e-58a09e402dce could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36bb20df-b6db-45a1-b9b4-f1da1311d269 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce" status: 404 len: 111 microversion: 2.1 time: 0.035745 Jun 16 19:18:03.316232 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3018/5930] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:03 2022] GET /compute/v2.1/servers/3d8af121-0d25-48ed-a47e-58a09e402dce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:18:06.515768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b10330f1-b117-4da0-867e-f58030b6e702 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] Calling method '.version_select at 0x7f866d86a9d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:06.524522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:06.541042 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b10330f1-b117-4da0-867e-f58030b6e702 tempest-TestNetworkAdvancedServerOps-1236703827 tempest-TestNetworkAdvancedServerOps-1236703827-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-64510324" status: 202 len: 0 microversion: 2.1 time: 0.029143 Jun 16 19:18:06.541713 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2913/5931] 10.222.0.27 () {58 vars in 1277 bytes} [Thu Jun 16 19:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-64510324 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:18:10.497276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-925546792", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "4e64c747-5401-4868-a29c-9a79d2712071"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:10.504167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=29 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:10.721744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] validate_networks() for [('4e64c747-5401-4868-a29c-9a79d2712071', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:18:11.231388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:18:11.231823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:18:11.232341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:18:11.232786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:18:11.233208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:18:11.242903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:11.243365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:11.244177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:11.244629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:11.252302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=58 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:11.263981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Getting quotas for project 51fd39de13e44c90a171780d3c6b30f8. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:18:11.269519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Getting quotas for user 9ec452ad4b4247f9b4f0025ae42eead3 and project 51fd39de13e44c90a171780d3c6b30f8. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:18:11.282832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:18:11.285230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:18:11.334691 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c0162d95-1dea-4128-b09e-eda3fef7e019 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965815 Jun 16 19:18:11.335562 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3019/5932] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:18:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:18:11.346173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f28e03ca-1e1c-4ec7-a3ff-02246d09bcb1 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:11.347112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f28e03ca-1e1c-4ec7-a3ff-02246d09bcb1 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:11.408409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f28e03ca-1e1c-4ec7-a3ff-02246d09bcb1 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:11.415250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f28e03ca-1e1c-4ec7-a3ff-02246d09bcb1 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1214 microversion: 2.1 time: 0.073403 Jun 16 19:18:11.415846 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2914/5933] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:11 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:12.434449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:12.436133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:12.445298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:12.446204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:12.447269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:12.447933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:12.540195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:12.548543 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8cc471dc-172c-421b-98f3-0a3d0fc85cdf tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1284 microversion: 2.1 time: 0.118866 Jun 16 19:18:12.549216 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3020/5934] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:12 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:13.566596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:13.567238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:13.569098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:13.576051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:13.576506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:13.577283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:13.577722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:13.866502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:13.874905 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bbc435f8-b29b-440c-8b4f-eacee112c384 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1314 microversion: 2.1 time: 0.312779 Jun 16 19:18:13.875415 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2915/5935] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:13 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:14.124053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b31837d3-fbfd-44bb-8754-a5a226cc6b5e req-35504e6c-6bf3-4e99-8289-153164579c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2", "tag": "4e8a0e30-b92c-4557-99ed-08f7ca69df3b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:14.135620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b31837d3-fbfd-44bb-8754-a5a226cc6b5e req-35504e6c-6bf3-4e99-8289-153164579c91 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:14.136140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b31837d3-fbfd-44bb-8754-a5a226cc6b5e req-35504e6c-6bf3-4e99-8289-153164579c91 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:14.150466 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b31837d3-fbfd-44bb-8754-a5a226cc6b5e req-35504e6c-6bf3-4e99-8289-153164579c91 service nova] Creating event network-changed:4e8a0e30-b92c-4557-99ed-08f7ca69df3b for instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 on n-h1-846209-2 Jun 16 19:18:14.155600 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b31837d3-fbfd-44bb-8754-a5a226cc6b5e req-35504e6c-6bf3-4e99-8289-153164579c91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036614 Jun 16 19:18:14.156231 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3021/5936] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:14.893073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:14.893711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:14.901992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:14.902470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:14.903262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:14.903711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:15.043318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:15.051513 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e09dd8b-038a-46df-9fab-0c4bcc4e388c tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1314 microversion: 2.1 time: 0.162784 Jun 16 19:18:15.052184 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2916/5937] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:14 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:18:16.069830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:16.070658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:16.077554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:16.078071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:16.078842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:16.079864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:16.217112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:16.224951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1b31558-aeec-48cf-af03-482edf85d459 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1314 microversion: 2.1 time: 0.159255 Jun 16 19:18:16.225451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3022/5938] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:16 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:17.242050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:17.242671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:17.249586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:17.250077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:17.250850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:17.251605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:17.403708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:17.412550 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f80e34a7-82c2-4713-bb53-e68eeb187eb7 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1314 microversion: 2.1 time: 0.174436 Jun 16 19:18:17.413135 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2917/5939] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:17 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:18.430052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:18.430684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:18.437963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:18.438438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:18.439731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:18.440191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:18.582510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:18.590033 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5cb73245-785f-4840-ad5a-42dc1709b86e tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1314 microversion: 2.1 time: 0.163896 Jun 16 19:18:18.590809 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3023/5940] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:18 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:18.717942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c0addd92-299c-4e56-aacc-8090f02c00b5 req-a5fca1f1-576b-45e0-907e-b2b8e17b60c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2", "name": "network-vif-plugged", "status": "completed", "tag": "4e8a0e30-b92c-4557-99ed-08f7ca69df3b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:18.727921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c0addd92-299c-4e56-aacc-8090f02c00b5 req-a5fca1f1-576b-45e0-907e-b2b8e17b60c6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:18.728377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c0addd92-299c-4e56-aacc-8090f02c00b5 req-a5fca1f1-576b-45e0-907e-b2b8e17b60c6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:18.742653 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c0addd92-299c-4e56-aacc-8090f02c00b5 req-a5fca1f1-576b-45e0-907e-b2b8e17b60c6 service nova] Creating event network-vif-plugged:4e8a0e30-b92c-4557-99ed-08f7ca69df3b for instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 on n-h1-846209-2 Jun 16 19:18:18.749391 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c0addd92-299c-4e56-aacc-8090f02c00b5 req-a5fca1f1-576b-45e0-907e-b2b8e17b60c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035426 Jun 16 19:18:18.750117 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2918/5941] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:19.607009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:19.607684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:19.615561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:19.616036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:19.616969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:19.617493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:19.750832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:19.759263 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0cfdb2fe-0c63-4dd7-80c5-6c75b1c89c36 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1314 microversion: 2.1 time: 0.156125 Jun 16 19:18:19.759849 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3024/5942] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:19 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:18:20.777602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:20.778351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:20.785339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:20.785798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:20.786604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:20.787051 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:20.918912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:20.927563 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-40ea5c25-5a47-48a2-815a-04bcdf65a061 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1501 microversion: 2.1 time: 0.155192 Jun 16 19:18:20.928147 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2919/5943] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:20 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:20.944150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:20.944779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:20.951694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:20.952224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:20.952935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:20.953385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:21.091366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:21.100370 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-771d9465-ce84-4203-ab60-8b998cdf7304 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1501 microversion: 2.1 time: 0.160683 Jun 16 19:18:21.100951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3025/5944] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:20 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:21.116486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:21.117029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:21.123365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:21.123815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:21.124584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:21.125019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:21.148174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lazy-loading 'flavor' on Instance uuid 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:18:21.218335 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a7adb7f-ae52-4663-b198-cf66bd480023 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action" status: 202 len: 0 microversion: 2.1 time: 0.105453 Jun 16 19:18:21.219129 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2920/5945] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:18:21 2022] POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:18:21.228054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:21.228854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:21.235097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:21.235571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:21.237420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:21.237926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:21.254738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:21.276026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:21.380643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:21.388270 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-893924da-9044-4bf1-9f12-e0f85403465a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1509 microversion: 2.1 time: 0.164166 Jun 16 19:18:21.388854 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3026/5946] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:21 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:22.405162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:22.405931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:22.408032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:22.414524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:22.414989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:22.415763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:22.416207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:22.560611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:22.569056 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-76ef2fb4-6c63-46e4-912f-d2290726580f tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1492 microversion: 2.1 time: 0.168169 Jun 16 19:18:22.569627 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2921/5947] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:22 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1492 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:22.585592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8498a86e-10e9-4199-b593-1ac5623a4013 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:22.586205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8498a86e-10e9-4199-b593-1ac5623a4013 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:22.593538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8498a86e-10e9-4199-b593-1ac5623a4013 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:22.594207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8498a86e-10e9-4199-b593-1ac5623a4013 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:22.595136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8498a86e-10e9-4199-b593-1ac5623a4013 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:22.595853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8498a86e-10e9-4199-b593-1ac5623a4013 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:22.661818 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8498a86e-10e9-4199-b593-1ac5623a4013 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action" status: 202 len: 0 microversion: 2.1 time: 0.079826 Jun 16 19:18:22.662546 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3027/5948] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:18:22 2022] POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:18:22.671008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:22.671621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:22.678647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:22.679091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:22.679860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:22.680531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:22.882232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:22.890063 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f1710b18-0480-4f68-bb79-d8e98b2a999a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1498 microversion: 2.1 time: 0.223291 Jun 16 19:18:22.890653 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2922/5949] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:22 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1498 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:23.909093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:23.909738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:23.916120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:23.916593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:23.917398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:23.917883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:24.057643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:24.066724 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ed5c4171-8afb-406d-b53a-3696d0f1c99a tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1501 microversion: 2.1 time: 0.163081 Jun 16 19:18:24.067313 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3028/5950] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:23 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:24.084188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:24.084724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:24.092259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:24.092746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:24.093525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:24.094012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:24.117598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lazy-loading 'flavor' on Instance uuid 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:18:24.182616 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8e913542-9b01-42ad-83a6-1addb9db6c11 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action" status: 202 len: 0 microversion: 2.1 time: 0.102212 Jun 16 19:18:24.183197 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2923/5951] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:18:24 2022] POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:18:24.192247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:24.193983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:24.202088 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:24.202798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:24.203649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:24.204208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:24.340745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:24.348876 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-352793c8-02b2-4ebc-b2ac-c95d4cefcc93 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1509 microversion: 2.1 time: 0.161489 Jun 16 19:18:24.349450 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3029/5952] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:24 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:25.368611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:25.369505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:25.375995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:25.376445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:25.378025 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:25.378471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:25.510260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:25.518869 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9e794c24-dab7-4c89-82b2-67bf9a8c1de2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1492 microversion: 2.1 time: 0.155794 Jun 16 19:18:25.519450 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2924/5953] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:25 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1492 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:25.536331 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b67cd174-742c-4111-804e-a58b61ec2146 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:25.536874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b67cd174-742c-4111-804e-a58b61ec2146 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:25.543835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67cd174-742c-4111-804e-a58b61ec2146 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:25.544314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67cd174-742c-4111-804e-a58b61ec2146 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:25.545105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67cd174-742c-4111-804e-a58b61ec2146 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:25.546061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b67cd174-742c-4111-804e-a58b61ec2146 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:25.613999 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b67cd174-742c-4111-804e-a58b61ec2146 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action" status: 202 len: 0 microversion: 2.1 time: 0.081415 Jun 16 19:18:25.614607 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3030/5954] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:18:25 2022] POST /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:18:25.623458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:25.624014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:25.631780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:25.632334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:25.633128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:25.633568 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:25.856916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:25.873239 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c825f4f6-8ba5-4afe-8e90-2410e563fdeb tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1498 microversion: 2.1 time: 0.254017 Jun 16 19:18:25.874073 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2925/5955] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:25 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1498 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:26.891476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:26.892226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:26.901386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:26.901851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:26.905388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:26.905388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:27.055489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:27.063340 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f329926c-51fb-42c8-a939-c48a63bb9b39 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1498 microversion: 2.1 time: 0.176964 Jun 16 19:18:27.063903 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3031/5956] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:26 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:28.080873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:28.081513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:28.088895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:28.089362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:28.090197 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:28.090957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:28.224731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:28.232376 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9544739b-1969-47fe-ac41-4ca513f9ae62 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1501 microversion: 2.1 time: 0.155640 Jun 16 19:18:28.232959 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2926/5957] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:28 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:28.249078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:28.249593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:28.256735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:28.257211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:28.258047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:28.258512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:28.286444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:18:28.362817 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b9366c1-75c1-4a61-b8fd-a565a3c9d8a2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 204 len: 0 microversion: 2.1 time: 0.117039 Jun 16 19:18:28.363853 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3032/5958] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:18:28 2022] DELETE /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:18:28.373378 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:28.374474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:28.380869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:28.381325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:28.382173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:28.382621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:28.513302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:28.522852 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e97fa965-2396-41a0-84a0-5e22f10ddea2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1507 microversion: 2.1 time: 0.153641 Jun 16 19:18:28.523429 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2927/5959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:28 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:29.540827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:29.541542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:29.548869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:29.549323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:29.550122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:29.550573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:29.566506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:29.690757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:29.698316 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b49d87c-8cb8-492f-99e8-0b2f7577f362 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1507 microversion: 2.1 time: 0.161748 Jun 16 19:18:29.698891 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3033/5960] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:29 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:30.720177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:30.722091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:30.730001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:30.730541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:30.731358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:30.731826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:30.765580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-10442406-96af-4e3d-86a4-bc5a4d2d36b3 req-bee45336-8e53-49a8-b00b-e64116208c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2", "name": "network-vif-deleted", "tag": "4e8a0e30-b92c-4557-99ed-08f7ca69df3b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:30.776260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-10442406-96af-4e3d-86a4-bc5a4d2d36b3 req-bee45336-8e53-49a8-b00b-e64116208c81 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:30.776729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-10442406-96af-4e3d-86a4-bc5a4d2d36b3 req-bee45336-8e53-49a8-b00b-e64116208c81 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:30.789631 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-10442406-96af-4e3d-86a4-bc5a4d2d36b3 req-bee45336-8e53-49a8-b00b-e64116208c81 service nova] Creating event network-vif-deleted:4e8a0e30-b92c-4557-99ed-08f7ca69df3b for instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 on n-h1-846209-2 Jun 16 19:18:30.795232 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-10442406-96af-4e3d-86a4-bc5a4d2d36b3 req-bee45336-8e53-49a8-b00b-e64116208c81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033439 Jun 16 19:18:30.796344 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3034/5961] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:30.810890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec452ad4b4247f9b4f0025ae42eead3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fd39de13e44c90a171780d3c6b30f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:18:30.815193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:30.822221 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16ac2a3a-d672-4b2c-823d-d21cd4a0bba2 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 200 len: 1465 microversion: 2.1 time: 0.107327 Jun 16 19:18:30.831191 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2928/5962] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:30 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 1465 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:31.841376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:31.842039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] [instance: 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:31.849179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:31.849651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:31.850464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:31.850924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:31.865826 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] HTTP exception thrown: Instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 could not be found. Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Request method failure captured: Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 HTTP/1.1 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4HxstvFsdjilCkqThu7A4eAJm4KxJ1-sYoKDOZ_Ee_EyuGFvoDG0TYyqS7k-k95wBdT1WYxRlSvMYm6AfrUrelKZ4QXtHP7hxmj6dYiBhqe4IvV92ozhBYZkUSwVnKftHPZLUrCCJ4pv6hA5STIasEQegkako97Iw4qzR0OTBXyCDg Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 51fd39de13e44c90a171780d3c6b30f8 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestServerAdvancedOps-716069217 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51fd39de13e44c90a171780d3c6b30f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51fd39de13e44c90a171780d3c6b30f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51fd39de13e44c90a171780d3c6b30f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51fd39de13e44c90a171780d3c6b30f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestServerAdvancedOps-716069217 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 51fd39de13e44c90a171780d3c6b30f8 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestServerAdvancedOps-716069217 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestServerAdvancedOps-716069217-project Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9ec452ad4b4247f9b4f0025ae42eead3 Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestServerAdvancedOps-716069217-project Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 could not be found. Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2'} Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 could not be found. Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 could not be found. Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:18:31.867510 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 could not be found. Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] Returning 404 to user: Instance 35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a7e488e2-9726-4f4b-b608-e59975701d98 tempest-TestServerAdvancedOps-716069217 tempest-TestServerAdvancedOps-716069217-project] 10.222.0.27 "GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2" status: 404 len: 111 microversion: 2.1 time: 0.032986 Jun 16 19:18:31.872792 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3035/5963] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:31 2022] GET /compute/v2.1/servers/35b2d93d-f8a8-4cfb-a2c4-3aae91ec70f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:18:44.372772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:44.514667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d8c17ff7-2f5b-4317-aca3-46bb08a1233c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:44.518316 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:18:44.518316 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:18:44.522388 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c17ff7-2f5b-4317-aca3-46bb08a1233c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:44.522861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c17ff7-2f5b-4317-aca3-46bb08a1233c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:44.523707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c17ff7-2f5b-4317-aca3-46bb08a1233c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:44.524154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d8c17ff7-2f5b-4317-aca3-46bb08a1233c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:44.561211 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d8c17ff7-2f5b-4317-aca3-46bb08a1233c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.194273 Jun 16 19:18:44.561824 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2929/5964] 10.222.0.27 () {58 vars in 1184 bytes} [Thu Jun 16 19:18:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:44.684067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2144946250", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "availability_zone": "nova:n-h1-846209-2", "networks": [{"uuid": "afe7acab-5c77-4e99-956b-650aea439b7a"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:44.694908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:44.695443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:44.818896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] validate_networks() for [('afe7acab-5c77-4e99-956b-650aea439b7a', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:18:45.706841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:18:45.707488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:18:45.708326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:18:45.708777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:18:45.709461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:18:45.720644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:45.721136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:45.721979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:45.722445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:45.742060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Getting quotas for project 7ab14ea223744a81974eb6d9f95747a6. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:18:45.749303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Getting quotas for user 6b04bec50e0146c1a2eb4e58f720f939 and project 7ab14ea223744a81974eb6d9f95747a6. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:18:45.765973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:18:45.768625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:18:45.837158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04c271a1-6f0d-4b85-9c73-2ceae757afe7 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159515 Jun 16 19:18:45.839055 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3036/5965] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:18:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:18:45.851380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4b508af7-c97e-400a-8a2c-2cb827f5ff01 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:45.851848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4b508af7-c97e-400a-8a2c-2cb827f5ff01 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:45.929843 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4b508af7-c97e-400a-8a2c-2cb827f5ff01 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1329 microversion: 2.1 time: 0.084337 Jun 16 19:18:45.931065 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2930/5966] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:45 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1329 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:46.948360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0000f06f-a98c-4fd0-8905-0649ff73c3d1 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:46.949121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0000f06f-a98c-4fd0-8905-0649ff73c3d1 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:46.957506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0000f06f-a98c-4fd0-8905-0649ff73c3d1 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:46.957994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0000f06f-a98c-4fd0-8905-0649ff73c3d1 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:46.958830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0000f06f-a98c-4fd0-8905-0649ff73c3d1 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:46.959282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0000f06f-a98c-4fd0-8905-0649ff73c3d1 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:47.050146 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0000f06f-a98c-4fd0-8905-0649ff73c3d1 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1416 microversion: 2.1 time: 0.105814 Jun 16 19:18:47.057976 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3037/5967] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:46 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1416 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:48.072703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e5db9e55-ff36-4582-a709-649725b016ba tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:48.074132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e5db9e55-ff36-4582-a709-649725b016ba tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:48.083779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5db9e55-ff36-4582-a709-649725b016ba tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:48.084630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5db9e55-ff36-4582-a709-649725b016ba tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:48.086097 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5db9e55-ff36-4582-a709-649725b016ba tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:48.086736 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5db9e55-ff36-4582-a709-649725b016ba tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:48.342235 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e5db9e55-ff36-4582-a709-649725b016ba tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1464 microversion: 2.1 time: 0.276353 Jun 16 19:18:48.342825 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2931/5968] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:48 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1464 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:48.721478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-627ab628-b542-4778-b979-ed30bb3109ee req-f7c109fe-20a7-494c-ba2c-42191e863947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c8a606-c78b-4152-bcf8-bad505b433e3", "tag": "5d3e0bf3-c729-4a57-8840-5ac4af00d9b3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:48.738229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-627ab628-b542-4778-b979-ed30bb3109ee req-f7c109fe-20a7-494c-ba2c-42191e863947 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:48.738696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-627ab628-b542-4778-b979-ed30bb3109ee req-f7c109fe-20a7-494c-ba2c-42191e863947 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:48.759462 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-627ab628-b542-4778-b979-ed30bb3109ee req-f7c109fe-20a7-494c-ba2c-42191e863947 service nova] Creating event network-changed:5d3e0bf3-c729-4a57-8840-5ac4af00d9b3 for instance a6c8a606-c78b-4152-bcf8-bad505b433e3 on n-h1-846209-2 Jun 16 19:18:48.764990 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-627ab628-b542-4778-b979-ed30bb3109ee req-f7c109fe-20a7-494c-ba2c-42191e863947 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051306 Jun 16 19:18:48.772697 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3038/5969] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:49.359850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a1df59a7-bd6e-4245-be43-297f8ff863fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:49.360506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a1df59a7-bd6e-4245-be43-297f8ff863fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:49.367593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1df59a7-bd6e-4245-be43-297f8ff863fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:49.368059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1df59a7-bd6e-4245-be43-297f8ff863fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:49.368841 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1df59a7-bd6e-4245-be43-297f8ff863fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:49.369284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1df59a7-bd6e-4245-be43-297f8ff863fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:49.503042 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a1df59a7-bd6e-4245-be43-297f8ff863fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1464 microversion: 2.1 time: 0.147000 Jun 16 19:18:49.503968 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2932/5970] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:49 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:50.521416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-42753cc4-7090-46f5-8c27-0d1dcdb9c030 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:50.522179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-42753cc4-7090-46f5-8c27-0d1dcdb9c030 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:50.529609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42753cc4-7090-46f5-8c27-0d1dcdb9c030 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:50.530163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42753cc4-7090-46f5-8c27-0d1dcdb9c030 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:50.530965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42753cc4-7090-46f5-8c27-0d1dcdb9c030 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:50.531424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42753cc4-7090-46f5-8c27-0d1dcdb9c030 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:50.738886 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-42753cc4-7090-46f5-8c27-0d1dcdb9c030 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1464 microversion: 2.1 time: 0.221977 Jun 16 19:18:50.739494 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3039/5971] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:50 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1464 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:51.755905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3bdfe6f-362e-4dc6-97f3-fb4be5021ccd tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:51.756534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3bdfe6f-362e-4dc6-97f3-fb4be5021ccd tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:51.763573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bdfe6f-362e-4dc6-97f3-fb4be5021ccd tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:51.764043 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bdfe6f-362e-4dc6-97f3-fb4be5021ccd tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:51.764823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bdfe6f-362e-4dc6-97f3-fb4be5021ccd tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:51.765268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3bdfe6f-362e-4dc6-97f3-fb4be5021ccd tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:51.899986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3bdfe6f-362e-4dc6-97f3-fb4be5021ccd tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1464 microversion: 2.1 time: 0.147858 Jun 16 19:18:51.900566 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2933/5972] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:51 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:52.918597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-03f0bc4a-0aad-4f58-b5d8-cf4a8081711f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:52.919335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-03f0bc4a-0aad-4f58-b5d8-cf4a8081711f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:52.930184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f0bc4a-0aad-4f58-b5d8-cf4a8081711f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:52.930686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f0bc4a-0aad-4f58-b5d8-cf4a8081711f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:52.931997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f0bc4a-0aad-4f58-b5d8-cf4a8081711f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:52.932667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-03f0bc4a-0aad-4f58-b5d8-cf4a8081711f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:52.957337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e13f9270-6479-4fa1-b4d4-87d8f73544f9 req-4d20b362-a01a-4ec5-a729-89ae31537bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c8a606-c78b-4152-bcf8-bad505b433e3", "name": "network-vif-plugged", "status": "completed", "tag": "5d3e0bf3-c729-4a57-8840-5ac4af00d9b3"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:52.967636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e13f9270-6479-4fa1-b4d4-87d8f73544f9 req-4d20b362-a01a-4ec5-a729-89ae31537bcb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:52.968097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e13f9270-6479-4fa1-b4d4-87d8f73544f9 req-4d20b362-a01a-4ec5-a729-89ae31537bcb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:52.981024 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e13f9270-6479-4fa1-b4d4-87d8f73544f9 req-4d20b362-a01a-4ec5-a729-89ae31537bcb service nova] Creating event network-vif-plugged:5d3e0bf3-c729-4a57-8840-5ac4af00d9b3 for instance a6c8a606-c78b-4152-bcf8-bad505b433e3 on n-h1-846209-2 Jun 16 19:18:52.986380 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e13f9270-6479-4fa1-b4d4-87d8f73544f9 req-4d20b362-a01a-4ec5-a729-89ae31537bcb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112448 Jun 16 19:18:52.987007 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3040/5973] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:53.083688 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-03f0bc4a-0aad-4f58-b5d8-cf4a8081711f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1464 microversion: 2.1 time: 0.169826 Jun 16 19:18:53.084286 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2934/5974] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:52 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:18:54.101453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-058a502a-8c61-45ca-8859-4a03e274642c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:54.102223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-058a502a-8c61-45ca-8859-4a03e274642c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:54.109557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-058a502a-8c61-45ca-8859-4a03e274642c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:54.110080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-058a502a-8c61-45ca-8859-4a03e274642c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:54.110873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-058a502a-8c61-45ca-8859-4a03e274642c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:54.111339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-058a502a-8c61-45ca-8859-4a03e274642c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:54.247088 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-058a502a-8c61-45ca-8859-4a03e274642c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1464 microversion: 2.1 time: 0.149638 Jun 16 19:18:54.247593 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3041/5975] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:54 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:55.263723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-033f8198-852f-465f-a4e7-4361279a26ee tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:55.264321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-033f8198-852f-465f-a4e7-4361279a26ee tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:55.267040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:55.277205 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033f8198-852f-465f-a4e7-4361279a26ee tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:55.277670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033f8198-852f-465f-a4e7-4361279a26ee tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:55.278512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033f8198-852f-465f-a4e7-4361279a26ee tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:55.278956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-033f8198-852f-465f-a4e7-4361279a26ee tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:55.417087 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-033f8198-852f-465f-a4e7-4361279a26ee tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1649 microversion: 2.1 time: 0.157148 Jun 16 19:18:55.417668 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2935/5976] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:55 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1649 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:55.433813 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b4285041-a5e6-462c-bf2e-13ec54e75b51 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:55.434511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b4285041-a5e6-462c-bf2e-13ec54e75b51 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:55.442187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4285041-a5e6-462c-bf2e-13ec54e75b51 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:55.442663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4285041-a5e6-462c-bf2e-13ec54e75b51 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:55.443455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4285041-a5e6-462c-bf2e-13ec54e75b51 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:55.443915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b4285041-a5e6-462c-bf2e-13ec54e75b51 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:55.579002 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b4285041-a5e6-462c-bf2e-13ec54e75b51 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1649 microversion: 2.1 time: 0.148829 Jun 16 19:18:55.580597 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3042/5977] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:55 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1649 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:18:55.596337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e43d5b7a-93c1-480b-a6e3-ca383cada27a tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:55.596962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e43d5b7a-93c1-480b-a6e3-ca383cada27a tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:55.603192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e43d5b7a-93c1-480b-a6e3-ca383cada27a tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:55.603652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e43d5b7a-93c1-480b-a6e3-ca383cada27a tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:55.604427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e43d5b7a-93c1-480b-a6e3-ca383cada27a tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:55.604905 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e43d5b7a-93c1-480b-a6e3-ca383cada27a tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:55.731896 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e43d5b7a-93c1-480b-a6e3-ca383cada27a tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1649 microversion: 2.1 time: 0.139365 Jun 16 19:18:55.732503 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2936/5978] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:55 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:55.788967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1444075309", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "availability_zone": "nova:n-h2-846209-2", "networks": [{"uuid": "afe7acab-5c77-4e99-956b-650aea439b7a"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:55.796342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:55.797104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:55.851424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] validate_networks() for [('afe7acab-5c77-4e99-956b-650aea439b7a', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:18:56.214530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:18:56.214978 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:18:56.215478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:18:56.215911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:18:56.216344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:18:56.227047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:56.227518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:56.228341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:56.228796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:56.247947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Getting quotas for project 7ab14ea223744a81974eb6d9f95747a6. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:18:56.253455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Getting quotas for user 6b04bec50e0146c1a2eb4e58f720f939 and project 7ab14ea223744a81974eb6d9f95747a6. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:18:56.266708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:18:56.269191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:18:56.315165 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-479c83a6-bac8-4ab2-ac5e-d187a050ee6f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529963 Jun 16 19:18:56.316196 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3043/5979] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:18:56.327506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-100de70e-92b1-411d-8562-91b61b569268 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:56.328914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-100de70e-92b1-411d-8562-91b61b569268 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:56.331925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:18:56.406684 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-100de70e-92b1-411d-8562-91b61b569268 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1329 microversion: 2.1 time: 0.084176 Jun 16 19:18:56.407280 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2937/5980] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:56 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1329 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:18:57.428977 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6635f6a6-ca8e-49da-99c4-4a4a4a76af4f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:57.429729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6635f6a6-ca8e-49da-99c4-4a4a4a76af4f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:57.438141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6635f6a6-ca8e-49da-99c4-4a4a4a76af4f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:57.438620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6635f6a6-ca8e-49da-99c4-4a4a4a76af4f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:57.440663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6635f6a6-ca8e-49da-99c4-4a4a4a76af4f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:57.441183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6635f6a6-ca8e-49da-99c4-4a4a4a76af4f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:57.515773 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6635f6a6-ca8e-49da-99c4-4a4a4a76af4f tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1434 microversion: 2.1 time: 0.092658 Jun 16 19:18:57.516451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3044/5981] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:57 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1434 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:58.532976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b1874437-2565-4ad0-944b-fc295d52444c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:58.533612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b1874437-2565-4ad0-944b-fc295d52444c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:58.541760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1874437-2565-4ad0-944b-fc295d52444c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:58.542313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1874437-2565-4ad0-944b-fc295d52444c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:58.543103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1874437-2565-4ad0-944b-fc295d52444c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:58.543552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b1874437-2565-4ad0-944b-fc295d52444c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:58.584255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-83a5cc2b-421c-4c14-9834-f7688fbc2dfe req-0569c8fd-ae44-444f-b095-53dba9fb7526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f313fdb-9a70-462e-984f-c98fffec58e5", "tag": "d999b453-7872-40b2-82ea-e95aeb27944d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:18:58.608742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-83a5cc2b-421c-4c14-9834-f7688fbc2dfe req-0569c8fd-ae44-444f-b095-53dba9fb7526 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:58.609632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-83a5cc2b-421c-4c14-9834-f7688fbc2dfe req-0569c8fd-ae44-444f-b095-53dba9fb7526 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:58.631634 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-83a5cc2b-421c-4c14-9834-f7688fbc2dfe req-0569c8fd-ae44-444f-b095-53dba9fb7526 service nova] Creating event network-changed:d999b453-7872-40b2-82ea-e95aeb27944d for instance 3f313fdb-9a70-462e-984f-c98fffec58e5 on n-h2-846209-2 Jun 16 19:18:58.642265 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-83a5cc2b-421c-4c14-9834-f7688fbc2dfe req-0569c8fd-ae44-444f-b095-53dba9fb7526 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062284 Jun 16 19:18:58.644426 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3045/5982] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:18:58.701839 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b1874437-2565-4ad0-944b-fc295d52444c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1464 microversion: 2.1 time: 0.172772 Jun 16 19:18:58.702692 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2938/5983] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:58 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:18:59.720134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b376fc3-6fef-4ea7-b533-30904602ac41 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:18:59.721571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b376fc3-6fef-4ea7-b533-30904602ac41 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:18:59.731337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b376fc3-6fef-4ea7-b533-30904602ac41 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:59.731809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b376fc3-6fef-4ea7-b533-30904602ac41 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:59.732634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b376fc3-6fef-4ea7-b533-30904602ac41 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:18:59.733125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b376fc3-6fef-4ea7-b533-30904602ac41 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:18:59.860692 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b376fc3-6fef-4ea7-b533-30904602ac41 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1464 microversion: 2.1 time: 0.144575 Jun 16 19:18:59.861545 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3046/5984] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:18:59 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:00.878948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dcc9d3c5-3b9d-4726-999f-708c35ea2288 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:00.879601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dcc9d3c5-3b9d-4726-999f-708c35ea2288 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:00.886598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcc9d3c5-3b9d-4726-999f-708c35ea2288 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:00.887054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcc9d3c5-3b9d-4726-999f-708c35ea2288 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:00.887820 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcc9d3c5-3b9d-4726-999f-708c35ea2288 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:00.888258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcc9d3c5-3b9d-4726-999f-708c35ea2288 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:01.018214 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dcc9d3c5-3b9d-4726-999f-708c35ea2288 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1464 microversion: 2.1 time: 0.143224 Jun 16 19:19:01.018837 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2939/5985] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:00 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:02.035724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b9b73e90-2830-4daa-ad73-8f13ed8ee097 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:02.036368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b9b73e90-2830-4daa-ad73-8f13ed8ee097 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:02.043472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9b73e90-2830-4daa-ad73-8f13ed8ee097 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:02.043949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9b73e90-2830-4daa-ad73-8f13ed8ee097 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:02.044766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9b73e90-2830-4daa-ad73-8f13ed8ee097 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:02.045255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b9b73e90-2830-4daa-ad73-8f13ed8ee097 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:02.173874 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b9b73e90-2830-4daa-ad73-8f13ed8ee097 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1464 microversion: 2.1 time: 0.142032 Jun 16 19:19:02.174830 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3047/5986] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:02 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:03.191743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-39a594c7-e720-4e97-a056-a7b5e1b7c7fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:03.192406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-39a594c7-e720-4e97-a056-a7b5e1b7c7fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:03.198999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39a594c7-e720-4e97-a056-a7b5e1b7c7fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:03.199456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39a594c7-e720-4e97-a056-a7b5e1b7c7fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:03.200214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39a594c7-e720-4e97-a056-a7b5e1b7c7fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:03.200681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39a594c7-e720-4e97-a056-a7b5e1b7c7fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:03.328925 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-39a594c7-e720-4e97-a056-a7b5e1b7c7fb tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1464 microversion: 2.1 time: 0.141758 Jun 16 19:19:03.329740 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2940/5987] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:03 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:03.377242 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-52e2f48b-6360-490d-8cfd-bbdc8a4af41f req-5b6b0352-40af-4893-9e4c-05b6a578b255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f313fdb-9a70-462e-984f-c98fffec58e5", "name": "network-vif-plugged", "status": "completed", "tag": "d999b453-7872-40b2-82ea-e95aeb27944d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:19:03.386528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-52e2f48b-6360-490d-8cfd-bbdc8a4af41f req-5b6b0352-40af-4893-9e4c-05b6a578b255 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:03.387191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-52e2f48b-6360-490d-8cfd-bbdc8a4af41f req-5b6b0352-40af-4893-9e4c-05b6a578b255 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:03.398920 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-52e2f48b-6360-490d-8cfd-bbdc8a4af41f req-5b6b0352-40af-4893-9e4c-05b6a578b255 service nova] Creating event network-vif-plugged:d999b453-7872-40b2-82ea-e95aeb27944d for instance 3f313fdb-9a70-462e-984f-c98fffec58e5 on n-h2-846209-2 Jun 16 19:19:03.403744 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-52e2f48b-6360-490d-8cfd-bbdc8a4af41f req-5b6b0352-40af-4893-9e4c-05b6a578b255 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031390 Jun 16 19:19:03.404336 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3048/5988] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:19:04.346791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-da34ea11-cb40-439c-905b-ed7807911856 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:04.347421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-da34ea11-cb40-439c-905b-ed7807911856 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:04.354553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da34ea11-cb40-439c-905b-ed7807911856 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:04.355007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da34ea11-cb40-439c-905b-ed7807911856 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:04.355785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da34ea11-cb40-439c-905b-ed7807911856 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:04.356228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-da34ea11-cb40-439c-905b-ed7807911856 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:04.487081 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-da34ea11-cb40-439c-905b-ed7807911856 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1464 microversion: 2.1 time: 0.144930 Jun 16 19:19:04.487659 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2941/5989] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:04 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:05.506211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c651dc7b-60d0-42c0-9376-d3ab9b959595 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:05.506936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c651dc7b-60d0-42c0-9376-d3ab9b959595 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:05.513431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c651dc7b-60d0-42c0-9376-d3ab9b959595 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.513900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c651dc7b-60d0-42c0-9376-d3ab9b959595 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:05.514707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c651dc7b-60d0-42c0-9376-d3ab9b959595 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.515162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c651dc7b-60d0-42c0-9376-d3ab9b959595 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:05.645253 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c651dc7b-60d0-42c0-9376-d3ab9b959595 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1650 microversion: 2.1 time: 0.144559 Jun 16 19:19:05.645843 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3049/5990] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:05 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1650 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:05.661789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c85c6435-9104-4deb-b893-90f0cd57a21c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:05.662502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c85c6435-9104-4deb-b893-90f0cd57a21c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:05.670019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c85c6435-9104-4deb-b893-90f0cd57a21c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.670481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c85c6435-9104-4deb-b893-90f0cd57a21c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:05.671555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c85c6435-9104-4deb-b893-90f0cd57a21c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.672037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c85c6435-9104-4deb-b893-90f0cd57a21c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:05.805174 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c85c6435-9104-4deb-b893-90f0cd57a21c tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1650 microversion: 2.1 time: 0.147770 Jun 16 19:19:05.805762 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2942/5991] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:05 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1650 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:05.821414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6a4d54d1-9fcc-4a27-9991-26771dea9daa tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:05.822084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6a4d54d1-9fcc-4a27-9991-26771dea9daa tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:05.828434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a4d54d1-9fcc-4a27-9991-26771dea9daa tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.829368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a4d54d1-9fcc-4a27-9991-26771dea9daa tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:05.831218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a4d54d1-9fcc-4a27-9991-26771dea9daa tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.831861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a4d54d1-9fcc-4a27-9991-26771dea9daa tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:05.960945 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6a4d54d1-9fcc-4a27-9991-26771dea9daa tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1650 microversion: 2.1 time: 0.143251 Jun 16 19:19:05.961514 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3050/5992] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:05 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:05.977134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:05.977642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:05.983878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.984336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:05.985110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:05.985566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:06.011267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:19:06.089665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78b03908-8589-4844-b8e3-d56a8db10005 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 204 len: 0 microversion: 2.1 time: 0.115830 Jun 16 19:19:06.090856 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2943/5993] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:19:05 2022] DELETE /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:19:06.101996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a92d3091-cbd6-4af6-a57c-86941d3e1a13 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:06.102702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a92d3091-cbd6-4af6-a57c-86941d3e1a13 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:06.108890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a92d3091-cbd6-4af6-a57c-86941d3e1a13 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:06.109366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a92d3091-cbd6-4af6-a57c-86941d3e1a13 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:06.110239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a92d3091-cbd6-4af6-a57c-86941d3e1a13 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:06.110967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a92d3091-cbd6-4af6-a57c-86941d3e1a13 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:06.239596 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a92d3091-cbd6-4af6-a57c-86941d3e1a13 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1656 microversion: 2.1 time: 0.142322 Jun 16 19:19:06.240280 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3051/5994] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:06 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1656 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:07.258428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eddb1415-662b-4907-92ff-e05c1f262021 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:07.259149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eddb1415-662b-4907-92ff-e05c1f262021 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:07.261085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:07.268405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eddb1415-662b-4907-92ff-e05c1f262021 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:07.268871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eddb1415-662b-4907-92ff-e05c1f262021 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:07.269649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eddb1415-662b-4907-92ff-e05c1f262021 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:07.270128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eddb1415-662b-4907-92ff-e05c1f262021 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:07.400099 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eddb1415-662b-4907-92ff-e05c1f262021 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 200 len: 1656 microversion: 2.1 time: 0.145758 Jun 16 19:19:07.400695 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2944/5995] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:07 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 1656 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:07.834879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fb74b7e2-37ce-44e4-864c-8e281b0efbfc req-acc9b994-5bcf-40aa-a904-c375bbeaf801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f313fdb-9a70-462e-984f-c98fffec58e5", "name": "network-vif-deleted", "tag": "d999b453-7872-40b2-82ea-e95aeb27944d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:19:07.843248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:07.844336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:07.848104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb74b7e2-37ce-44e4-864c-8e281b0efbfc req-acc9b994-5bcf-40aa-a904-c375bbeaf801 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:07.848570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fb74b7e2-37ce-44e4-864c-8e281b0efbfc req-acc9b994-5bcf-40aa-a904-c375bbeaf801 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:07.870910 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fb74b7e2-37ce-44e4-864c-8e281b0efbfc req-acc9b994-5bcf-40aa-a904-c375bbeaf801 service nova] Creating event network-vif-deleted:d999b453-7872-40b2-82ea-e95aeb27944d for instance 3f313fdb-9a70-462e-984f-c98fffec58e5 on n-h2-846209-2 Jun 16 19:19:07.877066 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fb74b7e2-37ce-44e4-864c-8e281b0efbfc req-acc9b994-5bcf-40aa-a904-c375bbeaf801 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046911 Jun 16 19:19:07.878942 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3052/5996] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:19:08.418662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:08.419268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: 3f313fdb-9a70-462e-984f-c98fffec58e5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:08.426858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:08.427337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:08.428103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:08.428539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:08.442009 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] HTTP exception thrown: Instance 3f313fdb-9a70-462e-984f-c98fffec58e5 could not be found. Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Request method failure captured: Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 HTTP/1.1 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4IUdYvZYSHEglv0PYLo-SSAj0l3aZp_0n1pPyjsuJfq1BdV_IPbzVc9P8amOAtKmOPBz58AtrdZYcAGTmzcsGYoFjKSTrgqRvpqLeAfZkridKaCaRvr1XGKay5SM58OGutICoDu53X84YTcO_a8teSZoReIWzv4JJFasKa5bF6o1WU Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 7ab14ea223744a81974eb6d9f95747a6 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestServerMultinode-1055180616 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ab14ea223744a81974eb6d9f95747a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ab14ea223744a81974eb6d9f95747a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ab14ea223744a81974eb6d9f95747a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ab14ea223744a81974eb6d9f95747a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestServerMultinode-1055180616 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 7ab14ea223744a81974eb6d9f95747a6 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestServerMultinode-1055180616 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestServerMultinode-1055180616-project-admin Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6b04bec50e0146c1a2eb4e58f720f939 Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestServerMultinode-1055180616-project-admin Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 3f313fdb-9a70-462e-984f-c98fffec58e5 could not be found. Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '3f313fdb-9a70-462e-984f-c98fffec58e5'} Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f313fdb-9a70-462e-984f-c98fffec58e5 could not be found. Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f313fdb-9a70-462e-984f-c98fffec58e5 could not be found. Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:19:08.443657 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f313fdb-9a70-462e-984f-c98fffec58e5 could not be found. Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Returning 404 to user: Instance 3f313fdb-9a70-462e-984f-c98fffec58e5 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dc17ade8-788e-4bf3-9bf2-de9beb459608 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5" status: 404 len: 111 microversion: 2.1 time: 0.030709 Jun 16 19:19:08.449410 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2945/5997] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:08 2022] GET /compute/v2.1/servers/3f313fdb-9a70-462e-984f-c98fffec58e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:19:08.454538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:08.455536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:08.461516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:08.461988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:08.462780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:08.463240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:08.488718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:19:08.570232 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-68614505-b2be-4c7f-a1df-fb209881e644 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 204 len: 0 microversion: 2.1 time: 0.119626 Jun 16 19:19:08.570934 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3053/5998] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:19:08 2022] DELETE /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:19:08.580599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4f00f216-7b0d-45dd-b6a8-91446f96d206 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:08.581234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4f00f216-7b0d-45dd-b6a8-91446f96d206 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:08.589358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f00f216-7b0d-45dd-b6a8-91446f96d206 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:08.589879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f00f216-7b0d-45dd-b6a8-91446f96d206 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:08.590763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f00f216-7b0d-45dd-b6a8-91446f96d206 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:08.591214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f00f216-7b0d-45dd-b6a8-91446f96d206 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:08.723303 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4f00f216-7b0d-45dd-b6a8-91446f96d206 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1655 microversion: 2.1 time: 0.147552 Jun 16 19:19:08.723876 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2946/5999] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:08 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:09.741216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6acff5eb-de71-4dba-a7f6-5b56ce31b9df tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:09.741984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6acff5eb-de71-4dba-a7f6-5b56ce31b9df tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:09.749573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6acff5eb-de71-4dba-a7f6-5b56ce31b9df tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:09.750083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6acff5eb-de71-4dba-a7f6-5b56ce31b9df tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:09.750866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6acff5eb-de71-4dba-a7f6-5b56ce31b9df tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:09.751338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6acff5eb-de71-4dba-a7f6-5b56ce31b9df tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:09.889715 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6acff5eb-de71-4dba-a7f6-5b56ce31b9df tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1655 microversion: 2.1 time: 0.152626 Jun 16 19:19:09.890317 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3054/6000] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:09 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:10.455680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f688f1d7-9ace-40cd-9fae-c9cbf96feca0 req-05a31631-e363-4f22-9508-0724e08ad38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c8a606-c78b-4152-bcf8-bad505b433e3", "name": "network-vif-deleted", "tag": "5d3e0bf3-c729-4a57-8840-5ac4af00d9b3"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:19:10.473206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f688f1d7-9ace-40cd-9fae-c9cbf96feca0 req-05a31631-e363-4f22-9508-0724e08ad38c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:10.473662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f688f1d7-9ace-40cd-9fae-c9cbf96feca0 req-05a31631-e363-4f22-9508-0724e08ad38c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:10.478375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:10.487817 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f688f1d7-9ace-40cd-9fae-c9cbf96feca0 req-05a31631-e363-4f22-9508-0724e08ad38c service nova] Creating event network-vif-deleted:5d3e0bf3-c729-4a57-8840-5ac4af00d9b3 for instance a6c8a606-c78b-4152-bcf8-bad505b433e3 on n-h1-846209-2 Jun 16 19:19:10.493973 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f688f1d7-9ace-40cd-9fae-c9cbf96feca0 req-05a31631-e363-4f22-9508-0724e08ad38c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042503 Jun 16 19:19:10.494935 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2947/6001] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:19:10.909988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:10.910763 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:10.918864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:10.919339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:10.920125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:10.920583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:10.942309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:10.959774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:10.960402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:10.961067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lazy-loading 'fault' on Instance uuid a6c8a606-c78b-4152-bcf8-bad505b433e3 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:19:11.013890 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9e5bd8a1-4fe0-49e9-b4ff-1f95632e56e5 tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 200 len: 1454 microversion: 2.1 time: 0.109837 Jun 16 19:19:11.014498 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3055/6002] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:10 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:12.032664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:12.033508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] [instance: a6c8a606-c78b-4152-bcf8-bad505b433e3] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:12.041201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:12.041663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:12.042481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:12.042929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:12.056634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] HTTP exception thrown: Instance a6c8a606-c78b-4152-bcf8-bad505b433e3 could not be found. Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Request method failure captured: Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 HTTP/1.1 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4IUdYvZYSHEglv0PYLo-SSAj0l3aZp_0n1pPyjsuJfq1BdV_IPbzVc9P8amOAtKmOPBz58AtrdZYcAGTmzcsGYoFjKSTrgqRvpqLeAfZkridKaCaRvr1XGKay5SM58OGutICoDu53X84YTcO_a8teSZoReIWzv4JJFasKa5bF6o1WU Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 7ab14ea223744a81974eb6d9f95747a6 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestServerMultinode-1055180616 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ab14ea223744a81974eb6d9f95747a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ab14ea223744a81974eb6d9f95747a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ab14ea223744a81974eb6d9f95747a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ab14ea223744a81974eb6d9f95747a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestServerMultinode-1055180616 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 7ab14ea223744a81974eb6d9f95747a6 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestServerMultinode-1055180616 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestServerMultinode-1055180616-project-admin Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6b04bec50e0146c1a2eb4e58f720f939 Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestServerMultinode-1055180616-project-admin Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a6c8a606-c78b-4152-bcf8-bad505b433e3 could not be found. Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a6c8a606-c78b-4152-bcf8-bad505b433e3'} Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c8a606-c78b-4152-bcf8-bad505b433e3 could not be found. Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c8a606-c78b-4152-bcf8-bad505b433e3 could not be found. Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:19:12.058314 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c8a606-c78b-4152-bcf8-bad505b433e3 could not be found. Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] Returning 404 to user: Instance a6c8a606-c78b-4152-bcf8-bad505b433e3 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cc568a92-eb6a-46c7-8ced-78e8fe87423e tempest-TestServerMultinode-1055180616 tempest-TestServerMultinode-1055180616-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3" status: 404 len: 111 microversion: 2.1 time: 0.032150 Jun 16 19:19:12.063499 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2948/6003] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:12 2022] GET /compute/v2.1/servers/a6c8a606-c78b-4152-bcf8-bad505b433e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:19:46.708444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-437789772", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-998173704", "security_groups": [{"name": "tempest-secgroup-smoke-209112256"}], "block_device_mapping_v2": [{"uuid": "60fdd364-5e48-443c-ab66-9e885fdb8c45", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b0a-381d-4be1-a4a0-bfd044486ffa"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:19:46.717169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:46.717841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:46.834905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] validate_networks() for [('06296b0a-381d-4be1-a4a0-bfd044486ffa', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:19:47.273312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:19:47.273872 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:19:47.274680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:19:47.275306 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:19:47.275842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:19:47.290175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:47.291021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:47.292518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:47.293350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:47.316091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:19:47.323141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Getting quotas for user 6e3290377ed54fb59c66e342a8886701 and project 7503a0204b234d05bbed3e81e0485797. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:19:47.384801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:19:47.386982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60fdd364-5e48-443c-ab66-9e885fdb8c45',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:19:47.515622 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a174456-ccc9-49ca-bd72-42bcd68cedff tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811095 Jun 16 19:19:47.516944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3056/6004] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:19:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:19:47.529398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bbd2ec75-2a15-4ec9-8a15-385aa7714284 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:47.530013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bbd2ec75-2a15-4ec9-8a15-385aa7714284 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:47.533200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:47.534661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:47.592009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bbd2ec75-2a15-4ec9-8a15-385aa7714284 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:47.599237 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bbd2ec75-2a15-4ec9-8a15-385aa7714284 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1093 microversion: 2.1 time: 0.074131 Jun 16 19:19:47.599821 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2949/6005] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:47 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:48.616456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:48.617101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:48.626075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:48.626637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:48.628556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:48.629021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:48.714262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:48.723386 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f3cd57e0-79a7-4b8a-b36d-62b933ab79e8 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1209 microversion: 2.1 time: 0.111299 Jun 16 19:19:48.724193 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3057/6006] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:48 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:49.750198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:49.751902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:49.760955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:49.761839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:49.762884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:49.763523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:49.991628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:50.002554 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d54d2ef-2e52-4efc-b7e4-da47d6b2c511 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1276 microversion: 2.1 time: 0.265069 Jun 16 19:19:50.003092 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2950/6007] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:49 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:19:50.138054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a7e480a9-3605-40a2-a1ce-dc6401237920 req-d46865c2-533d-4b48-b272-d8cce3ad4fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c91599-183e-486d-96b8-451fe675fcf4", "tag": "a5b9228c-b423-430f-b3e1-27fb7f5cd417"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:19:50.166200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a7e480a9-3605-40a2-a1ce-dc6401237920 req-d46865c2-533d-4b48-b272-d8cce3ad4fff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:50.166911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a7e480a9-3605-40a2-a1ce-dc6401237920 req-d46865c2-533d-4b48-b272-d8cce3ad4fff service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:50.192638 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a7e480a9-3605-40a2-a1ce-dc6401237920 req-d46865c2-533d-4b48-b272-d8cce3ad4fff service nova] Creating event network-changed:a5b9228c-b423-430f-b3e1-27fb7f5cd417 for instance 86c91599-183e-486d-96b8-451fe675fcf4 on n-h1-846209-2 Jun 16 19:19:50.198103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a7e480a9-3605-40a2-a1ce-dc6401237920 req-d46865c2-533d-4b48-b272-d8cce3ad4fff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066228 Jun 16 19:19:50.199742 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3058/6008] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:19:51.020239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:51.020857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:51.028949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:51.029407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:51.030462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:51.030913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:51.246113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:51.254109 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fe77d878-94a4-476f-807e-1454def5b4e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1276 microversion: 2.1 time: 0.238695 Jun 16 19:19:51.254687 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2951/6009] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:51 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:52.272961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:52.273724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:52.280261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:52.280744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:52.281539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:52.282543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:52.424524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:52.433826 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6c6c2c1e-035b-4230-be55-0ca310647e0e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1276 microversion: 2.1 time: 0.166354 Jun 16 19:19:52.434793 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3059/6010] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:52 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:53.451673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:53.452592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:53.460209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:53.460674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:53.461497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:53.461963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:53.607543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:53.615928 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-797634fb-53cb-47c0-8595-7c479a315d73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1276 microversion: 2.1 time: 0.168293 Jun 16 19:19:53.616766 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2952/6011] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:53 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:54.632955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:54.633504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:54.640628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:54.641099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:54.642551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:54.642998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:54.776143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:54.784055 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-643a6a65-07f9-4706-aaf4-96c1ff7e8914 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.155187 Jun 16 19:19:54.784630 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3060/6012] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:54 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:55.802576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:55.803306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:55.810726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:55.811185 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:55.812221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:55.812714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:55.953056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:55.961948 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bd855854-0b27-4ba6-83e3-6826691ad1e3 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.164936 Jun 16 19:19:55.962525 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2953/6013] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:55 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:56.978346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:56.978983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:56.986455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:56.986931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:56.987718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:56.988181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:57.123900 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:57.131778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6ddd2264-979f-4bb1-a497-4651a61b8afc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.157587 Jun 16 19:19:57.132365 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3061/6014] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:56 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:58.147638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:58.148260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:58.151046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:58.156470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:58.157722 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:58.159136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:58.159592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:58.295471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:58.303895 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d7642920-d801-4b23-9d0b-60b1deef12f5 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.160125 Jun 16 19:19:58.304450 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2954/6015] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:58 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:19:59.320834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:19:59.321475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:19:59.323607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:59.324366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:19:59.331739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:59.332214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:59.333079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:19:59.333534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:19:59.474501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:19:59.482446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8fea47e2-61ad-48c0-98b2-357c6ec69971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.165683 Jun 16 19:19:59.483016 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3062/6016] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:19:59 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:20:00.500753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:20:00.501322 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:20:00.508301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:00.508849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:00.509654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:00.510136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:00.646350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:20:00.654799 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f4ae54d6-006c-40eb-a158-1b7b2421b4fb tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.158176 Jun 16 19:20:00.655485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2955/6017] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:20:00 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:20:01.675049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:20:01.675665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:20:01.682761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:01.683240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:01.684026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:01.684483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:01.821424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:20:01.830286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ea7a96bb-d8f0-413e-a705-5dc561b4e62b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.160168 Jun 16 19:20:01.830870 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3063/6018] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:20:01 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:20:02.849670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:20:02.850319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:20:02.856848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:02.857295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:02.858084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:02.858520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:02.993395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:20:03.001703 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9efa9a39-9713-4cde-95a6-4f201a05cb02 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.157900 Jun 16 19:20:03.002340 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2956/6019] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:20:02 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:20:03.166226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-75aa55aa-9e6d-44e9-94ad-a3784368b667 req-80c5224e-ebb5-4a2d-b5d1-b6a3a25d1004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c91599-183e-486d-96b8-451fe675fcf4", "name": "network-vif-plugged", "status": "completed", "tag": "a5b9228c-b423-430f-b3e1-27fb7f5cd417"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:20:03.178209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75aa55aa-9e6d-44e9-94ad-a3784368b667 req-80c5224e-ebb5-4a2d-b5d1-b6a3a25d1004 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:03.178704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-75aa55aa-9e6d-44e9-94ad-a3784368b667 req-80c5224e-ebb5-4a2d-b5d1-b6a3a25d1004 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:03.191621 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-75aa55aa-9e6d-44e9-94ad-a3784368b667 req-80c5224e-ebb5-4a2d-b5d1-b6a3a25d1004 service nova] Creating event network-vif-plugged:a5b9228c-b423-430f-b3e1-27fb7f5cd417 for instance 86c91599-183e-486d-96b8-451fe675fcf4 on n-h1-846209-2 Jun 16 19:20:03.197068 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-75aa55aa-9e6d-44e9-94ad-a3784368b667 req-80c5224e-ebb5-4a2d-b5d1-b6a3a25d1004 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 Jun 16 19:20:03.197696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3064/6020] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:20:04.020914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:20:04.021570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:20:04.028718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:04.029180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:04.029997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:04.030452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:04.166764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:20:04.175420 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e07a2a37-2c3f-495c-adad-9e6ba1842603 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1264 microversion: 2.1 time: 0.158527 Jun 16 19:20:04.175996 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2957/6021] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:20:04 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:20:05.194049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:20:05.194766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:20:05.201971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:05.202437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:05.203215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:05.204488 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:05.337722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:20:05.346112 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-604183db-4766-4003-bd76-4a22ed18095e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1451 microversion: 2.1 time: 0.156410 Jun 16 19:20:05.346696 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3065/6022] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:20:05 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:20:05.362503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:20:05.363125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:20:05.370266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:05.371150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:05.371482 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:05.371921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:05.508154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:20:05.516426 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7116eb23-3a1c-4d0f-ad51-6c4bcef7b5ab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1451 microversion: 2.1 time: 0.157811 Jun 16 19:20:05.517090 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2958/6023] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:20:05 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:20:07.429422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-dcfdf538-3c47-466e-bcfc-dbbfd17cb5dd req-317210af-d78a-48cb-98a8-88c353e58b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c91599-183e-486d-96b8-451fe675fcf4", "tag": "a5b9228c-b423-430f-b3e1-27fb7f5cd417"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:20:07.437489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dcfdf538-3c47-466e-bcfc-dbbfd17cb5dd req-317210af-d78a-48cb-98a8-88c353e58b88 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:20:07.438786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-dcfdf538-3c47-466e-bcfc-dbbfd17cb5dd req-317210af-d78a-48cb-98a8-88c353e58b88 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:20:07.450855 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-dcfdf538-3c47-466e-bcfc-dbbfd17cb5dd req-317210af-d78a-48cb-98a8-88c353e58b88 service nova] Creating event network-changed:a5b9228c-b423-430f-b3e1-27fb7f5cd417 for instance 86c91599-183e-486d-96b8-451fe675fcf4 on n-h1-846209-2 Jun 16 19:20:07.456770 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-dcfdf538-3c47-466e-bcfc-dbbfd17cb5dd req-317210af-d78a-48cb-98a8-88c353e58b88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031999 Jun 16 19:20:07.457736 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3066/6024] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:20:24.507319 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:20:24.507965 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:20:24.515127 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:20:24.515269 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:21:46.974448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=22 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:21:46.975212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=54 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:21:46.981279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:46.982079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:46.985340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:21:46.986770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=50 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:21:46.988747 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:46.989490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:46.990438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:46.991121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:47.019430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:21:47.091857 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [fd6a8d41-3289-416b-9ff6-63193819d7a6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:21:47.186697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-64adf766-b2b1-4835-a270-890b67bb4faf req-5cbb51a9-b784-4464-a319-20a7a22915d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c91599-183e-486d-96b8-451fe675fcf4", "tag": "a5b9228c-b423-430f-b3e1-27fb7f5cd417"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:21:47.195133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-64adf766-b2b1-4835-a270-890b67bb4faf req-5cbb51a9-b784-4464-a319-20a7a22915d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:47.196211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-64adf766-b2b1-4835-a270-890b67bb4faf req-5cbb51a9-b784-4464-a319-20a7a22915d7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:47.208531 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-64adf766-b2b1-4835-a270-890b67bb4faf req-5cbb51a9-b784-4464-a319-20a7a22915d7 service nova] Creating event network-changed:a5b9228c-b423-430f-b3e1-27fb7f5cd417 for instance 86c91599-183e-486d-96b8-451fe675fcf4 on n-h1-846209-2 Jun 16 19:21:47.214755 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-64adf766-b2b1-4835-a270-890b67bb4faf req-5cbb51a9-b784-4464-a319-20a7a22915d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231450 Jun 16 19:21:47.215461 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3067/6025] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:21:48.098948 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [fd6a8d41-3289-416b-9ff6-63193819d7a6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 37010. Jun 16 19:21:48.123969 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3711a4d0-f1f0-4d34-a767-043ca5b14dd7 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 204 len: 0 microversion: 2.1 time: 1.151304 Jun 16 19:21:48.124572 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2959/6026] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:21:46 2022] DELETE /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 0 bytes in 1153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:21:48.133573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:48.134260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:48.141652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:48.142160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:48.142948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:48.143395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:48.279160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:21:48.287011 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e0b82e49-c9e0-4c3c-a476-a94a71d2bd66 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1457 microversion: 2.1 time: 0.157887 Jun 16 19:21:48.287591 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3068/6027] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:48 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:21:49.306170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:49.306915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:49.314832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:49.315284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:49.316055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:49.316491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:49.455846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:21:49.463662 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-13bc7db0-9e24-4795-a589-6677b2a7dc11 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1457 microversion: 2.1 time: 0.162600 Jun 16 19:21:49.464252 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2960/6028] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:49 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1457 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:21:50.332541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d50c737c-9fb4-4a61-8aab-5f781a89c39b req-8388a9b8-12de-4e0e-b126-c5f31d96fae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c91599-183e-486d-96b8-451fe675fcf4", "name": "network-vif-deleted", "tag": "a5b9228c-b423-430f-b3e1-27fb7f5cd417"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:21:50.344366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d50c737c-9fb4-4a61-8aab-5f781a89c39b req-8388a9b8-12de-4e0e-b126-c5f31d96fae4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:50.345491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d50c737c-9fb4-4a61-8aab-5f781a89c39b req-8388a9b8-12de-4e0e-b126-c5f31d96fae4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:50.361736 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d50c737c-9fb4-4a61-8aab-5f781a89c39b req-8388a9b8-12de-4e0e-b126-c5f31d96fae4 service nova] Creating event network-vif-deleted:a5b9228c-b423-430f-b3e1-27fb7f5cd417 for instance 86c91599-183e-486d-96b8-451fe675fcf4 on n-h1-846209-2 Jun 16 19:21:50.371022 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d50c737c-9fb4-4a61-8aab-5f781a89c39b req-8388a9b8-12de-4e0e-b126-c5f31d96fae4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042180 Jun 16 19:21:50.371657 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3069/6029] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:21:50.484882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:50.485505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:50.492753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:50.493211 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:50.494014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:50.494451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:50.558745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:21:50.566529 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c3a1dace-184a-491d-a1af-c0479241e54e tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1224 microversion: 2.1 time: 0.086874 Jun 16 19:21:50.567175 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2961/6030] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:50 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:21:51.585650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:51.586285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:51.592648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:51.593116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:51.593896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:51.594396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:51.662848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:21:51.671220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c99d2781-6169-4c8a-af0e-376634d36c91 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1224 microversion: 2.1 time: 0.090802 Jun 16 19:21:51.671835 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3070/6031] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:51 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:21:52.688719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:52.689336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:52.696518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:52.696979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:52.697768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:52.698316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:52.766104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:21:52.774200 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dde9b437-a0c2-466d-8e8e-45d8008cdd2a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1224 microversion: 2.1 time: 0.089340 Jun 16 19:21:52.776048 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2962/6032] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:52 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:21:53.793076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:53.793718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:53.801063 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:53.801540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:53.802417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:53.802843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:53.866121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:21:53.875978 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c11a1ed3-dd17-4dc6-a1e7-6ce8349cd3f6 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1224 microversion: 2.1 time: 0.087284 Jun 16 19:21:53.876727 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3071/6033] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:53 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:21:54.894657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:54.895199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:54.902892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:54.903353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:54.904134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:54.904579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:54.938915 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:54.939373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:54.939826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lazy-loading 'fault' on Instance uuid 86c91599-183e-486d-96b8-451fe675fcf4 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:21:54.985867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:21:54.995410 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7434ebe6-6c25-41f9-b5f1-2d2b5740cb96 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 200 len: 1229 microversion: 2.1 time: 0.104814 Jun 16 19:21:54.996004 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2963/6034] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:54 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:21:56.013084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:21:56.013721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 86c91599-183e-486d-96b8-451fe675fcf4] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:21:56.020809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:56.021282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:56.022102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:21:56.022561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:21:56.037039 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance 86c91599-183e-486d-96b8-451fe675fcf4 could not be found. Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 HTTP/1.1 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 86c91599-183e-486d-96b8-451fe675fcf4 could not be found. Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '86c91599-183e-486d-96b8-451fe675fcf4'} Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c91599-183e-486d-96b8-451fe675fcf4 could not be found. Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c91599-183e-486d-96b8-451fe675fcf4 could not be found. Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:21:56.038757 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c91599-183e-486d-96b8-451fe675fcf4 could not be found. Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance 86c91599-183e-486d-96b8-451fe675fcf4 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-52b14e91-ba95-4815-863b-8ac28ed8aa5a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4" status: 404 len: 111 microversion: 2.1 time: 0.031730 Jun 16 19:21:56.045189 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3072/6035] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:21:56 2022] GET /compute/v2.1/servers/86c91599-183e-486d-96b8-451fe675fcf4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:22:02.588623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:02.589226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:02.590130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-3775f1d4-4b10-4498-a7a1-8eba44718ab7 req-4326dcaf-a09c-4672-955f-f6bae1dbec0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b28848a-25ee-4e81-b08d-bf849255e0a5", "tag": "adb531ba-b9e1-480b-a00c-7e375e94467f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:02.596406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:02.596868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:02.597652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:02.598124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:02.600700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3775f1d4-4b10-4498-a7a1-8eba44718ab7 req-4326dcaf-a09c-4672-955f-f6bae1dbec0a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:02.601304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-3775f1d4-4b10-4498-a7a1-8eba44718ab7 req-4326dcaf-a09c-4672-955f-f6bae1dbec0a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:02.614922 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-3775f1d4-4b10-4498-a7a1-8eba44718ab7 req-4326dcaf-a09c-4672-955f-f6bae1dbec0a service nova] Creating event network-changed:adb531ba-b9e1-480b-a00c-7e375e94467f for instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 on n-h2-846209-2 Jun 16 19:22:02.621574 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-3775f1d4-4b10-4498-a7a1-8eba44718ab7 req-4326dcaf-a09c-4672-955f-f6bae1dbec0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035634 Jun 16 19:22:02.623357 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3073/6036] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:22:02.628410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:22:02.721287 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9be7eb10-f1b5-479b-9d94-44802b117c77 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 204 len: 0 microversion: 2.1 time: 0.137424 Jun 16 19:22:02.722403 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2964/6037] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:22:02 2022] DELETE /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:22:02.732252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:02.733046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:02.749385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:02.749942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:02.750825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:02.751288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:02.890698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:02.898576 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c5e4c472-75cf-4d09-8571-717128c06a73 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1578 microversion: 2.1 time: 0.171690 Jun 16 19:22:02.899162 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3074/6038] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:02 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:03.919701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:03.920478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:03.929493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:03.929968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:03.930817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:03.931577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:04.078307 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:04.085977 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1cc55cd3-3e66-4eab-b0d4-f850cf55d971 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1578 microversion: 2.1 time: 0.172823 Jun 16 19:22:04.086744 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2965/6039] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:03 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:05.073304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9cb99937-2049-44f3-834c-62a093260f1f req-6f8e19ae-0fa1-4263-990a-b3d64bf20fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b28848a-25ee-4e81-b08d-bf849255e0a5", "name": "network-vif-deleted", "tag": "adb531ba-b9e1-480b-a00c-7e375e94467f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:05.082749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9cb99937-2049-44f3-834c-62a093260f1f req-6f8e19ae-0fa1-4263-990a-b3d64bf20fbf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:05.083219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9cb99937-2049-44f3-834c-62a093260f1f req-6f8e19ae-0fa1-4263-990a-b3d64bf20fbf service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:05.096039 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9cb99937-2049-44f3-834c-62a093260f1f req-6f8e19ae-0fa1-4263-990a-b3d64bf20fbf service nova] Creating event network-vif-deleted:adb531ba-b9e1-480b-a00c-7e375e94467f for instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 on n-h2-846209-2 Jun 16 19:22:05.101146 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9cb99937-2049-44f3-834c-62a093260f1f req-6f8e19ae-0fa1-4263-990a-b3d64bf20fbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111834 Jun 16 19:22:05.101770 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3075/6040] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:22:05.108602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:05.109409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:05.117203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:05.117697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:05.119283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:05.119738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:05.188405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:05.196316 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-60467835-562d-4ec6-89c3-bbbba33d633a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1225 microversion: 2.1 time: 0.095927 Jun 16 19:22:05.196975 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2966/6041] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:05 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:22:06.098749 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:22:06.099347 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:22:06.215448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:06.216201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:06.222657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:06.223135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:06.223994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:06.224454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:06.287690 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:06.296244 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-785e7337-0c1d-4248-a707-e289aedb3e5c tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1225 microversion: 2.1 time: 0.086723 Jun 16 19:22:06.296822 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3076/6042] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:06 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:06.565095 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:22:06.565327 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:22:07.312818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:07.313430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:07.320691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:07.321144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:07.322504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:07.322938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:07.393119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:07.402006 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0ea6e36b-2fd0-4249-89ba-ccb15d360314 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1225 microversion: 2.1 time: 0.093050 Jun 16 19:22:07.402623 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2967/6043] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:07 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:08.419005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:08.419756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:08.427191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:08.427743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:08.428612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:08.429070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:08.495106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:08.502772 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-543ac64c-6153-4e5a-8517-0bb734e36984 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1225 microversion: 2.1 time: 0.087791 Jun 16 19:22:08.503346 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3077/6044] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:08 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:09.519519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:09.520156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:09.527931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:09.528387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:09.529233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:09.529680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:09.564647 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:09.565098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:09.565557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lazy-loading 'fault' on Instance uuid 4b28848a-25ee-4e81-b08d-bf849255e0a5 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:22:09.614986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3290377ed54fb59c66e342a8886701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503a0204b234d05bbed3e81e0485797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:09.623109 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a6371d7e-bcca-4710-86ac-0866ab999dab tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 200 len: 1184 microversion: 2.1 time: 0.107488 Jun 16 19:22:09.623621 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2968/6045] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:09 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 1184 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:10.641597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:10.642209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: 4b28848a-25ee-4e81-b08d-bf849255e0a5] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:10.649135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:10.649606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:10.650612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:10.651019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:10.664548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 could not be found. Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 HTTP/1.1 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 could not be found. Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '4b28848a-25ee-4e81-b08d-bf849255e0a5'} Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 could not be found. Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 could not be found. Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:10.666436 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 could not be found. Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance 4b28848a-25ee-4e81-b08d-bf849255e0a5 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-51335150-51df-4a73-a79a-89ada14b6587 tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5" status: 404 len: 111 microversion: 2.1 time: 0.030350 Jun 16 19:22:10.672767 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3078/6046] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:10 2022] GET /compute/v2.1/servers/4b28848a-25ee-4e81-b08d-bf849255e0a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:22:11.112929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:11.113464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:11.121157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:11.121618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:11.122417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:11.122867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:11.136382 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 HTTP/1.1 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'a816db3b-f90d-445f-b0e6-9b0d73981b39'} Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:22:11.138075 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72e9381f-ec9a-4b1e-986e-569094d01a3a tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 404 len: 111 microversion: 2.1 time: 0.030565 Jun 16 19:22:11.146710 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2969/6047] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:22:11 2022] DELETE /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:22:11.148226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:11.148860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] [instance: a816db3b-f90d-445f-b0e6-9b0d73981b39] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:11.155302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:11.155773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:11.156550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:11.157004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:11.172018 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] HTTP exception thrown: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Request method failure captured: Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 HTTP/1.1 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4BWbm5JBps1x424k1oVexZD0DcSIYHCllhuanX1jHTkbAtIcWdw7pbt5EHNBBi-znszLr0jRCJhMlIKQ8qK0EdnvDu2T8ZXgO1i-GM1jD7dzWMwuG769Q3Put8t2SRUIOSKmOh51gBTaCCT2VfHgHSr_Sl6WahZ5BOyZ5VWdCkM7lA Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7503a0204b234d05bbed3e81e0485797", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7503a0204b234d05bbed3e81e0485797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 7503a0204b234d05bbed3e81e0485797 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestVolumeBootPattern-1016818364 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6e3290377ed54fb59c66e342a8886701 Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestVolumeBootPattern-1016818364-project Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'a816db3b-f90d-445f-b0e6-9b0d73981b39'} Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:11.173833 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Returning 404 to user: Instance a816db3b-f90d-445f-b0e6-9b0d73981b39 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f29b29e9-323b-4655-855e-03ed438927fc tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39" status: 404 len: 111 microversion: 2.1 time: 0.030995 Jun 16 19:22:11.178809 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3079/6048] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:11 2022] GET /compute/v2.1/servers/a816db3b-f90d-445f-b0e6-9b0d73981b39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:22:14.604749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-626674f1-5b25-44df-aaa9-3a7de3c3bc4b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] Calling method '.version_select at 0x7f866d9501f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:14.639076 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-626674f1-5b25-44df-aaa9-3a7de3c3bc4b tempest-TestVolumeBootPattern-1016818364 tempest-TestVolumeBootPattern-1016818364-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-998173704" status: 202 len: 0 microversion: 2.1 time: 0.039995 Jun 16 19:22:14.640702 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2970/6049] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jun 16 19:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-998173704 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:22:32.602601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=26 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:32.603351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=50 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:32.715607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1889249105", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:32.765431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] validate_networks() for None {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:22:32.956687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:22:32.957151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:22:32.957642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:22:32.958115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:22:32.958541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:22:32.967796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:32.968261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:32.969074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:32.969522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:32.987691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Getting quotas for project 6311c571a6074fb6841dd9ad6ad3680c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:22:32.992929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Getting quotas for user e16b1c0a7ae942f0b207db8a0537b2a9 and project 6311c571a6074fb6841dd9ad6ad3680c. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:22:33.005849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:22:33.008204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:22:33.054922 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-112fdb8b-484e-4461-be5e-27ef45b0586b tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457170 Jun 16 19:22:33.055583 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3080/6050] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:22:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:22:33.064343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:33.065188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:33.069497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f1bd8d9-6642-40cb-a669-725ded26b663 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:33.071815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f1bd8d9-6642-40cb-a669-725ded26b663 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:33.136583 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6f1bd8d9-6642-40cb-a669-725ded26b663 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:33.143502 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f1bd8d9-6642-40cb-a669-725ded26b663 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1222 microversion: 2.1 time: 0.080931 Jun 16 19:22:33.144270 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2971/6051] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:33 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:34.161543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:34.163439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:34.170085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:34.170559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:34.171358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:34.171814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:34.258914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:34.268842 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87e0ad41-6f46-4bc4-829c-aeb2621a0058 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1282 microversion: 2.1 time: 0.112017 Jun 16 19:22:34.279389 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3081/6052] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:34 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:35.287236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:35.287870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:35.295758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:35.296267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:35.297052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:35.297492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:35.508406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:35.520534 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d87d2574-7e8a-418d-bf9f-2d75295b43d0 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1322 microversion: 2.1 time: 0.237050 Jun 16 19:22:35.521517 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2972/6053] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:35 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:36.119203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a856f8df-baaf-4ba6-b21a-5a1f1a36fa80 req-19b53505-1dad-404a-a659-dc8970705a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4899451d-b840-4c3d-a274-bb9e044e6977", "tag": "50127e29-1118-4435-ae05-9bd215844a6e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:36.128685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a856f8df-baaf-4ba6-b21a-5a1f1a36fa80 req-19b53505-1dad-404a-a659-dc8970705a4f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:36.129850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a856f8df-baaf-4ba6-b21a-5a1f1a36fa80 req-19b53505-1dad-404a-a659-dc8970705a4f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:36.143523 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a856f8df-baaf-4ba6-b21a-5a1f1a36fa80 req-19b53505-1dad-404a-a659-dc8970705a4f service nova] Creating event network-changed:50127e29-1118-4435-ae05-9bd215844a6e for instance 4899451d-b840-4c3d-a274-bb9e044e6977 on n-h1-846209-2 Jun 16 19:22:36.149369 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a856f8df-baaf-4ba6-b21a-5a1f1a36fa80 req-19b53505-1dad-404a-a659-dc8970705a4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034470 Jun 16 19:22:36.150244 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3082/6054] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:22:36.538124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:36.538796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:36.545889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:36.546577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:36.547350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:36.548050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:36.688743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:36.696333 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aacdfc0d-3b55-408f-be10-a969763c4fb8 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1322 microversion: 2.1 time: 0.162234 Jun 16 19:22:36.696910 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2973/6055] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:36 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:37.715543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:37.716279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:37.722773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:37.723256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:37.724066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:37.724510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:37.927150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:37.935448 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-875a1dd0-0009-46f5-b4af-cd8c9859cdff tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1322 microversion: 2.1 time: 0.225916 Jun 16 19:22:37.936043 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3083/6056] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:37 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:38.953924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:38.954547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:38.961150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:38.961608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:38.962410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:38.962855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:39.099289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:39.107137 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3b77e64-b487-43dd-b746-cbc45e3a079f tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1322 microversion: 2.1 time: 0.157395 Jun 16 19:22:39.107727 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2974/6057] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:38 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:22:40.124984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:40.125721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:40.134071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:40.134548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:40.135382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:40.135892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:40.309045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:40.319123 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d0f2cc44-8b63-436e-8bef-f12d0316e55a tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1322 microversion: 2.1 time: 0.198721 Jun 16 19:22:40.321309 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3084/6058] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:40 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:41.339597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:41.340291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:41.347366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:41.347818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:41.348619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:41.349068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:41.482255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:41.489825 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8cb99ca3-a7e2-4666-a922-cd305037caaf tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1322 microversion: 2.1 time: 0.154841 Jun 16 19:22:41.490440 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2975/6059] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:41 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:41.952167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-278323e8-cf85-4c2f-827c-d2e015f9ab86 req-335f4349-8775-4aff-b807-916ef6aa95ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4899451d-b840-4c3d-a274-bb9e044e6977", "name": "network-vif-plugged", "status": "completed", "tag": "50127e29-1118-4435-ae05-9bd215844a6e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:41.961332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-278323e8-cf85-4c2f-827c-d2e015f9ab86 req-335f4349-8775-4aff-b807-916ef6aa95ce service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:41.961796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-278323e8-cf85-4c2f-827c-d2e015f9ab86 req-335f4349-8775-4aff-b807-916ef6aa95ce service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:41.975927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-278323e8-cf85-4c2f-827c-d2e015f9ab86 req-335f4349-8775-4aff-b807-916ef6aa95ce service nova] Creating event network-vif-plugged:50127e29-1118-4435-ae05-9bd215844a6e for instance 4899451d-b840-4c3d-a274-bb9e044e6977 on n-h1-846209-2 Jun 16 19:22:41.981698 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-278323e8-cf85-4c2f-827c-d2e015f9ab86 req-335f4349-8775-4aff-b807-916ef6aa95ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Jun 16 19:22:41.982346 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3085/6060] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:22:42.507681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:42.508384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:42.515961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:42.516419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:42.517201 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:42.517640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:42.651299 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:42.659048 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5fbced10-0283-45c6-8680-15c3dfbbadc1 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1322 microversion: 2.1 time: 0.155366 Jun 16 19:22:42.659627 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2976/6061] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:42 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:43.673750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:43.675034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:43.679355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:43.680082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:43.687504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:43.687976 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:43.688764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:43.689254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:43.823944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:43.831542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8db7b00f-9292-4c6b-9117-bc6cdc4446fa tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1472 microversion: 2.1 time: 0.159844 Jun 16 19:22:43.832152 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3086/6062] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:43 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1472 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:43.851325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:43.909997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-99d78d13-e0af-48c8-8452-7027ce325f8e tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Calling method '.version_select at 0x7f866e23f550>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:43.976943 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-99d78d13-e0af-48c8-8452-7027ce325f8e tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/bcd81a2f91be48e195fd1d678fa042e2" status: 200 len: 371 microversion: 2.1 time: 0.130293 Jun 16 19:22:43.977522 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2977/6063] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 19:22:43 2022] GET /compute/v2.1/os-quota-sets/bcd81a2f91be48e195fd1d678fa042e2 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:22:43.987881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d5be6775-c68d-4c84-8d8f-e999ad6f9c61 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1355899080", "id": 312044714, "os-flavor-access:is_public": "True"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:43.989489 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:22:43.989489 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 19:22:44.012724 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d5be6775-c68d-4c84-8d8f-e999ad6f9c61 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.028589 Jun 16 19:22:44.013346 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3087/6064] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:22:43 2022] POST /compute/v2.1/flavors => generated 435 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:22:44.024096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "312044714"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:44.025060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:44.033028 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.033537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.034346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.034789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.249429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '66eed896577e4b5589257fd3cdff8664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd81a2f91be48e195fd1d678fa042e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:44.256002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1355899080 {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:22:44.263085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.263616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.264506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.265024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.293003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Getting quotas for project 6311c571a6074fb6841dd9ad6ad3680c. Resources: {'cores', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:22:44.300437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Getting quotas for user e16b1c0a7ae942f0b207db8a0537b2a9 and project 6311c571a6074fb6841dd9ad6ad3680c. Resources: {'cores', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:22:44.314585 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.compute.api [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] ram quota exceeded for bcd81a2f91be48e195fd1d678fa042e2, tried to resize instance. Jun 16 19:22:44.315134 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Request method failure captured: Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977/action HTTP/1.1 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 38 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4L4CfHUFBDlCmeHaPSro8IXT3MKWlX1ihTEaUok8ihf1TwTUgTYg4jumwdYhoOUH5kTNEZc3TwCV74VmHren9SqXoPDfCIPTGq0X9AGW8MnVx38v6yFm4NjbQ4WHZQt_RNawgMWZ1ZitIYFrI-RuF_Bd38a9E3dY83K-a_Xiw5u87g Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: bcd81a2f91be48e195fd1d678fa042e2 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1939574774 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,admin,reader Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,admin,reader Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bcd81a2f91be48e195fd1d678fa042e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bcd81a2f91be48e195fd1d678fa042e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bcd81a2f91be48e195fd1d678fa042e2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bcd81a2f91be48e195fd1d678fa042e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1939574774 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: bcd81a2f91be48e195fd1d678fa042e2 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1939574774 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersAdminNegativeTestJSON-1939574774-project-admin Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 66eed896577e4b5589257fd3cdff8664 Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1939574774-project-admin Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: {"resize": {"flavorRef": "312044714"}} Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '4899451d-b840-4c3d-a274-bb9e044e6977', 'body': {'resize': {'flavorRef': '312044714'}}} Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:22:44.317150 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-23c9344a-9406-458c-aa75-d0b0307a71a4 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977/action" status: 403 len: 118 microversion: 2.1 time: 0.298566 Jun 16 19:22:44.324527 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2978/6065] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:22:44 2022] POST /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977/action => generated 118 bytes in 300 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:22:44.331805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-75953cec-102c-4f1d-aff5-d065d71b8fe0 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:44.331805 n-d-846209-2 devstack@n-api.service[119206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:22:44.331805 n-d-846209-2 devstack@n-api.service[119206]: warnings.warn(msg) Jun 16 19:22:44.345783 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-75953cec-102c-4f1d-aff5-d065d71b8fe0 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/312044714" status: 202 len: 0 microversion: 2.1 time: 0.021700 Jun 16 19:22:44.355616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dd44797d-68f9-43f6-9a98-f164a73c9fbf tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:44.358007 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3088/6066] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 19:22:44 2022] DELETE /compute/v2.1/flavors/312044714 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:22:44.374769 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dd44797d-68f9-43f6-9a98-f164a73c9fbf tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023823 Jun 16 19:22:44.375381 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2979/6067] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 19:22:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:44.391543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-687ac797-d477-42c6-93ce-01f92551f9b5 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Calling method '.version_select at 0x7f86781bb790>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:44.470413 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-687ac797-d477-42c6-93ce-01f92551f9b5 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/bcd81a2f91be48e195fd1d678fa042e2" status: 200 len: 371 microversion: 2.1 time: 0.082485 Jun 16 19:22:44.471012 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3089/6068] 10.222.0.27 () {58 vars in 1241 bytes} [Thu Jun 16 19:22:44 2022] GET /compute/v2.1/os-quota-sets/bcd81a2f91be48e195fd1d678fa042e2 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:22:44.481556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-692fe941-e478-40cc-a8db-0b70a80b5e22 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2115480976", "id": 585866906, "os-flavor-access:is_public": "True"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:44.483173 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:22:44.483173 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:22:44.499097 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-692fe941-e478-40cc-a8db-0b70a80b5e22 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021874 Jun 16 19:22:44.499705 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2980/6069] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:22:44 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:22:44.510882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "585866906"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:44.512047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:44.519905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.520378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.521213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.521663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.628059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '66eed896577e4b5589257fd3cdff8664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd81a2f91be48e195fd1d678fa042e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:44.635283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2115480976 {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:22:44.642105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.642568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.643421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.643868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.664486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Getting quotas for project 6311c571a6074fb6841dd9ad6ad3680c. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:22:44.670666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Getting quotas for user e16b1c0a7ae942f0b207db8a0537b2a9 and project 6311c571a6074fb6841dd9ad6ad3680c. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:22:44.683664 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] cores quota exceeded for bcd81a2f91be48e195fd1d678fa042e2, tried to resize instance. Jun 16 19:22:44.684346 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Request method failure captured: Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977/action HTTP/1.1 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 38 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4L4CfHUFBDlCmeHaPSro8IXT3MKWlX1ihTEaUok8ihf1TwTUgTYg4jumwdYhoOUH5kTNEZc3TwCV74VmHren9SqXoPDfCIPTGq0X9AGW8MnVx38v6yFm4NjbQ4WHZQt_RNawgMWZ1ZitIYFrI-RuF_Bd38a9E3dY83K-a_Xiw5u87g Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bcd81a2f91be48e195fd1d678fa042e2 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1939574774 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,admin,reader Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,admin,reader Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bcd81a2f91be48e195fd1d678fa042e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bcd81a2f91be48e195fd1d678fa042e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bcd81a2f91be48e195fd1d678fa042e2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bcd81a2f91be48e195fd1d678fa042e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1939574774 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bcd81a2f91be48e195fd1d678fa042e2 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1939574774 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersAdminNegativeTestJSON-1939574774-project-admin Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 66eed896577e4b5589257fd3cdff8664 Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1939574774-project-admin Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: {"resize": {"flavorRef": "585866906"}} Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '4899451d-b840-4c3d-a274-bb9e044e6977', 'body': {'resize': {'flavorRef': '585866906'}}} Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:22:44.686360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-640a9cfa-3008-44a5-a866-4ca25c19a5b6 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977/action" status: 403 len: 113 microversion: 2.1 time: 0.181015 Jun 16 19:22:44.691507 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3090/6070] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:22:44 2022] POST /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977/action => generated 113 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:22:44.696751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97907084-5b0a-42f8-a95f-c963e91ffab7 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:44.698072 n-d-846209-2 devstack@n-api.service[119207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:22:44.698072 n-d-846209-2 devstack@n-api.service[119207]: warnings.warn(msg) Jun 16 19:22:44.715923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97907084-5b0a-42f8-a95f-c963e91ffab7 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/585866906" status: 202 len: 0 microversion: 2.1 time: 0.022766 Jun 16 19:22:44.716529 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2981/6071] 10.222.0.27 () {58 vars in 1157 bytes} [Thu Jun 16 19:22:44 2022] DELETE /compute/v2.1/flavors/585866906 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:22:44.725390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd3f31ef-4e69-4276-9cda-a69e84b1cdd0 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:44.746659 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd3f31ef-4e69-4276-9cda-a69e84b1cdd0 tempest-ServersAdminNegativeTestJSON-1939574774 tempest-ServersAdminNegativeTestJSON-1939574774-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025626 Jun 16 19:22:44.747250 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3091/6072] 10.222.0.27 () {58 vars in 1145 bytes} [Thu Jun 16 19:22:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:44.764876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:44.765391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:44.771727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.772189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.772965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.773414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.799423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:22:44.875562 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8043c18-cd6f-41b0-8ba6-48994985cdda tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 204 len: 0 microversion: 2.1 time: 0.114726 Jun 16 19:22:44.876291 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2982/6073] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:22:44 2022] DELETE /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:22:44.884449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:44.885720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:44.892237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.892717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:44.893509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:44.894032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:45.026983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:45.034529 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b87fb58c-aef1-44dc-81d6-f5f8682d0e98 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1478 microversion: 2.1 time: 0.153993 Jun 16 19:22:45.035101 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3092/6074] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:44 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1478 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:46.052735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:46.053445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:46.061941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:46.062427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:46.063200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:46.063636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:46.205838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e16b1c0a7ae942f0b207db8a0537b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311c571a6074fb6841dd9ad6ad3680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:46.214282 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10fd2f9f-f366-4804-a87c-5f6afd3508e4 tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 200 len: 1478 microversion: 2.1 time: 0.165363 Jun 16 19:22:46.214869 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2983/6075] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:46 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:46.735320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c89b47c2-9be7-430e-9aa4-d61b8514e6d4 req-2a55af8e-d883-4cf0-a25d-fe6d9e13606e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4899451d-b840-4c3d-a274-bb9e044e6977", "name": "network-vif-deleted", "tag": "50127e29-1118-4435-ae05-9bd215844a6e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:46.746411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c89b47c2-9be7-430e-9aa4-d61b8514e6d4 req-2a55af8e-d883-4cf0-a25d-fe6d9e13606e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:46.746883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c89b47c2-9be7-430e-9aa4-d61b8514e6d4 req-2a55af8e-d883-4cf0-a25d-fe6d9e13606e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:46.766350 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c89b47c2-9be7-430e-9aa4-d61b8514e6d4 req-2a55af8e-d883-4cf0-a25d-fe6d9e13606e service nova] Creating event network-vif-deleted:50127e29-1118-4435-ae05-9bd215844a6e for instance 4899451d-b840-4c3d-a274-bb9e044e6977 on n-h1-846209-2 Jun 16 19:22:46.772702 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c89b47c2-9be7-430e-9aa4-d61b8514e6d4 req-2a55af8e-d883-4cf0-a25d-fe6d9e13606e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041503 Jun 16 19:22:46.773502 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3093/6076] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:22:47.231800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:47.232694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] [instance: 4899451d-b840-4c3d-a274-bb9e044e6977] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:47.239495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:47.239959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:47.240740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:47.241187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:47.255621 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] HTTP exception thrown: Instance 4899451d-b840-4c3d-a274-bb9e044e6977 could not be found. Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Request method failure captured: Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 HTTP/1.1 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4L3zEGFxaxJmxcRiGJ6DXz6ZdY0zpBlepFteIIdmUKHoa0HCMLqA8_NWaQbCq0A5P1n6ZNvzuZ4hrcrYszZu3Dly_wIbJnBhtVJGS6vhT2s4xkGGgFCMLIz8yT7FrCJjZXRxNUTO-rFOcn2uEOoSzfNUel2dEeBuZ36yqrc5xFrLB8 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 6311c571a6074fb6841dd9ad6ad3680c Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-132870491 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6311c571a6074fb6841dd9ad6ad3680c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6311c571a6074fb6841dd9ad6ad3680c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6311c571a6074fb6841dd9ad6ad3680c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6311c571a6074fb6841dd9ad6ad3680c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersAdminNegativeTestJSON-132870491 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 6311c571a6074fb6841dd9ad6ad3680c Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-132870491 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersAdminNegativeTestJSON-132870491-project Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: e16b1c0a7ae942f0b207db8a0537b2a9 Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersAdminNegativeTestJSON-132870491-project Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 4899451d-b840-4c3d-a274-bb9e044e6977 could not be found. Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '4899451d-b840-4c3d-a274-bb9e044e6977'} Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4899451d-b840-4c3d-a274-bb9e044e6977 could not be found. Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4899451d-b840-4c3d-a274-bb9e044e6977 could not be found. Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:22:47.257275 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4899451d-b840-4c3d-a274-bb9e044e6977 could not be found. Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] Returning 404 to user: Instance 4899451d-b840-4c3d-a274-bb9e044e6977 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26c2343f-010a-4e5c-8da6-6290bfa95c3e tempest-ServersAdminNegativeTestJSON-132870491 tempest-ServersAdminNegativeTestJSON-132870491-project] 10.222.0.27 "GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977" status: 404 len: 111 microversion: 2.1 time: 0.030896 Jun 16 19:22:47.263503 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2984/6077] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:47 2022] GET /compute/v2.1/servers/4899451d-b840-4c3d-a274-bb9e044e6977 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:22:53.682517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-258624563", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "fedc5fb1-ba3f-4ab5-885c-e2fbb6ab4b57"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:53.746996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] validate_networks() for [('fedc5fb1-ba3f-4ab5-885c-e2fbb6ab4b57', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:22:54.189605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:22:54.190101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:22:54.190605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:22:54.191034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:22:54.191466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:22:54.201233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:54.202064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:54.202801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:54.203263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:54.222718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Getting quotas for project 9db2698c6fdb483ab579aa7550ad5232. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:22:54.229453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Getting quotas for user 945d52d38eb246fb91684034a2dd5707 and project 9db2698c6fdb483ab579aa7550ad5232. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:22:54.253951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:22:54.256646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:22:54.320743 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-84aa4989-935e-450d-8730-d3831bf95fd7 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767898 Jun 16 19:22:54.321521 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3094/6078] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:22:54.332165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a3d34a6-bef7-4242-9370-ce9703fb768c tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:54.332918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a3d34a6-bef7-4242-9370-ce9703fb768c tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:54.351379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:54.351705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:22:54.418259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a3d34a6-bef7-4242-9370-ce9703fb768c tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:54.427068 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a3d34a6-bef7-4242-9370-ce9703fb768c tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1214 microversion: 2.1 time: 0.099046 Jun 16 19:22:54.428001 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2985/6079] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:54 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:55.445697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:55.446348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:55.453323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:55.453785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:55.454583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:55.455033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:55.519913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:55.532248 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-42d5eac1-4cb9-48df-9b91-5969978e534d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1266 microversion: 2.1 time: 0.091438 Jun 16 19:22:55.533206 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3095/6080] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:55 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:56.554623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:56.555275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:56.568949 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:56.580894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:56.582630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:56.584275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:57.015360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:57.033123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7597b4e-f43f-4889-a76e-4b1cbc9515ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.484092 Jun 16 19:22:57.039569 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2986/6081] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:56 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:57.274325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a7550dc8-173e-4b66-9321-6d3867b88bf6 req-75a6c2f3-d245-4fc3-aca0-715f91ca94a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b269f3-7403-4e7d-b6bb-0186f73313d8", "tag": "c35a02fc-2e32-483a-b1cd-3fe5296c0949"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:22:57.300967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a7550dc8-173e-4b66-9321-6d3867b88bf6 req-75a6c2f3-d245-4fc3-aca0-715f91ca94a8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:57.301443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a7550dc8-173e-4b66-9321-6d3867b88bf6 req-75a6c2f3-d245-4fc3-aca0-715f91ca94a8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:57.320415 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a7550dc8-173e-4b66-9321-6d3867b88bf6 req-75a6c2f3-d245-4fc3-aca0-715f91ca94a8 service nova] Creating event network-changed:c35a02fc-2e32-483a-b1cd-3fe5296c0949 for instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 on n-h1-846209-2 Jun 16 19:22:57.328002 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a7550dc8-173e-4b66-9321-6d3867b88bf6 req-75a6c2f3-d245-4fc3-aca0-715f91ca94a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058686 Jun 16 19:22:57.329111 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3096/6082] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:22:58.051519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:58.052143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:58.060472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:58.060923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:58.061714 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:58.062180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:58.197447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:58.205675 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-db08cd98-5057-4e76-b8a5-26a17349b7bc tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.158260 Jun 16 19:22:58.206307 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2987/6083] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:58 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:22:59.224669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:22:59.225549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:22:59.232243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:59.232738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:59.233535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:22:59.234021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:22:59.371766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:22:59.379436 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-96184999-ebd0-4e38-86c9-6f5b58230cce tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.160326 Jun 16 19:22:59.380028 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3097/6084] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:22:59 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:23:00.396687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:00.397311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:00.405049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:00.405506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:00.406315 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:00.406760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:00.537881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:00.545802 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-255587c7-ed6a-4bed-95af-663184eae4fa tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.153083 Jun 16 19:23:00.546409 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2988/6085] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:00 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:01.563961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:01.564617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:01.571605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:01.572091 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:01.572943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:01.573410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:01.702650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:01.710350 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-749ef86b-c58d-409f-9c1b-7bf9222064f4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.150327 Jun 16 19:23:01.710925 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3098/6086] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:01 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:23:02.727974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:02.729285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:02.736303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:02.736758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:02.737529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:02.738007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:02.878729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:02.886738 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d645e8e0-326d-4191-b4f3-832940c28efe tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.162772 Jun 16 19:23:02.887317 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2989/6087] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:02 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:03.903773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:03.904377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:03.908267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:03.912441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:03.912906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:03.913682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:03.914156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:03.917786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=74 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:04.055169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:04.063555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-59a749f9-6a7f-4e27-afe5-c721180edca1 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.163793 Jun 16 19:23:04.064137 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3099/6088] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:03 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:04.094436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5ac6662d-479a-42e5-9fbc-db279066f094 req-4c8787a4-99df-414f-9028-5297e48d98f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b269f3-7403-4e7d-b6bb-0186f73313d8", "name": "network-vif-plugged", "status": "completed", "tag": "c35a02fc-2e32-483a-b1cd-3fe5296c0949"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:04.099068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:04.108062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5ac6662d-479a-42e5-9fbc-db279066f094 req-4c8787a4-99df-414f-9028-5297e48d98f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:04.108524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5ac6662d-479a-42e5-9fbc-db279066f094 req-4c8787a4-99df-414f-9028-5297e48d98f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:04.114265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:04.123772 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5ac6662d-479a-42e5-9fbc-db279066f094 req-4c8787a4-99df-414f-9028-5297e48d98f6 service nova] Creating event network-vif-plugged:c35a02fc-2e32-483a-b1cd-3fe5296c0949 for instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 on n-h1-846209-2 Jun 16 19:23:04.129495 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5ac6662d-479a-42e5-9fbc-db279066f094 req-4c8787a4-99df-414f-9028-5297e48d98f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038673 Jun 16 19:23:04.130416 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2990/6089] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:23:05.081216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:05.081782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:05.083908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=5 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:05.084695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:05.091757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:05.092223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:05.092997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:05.093445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:05.235641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:05.243564 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-731df27b-1a80-4c0c-a7ea-e46e559003ec tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1314 microversion: 2.1 time: 0.166441 Jun 16 19:23:05.244363 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3100/6090] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:05 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:06.258512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:06.264224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:06.264931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:06.272846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:06.273301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:06.274102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:06.274546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:06.409627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:06.418593 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fc1163f4-15fa-4ee2-bf30-27b76abc0ed3 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1500 microversion: 2.1 time: 0.161138 Jun 16 19:23:06.419186 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2991/6091] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:06 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:06.435502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:06.436514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:06.443468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:06.443931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:06.444701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:06.445149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:06.478047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:06.484062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Old instance type m1.heat2, new instance type m1.heat {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:23:06.490180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:23:06.490617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:23:06.491105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:23:06.491524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:23:06.491944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:23:06.555367 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19e3173d-5a78-41af-a109-36d9b5d1e788 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "POST /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8/action" status: 202 len: 0 microversion: 2.1 time: 0.123721 Jun 16 19:23:06.555913 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3101/6092] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:23:06 2022] POST /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:23:06.564371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:06.564994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:06.571863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:06.572919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:06.573697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:06.574221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:06.749487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:06.757098 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-93679428-65b1-4ba3-a4c7-4c4e2b9d15a6 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1509 microversion: 2.1 time: 0.196659 Jun 16 19:23:06.757682 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2992/6093] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:06 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:07.776106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:07.776745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:07.784528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:07.784994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:07.785770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:07.786259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:07.962779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:07.970729 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cc56c94c-5c81-4b73-8259-a2f3f903def4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1509 microversion: 2.1 time: 0.198560 Jun 16 19:23:07.971346 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3102/6094] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:07 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:08.989175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:08.990012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:08.996807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:08.997274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:08.998128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:08.998596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:09.130793 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:09.139111 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92dde315-bc6b-410c-9329-989593c8cedd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.154080 Jun 16 19:23:09.139701 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2993/6095] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:08 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:10.156992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:10.157622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:10.164601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:10.165112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:10.165883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:10.166375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:10.361352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:10.369307 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4e27a37-59dc-4be3-b3a3-a8b5e434e15f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.216202 Jun 16 19:23:10.370743 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3103/6096] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:10 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:11.387840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:11.388542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:11.395414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:11.396009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:11.396798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:11.397238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:11.528731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:11.536767 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5a2b5ecd-2c2c-47d9-9698-5c07c04d7793 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.154140 Jun 16 19:23:11.537342 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2994/6097] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:11 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:12.554631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:12.555303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:12.563450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:12.563925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:12.564719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:12.565182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:12.698115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:12.706019 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f28c61b-cebc-4bb9-91c6-94d1b67e6e58 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.155227 Jun 16 19:23:12.706605 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3104/6098] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:12 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:13.724199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:13.724861 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:13.731822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:13.732390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:13.733189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:13.733638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:13.928015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:13.936326 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f0cecfc8-3c43-4a5d-b6d3-ad65aa7906e4 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.215507 Jun 16 19:23:13.936905 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2995/6099] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:13 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:14.953326 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:14.953898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:14.961005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:14.961479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:14.962314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:14.962771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:15.097603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:15.105262 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dccaa5cc-2d7c-4559-ba86-618f984bcc9a tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.155915 Jun 16 19:23:15.105838 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3105/6100] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:14 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:16.122301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:16.123553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:16.130547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:16.131003 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:16.131763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:16.132204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:16.273410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:16.282142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0eb45500-1d16-40f4-a1fd-973fb64c2dc5 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.163771 Jun 16 19:23:16.282721 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2996/6101] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:16 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:17.300364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:17.301016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:17.307959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:17.308434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:17.309219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:17.309675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:17.448094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:17.456502 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b26dc3a1-4369-4ea7-b716-79707092c187 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.160618 Jun 16 19:23:17.457076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3106/6102] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:17 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:18.474399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:18.475068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:18.482128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:18.483716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:18.484503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:18.484950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:18.621760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:18.629756 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e8e22d6b-129f-474c-af6a-87ac064bb3df tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.159318 Jun 16 19:23:18.630365 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2997/6103] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:18 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:19.647028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:19.647605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:19.654830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:19.655298 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:19.656085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:19.656542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:19.789825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:19.798260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ad8ab101-f869-4431-8f4f-cd4780a887ea tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.155002 Jun 16 19:23:19.798843 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3107/6104] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:19 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:20.816094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:20.817042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:20.827296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:20.827982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:20.829147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:20.829814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:20.973712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:20.981407 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a8ccf0db-88e7-4d94-8e1d-1f247eb31a01 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.169882 Jun 16 19:23:20.982004 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2998/6105] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:20 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:21.999429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:22.000055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:22.007085 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:22.007557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:22.008327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:22.008778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:22.145640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:22.153365 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-32a150da-05e4-4a3f-9784-9f69b26a62eb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.158633 Jun 16 19:23:22.153951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3108/6106] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:21 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:23.171745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:23.172366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:23.179730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:23.180188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:23.180967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:23.181412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:23.313455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:23.321070 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fb154331-0fe1-49a3-9e99-b1ce047a119b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.153936 Jun 16 19:23:23.321651 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 2999/6107] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:23 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:23:24.340227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:24.340890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:24.348771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:24.349241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:24.350098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:24.350554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:24.489757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:24.497392 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3da773f5-9dd8-478b-adb7-43729ae70bda tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.162160 Jun 16 19:23:24.497994 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3109/6108] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:24 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:23:25.514453 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:25.515070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:25.522202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:25.522652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:25.523436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:25.523883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:25.659431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:25.667427 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c6231b41-904b-40b6-bd15-a0710197b0f9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.156989 Jun 16 19:23:25.668016 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3000/6109] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:25 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:26.686783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:26.687516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:26.694557 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:26.695031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:26.695819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:26.696280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:26.832170 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:26.839756 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-22e7ccb8-4353-4278-abac-5d216cf58e99 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.157559 Jun 16 19:23:26.840323 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3110/6110] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:26 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:27.856808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:27.857425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:27.865353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:27.865877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:27.866682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:27.867126 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:28.008402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:28.018434 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b45d42ed-9182-48fd-bda0-eb61770f7b7b tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.166015 Jun 16 19:23:28.019027 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3001/6111] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:27 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:29.035425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:29.036058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:29.043177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:29.043640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:29.044414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:29.044865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:29.177322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:29.185088 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-63a8d36a-b212-4690-9cf7-b810801f6852 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.153611 Jun 16 19:23:29.185664 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3111/6112] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:29 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:30.203183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:30.203942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:30.211099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:30.211556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:30.212321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:30.212765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:30.347063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:30.354895 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fcc09215-7d4e-40b5-a83d-eb4f4d6dc7dd tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.155613 Jun 16 19:23:30.355679 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3002/6113] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:30 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:31.372852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:31.373490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:31.381302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:31.381776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:31.382597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:31.383066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:31.519937 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:31.527613 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-524a510d-13b1-4073-a510-96e183d2f885 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.158763 Jun 16 19:23:31.528201 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3112/6114] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:31 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:32.544974 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:32.545588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:32.553422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:32.553879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:32.554682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:32.555128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:32.692967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:32.700575 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d2095c4d-4601-434f-a178-cfcb475d6040 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.159603 Jun 16 19:23:32.701151 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3003/6115] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:32 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:33.718107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:33.718735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:33.726365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:33.726831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:33.727599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:33.728047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:33.859207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:33.867048 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2256b6b2-4690-4978-99f5-42f3df8ce59e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.152935 Jun 16 19:23:33.867622 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3113/6116] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:33 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:34.884218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:34.884865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:34.892036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:34.892595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:34.893435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:34.894061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:35.027685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:35.035947 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2fe7a86c-4f6d-407b-b9c0-04ca9f29942e tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1514 microversion: 2.1 time: 0.155725 Jun 16 19:23:35.036454 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3004/6117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:34 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:36.054167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:36.055051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:36.057734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=34 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:36.065065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:36.065065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:36.066365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:36.066826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:36.071466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:36.206545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:36.214389 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ff2c26e-b071-4b12-b217-a0ab73d50feb tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1513 microversion: 2.1 time: 0.164626 Jun 16 19:23:36.215014 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3114/6118] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:36 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:36.367021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f561ed82-6384-40a3-b947-3f8a4ec90082 req-e04e9bf8-c278-4b34-9c96-a503e034eada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b269f3-7403-4e7d-b6bb-0186f73313d8", "name": "network-vif-unplugged", "status": "completed", "tag": "c35a02fc-2e32-483a-b1cd-3fe5296c0949"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:36.371942 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=30 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:36.379452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f561ed82-6384-40a3-b947-3f8a4ec90082 req-e04e9bf8-c278-4b34-9c96-a503e034eada service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:36.380017 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f561ed82-6384-40a3-b947-3f8a4ec90082 req-e04e9bf8-c278-4b34-9c96-a503e034eada service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:36.384054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=86 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:36.394065 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f561ed82-6384-40a3-b947-3f8a4ec90082 req-e04e9bf8-c278-4b34-9c96-a503e034eada service nova] Creating event network-vif-unplugged:c35a02fc-2e32-483a-b1cd-3fe5296c0949 for instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 on n-h2-846209-2 Jun 16 19:23:36.399590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-f561ed82-6384-40a3-b947-3f8a4ec90082 req-e04e9bf8-c278-4b34-9c96-a503e034eada service nova] Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:23:36.410963 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f561ed82-6384-40a3-b947-3f8a4ec90082 req-e04e9bf8-c278-4b34-9c96-a503e034eada service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048197 Jun 16 19:23:36.411798 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3005/6119] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:23:37.232701 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:37.233448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:37.240665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:37.241129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:37.241929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:37.242382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:37.382812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:37.390349 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-67b093c4-fd78-40a2-8c2d-28c43a018e8f tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1513 microversion: 2.1 time: 0.161573 Jun 16 19:23:37.390918 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3115/6120] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:37 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:38.409055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:38.409800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:38.416156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:38.416852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:38.417368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:38.417811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:38.427095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-82f2287b-8921-49f7-9f56-3a5d7ff66799 req-c882dabc-846d-4be8-ab74-cc21a2f6b04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b269f3-7403-4e7d-b6bb-0186f73313d8", "tag": "c35a02fc-2e32-483a-b1cd-3fe5296c0949"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:38.436218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-82f2287b-8921-49f7-9f56-3a5d7ff66799 req-c882dabc-846d-4be8-ab74-cc21a2f6b04d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:38.436691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-82f2287b-8921-49f7-9f56-3a5d7ff66799 req-c882dabc-846d-4be8-ab74-cc21a2f6b04d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:38.450321 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-82f2287b-8921-49f7-9f56-3a5d7ff66799 req-c882dabc-846d-4be8-ab74-cc21a2f6b04d service nova] Creating event network-changed:c35a02fc-2e32-483a-b1cd-3fe5296c0949 for instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 on n-h2-846209-2 Jun 16 19:23:38.456015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-82f2287b-8921-49f7-9f56-3a5d7ff66799 req-c882dabc-846d-4be8-ab74-cc21a2f6b04d service nova] Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:23:38.467531 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-82f2287b-8921-49f7-9f56-3a5d7ff66799 req-c882dabc-846d-4be8-ab74-cc21a2f6b04d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045010 Jun 16 19:23:38.468280 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3116/6121] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:23:38.617806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:38.625383 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-808c1bbf-ccba-46ca-9dea-5ed146cda8de tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1511 microversion: 2.1 time: 0.221843 Jun 16 19:23:38.625915 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3006/6122] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:38 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:39.648405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:39.649057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:39.655668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:39.656138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:39.656921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:39.657372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:39.799705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:39.807542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2f05e11b-abc9-4bb7-93a1-87eeca8d7c17 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1508 microversion: 2.1 time: 0.167973 Jun 16 19:23:39.808121 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3117/6123] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:39 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:39.824383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:39.824911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:39.832240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:39.832702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:39.833483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:39.833983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:39.860556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:23:39.914984 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.compute.api [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Found an unconfirmed migration during delete, id: 16, status: finished Jun 16 19:23:41.369037 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c680bf71-313a-4825-8760-a3a138db7278 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 204 len: 0 microversion: 2.1 time: 1.548242 Jun 16 19:23:41.372837 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3007/6124] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:23:39 2022] DELETE /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 0 bytes in 1550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:23:41.379235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:41.380746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:41.389053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:41.389945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:41.390834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:41.391275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:41.521526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:41.529292 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46a2728f-c1f1-4e70-b44a-b9626873110d tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1500 microversion: 2.1 time: 0.155285 Jun 16 19:23:41.529869 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3118/6125] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:41 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:42.548605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:42.549690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:42.556196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:42.556650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:42.557416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:42.557852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:42.702411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945d52d38eb246fb91684034a2dd5707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db2698c6fdb483ab579aa7550ad5232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:42.712091 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8aef6a79-4cbf-453f-9cbb-310c71539407 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 200 len: 1500 microversion: 2.1 time: 0.167965 Jun 16 19:23:42.712810 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3008/6126] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:42 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:42.756817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d73a7805-d513-418d-a5a7-65decc35d638 req-e0f13ac6-f0df-4e93-a5e1-8a026ee58000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b269f3-7403-4e7d-b6bb-0186f73313d8", "name": "network-vif-plugged", "status": "completed", "tag": "c35a02fc-2e32-483a-b1cd-3fe5296c0949"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:42.766520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d73a7805-d513-418d-a5a7-65decc35d638 req-e0f13ac6-f0df-4e93-a5e1-8a026ee58000 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:42.766979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d73a7805-d513-418d-a5a7-65decc35d638 req-e0f13ac6-f0df-4e93-a5e1-8a026ee58000 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:42.782164 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d73a7805-d513-418d-a5a7-65decc35d638 req-e0f13ac6-f0df-4e93-a5e1-8a026ee58000 service nova] Creating event network-vif-plugged:c35a02fc-2e32-483a-b1cd-3fe5296c0949 for instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 on n-h2-846209-2 Jun 16 19:23:42.787738 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d73a7805-d513-418d-a5a7-65decc35d638 req-e0f13ac6-f0df-4e93-a5e1-8a026ee58000 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035435 Jun 16 19:23:42.788647 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3119/6127] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:23:43.245334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2d50f72c-23d8-4457-9bfd-d862343bdcdd req-82ecb4ee-b489-47a5-b33b-781ae83e479c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b269f3-7403-4e7d-b6bb-0186f73313d8", "name": "network-vif-deleted", "tag": "c35a02fc-2e32-483a-b1cd-3fe5296c0949"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:43.256288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2d50f72c-23d8-4457-9bfd-d862343bdcdd req-82ecb4ee-b489-47a5-b33b-781ae83e479c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:43.257212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2d50f72c-23d8-4457-9bfd-d862343bdcdd req-82ecb4ee-b489-47a5-b33b-781ae83e479c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:43.270731 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2d50f72c-23d8-4457-9bfd-d862343bdcdd req-82ecb4ee-b489-47a5-b33b-781ae83e479c service nova] Creating event network-vif-deleted:c35a02fc-2e32-483a-b1cd-3fe5296c0949 for instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 on n-h2-846209-2 Jun 16 19:23:43.275947 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2d50f72c-23d8-4457-9bfd-d862343bdcdd req-82ecb4ee-b489-47a5-b33b-781ae83e479c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034563 Jun 16 19:23:43.276804 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3009/6128] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:23:43.729838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:43.730588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:43.737485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:43.738104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:43.738765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:43.739247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:43.753453 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] HTTP exception thrown: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Request method failure captured: Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 HTTP/1.1 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4MNu5Uii-JO-VHXGQUERwv-t2VirNzxWq4QusB2M6VXqgdArpc0qPXf_gfb1VAj3UO4nyCSKu8a5NzCzSVdmLpqoqBUGfzaI6Mg2Trg96Vo-_GEtbzHQOcbrCSN1mv8I8nubl3CJu27p--JeA456HvIngE45vFvXX5rcGZwZk8AD2c Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 9db2698c6fdb483ab579aa7550ad5232 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9db2698c6fdb483ab579aa7550ad5232", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 9db2698c6fdb483ab579aa7550ad5232 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1149597350-project Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 945d52d38eb246fb91684034a2dd5707 Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1149597350-project Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f6b269f3-7403-4e7d-b6bb-0186f73313d8'} Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:23:43.755149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Returning 404 to user: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1195c5dc-9e30-4865-ba18-e8b0a788e3e9 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 404 len: 111 microversion: 2.1 time: 0.031185 Jun 16 19:23:43.761427 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3120/6129] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:43 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:23:43.773279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:43.773872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:43.780189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:43.780645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:43.781417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:43.781860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:43.798657 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] HTTP exception thrown: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Request method failure captured: Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 HTTP/1.1 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4MNu5Uii-JO-VHXGQUERwv-t2VirNzxWq4QusB2M6VXqgdArpc0qPXf_gfb1VAj3UO4nyCSKu8a5NzCzSVdmLpqoqBUGfzaI6Mg2Trg96Vo-_GEtbzHQOcbrCSN1mv8I8nubl3CJu27p--JeA456HvIngE45vFvXX5rcGZwZk8AD2c Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 9db2698c6fdb483ab579aa7550ad5232 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9db2698c6fdb483ab579aa7550ad5232", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 9db2698c6fdb483ab579aa7550ad5232 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-DeleteServersTestJSON-1149597350-project Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 945d52d38eb246fb91684034a2dd5707 Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-DeleteServersTestJSON-1149597350-project Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'f6b269f3-7403-4e7d-b6bb-0186f73313d8'} Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:23:43.800492 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Returning 404 to user: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7a83308-1586-46b2-a61c-daa9bf8a9e31 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 404 len: 111 microversion: 2.1 time: 0.034386 Jun 16 19:23:43.805551 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3010/6130] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:23:43 2022] DELETE /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:23:43.811798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:43.812427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] [instance: f6b269f3-7403-4e7d-b6bb-0186f73313d8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:43.820312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:43.820776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:43.821556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:43.822027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:43.836741 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] HTTP exception thrown: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Request method failure captured: Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 HTTP/1.1 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4MNu5Uii-JO-VHXGQUERwv-t2VirNzxWq4QusB2M6VXqgdArpc0qPXf_gfb1VAj3UO4nyCSKu8a5NzCzSVdmLpqoqBUGfzaI6Mg2Trg96Vo-_GEtbzHQOcbrCSN1mv8I8nubl3CJu27p--JeA456HvIngE45vFvXX5rcGZwZk8AD2c Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 9db2698c6fdb483ab579aa7550ad5232 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9db2698c6fdb483ab579aa7550ad5232", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9db2698c6fdb483ab579aa7550ad5232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 9db2698c6fdb483ab579aa7550ad5232 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-DeleteServersTestJSON-1149597350 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-DeleteServersTestJSON-1149597350-project Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 945d52d38eb246fb91684034a2dd5707 Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-DeleteServersTestJSON-1149597350-project Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f6b269f3-7403-4e7d-b6bb-0186f73313d8'} Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:23:43.838376 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] Returning 404 to user: Instance f6b269f3-7403-4e7d-b6bb-0186f73313d8 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-caa55d34-1ceb-496b-ace7-1c2c585eb436 tempest-DeleteServersTestJSON-1149597350 tempest-DeleteServersTestJSON-1149597350-project] 10.222.0.27 "GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8" status: 404 len: 111 microversion: 2.1 time: 0.031905 Jun 16 19:23:43.843807 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3121/6131] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:43 2022] GET /compute/v2.1/servers/f6b269f3-7403-4e7d-b6bb-0186f73313d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:23:44.522819 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:23:44.523109 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:23:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:23:52.514821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-341623669", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "b34ba0b1-7791-424a-bf4b-4d7ea1776cba"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:52.572178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] validate_networks() for [('b34ba0b1-7791-424a-bf4b-4d7ea1776cba', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:23:52.958133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:23:52.958562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:23:52.959070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:23:52.959486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:23:52.959902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:23:52.968956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:52.969410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:52.970258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:52.971208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:52.990259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Getting quotas for project bb108850e8504a3aafc08934f85e91e9. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:23:52.996029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Getting quotas for user 6d36cad2b8e64189a2645f5367f7c85a and project bb108850e8504a3aafc08934f85e91e9. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:23:53.010101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:23:53.012411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:23:53.061626 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f2e979e8-3d5c-41d5-8888-23a25e823089 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698060 Jun 16 19:23:53.062353 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3011/6132] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:23:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:23:53.074105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d763767-21a2-410c-b465-f3a4a0b14076 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:53.074734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1d763767-21a2-410c-b465-f3a4a0b14076 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:53.131642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1d763767-21a2-410c-b465-f3a4a0b14076 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:53.138837 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d763767-21a2-410c-b465-f3a4a0b14076 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1217 microversion: 2.1 time: 0.069028 Jun 16 19:23:53.139648 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3122/6133] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:53 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:54.157473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:54.158619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:54.167927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:54.168839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:54.169849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:54.170348 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:54.250835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:54.260877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-234ea75c-efe1-41eb-9719-b673156891da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1287 microversion: 2.1 time: 0.108058 Jun 16 19:23:54.261834 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3012/6134] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:54 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:55.279736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:55.280416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:55.282774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=33 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:23:55.304371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:55.305008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:55.306856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:55.307411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:55.472818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:55.481138 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4171733-7261-4344-9560-d2ed7d19e3de tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.205279 Jun 16 19:23:55.481775 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3123/6135] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:55 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:55.957636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-51daf8ce-37bb-4d9c-b7bb-0629319c1c3a req-7775fecb-957b-451e-8f31-6bf84afa1004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f76d450-6d7e-407c-a6a0-60f9be75e201", "tag": "ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:23:55.982969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-51daf8ce-37bb-4d9c-b7bb-0629319c1c3a req-7775fecb-957b-451e-8f31-6bf84afa1004 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:55.983416 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-51daf8ce-37bb-4d9c-b7bb-0629319c1c3a req-7775fecb-957b-451e-8f31-6bf84afa1004 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:56.002651 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-51daf8ce-37bb-4d9c-b7bb-0629319c1c3a req-7775fecb-957b-451e-8f31-6bf84afa1004 service nova] Creating event network-changed:ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a for instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 on n-h2-846209-2 Jun 16 19:23:56.014233 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-51daf8ce-37bb-4d9c-b7bb-0629319c1c3a req-7775fecb-957b-451e-8f31-6bf84afa1004 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061342 Jun 16 19:23:56.016427 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3013/6136] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:23:56.499720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:56.500346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:56.509608 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:56.510129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:56.510931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:56.511386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:56.651664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:56.659563 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-31a4a7d9-7aed-486c-b1cf-c5b178b0e99c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.164823 Jun 16 19:23:56.660142 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3124/6137] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:56 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:57.677394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:57.678227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:57.685507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:57.685984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:57.686753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:57.687190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:57.828622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:57.836258 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-10c97361-a134-4fc9-8a09-17c98e104500 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.163472 Jun 16 19:23:57.836832 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3014/6138] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:57 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:23:58.853059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:23:58.853698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:23:58.862206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:58.862681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:58.863470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:23:58.863922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:23:58.995103 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:23:59.002886 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-22460d7b-64e8-4e86-83d3-fd66d4f00941 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.153791 Jun 16 19:23:59.003490 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3125/6139] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:23:58 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:00.019784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:00.020396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:00.027414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:00.027871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:00.028635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:00.029071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:00.166653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:00.175060 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a9320eba-373d-4ec4-9990-74f9e8820cd8 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.159212 Jun 16 19:24:00.175647 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3015/6140] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:00 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:01.192981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:01.193621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:01.200546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:01.201042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:01.201856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:01.202354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:01.341260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:01.349575 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c23e54e-fb6b-41df-af62-61b97c4699c4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.161705 Jun 16 19:24:01.350186 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3126/6141] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:01 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:02.366798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:02.367415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:02.374312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:02.374773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:02.375537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:02.375975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:02.506561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:02.514488 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3a21e11-4e14-48a4-9b23-a2656e83fd02 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.151580 Jun 16 19:24:02.515065 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3016/6142] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:02 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:02.996685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-d49e2fe1-2962-44ff-84d7-67578b88dac3 req-287c29a4-a6d3-405a-bdfa-4956fe071e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f76d450-6d7e-407c-a6a0-60f9be75e201", "name": "network-vif-plugged", "status": "completed", "tag": "ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:03.007245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d49e2fe1-2962-44ff-84d7-67578b88dac3 req-287c29a4-a6d3-405a-bdfa-4956fe071e4d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:03.007747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-d49e2fe1-2962-44ff-84d7-67578b88dac3 req-287c29a4-a6d3-405a-bdfa-4956fe071e4d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:03.019003 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-d49e2fe1-2962-44ff-84d7-67578b88dac3 req-287c29a4-a6d3-405a-bdfa-4956fe071e4d service nova] Creating event network-vif-plugged:ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a for instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 on n-h2-846209-2 Jun 16 19:24:03.024332 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-d49e2fe1-2962-44ff-84d7-67578b88dac3 req-287c29a4-a6d3-405a-bdfa-4956fe071e4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114457 Jun 16 19:24:03.024951 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3127/6143] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:24:03.531626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:03.532394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:03.535566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:03.536250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:03.542496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:03.543016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:03.543894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:03.544523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:03.696407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:03.704119 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fade1874-bf2f-44a1-a17f-f378cfaedd47 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1317 microversion: 2.1 time: 0.176459 Jun 16 19:24:03.705266 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3017/6144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:03 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:24:04.718720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:04.725493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:04.726267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:04.733209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:04.733688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:04.734531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:04.734992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:04.873011 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:04.880859 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6dd2aa8-8829-40a7-8247-c10998293149 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1507 microversion: 2.1 time: 0.163192 Jun 16 19:24:04.881444 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3128/6145] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:04 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:04.897648 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:04.898287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:04.906002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:04.906461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:04.907236 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:04.907674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.043581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:05.052174 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9710396-f0ec-4672-bdf7-676cca6feb4e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1507 microversion: 2.1 time: 0.158470 Jun 16 19:24:05.052747 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3018/6146] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:04 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:05.068915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e75a62b-b3a9-44e6-a95d-79b946b602b6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:05.070121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4e75a62b-b3a9-44e6-a95d-79b946b602b6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:05.076219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75a62b-b3a9-44e6-a95d-79b946b602b6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.076683 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75a62b-b3a9-44e6-a95d-79b946b602b6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.077454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75a62b-b3a9-44e6-a95d-79b946b602b6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.077919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e75a62b-b3a9-44e6-a95d-79b946b602b6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.142189 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4e75a62b-b3a9-44e6-a95d-79b946b602b6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "PUT /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1079 microversion: 2.1 time: 0.078049 Jun 16 19:24:05.143677 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3129/6147] 10.222.0.27 () {60 vars in 1255 bytes} [Thu Jun 16 19:24:05 2022] PUT /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:05.157370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:05.158424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:05.164948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.165417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.166282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.166753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.299265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:05.307147 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c65d6839-f611-410b-b82d-fde23983da60 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1505 microversion: 2.1 time: 0.153681 Jun 16 19:24:05.307727 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3019/6148] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:05 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:05.324193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:05.324879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:05.331786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.332401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.333029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.333491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.466367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:05.474552 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d08cbb11-516f-4c6c-9801-fef281d9e422 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1505 microversion: 2.1 time: 0.154398 Jun 16 19:24:05.475108 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3130/6149] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:05 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:05.490944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:05.492122 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:05.498274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.498683 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.499458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.499904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.576329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:05.582465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Old instance type m1.heat2, new instance type m1.heat {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:24:05.588760 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:24:05.589195 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:24:05.589684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:24:05.590140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:24:05.590571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:24:05.705453 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca3f248e-aa51-4a4c-a490-1cb54f70649a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "POST /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201/action" status: 202 len: 0 microversion: 2.1 time: 0.219146 Jun 16 19:24:05.709231 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3020/6150] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:24:05 2022] POST /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:24:05.714565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:05.715241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:05.723734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.724377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.725062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:05.725516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:05.888830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:05.897661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-72ef7440-15d0-4236-91fb-1534e316e804 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1516 microversion: 2.1 time: 0.187066 Jun 16 19:24:05.898455 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3131/6151] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:05 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:06.916575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:06.917167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:06.918982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:06.926384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:06.926842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:06.927619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:06.928064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:06.933000 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:07.083673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:07.094782 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8130deee-315e-426f-8980-e6da551b240a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1516 microversion: 2.1 time: 0.183364 Jun 16 19:24:07.096287 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3021/6152] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:06 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:24:08.113229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:08.113837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:08.116615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=38 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:08.122161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:08.122633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:08.123412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:08.123868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:08.257177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:08.264893 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25313a41-d7b0-4eb1-aeb0-4cb1a599cc98 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.156361 Jun 16 19:24:08.265473 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3132/6153] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:08 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:09.283130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:09.283987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:09.291033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:09.291498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:09.292278 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:09.292724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:09.430263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:09.437885 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d3c272f-d46a-4e97-b422-95b746b07120 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.159207 Jun 16 19:24:09.438482 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3022/6154] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:09 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:10.455036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:10.455795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:10.463030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:10.463566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:10.464353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:10.464811 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:10.595068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:10.603201 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a69b6b4-0a53-440f-9d3d-f33c051e1de0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.152146 Jun 16 19:24:10.603773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3133/6155] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:10 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:11.621346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:11.621934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:11.629312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:11.629757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:11.630691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:11.631114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:11.764961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:11.773571 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1efc21b2-2d2f-4b2a-be74-7b6effdf37b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.156214 Jun 16 19:24:11.774186 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3023/6156] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:11 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:12.790955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:12.791599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:12.799428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:12.799906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:12.800686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:12.801140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:12.935762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:12.943487 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8385a81f-d523-4e94-aca7-261ba6102bbb tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.156455 Jun 16 19:24:12.944064 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3134/6157] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:12 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:13.961240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:13.961800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:13.968881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:13.969337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:13.970148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:13.970579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:14.100765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:14.108293 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9d604d66-041a-44e5-aa23-680b4054f660 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.152073 Jun 16 19:24:14.108870 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3024/6158] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:13 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:15.125704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:15.126381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:15.133312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:15.133780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:15.134841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:15.135297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:15.271621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:15.279254 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ff745b5c-bc12-42f7-95d3-92e3d4f4d7c7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.157675 Jun 16 19:24:15.279827 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3135/6159] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:15 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:16.296546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:16.297161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:16.304468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:16.304922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:16.305693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:16.306162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:16.437250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:16.446269 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a15da502-f104-42c1-8adf-235ad6cb6e94 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.153611 Jun 16 19:24:16.446850 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3025/6160] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:16 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:17.463397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:17.464008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:17.470835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:17.471456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:17.472362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:17.472821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:17.607219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:17.615304 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-351f9997-4cb5-46cc-8004-ad98f1fb736b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.155887 Jun 16 19:24:17.615890 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3136/6161] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:17 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:18.633055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:18.633626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:18.640534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:18.640994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:18.641791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:18.642264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:18.776326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:18.783894 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4939f3c3-a676-47a8-be87-0420b7061087 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.154770 Jun 16 19:24:18.784780 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3026/6162] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:18 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:19.801609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:19.802270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:19.809592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:19.810090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:19.810870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:19.811320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:19.940748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:19.948427 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2449f453-55d9-4725-97e4-aab209b612e1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.151648 Jun 16 19:24:19.949019 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3137/6163] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:19 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:20.968907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:20.969528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:20.977635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:20.978131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:20.978922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:20.979364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:21.116354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:21.123818 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-75cd38e1-60c1-4fab-9567-88453c2a18b0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.158890 Jun 16 19:24:21.124425 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3027/6164] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:20 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:22.142963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:22.143601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:22.150679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:22.151143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:22.151933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:22.152388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:22.283764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:22.292412 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1b1fc9a-6848-4af8-8f50-981fdc7fe2c2 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.153415 Jun 16 19:24:22.293001 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3138/6165] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:22 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:23.309768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:23.310429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:23.318175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:23.318628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:23.319396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:23.319838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:23.456014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:23.464124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53c16a76-7f14-4baa-904e-77e24e101919 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.158288 Jun 16 19:24:23.464687 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3028/6166] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:23 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:24.482132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:24.482765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:24.490950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:24.491413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:24.492192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:24.492643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:24.510833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:24.627755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:24.635717 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4b525dd-175f-4a6a-a358-0a98a8714891 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.157540 Jun 16 19:24:24.636299 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3139/6167] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:24 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:25.652969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:25.653530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:25.661825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:25.662311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:25.663084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:25.663524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:25.828802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:25.828802 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9999711e-2722-4f08-8bd1-b9e543453608 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.165486 Jun 16 19:24:25.828802 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3029/6168] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:25 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:26.831544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:26.832385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:26.839693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:26.840156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:26.840946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:26.841416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:26.977840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:26.985537 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f50e945d-2253-412e-90a6-aa710af42a05 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.157936 Jun 16 19:24:26.986142 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3140/6169] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:26 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:28.004985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:28.005673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:28.012636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:28.013164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:28.014115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:28.014581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:28.147193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:28.154635 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c5522cd-8e3e-426f-ad2c-f0f3ec007882 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.155230 Jun 16 19:24:28.155205 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3030/6170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:27 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:29.171870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:29.172505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:29.180151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:29.180617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:29.181394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:29.181852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:29.316547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:29.325341 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0fd1ff6b-5ddb-429a-8922-efc7f875c94b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.157441 Jun 16 19:24:29.325929 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3141/6171] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:29 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:30.343179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:30.343799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:30.351366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:30.351821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:30.352597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:30.353040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:30.484206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:30.492517 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-30a4eab3-2ff4-4dbd-9a9f-18d81271d719 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.153240 Jun 16 19:24:30.493108 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3031/6172] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:30 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:31.510009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:31.510674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:31.517649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:31.518159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:31.518948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:31.519407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:31.653391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:31.661551 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2044f202-efc9-4a97-9036-c1174462d8f9 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.155481 Jun 16 19:24:31.662230 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3142/6173] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:31 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:32.679737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:32.680290 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:32.686948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:32.687410 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:32.688184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:32.688632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:32.822907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:32.830590 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6730c52b-6192-48fb-9132-0f13cc2e967e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.155699 Jun 16 19:24:32.831160 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3032/6174] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:32 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:24:33.848790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:33.849454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:33.856563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:33.857040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:33.857828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:33.858315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:33.993222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:34.000889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-703e0dc7-d118-46d8-b130-9ec72440a28c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1521 microversion: 2.1 time: 0.156231 Jun 16 19:24:34.001466 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3143/6175] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:33 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:35.018308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:35.018937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:35.026813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:35.027275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:35.028182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:35.029063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:35.129028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bf50b8d1-e722-4ed6-9d25-398d2f63ecc3 req-83268ca4-a7ce-4f2c-9297-5cfa2c115329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f76d450-6d7e-407c-a6a0-60f9be75e201", "name": "network-vif-unplugged", "status": "completed", "tag": "ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:35.138625 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bf50b8d1-e722-4ed6-9d25-398d2f63ecc3 req-83268ca4-a7ce-4f2c-9297-5cfa2c115329 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:35.139093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bf50b8d1-e722-4ed6-9d25-398d2f63ecc3 req-83268ca4-a7ce-4f2c-9297-5cfa2c115329 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:35.152186 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bf50b8d1-e722-4ed6-9d25-398d2f63ecc3 req-83268ca4-a7ce-4f2c-9297-5cfa2c115329 service nova] Creating event network-vif-unplugged:ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a for instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 on n-h1-846209-2 Jun 16 19:24:35.157881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-bf50b8d1-e722-4ed6-9d25-398d2f63ecc3 req-83268ca4-a7ce-4f2c-9297-5cfa2c115329 service nova] Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:24:35.170964 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bf50b8d1-e722-4ed6-9d25-398d2f63ecc3 req-83268ca4-a7ce-4f2c-9297-5cfa2c115329 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045712 Jun 16 19:24:35.171908 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3144/6176] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:24:35.266693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:35.277643 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94bf9a2f-95b4-45f9-a08e-dd85fec1884d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1520 microversion: 2.1 time: 0.263256 Jun 16 19:24:35.278384 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3033/6177] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:35 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:36.297118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:36.297837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:36.305165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:36.305664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:36.306648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:36.307060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:36.444544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:36.452224 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8432ed03-5268-424b-a0a8-c0be0c639a35 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1518 microversion: 2.1 time: 0.160312 Jun 16 19:24:36.452802 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3145/6178] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:36 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:37.199827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-cece8a15-ea36-4e69-9a73-5f52c269e2ad req-88479807-e80b-4127-a2e2-d676cc4ad61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f76d450-6d7e-407c-a6a0-60f9be75e201", "tag": "ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:37.204189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=26 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:37.210085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cece8a15-ea36-4e69-9a73-5f52c269e2ad req-88479807-e80b-4127-a2e2-d676cc4ad61b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:37.210531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-cece8a15-ea36-4e69-9a73-5f52c269e2ad req-88479807-e80b-4127-a2e2-d676cc4ad61b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:37.213292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=78 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:37.223748 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-cece8a15-ea36-4e69-9a73-5f52c269e2ad req-88479807-e80b-4127-a2e2-d676cc4ad61b service nova] Creating event network-changed:ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a for instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 on n-h1-846209-2 Jun 16 19:24:37.229822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-cece8a15-ea36-4e69-9a73-5f52c269e2ad req-88479807-e80b-4127-a2e2-d676cc4ad61b service nova] Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:24:37.241230 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-cece8a15-ea36-4e69-9a73-5f52c269e2ad req-88479807-e80b-4127-a2e2-d676cc4ad61b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045080 Jun 16 19:24:37.241817 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3034/6179] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:24:37.469796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:37.470885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:37.479025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:37.479647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:37.480525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:37.481333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:37.639227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:37.648668 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ea87bbd9-9a8d-460e-b115-6da3c7dcd638 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1518 microversion: 2.1 time: 0.182974 Jun 16 19:24:37.649272 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3146/6180] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:37 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:38.670210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:38.670931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:38.678506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:38.678964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:38.679739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:38.680187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:38.815306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:38.824494 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8b90fdfa-b7de-4937-a534-249058d2adda tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1515 microversion: 2.1 time: 0.161783 Jun 16 19:24:38.825074 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3035/6181] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:38 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:38.841309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b571c4b-0f10-4a59-9eed-ab05fcd5ad7e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:38.841853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1b571c4b-0f10-4a59-9eed-ab05fcd5ad7e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:38.844835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=30 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:38.851460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b571c4b-0f10-4a59-9eed-ab05fcd5ad7e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:38.851925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b571c4b-0f10-4a59-9eed-ab05fcd5ad7e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:38.852718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b571c4b-0f10-4a59-9eed-ab05fcd5ad7e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:38.853165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1b571c4b-0f10-4a59-9eed-ab05fcd5ad7e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:38.916434 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b571c4b-0f10-4a59-9eed-ab05fcd5ad7e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "POST /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201/action" status: 204 len: 0 microversion: 2.1 time: 0.078840 Jun 16 19:24:38.917353 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3147/6182] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:24:38 2022] POST /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:24:38.925515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:38.929078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:38.935441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:38.936163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:38.937013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:38.937461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:39.087610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:39.095699 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-413c63b9-cf44-4e01-9e8e-0a6deb331013 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1515 microversion: 2.1 time: 0.174246 Jun 16 19:24:39.096277 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3036/6183] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:38 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:24:40.115686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:40.116544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:40.122910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:40.123427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:40.124649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:40.124921 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:40.277420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:40.285360 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2b760adc-7e13-432a-9857-630fc24fa0db tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1507 microversion: 2.1 time: 0.175214 Jun 16 19:24:40.286107 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3148/6184] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:40 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:40.302622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:40.303339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:40.310946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:40.311553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:40.312519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:40.313090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:40.453036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:40.461234 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6a2b2e10-4f48-4989-85db-b6befc76f9b7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1507 microversion: 2.1 time: 0.163369 Jun 16 19:24:40.461846 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3037/6185] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:40 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:40.481442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1b32da17-5c67-4f5d-b2ce-c8dc3a4ae910 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'create', calling method: .version_select at 0x7f866ddef160>, body: {"keypair": {"name": "tempest-keypair-989327420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1P4OpszFEGZNRF724WhXv0GRcK3YtUYHRdxMaaupSPSkRIBOjqbJyrJqv9z3T2Yr4TmcFYmafgrn9j6x5SSRSKBifpZJzDOuEidLsp1n/jpa3/fN/lCLZJguRwqCwq0g=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:40.496051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1b32da17-5c67-4f5d-b2ce-c8dc3a4ae910 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Getting quotas for project bb108850e8504a3aafc08934f85e91e9. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:24:40.501201 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-1b32da17-5c67-4f5d-b2ce-c8dc3a4ae910 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Getting quotas for user 6d36cad2b8e64189a2645f5367f7c85a and project bb108850e8504a3aafc08934f85e91e9. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:24:40.542461 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1b32da17-5c67-4f5d-b2ce-c8dc3a4ae910 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064734 Jun 16 19:24:40.542998 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3149/6186] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:24:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:24:40.694065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-2aa0cd37-82e0-4b7c-b72a-7928b6d94dfc req-5193c021-3fd1-47ff-aa16-9070c2919357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f76d450-6d7e-407c-a6a0-60f9be75e201", "name": "network-vif-plugged", "status": "completed", "tag": "ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:40.702929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2aa0cd37-82e0-4b7c-b72a-7928b6d94dfc req-5193c021-3fd1-47ff-aa16-9070c2919357 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:40.703650 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-2aa0cd37-82e0-4b7c-b72a-7928b6d94dfc req-5193c021-3fd1-47ff-aa16-9070c2919357 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:40.719959 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-2aa0cd37-82e0-4b7c-b72a-7928b6d94dfc req-5193c021-3fd1-47ff-aa16-9070c2919357 service nova] Creating event network-vif-plugged:ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a for instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 on n-h1-846209-2 Jun 16 19:24:40.726580 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-2aa0cd37-82e0-4b7c-b72a-7928b6d94dfc req-5193c021-3fd1-47ff-aa16-9070c2919357 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036296 Jun 16 19:24:40.727647 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3038/6187] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:24:42.180214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:42.180852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:42.187648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:42.188120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:42.188899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:42.189356 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:42.323196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:42.330791 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0cc84d2d-d99c-4c0b-8472-e8b56e60d516 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 200 len: 1507 microversion: 2.1 time: 0.156189 Jun 16 19:24:42.331363 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3150/6188] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:42 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:42.349518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:42.350143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:42.356532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:42.356990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:42.357759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:42.358245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:42.386589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:24:42.461599 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9c35807c-13b8-422f-8435-ff6905b3fd3a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 204 len: 0 microversion: 2.1 time: 0.117692 Jun 16 19:24:42.462247 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3039/6189] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:24:42 2022] DELETE /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:24:42.519780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2075382663", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "b34ba0b1-7791-424a-bf4b-4d7ea1776cba"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:42.570764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] validate_networks() for [('b34ba0b1-7791-424a-bf4b-4d7ea1776cba', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:24:42.991924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:24:42.992374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:24:42.992869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:24:42.993297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:24:42.993766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:24:43.003957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:43.004416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:43.005842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:43.006318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:43.024038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Getting quotas for project bb108850e8504a3aafc08934f85e91e9. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:24:43.029329 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Getting quotas for user 6d36cad2b8e64189a2645f5367f7c85a and project bb108850e8504a3aafc08934f85e91e9. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:24:43.042559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:24:43.044873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:24:43.090460 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-534704d9-a0c5-40a0-888b-f5b6a68ae628 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574465 Jun 16 19:24:43.091028 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3151/6190] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:24:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:24:43.102509 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4313e4cb-6926-4353-9601-8da6a15b9cae tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:43.103224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4313e4cb-6926-4353-9601-8da6a15b9cae tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:43.162105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4313e4cb-6926-4353-9601-8da6a15b9cae tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:43.169256 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4313e4cb-6926-4353-9601-8da6a15b9cae tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1218 microversion: 2.1 time: 0.071788 Jun 16 19:24:43.169986 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3040/6191] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:43 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:44.188353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:44.189243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:44.198135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:44.198604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:44.199413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:44.199860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:44.321619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:44.332195 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6e40dc5f-573b-442d-89ea-9a344cddd5b3 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1270 microversion: 2.1 time: 0.148546 Jun 16 19:24:44.333589 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3152/6192] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:44 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:44.929332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-3596c719-e261-4e67-baac-74ce512396e6 req-41ba3a7f-1d0b-4f4e-b91b-5bbc81d38314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f76d450-6d7e-407c-a6a0-60f9be75e201", "name": "network-vif-deleted", "tag": "ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:44.941744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3596c719-e261-4e67-baac-74ce512396e6 req-41ba3a7f-1d0b-4f4e-b91b-5bbc81d38314 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:44.942223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-3596c719-e261-4e67-baac-74ce512396e6 req-41ba3a7f-1d0b-4f4e-b91b-5bbc81d38314 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:44.956329 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-3596c719-e261-4e67-baac-74ce512396e6 req-41ba3a7f-1d0b-4f4e-b91b-5bbc81d38314 service nova] Creating event network-vif-deleted:ddfd3c5c-14d5-46a0-83d6-31ae86f26d6a for instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 on n-h1-846209-2 Jun 16 19:24:44.962273 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-3596c719-e261-4e67-baac-74ce512396e6 req-41ba3a7f-1d0b-4f4e-b91b-5bbc81d38314 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037008 Jun 16 19:24:44.963205 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3041/6193] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:24:45.354635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:45.356685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:45.363838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:45.364522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:45.365441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:45.366791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:45.742441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:45.750098 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4befc094-5370-4408-92ea-2138b53377ba tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.403172 Jun 16 19:24:45.750610 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3153/6194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:45 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:46.769459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:46.770220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:46.776670 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:46.777066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:46.777837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:46.778301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:46.919567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:46.927427 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ac4a1e19-ebdd-498b-a1c4-4b022f6c8423 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.163037 Jun 16 19:24:46.928658 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3042/6195] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:46 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:46.984019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e1426243-1745-4818-aff3-1f1f21239d41 req-a9b31167-fffa-4ed9-ae97-8d264c15784a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf85f41-ec83-4111-bf0e-824233c6df68", "tag": "d66ba544-b4fc-4a1e-9cde-a160aee37ad2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:46.993456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e1426243-1745-4818-aff3-1f1f21239d41 req-a9b31167-fffa-4ed9-ae97-8d264c15784a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:46.993943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e1426243-1745-4818-aff3-1f1f21239d41 req-a9b31167-fffa-4ed9-ae97-8d264c15784a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:47.009016 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e1426243-1745-4818-aff3-1f1f21239d41 req-a9b31167-fffa-4ed9-ae97-8d264c15784a service nova] Creating event network-changed:d66ba544-b4fc-4a1e-9cde-a160aee37ad2 for instance 5cf85f41-ec83-4111-bf0e-824233c6df68 on n-h1-846209-2 Jun 16 19:24:47.014026 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e1426243-1745-4818-aff3-1f1f21239d41 req-a9b31167-fffa-4ed9-ae97-8d264c15784a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033885 Jun 16 19:24:47.014623 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3154/6196] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:24:47.944681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:47.945451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:47.952824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:47.953279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:47.954101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:47.954560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:48.166825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:48.174882 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b4611102-01c9-4e34-ba7e-e3c38fa5143a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.234159 Jun 16 19:24:48.175466 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3043/6197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:47 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:49.193581 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:49.194330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:49.200988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:49.201450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:49.202253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:49.202699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:49.334299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:49.343027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e03c3fa-e863-489b-bb7e-13adeafd4007 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.154619 Jun 16 19:24:49.343606 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3155/6198] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:49 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:50.360659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:50.361280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:50.368995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:50.369450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:50.370776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:50.370776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:50.504530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:50.513319 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92f8851d-3a1b-4ef6-b76c-c5b3045f66dd tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.156617 Jun 16 19:24:50.514018 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3044/6199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:50 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:51.530408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:51.531079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:51.538942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:51.539410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:51.540193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:51.540650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:51.692759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:51.702598 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-033b377d-206d-4e66-9160-a21ea696c524 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.176065 Jun 16 19:24:51.703153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3156/6200] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:51 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:52.697703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f52f0d12-f7f8-4883-aedd-af9e18c9f2a4 req-229ec993-15ce-4dde-8f39-0f692ef9c648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf85f41-ec83-4111-bf0e-824233c6df68", "name": "network-vif-plugged", "status": "completed", "tag": "d66ba544-b4fc-4a1e-9cde-a160aee37ad2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:52.707269 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f52f0d12-f7f8-4883-aedd-af9e18c9f2a4 req-229ec993-15ce-4dde-8f39-0f692ef9c648 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:52.707728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f52f0d12-f7f8-4883-aedd-af9e18c9f2a4 req-229ec993-15ce-4dde-8f39-0f692ef9c648 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:52.720142 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f52f0d12-f7f8-4883-aedd-af9e18c9f2a4 req-229ec993-15ce-4dde-8f39-0f692ef9c648 service nova] Creating event network-vif-plugged:d66ba544-b4fc-4a1e-9cde-a160aee37ad2 for instance 5cf85f41-ec83-4111-bf0e-824233c6df68 on n-h1-846209-2 Jun 16 19:24:52.721082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:52.721793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:52.725870 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f52f0d12-f7f8-4883-aedd-af9e18c9f2a4 req-229ec993-15ce-4dde-8f39-0f692ef9c648 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031279 Jun 16 19:24:52.726685 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3045/6201] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:24:52.730958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:52.731504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:52.732370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:52.732892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:52.948523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:52.950895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:52.958622 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-502b0dce-6f5b-4820-8e3b-9c88913c1fa0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.241814 Jun 16 19:24:52.959209 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3157/6202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:52 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:53.973150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:53.979773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:53.980813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:53.991359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:53.993080 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:53.993883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:53.994357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:54.130314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:54.139554 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d818952a-4065-4bae-858f-c6aeb295ebaa tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1318 microversion: 2.1 time: 0.167202 Jun 16 19:24:54.140359 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3046/6203] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:53 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:24:55.157241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:55.157877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:55.159731 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:55.160413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=10 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:24:55.169082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.169552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:55.170388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.170847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:55.640624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:55.648342 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1b2ff91-f4a4-40d9-b856-e60af526ad4c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1507 microversion: 2.1 time: 0.495399 Jun 16 19:24:55.649569 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3158/6204] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:55 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1507 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:55.666071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:55.666705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:55.674073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.674611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:55.675391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.675831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:55.814006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:55.822728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9c6a5e8a-1cac-4a6f-9043-7d66c60e981a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1507 microversion: 2.1 time: 0.161668 Jun 16 19:24:55.823320 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3047/6205] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:55 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:55.839669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:24:55.840719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:55.848221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.848689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:55.849725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.850349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:55.883209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:55.889621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Old instance type m1.heat2, new instance type m1.heat {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:24:55.896686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:24:55.897245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:24:55.897808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:24:55.898430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:24:55.899513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:24:55.964962 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-013443f0-27e5-49fc-9cb6-c0dab3a91f30 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "POST /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68/action" status: 202 len: 0 microversion: 2.1 time: 0.130296 Jun 16 19:24:55.965583 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3159/6206] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:24:55 2022] POST /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:24:55.973754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:55.974414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:55.980547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.981393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:55.981807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:55.982351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:56.143699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:56.151802 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3bc53409-d0f1-4720-a92a-61304de41c85 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1514 microversion: 2.1 time: 0.181996 Jun 16 19:24:56.152379 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3048/6207] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:55 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:24:57.170012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:57.170565 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:57.183919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:57.184421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:57.185221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:57.185677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:57.433584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:57.441951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-03d6cb7e-fe3f-4435-969d-a42814b14ad5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1514 microversion: 2.1 time: 0.277125 Jun 16 19:24:57.442557 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3160/6208] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:57 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:58.460532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:58.461213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:58.468587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:58.469044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:58.469849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:58.470327 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:58.607026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:58.614794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17a65faa-3b0c-4293-b078-c3d0fda69159 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.158247 Jun 16 19:24:58.615369 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3049/6209] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:58 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:24:59.632854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:24:59.633395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:24:59.641218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:59.641696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:59.642547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:24:59.643007 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:24:59.776805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:24:59.784437 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ac509c83-69ce-4a00-8d48-70811c07a19b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.155603 Jun 16 19:24:59.785005 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3161/6210] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:24:59 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:00.800866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:00.801485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:00.808500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:00.809204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:00.809989 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:00.810429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:00.946595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:00.954989 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16a1e3b5-b548-4f27-8f77-e8c14f996014 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.158246 Jun 16 19:25:00.955574 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3050/6211] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:00 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:01.972619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:01.973265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:01.980357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:01.980804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:01.981578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:01.982058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:02.112924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:02.120495 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6f895d0f-adf3-41e1-a88d-8c1af4dc42d6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.151822 Jun 16 19:25:02.121077 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3162/6212] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:01 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:03.136961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:03.137893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:03.144716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:03.145178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:03.145972 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:03.146419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:03.331048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:03.338677 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c37525e-00cf-4f88-a494-16a6cb77ebe7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.205734 Jun 16 19:25:03.339258 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3051/6213] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:03 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:04.356563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:04.357265 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:04.364479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:04.364954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:04.365747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:04.366233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:04.541222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:04.550156 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c7bb1309-3604-4a71-804d-93a92cf42bd4 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.198191 Jun 16 19:25:04.550724 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3163/6214] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:04 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:05.567895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:05.568544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:05.575658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:05.576757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:05.577535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:05.578010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:05.592625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:05.716967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:05.724549 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a476d4b3-1fd7-4ed6-9f71-611053251a6e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.160543 Jun 16 19:25:05.725132 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3052/6215] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:05 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:06.741282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:06.741936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:06.749775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:06.750276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:06.751068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:06.751528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:06.970179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:06.979343 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5e02ebe7-e53f-429f-b664-8b9569c9ec55 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.241814 Jun 16 19:25:06.983660 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3164/6216] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:06 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:07.998856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:07.999372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:08.003625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:08.008352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:08.008805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:08.009620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:08.010087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:08.226297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:08.234272 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1beeb62c-b5b9-42f7-be26-12c821432dd1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.240219 Jun 16 19:25:08.234857 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3053/6217] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:07 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:09.250595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:09.251222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:09.253940 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:09.259290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:09.259756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:09.260530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:09.260986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:09.407554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:09.415179 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-53235f04-4c9d-4d5c-bdbb-8ef2e367c71a tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.168543 Jun 16 19:25:09.415770 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3165/6218] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:09 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:10.432649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:10.433306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:10.440796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:10.441254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:10.442085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:10.442532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:10.573302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:10.581602 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d170f30a-7a99-499b-a483-8da503f8289f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.152909 Jun 16 19:25:10.582215 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3054/6219] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:10 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:11.599005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:11.599630 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:11.606736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:11.607203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:11.608715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:11.609287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:11.744692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:11.752490 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4b881ffa-3fd7-4300-b401-2d72a899fb68 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.157388 Jun 16 19:25:11.753075 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3166/6220] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:11 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:12.769744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:12.770395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:12.777366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:12.777828 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:12.778662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:12.779112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:12.917633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:12.926428 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd4d43f0-8389-48ef-809f-5b2c13eb9a44 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.160652 Jun 16 19:25:12.927006 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3055/6221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:12 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:13.943670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:13.944308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:13.951273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:13.952281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:13.953070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:13.953505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:14.085481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:14.093813 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-360ed896-07e5-404e-9108-5d495a50c927 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.154176 Jun 16 19:25:14.094415 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3167/6222] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:13 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:15.111659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:15.112265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:15.119226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:15.119672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:15.120430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:15.120862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:15.259244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:15.266927 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-39088f00-0446-4262-8532-86626f770ed6 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.159971 Jun 16 19:25:15.267495 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3056/6223] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:15 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:16.284841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:16.285518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:16.292516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:16.292980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:16.293761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:16.294233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:16.429038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:16.436724 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9abf3c3c-34c9-466b-ac4e-4277f375e113 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.156269 Jun 16 19:25:16.437298 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3168/6224] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:16 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:17.454343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:17.454963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:17.463363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:17.463826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:17.464602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:17.465049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:17.595541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:17.603181 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26f1e43a-e824-420e-8252-9a6a589f5f5b tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.152882 Jun 16 19:25:17.603763 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3057/6225] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:17 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:18.620699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:18.621262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:18.628274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:18.628848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:18.629637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:18.630136 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:18.762185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:18.770009 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd80f508-3d83-44ae-b50e-cafc41e0c0d0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.153310 Jun 16 19:25:18.770594 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3169/6226] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:18 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:19.787572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:19.788196 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:19.795255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:19.795721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:19.796500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:19.796944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:19.929007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:19.936654 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d1eb3d7-cfe3-4ba9-8ebd-88a47f0d2358 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.153656 Jun 16 19:25:19.937235 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3058/6227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:19 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:20.954672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:20.955318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:20.963175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:20.963654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:20.964446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:20.964903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:21.098309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:21.106053 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5aa07d2f-effe-4dfa-a5c1-ace4bb56f332 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.155268 Jun 16 19:25:21.106638 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3170/6228] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:20 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:22.123634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:22.124177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:22.131502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:22.131964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:22.132749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:22.133209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:22.268746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:22.277071 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87a03820-2c0c-4eed-b48f-7493c72ee9f5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.157460 Jun 16 19:25:22.277665 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3059/6229] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:22 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:23.294749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:23.295382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:23.303612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:23.304077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:23.304858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:23.305315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:23.441744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:23.449786 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3760010b-6779-4f27-8726-07f7f059763c tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.158951 Jun 16 19:25:23.450394 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3171/6230] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:23 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:24.467550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:24.468171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:24.475319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:24.475775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:24.476578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:24.477021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:24.517571 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:25:24.517743 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:25:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 (ip 10.222.0.27) !!! Jun 16 19:25:24.610906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:24.619440 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2035a091-67b5-483b-9754-60c3d5940ec1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1519 microversion: 2.1 time: 0.155788 Jun 16 19:25:24.620020 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3060/6231] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:24 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:25.641872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:25.643325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:25.657518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:25.658696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:25.662032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:25.663093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:25.674812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-afc1da31-045a-44e4-8317-7da45c5c50be req-f9357834-2f77-48dd-9f26-2b12a05c0c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf85f41-ec83-4111-bf0e-824233c6df68", "name": "network-vif-unplugged", "status": "completed", "tag": "d66ba544-b4fc-4a1e-9cde-a160aee37ad2"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:25.690994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-afc1da31-045a-44e4-8317-7da45c5c50be req-f9357834-2f77-48dd-9f26-2b12a05c0c47 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:25.691964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-afc1da31-045a-44e4-8317-7da45c5c50be req-f9357834-2f77-48dd-9f26-2b12a05c0c47 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:25.700772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:25.730252 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-afc1da31-045a-44e4-8317-7da45c5c50be req-f9357834-2f77-48dd-9f26-2b12a05c0c47 service nova] Creating event network-vif-unplugged:d66ba544-b4fc-4a1e-9cde-a160aee37ad2 for instance 5cf85f41-ec83-4111-bf0e-824233c6df68 on n-h2-846209-2 Jun 16 19:25:25.739899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-afc1da31-045a-44e4-8317-7da45c5c50be req-f9357834-2f77-48dd-9f26-2b12a05c0c47 service nova] Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:25:25.755089 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-afc1da31-045a-44e4-8317-7da45c5c50be req-f9357834-2f77-48dd-9f26-2b12a05c0c47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166602 Jun 16 19:25:25.756837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3172/6232] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:25:25.877691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:25.897011 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2449967b-4144-42ff-9725-ffe3c34f77b5 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1518 microversion: 2.1 time: 0.262209 Jun 16 19:25:25.913169 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3061/6233] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:25 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1518 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:25:26.922327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:26.922994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:26.930890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:26.931355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:26.932141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:26.932589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:27.070230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:27.078142 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e11bbad5-c0df-400f-ae75-20c37ccbd3a0 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1516 microversion: 2.1 time: 0.161399 Jun 16 19:25:27.079043 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3173/6234] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:26 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:27.771685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7bbee49e-edb9-4601-b9f8-78051ecff293 req-590914a9-0f14-4ba7-a7be-bf6ab0b4dd36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf85f41-ec83-4111-bf0e-824233c6df68", "tag": "d66ba544-b4fc-4a1e-9cde-a160aee37ad2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:27.780720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7bbee49e-edb9-4601-b9f8-78051ecff293 req-590914a9-0f14-4ba7-a7be-bf6ab0b4dd36 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:27.781173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7bbee49e-edb9-4601-b9f8-78051ecff293 req-590914a9-0f14-4ba7-a7be-bf6ab0b4dd36 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:27.793216 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7bbee49e-edb9-4601-b9f8-78051ecff293 req-590914a9-0f14-4ba7-a7be-bf6ab0b4dd36 service nova] Creating event network-changed:d66ba544-b4fc-4a1e-9cde-a160aee37ad2 for instance 5cf85f41-ec83-4111-bf0e-824233c6df68 on n-h2-846209-2 Jun 16 19:25:27.799027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-7bbee49e-edb9-4601-b9f8-78051ecff293 req-590914a9-0f14-4ba7-a7be-bf6ab0b4dd36 service nova] Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:25:27.810804 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7bbee49e-edb9-4601-b9f8-78051ecff293 req-590914a9-0f14-4ba7-a7be-bf6ab0b4dd36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042856 Jun 16 19:25:27.811425 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3062/6235] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:25:28.096593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:28.098248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:28.105448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:28.105984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:28.106770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:28.107228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:28.340021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:28.355878 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f481d2de-6993-43cc-80eb-0d11d5d75c50 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1513 microversion: 2.1 time: 0.263421 Jun 16 19:25:28.356643 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3174/6236] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:28 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:28.374907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c8648165-1ba6-4ea0-9a34-41cc13593ad1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:28.375555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c8648165-1ba6-4ea0-9a34-41cc13593ad1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:28.382618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8648165-1ba6-4ea0-9a34-41cc13593ad1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:28.383085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8648165-1ba6-4ea0-9a34-41cc13593ad1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:28.383886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8648165-1ba6-4ea0-9a34-41cc13593ad1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:28.384805 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c8648165-1ba6-4ea0-9a34-41cc13593ad1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:28.458202 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c8648165-1ba6-4ea0-9a34-41cc13593ad1 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "POST /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68/action" status: 204 len: 0 microversion: 2.1 time: 0.086650 Jun 16 19:25:28.458860 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3063/6237] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:25:28 2022] POST /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:25:28.467717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:28.468441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:28.475451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:28.476279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:28.477260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:28.478176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:28.721029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:28.729258 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-43faca4c-dbf9-4a14-a369-5e877f0abae7 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1513 microversion: 2.1 time: 0.265997 Jun 16 19:25:28.729852 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3175/6238] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:28 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:25:29.749180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:29.750040 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:29.756741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:29.757203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:29.758026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:29.758498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:29.916010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:29.924147 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-046e2105-8a67-4abd-b078-980724ddaf8e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1505 microversion: 2.1 time: 0.180069 Jun 16 19:25:29.924731 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3064/6239] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:29 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:29.941544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:29.942471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:29.950379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:29.950846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:29.951636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:29.952090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.084542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:30.092297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-406a40ff-2e3d-43ac-aa12-668d62817795 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1505 microversion: 2.1 time: 0.155499 Jun 16 19:25:30.092902 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3176/6240] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:29 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:30.107958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:30.108572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:30.114694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.115142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.115903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.116338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.249641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:30.259214 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bc6978ec-b6ef-441e-ac2f-0e5b6e63792d tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1505 microversion: 2.1 time: 0.155072 Jun 16 19:25:30.259791 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3065/6241] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:30 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:30.275393 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:30.275903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:30.282023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.282489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.283290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.283736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.308705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:25:30.386029 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6c1f8900-b15e-4828-ba68-8887f2e6ba81 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 204 len: 0 microversion: 2.1 time: 0.114273 Jun 16 19:25:30.386698 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3177/6242] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:25:30 2022] DELETE /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:25:30.403435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:30.403939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:30.410396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.410849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.411619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.412060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.439929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:25:30.481653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:30.484856 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.compute.api [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Instance is already in deleting state, ignoring this request Jun 16 19:25:30.485682 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa174482-c5d7-44e8-88ac-89914f04b0da tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 204 len: 0 microversion: 2.1 time: 0.086250 Jun 16 19:25:30.486282 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3066/6243] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:25:30 2022] DELETE /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:25:30.495452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:30.496304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:30.502916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.504612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.505407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:30.505950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:30.641442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:30.649457 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3cf2132a-171a-45e1-bc21-59555a8c408f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1511 microversion: 2.1 time: 0.158227 Jun 16 19:25:30.650064 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3178/6244] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:30 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:31.517091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-e81d97b9-c759-4561-970f-4bee18b2b3de req-17d17f78-93f9-4f95-8ad4-fb5fc61f176e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf85f41-ec83-4111-bf0e-824233c6df68", "name": "network-vif-plugged", "status": "completed", "tag": "d66ba544-b4fc-4a1e-9cde-a160aee37ad2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:31.526020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e81d97b9-c759-4561-970f-4bee18b2b3de req-17d17f78-93f9-4f95-8ad4-fb5fc61f176e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:31.526466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-e81d97b9-c759-4561-970f-4bee18b2b3de req-17d17f78-93f9-4f95-8ad4-fb5fc61f176e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:31.537752 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-e81d97b9-c759-4561-970f-4bee18b2b3de req-17d17f78-93f9-4f95-8ad4-fb5fc61f176e service nova] Creating event network-vif-plugged:d66ba544-b4fc-4a1e-9cde-a160aee37ad2 for instance 5cf85f41-ec83-4111-bf0e-824233c6df68 on n-h2-846209-2 Jun 16 19:25:31.542798 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-e81d97b9-c759-4561-970f-4bee18b2b3de req-17d17f78-93f9-4f95-8ad4-fb5fc61f176e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080264 Jun 16 19:25:31.543391 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3067/6245] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:25:31.666304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:31.666927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:31.674123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:31.674589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:31.675359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:31.675814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:31.810583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d36cad2b8e64189a2645f5367f7c85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb108850e8504a3aafc08934f85e91e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:31.819579 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fea0aa86-0b67-4042-ba4d-20c44c29b831 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 200 len: 1511 microversion: 2.1 time: 0.157198 Jun 16 19:25:31.820269 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3179/6246] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:31 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:32.143490 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-db762c00-e4a5-4428-85be-be1853c08d69 req-76853bd9-5ba7-469d-9af0-b33dd005632d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf85f41-ec83-4111-bf0e-824233c6df68", "name": "network-vif-deleted", "tag": "d66ba544-b4fc-4a1e-9cde-a160aee37ad2"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:32.154706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-db762c00-e4a5-4428-85be-be1853c08d69 req-76853bd9-5ba7-469d-9af0-b33dd005632d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:32.155153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-db762c00-e4a5-4428-85be-be1853c08d69 req-76853bd9-5ba7-469d-9af0-b33dd005632d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:32.169296 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-db762c00-e4a5-4428-85be-be1853c08d69 req-76853bd9-5ba7-469d-9af0-b33dd005632d service nova] Creating event network-vif-deleted:d66ba544-b4fc-4a1e-9cde-a160aee37ad2 for instance 5cf85f41-ec83-4111-bf0e-824233c6df68 on n-h2-846209-2 Jun 16 19:25:32.174603 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-db762c00-e4a5-4428-85be-be1853c08d69 req-76853bd9-5ba7-469d-9af0-b33dd005632d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034845 Jun 16 19:25:32.175217 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3068/6247] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:25:32.837597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:32.838249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 5cf85f41-ec83-4111-bf0e-824233c6df68] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:32.845338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:32.845930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:32.846705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:32.847157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:32.861630 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] HTTP exception thrown: Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 could not be found. Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Request method failure captured: Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 HTTP/1.1 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4NIyv5OrP0IkZ6rDu5gMhJJzPWJYrQyHKuXiM4wYHAGIjz8AqNBZQmqs3ztN-kggmlEARXEWvVI1Tp8jsmD4nenQSfVAJQvyrHnDvVBk8SxIauGDP1prjZYW2mxbi8pYiG98BISJZ1iOWLOLbG7Cm1B8O5Ro1k5R1LGgZ49hndii_s Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bb108850e8504a3aafc08934f85e91e9 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb108850e8504a3aafc08934f85e91e9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bb108850e8504a3aafc08934f85e91e9 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerDiskConfigTestJSON-651204550-project Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d36cad2b8e64189a2645f5367f7c85a Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerDiskConfigTestJSON-651204550-project Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 could not be found. Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5cf85f41-ec83-4111-bf0e-824233c6df68'} Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 could not be found. Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 could not be found. Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:25:32.864072 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 could not be found. Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Returning 404 to user: Instance 5cf85f41-ec83-4111-bf0e-824233c6df68 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-318dba21-4d3b-451f-b655-4e00b2bce842 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68" status: 404 len: 111 microversion: 2.1 time: 0.032156 Jun 16 19:25:32.867994 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3180/6248] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:32 2022] GET /compute/v2.1/servers/5cf85f41-ec83-4111-bf0e-824233c6df68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:25:32.875513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b23ff462-c6a9-4965-9e82-b5ca4f346693 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '.version_select at 0x7f866de1ba60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:32.899123 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b23ff462-c6a9-4965-9e82-b5ca4f346693 tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989327420" status: 202 len: 0 microversion: 2.1 time: 0.028345 Jun 16 19:25:32.899732 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3069/6249] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 19:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989327420 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:25:33.498302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:33.498821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:33.505585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:33.506096 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:33.506885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:33.507342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:33.520966 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] HTTP exception thrown: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Request method failure captured: Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 HTTP/1.1 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4NIyv5OrP0IkZ6rDu5gMhJJzPWJYrQyHKuXiM4wYHAGIjz8AqNBZQmqs3ztN-kggmlEARXEWvVI1Tp8jsmD4nenQSfVAJQvyrHnDvVBk8SxIauGDP1prjZYW2mxbi8pYiG98BISJZ1iOWLOLbG7Cm1B8O5Ro1k5R1LGgZ49hndii_s Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: bb108850e8504a3aafc08934f85e91e9 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb108850e8504a3aafc08934f85e91e9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: bb108850e8504a3aafc08934f85e91e9 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerDiskConfigTestJSON-651204550-project Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d36cad2b8e64189a2645f5367f7c85a Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerDiskConfigTestJSON-651204550-project Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3f76d450-6d7e-407c-a6a0-60f9be75e201'} Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:25:33.522605 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Returning 404 to user: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e2230466-c966-4e02-b9dc-785b8dc53c9f tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 404 len: 111 microversion: 2.1 time: 0.030025 Jun 16 19:25:33.526231 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3181/6250] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:25:33 2022] DELETE /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:25:33.532799 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:33.533541 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] [instance: 3f76d450-6d7e-407c-a6a0-60f9be75e201] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:33.540932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:33.541382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:33.542192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:33.542627 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:33.556655 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] HTTP exception thrown: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Request method failure captured: Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 HTTP/1.1 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4NIyv5OrP0IkZ6rDu5gMhJJzPWJYrQyHKuXiM4wYHAGIjz8AqNBZQmqs3ztN-kggmlEARXEWvVI1Tp8jsmD4nenQSfVAJQvyrHnDvVBk8SxIauGDP1prjZYW2mxbi8pYiG98BISJZ1iOWLOLbG7Cm1B8O5Ro1k5R1LGgZ49hndii_s Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: bb108850e8504a3aafc08934f85e91e9 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb108850e8504a3aafc08934f85e91e9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb108850e8504a3aafc08934f85e91e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: bb108850e8504a3aafc08934f85e91e9 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-651204550 Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerDiskConfigTestJSON-651204550-project Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6d36cad2b8e64189a2645f5367f7c85a Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerDiskConfigTestJSON-651204550-project Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '3f76d450-6d7e-407c-a6a0-60f9be75e201'} Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:25:33.558313 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] Returning 404 to user: Instance 3f76d450-6d7e-407c-a6a0-60f9be75e201 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-86cc19e4-288f-432f-8c03-db547663534e tempest-ServerDiskConfigTestJSON-651204550 tempest-ServerDiskConfigTestJSON-651204550-project] 10.222.0.27 "GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201" status: 404 len: 111 microversion: 2.1 time: 0.030865 Jun 16 19:25:33.565094 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3070/6251] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:33 2022] GET /compute/v2.1/servers/3f76d450-6d7e-407c-a6a0-60f9be75e201 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:25:42.424396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3bad565a-d609-4ce7-9f42-9c118637a337 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'create', calling method: .version_select at 0x7f866ed9fee0>, body: {"keypair": {"name": "tempest-keypair-194723681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqubzs3YRlc3dQZYwwDwcI9xdCh1Woin2kuqUEKqcFzkYdDJ3xIl/tx13WMRYT+9c+Q9GdNqpPdI08R7qLb370Q1n9A81fbf0pOiHR2gH7hSKPgIxRMvPrX0L2sBOFfCQ=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:42.429816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:42.444885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3bad565a-d609-4ce7-9f42-9c118637a337 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:25:42.451751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3bad565a-d609-4ce7-9f42-9c118637a337 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for user b9974643a17249f5a709f5d5170f2bd1 and project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:25:42.488769 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3bad565a-d609-4ce7-9f42-9c118637a337 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.246064 Jun 16 19:25:42.489509 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3182/6252] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:25:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:25:43.830910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2014485558", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38f38477-4fc3-4d27-ac8e-5ff14334cf2c"}], "security_groups": [{"name": "tempest-securitygroup--1377102978"}], "key_name": "tempest-keypair-194723681", "user_data": "}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:43.839636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:43.840855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:43.951111 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] validate_networks() for [('38f38477-4fc3-4d27-ac8e-5ff14334cf2c', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:25:44.368004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:25:44.368442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:25:44.368920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:25:44.369544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:25:44.369995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:25:44.381121 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:44.381558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:44.382530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:44.382980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:44.401500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:25:44.407505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for user b9974643a17249f5a709f5d5170f2bd1 and project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:25:44.420733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:25:44.423078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:25:44.474861 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-160f92c5-c42e-4c95-ab83-dce101a92a7e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.647631 Jun 16 19:25:44.475455 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3071/6253] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:25:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:25:44.483780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:44.487837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c618f6b6-89f1-4437-8635-45e93c520dcd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:44.488472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c618f6b6-89f1-4437-8635-45e93c520dcd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:44.565523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c618f6b6-89f1-4437-8635-45e93c520dcd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:44.573994 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c618f6b6-89f1-4437-8635-45e93c520dcd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1238 microversion: 2.1 time: 0.091712 Jun 16 19:25:44.583628 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3183/6254] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:44 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:45.594612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:45.595929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:45.606428 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:45.607089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:45.608057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:45.608653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:45.679232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:45.687018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e6097586-97c6-4cdf-b241-40177c4e3875 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1308 microversion: 2.1 time: 0.099414 Jun 16 19:25:45.687607 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3072/6255] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:45 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:46.704457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:46.705726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:46.714115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:46.714592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:46.715397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:46.715857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:46.866194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:46.876772 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-87dd404c-79fd-420c-a373-50834b78afc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1364 microversion: 2.1 time: 0.176241 Jun 16 19:25:46.887868 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3184/6256] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:46 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:47.014999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5f90ee84-b241-4512-b38b-e176bda54b80 req-34917618-f519-4bec-8a0b-a42953264051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f91b78-77a9-448c-b89e-e24ee83b8545", "tag": "1ae4cbd2-5dc6-460b-9934-0daa6717c08d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:47.025227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5f90ee84-b241-4512-b38b-e176bda54b80 req-34917618-f519-4bec-8a0b-a42953264051 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:47.025874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5f90ee84-b241-4512-b38b-e176bda54b80 req-34917618-f519-4bec-8a0b-a42953264051 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:47.039107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5f90ee84-b241-4512-b38b-e176bda54b80 req-34917618-f519-4bec-8a0b-a42953264051 service nova] Creating event network-changed:1ae4cbd2-5dc6-460b-9934-0daa6717c08d for instance f6f91b78-77a9-448c-b89e-e24ee83b8545 on n-h2-846209-2 Jun 16 19:25:47.044721 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5f90ee84-b241-4512-b38b-e176bda54b80 req-34917618-f519-4bec-8a0b-a42953264051 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Jun 16 19:25:47.045706 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3073/6257] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:25:47.895194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:47.896523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:47.903594 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:47.904067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:47.904846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:47.905302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:48.039907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:48.047625 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e3d979b8-c32f-459d-a3f9-b0b61f1ca41a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1364 microversion: 2.1 time: 0.156454 Jun 16 19:25:48.048197 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3185/6258] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:47 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:49.066062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:49.066772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:49.073770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:49.074256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:49.075029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:49.075471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:49.207706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:49.215339 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e7c3db3a-44ac-428a-9de9-4de1f5af506c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1364 microversion: 2.1 time: 0.154335 Jun 16 19:25:49.215914 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3074/6259] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:49 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:50.232539 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:50.233231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:50.240468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:50.240948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:50.241735 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:50.242235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:50.736548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:50.745691 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5e34225d-ce70-4966-8383-f2e36008790f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1364 microversion: 2.1 time: 0.517119 Jun 16 19:25:50.746303 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3186/6260] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:50 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:51.764163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:51.764807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:51.772921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:51.773381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:51.774202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:51.774654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:51.916801 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:51.925928 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b8941f31-3c12-41bf-a577-26a0c8f8e4e7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1364 microversion: 2.1 time: 0.167053 Jun 16 19:25:51.926540 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3075/6261] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:51 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:52.944522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:52.945104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:52.952404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:52.952878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:52.953688 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:52.954173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:53.093867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:53.102561 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-373a5c62-af97-4847-8fa6-209eba102324 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1364 microversion: 2.1 time: 0.162797 Jun 16 19:25:53.103166 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3187/6262] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:52 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:53.436170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-d5ded4ae-44e5-42b7-bd28-56bde3022599 req-50314941-79fe-4d33-9ad7-5e74ed4b3438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f91b78-77a9-448c-b89e-e24ee83b8545", "name": "network-vif-plugged", "status": "completed", "tag": "1ae4cbd2-5dc6-460b-9934-0daa6717c08d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:53.447041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d5ded4ae-44e5-42b7-bd28-56bde3022599 req-50314941-79fe-4d33-9ad7-5e74ed4b3438 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:53.447512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-d5ded4ae-44e5-42b7-bd28-56bde3022599 req-50314941-79fe-4d33-9ad7-5e74ed4b3438 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:53.463040 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-d5ded4ae-44e5-42b7-bd28-56bde3022599 req-50314941-79fe-4d33-9ad7-5e74ed4b3438 service nova] Creating event network-vif-plugged:1ae4cbd2-5dc6-460b-9934-0daa6717c08d for instance f6f91b78-77a9-448c-b89e-e24ee83b8545 on n-h2-846209-2 Jun 16 19:25:53.468331 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-d5ded4ae-44e5-42b7-bd28-56bde3022599 req-50314941-79fe-4d33-9ad7-5e74ed4b3438 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035955 Jun 16 19:25:53.468955 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3076/6263] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:25:54.121966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:54.122692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:54.129747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:54.130263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:54.131113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:54.131554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:54.269210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:54.279569 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4390f90b-4f2a-4cf2-9cb8-1aa86e79da21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1364 microversion: 2.1 time: 0.162499 Jun 16 19:25:54.280155 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3188/6264] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:54 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:55.294517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:55.295304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:55.301398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:55.302166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:55.309577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:55.310137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:55.310912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:55.311353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:55.444575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:25:55.455770 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0202a94b-6203-42ff-b644-8df3bf1e6a8b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1551 microversion: 2.1 time: 0.161532 Jun 16 19:25:55.456118 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3077/6265] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:25:55 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:25:55.481861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-19ae741f-51bc-4aee-b68f-90db75d9dc67 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:25:55.482433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-19ae741f-51bc-4aee-b68f-90db75d9dc67 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:25:55.484416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:25:55.492859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19ae741f-51bc-4aee-b68f-90db75d9dc67 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:55.493659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19ae741f-51bc-4aee-b68f-90db75d9dc67 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:55.494495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19ae741f-51bc-4aee-b68f-90db75d9dc67 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:55.494952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-19ae741f-51bc-4aee-b68f-90db75d9dc67 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:55.578667 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-19ae741f-51bc-4aee-b68f-90db75d9dc67 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109837 Jun 16 19:25:55.579298 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3189/6266] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 19:25:55 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:25:56.660154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-07e97cee-8a4f-4679-b778-4bc93ae56a93 req-256c56de-11e3-4e12-bb9e-23085f452ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f91b78-77a9-448c-b89e-e24ee83b8545", "tag": "1ae4cbd2-5dc6-460b-9934-0daa6717c08d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:25:56.668626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-07e97cee-8a4f-4679-b778-4bc93ae56a93 req-256c56de-11e3-4e12-bb9e-23085f452ab3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:25:56.669075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-07e97cee-8a4f-4679-b778-4bc93ae56a93 req-256c56de-11e3-4e12-bb9e-23085f452ab3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:25:56.681106 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-07e97cee-8a4f-4679-b778-4bc93ae56a93 req-256c56de-11e3-4e12-bb9e-23085f452ab3 service nova] Creating event network-changed:1ae4cbd2-5dc6-460b-9934-0daa6717c08d for instance f6f91b78-77a9-448c-b89e-e24ee83b8545 on n-h2-846209-2 Jun 16 19:25:56.687631 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-07e97cee-8a4f-4679-b778-4bc93ae56a93 req-256c56de-11e3-4e12-bb9e-23085f452ab3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088299 Jun 16 19:25:56.688238 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3078/6267] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:26:32.791487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:26:32.792312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=34 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:26:32.796756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:32.797936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:32.805398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:32.805947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:32.806796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:32.807328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:32.948846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:32.956886 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f399262d-7a74-427b-b555-60ae7e06f3c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1670 microversion: 2.1 time: 0.167700 Jun 16 19:26:32.957472 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3190/6268] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:32 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:32.972325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:26:32.973071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=32 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:26:32.977592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:32.978334 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:32.986560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:32.987019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:32.987800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:32.988248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:33.128767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:33.136576 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d9d39e1-a854-4e2c-901a-65cb77a7df43 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1670 microversion: 2.1 time: 0.167189 Jun 16 19:26:33.137165 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3079/6269] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:32 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:33.153202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:33.153835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:33.162768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:33.163241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:33.164020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:33.164475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:33.296355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:33.304714 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4abc2319-37f4-447f-9a62-55145aebd11f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1670 microversion: 2.1 time: 0.155451 Jun 16 19:26:33.305297 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3191/6270] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:33 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:33.321962 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:26:33.322951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:33.332802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:33.333193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:33.333991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:33.334434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:33.364178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:33.370687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Old instance type m1.heat2, new instance type m1.heat {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:26:33.377158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:26:33.377579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:26:33.378103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:26:33.378520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:26:33.378934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:26:33.444665 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b7eb428b-0ef3-49f1-b89a-0d0e908f7821 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545/action" status: 202 len: 0 microversion: 2.1 time: 0.126567 Jun 16 19:26:33.445475 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3080/6271] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:26:33 2022] POST /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:26:33.454685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:33.455616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:33.462053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:33.462525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:33.463322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:33.463774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:33.623963 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:33.632214 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a65458b-6e9f-4fa7-93eb-49f86754cd4e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1679 microversion: 2.1 time: 0.182316 Jun 16 19:26:33.632800 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3192/6272] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:33 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:34.651580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:34.652202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:34.658901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:34.659357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:34.660127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:34.660591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:34.797777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:34.806182 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-85e400ec-095d-4407-ac35-c511cc296089 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1679 microversion: 2.1 time: 0.159377 Jun 16 19:26:34.806765 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3081/6273] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:34 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:35.823961 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:35.824624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:35.831675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:35.832135 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:35.832912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:35.833390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:35.966680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:35.975237 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-81ca8743-2818-4e79-8f4b-f89cbded355d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.155265 Jun 16 19:26:35.975847 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3193/6274] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:35 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:36.993274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:36.993868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:37.000665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:37.001109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:37.001887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:37.002356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:37.145543 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:37.153147 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d9656981-cc0c-4b88-81e8-d8cb4b2e16b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.163843 Jun 16 19:26:37.153718 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3082/6275] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:36 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:38.170729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:38.171456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:38.179444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:38.180014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:38.180806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:38.181267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:38.313111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:38.321682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3fe494b2-771b-4901-b4aa-3f9f2205f0b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.155110 Jun 16 19:26:38.322298 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3194/6276] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:38 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:39.339756 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:39.340390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:39.347258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:39.347789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:39.348576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:39.349090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:39.484164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:39.492615 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7bfb7a36-5f64-4ec3-95c9-7a93e48253a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.156949 Jun 16 19:26:39.493194 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3083/6277] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:39 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:40.510275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:40.510949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:40.517883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:40.518382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:40.519161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:40.519809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:40.663253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:40.671099 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5782b2f6-50c2-49dc-9df3-0f7a1704d155 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.164959 Jun 16 19:26:40.671695 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3195/6278] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:40 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:41.689339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:41.689864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:41.697545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:41.698037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:41.698807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:41.699250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:41.833833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:41.841461 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a422a91-3cc6-4b5a-9f04-dea50c3451d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.156158 Jun 16 19:26:41.842050 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3084/6279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:41 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:42.859157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:42.859812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:42.867644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:42.868138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:42.868948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:42.869407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:43.003399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:43.011893 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28438bdc-8f0f-4c00-8d28-40b234b8b24a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.156743 Jun 16 19:26:43.012468 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3196/6280] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:42 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:26:44.029036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:44.029766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:44.038048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:44.038510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:44.039295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:44.039741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:44.173569 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:44.182417 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae0814f6-957e-46e8-ac51-49f122ea2241 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.157657 Jun 16 19:26:44.183431 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3085/6281] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:44 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:45.200478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:45.201112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:45.208002 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:45.208481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:45.209441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:45.209899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:45.344062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:45.352607 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90c2cdca-4f32-4f2e-84c8-2e2645bbe7c7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.156035 Jun 16 19:26:45.353183 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3197/6282] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:45 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:26:46.371250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:46.371727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:46.378711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:46.379169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:46.379934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:46.380434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:46.514368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:46.522451 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa247f40-b964-471a-b726-b1f0aaa8774a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1684 microversion: 2.1 time: 0.155099 Jun 16 19:26:46.523360 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3086/6283] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:46 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:47.539571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:47.540774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:47.547677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:47.548154 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:47.548960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:47.549673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:47.791840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:47.799927 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5ba5b000-6955-4436-bbd9-a90ef734d7ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1683 microversion: 2.1 time: 0.264431 Jun 16 19:26:47.800513 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3198/6284] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:47 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1683 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:47.980042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b27aa3ff-e1f1-40a6-8bd9-cf9525a2e9d3 req-58bd7071-f0fc-4cbc-95de-f2a4408a086f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f91b78-77a9-448c-b89e-e24ee83b8545", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae4cbd2-5dc6-460b-9934-0daa6717c08d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:26:47.989151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b27aa3ff-e1f1-40a6-8bd9-cf9525a2e9d3 req-58bd7071-f0fc-4cbc-95de-f2a4408a086f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:47.989869 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b27aa3ff-e1f1-40a6-8bd9-cf9525a2e9d3 req-58bd7071-f0fc-4cbc-95de-f2a4408a086f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:48.002787 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b27aa3ff-e1f1-40a6-8bd9-cf9525a2e9d3 req-58bd7071-f0fc-4cbc-95de-f2a4408a086f service nova] Creating event network-vif-unplugged:1ae4cbd2-5dc6-460b-9934-0daa6717c08d for instance f6f91b78-77a9-448c-b89e-e24ee83b8545 on n-h1-846209-2 Jun 16 19:26:48.008787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-b27aa3ff-e1f1-40a6-8bd9-cf9525a2e9d3 req-58bd7071-f0fc-4cbc-95de-f2a4408a086f service nova] Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:26:48.030373 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b27aa3ff-e1f1-40a6-8bd9-cf9525a2e9d3 req-58bd7071-f0fc-4cbc-95de-f2a4408a086f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054175 Jun 16 19:26:48.031158 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3087/6285] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:26:48.818400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:48.819056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:48.827350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:48.827823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:48.828611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:48.829070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:49.028256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:49.036026 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7acbb090-30aa-40e3-80ab-1a655dc3be2d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1683 microversion: 2.1 time: 0.221751 Jun 16 19:26:49.036612 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3199/6286] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:48 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1683 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:50.046823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-526de93e-c737-426e-9d6f-1a2eef9275a7 req-11c2b856-bb76-4611-913a-9a5afa984526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f91b78-77a9-448c-b89e-e24ee83b8545", "tag": "1ae4cbd2-5dc6-460b-9934-0daa6717c08d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:26:50.052349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:50.052996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:50.055827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-526de93e-c737-426e-9d6f-1a2eef9275a7 req-11c2b856-bb76-4611-913a-9a5afa984526 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:50.056311 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-526de93e-c737-426e-9d6f-1a2eef9275a7 req-11c2b856-bb76-4611-913a-9a5afa984526 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:50.060715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:50.061187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:50.062040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:50.062492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:50.072076 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-526de93e-c737-426e-9d6f-1a2eef9275a7 req-11c2b856-bb76-4611-913a-9a5afa984526 service nova] Creating event network-changed:1ae4cbd2-5dc6-460b-9934-0daa6717c08d for instance f6f91b78-77a9-448c-b89e-e24ee83b8545 on n-h1-846209-2 Jun 16 19:26:50.077660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-526de93e-c737-426e-9d6f-1a2eef9275a7 req-11c2b856-bb76-4611-913a-9a5afa984526 service nova] Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:26:50.089236 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-526de93e-c737-426e-9d6f-1a2eef9275a7 req-11c2b856-bb76-4611-913a-9a5afa984526 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047504 Jun 16 19:26:50.089862 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3088/6287] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:26:50.201236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:50.209159 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2e9de924-61f3-4da0-b0fb-08067c990b5e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1681 microversion: 2.1 time: 0.160896 Jun 16 19:26:50.209748 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3200/6288] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:50 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:26:51.229135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:51.229874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:51.236192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:51.236646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:51.237414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:51.237993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:51.374881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:51.382709 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0b158411-e771-449f-86e9-389dbdad3889 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1678 microversion: 2.1 time: 0.159455 Jun 16 19:26:51.383296 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3089/6289] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:51 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:51.399611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e67f1c1f-5084-475c-9253-7608dadecacc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:26:51.400163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e67f1c1f-5084-475c-9253-7608dadecacc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:51.407651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e67f1c1f-5084-475c-9253-7608dadecacc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:51.408137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e67f1c1f-5084-475c-9253-7608dadecacc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:51.408919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e67f1c1f-5084-475c-9253-7608dadecacc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:51.409382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e67f1c1f-5084-475c-9253-7608dadecacc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:51.472768 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e67f1c1f-5084-475c-9253-7608dadecacc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545/action" status: 204 len: 0 microversion: 2.1 time: 0.077451 Jun 16 19:26:51.473697 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3201/6290] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:26:51 2022] POST /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:26:51.482189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:51.482886 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:51.489232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:51.489699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:51.490597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:51.491044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:51.631587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:51.640147 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a22e7c1e-469f-4d02-a65b-d9bf6db056c2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1678 microversion: 2.1 time: 0.162133 Jun 16 19:26:51.640736 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3090/6291] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:51 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:52.660309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:52.661054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:52.671236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:52.671710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:52.672517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:52.673674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:52.825896 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:52.833719 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-106050c8-f94b-497f-9cc2-376f05fe2a47 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1670 microversion: 2.1 time: 0.178751 Jun 16 19:26:52.834428 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3202/6292] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:52 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:26:52.850872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:52.852405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:52.859753 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:52.860303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:52.861223 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:52.861895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:53.006251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:53.019511 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2ddb8aee-c4c0-4f29-a6f3-74dbb7584fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1670 microversion: 2.1 time: 0.172306 Jun 16 19:26:53.020510 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3091/6293] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:52 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:53.037044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:53.037680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:53.044751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:53.045220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:53.046035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:53.046486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:53.190065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:53.198574 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab5a7ef4-b886-4e66-8775-14ff9c9c265b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1670 microversion: 2.1 time: 0.165601 Jun 16 19:26:53.199375 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3203/6294] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:53 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:53.216395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:53.217140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:53.223604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:53.224138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:53.224969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:53.225475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:53.251301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:26:53.332648 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-36ca7d6c-f12f-4549-afe7-d775567fbff2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 204 len: 0 microversion: 2.1 time: 0.119705 Jun 16 19:26:53.333518 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3092/6295] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:26:53 2022] DELETE /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:26:53.342673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:53.343337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:53.349495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:53.350037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:53.350876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:53.351370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:53.516207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:53.524938 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a1c1fe3-b6a7-4d99-af91-04c1a478c33b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1676 microversion: 2.1 time: 0.186269 Jun 16 19:26:53.525721 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3204/6296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:53 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:26:54.543604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:54.544246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:54.551790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:54.552234 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:54.553048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:54.553481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:54.559318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:26:54.692326 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:54.700999 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c613ddb7-a126-42e9-ab5c-6f825d77b642 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1676 microversion: 2.1 time: 0.162419 Jun 16 19:26:54.701787 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3093/6297] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:54 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:26:55.165118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f91cf164-9b6d-4505-884f-3c8449c824ef req-f7277ccf-b49f-41a4-b767-e784c1277481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f91b78-77a9-448c-b89e-e24ee83b8545", "name": "network-vif-plugged", "status": "completed", "tag": "1ae4cbd2-5dc6-460b-9934-0daa6717c08d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:26:55.177457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f91cf164-9b6d-4505-884f-3c8449c824ef req-f7277ccf-b49f-41a4-b767-e784c1277481 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:55.177457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f91cf164-9b6d-4505-884f-3c8449c824ef req-f7277ccf-b49f-41a4-b767-e784c1277481 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:55.189628 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f91cf164-9b6d-4505-884f-3c8449c824ef req-f7277ccf-b49f-41a4-b767-e784c1277481 service nova] Creating event network-vif-plugged:1ae4cbd2-5dc6-460b-9934-0daa6717c08d for instance f6f91b78-77a9-448c-b89e-e24ee83b8545 on n-h1-846209-2 Jun 16 19:26:55.194881 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f91cf164-9b6d-4505-884f-3c8449c824ef req-f7277ccf-b49f-41a4-b767-e784c1277481 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033684 Jun 16 19:26:55.195662 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3205/6298] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:26:55.718904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:55.719612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:55.726919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:55.727374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:55.728153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:55.728599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:55.816766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:55.826455 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5b07fc76-1787-4a72-be60-a3d5412a8132 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 200 len: 1608 microversion: 2.1 time: 0.111314 Jun 16 19:26:55.827051 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3094/6299] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:55 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 1608 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:55.939994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-436385ce-ff94-4eeb-b1f3-fff4af1bb82a req-b7c3a76a-bc11-4138-87c2-f2aaf0c2324e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f91b78-77a9-448c-b89e-e24ee83b8545", "name": "network-vif-deleted", "tag": "1ae4cbd2-5dc6-460b-9934-0daa6717c08d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:26:55.956640 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-436385ce-ff94-4eeb-b1f3-fff4af1bb82a req-b7c3a76a-bc11-4138-87c2-f2aaf0c2324e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:55.957205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-436385ce-ff94-4eeb-b1f3-fff4af1bb82a req-b7c3a76a-bc11-4138-87c2-f2aaf0c2324e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:55.962214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:26:55.972523 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-436385ce-ff94-4eeb-b1f3-fff4af1bb82a req-b7c3a76a-bc11-4138-87c2-f2aaf0c2324e service nova] Creating event network-vif-deleted:1ae4cbd2-5dc6-460b-9934-0daa6717c08d for instance f6f91b78-77a9-448c-b89e-e24ee83b8545 on n-h1-846209-2 Jun 16 19:26:55.978108 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-436385ce-ff94-4eeb-b1f3-fff4af1bb82a req-b7c3a76a-bc11-4138-87c2-f2aaf0c2324e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042483 Jun 16 19:26:55.979223 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3206/6300] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:26:56.844450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:56.845068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:56.852260 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:56.852718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:56.853515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:56.853988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:56.868171 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 HTTP/1.1 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'f6f91b78-77a9-448c-b89e-e24ee83b8545'} Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:26:56.870547 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a96880c8-f3af-4193-9526-15403ce16872 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 404 len: 111 microversion: 2.1 time: 0.031882 Jun 16 19:26:56.874104 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3095/6301] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:56 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:26:56.887250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:56.888344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:56.899790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:56.901222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:56.902635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:56.903093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:56.918434 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 HTTP/1.1 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f6f91b78-77a9-448c-b89e-e24ee83b8545'} Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:26:56.919711 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d0a73d2-1932-48b2-a72e-8a7480991fd5 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 404 len: 111 microversion: 2.1 time: 0.039577 Jun 16 19:26:56.924077 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3207/6302] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:56 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:26:56.974595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-304921963", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "38f38477-4fc3-4d27-ac8e-5ff14334cf2c"}], "security_groups": [{"name": "tempest-securitygroup--1377102978"}], "key_name": "tempest-keypair-194723681", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:26:57.079174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] validate_networks() for [('38f38477-4fc3-4d27-ac8e-5ff14334cf2c', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:26:57.528697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:26:57.529133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:26:57.529646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:26:57.530103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:26:57.530525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:26:57.545349 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:57.546068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:57.547328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:57.548004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:57.576294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:26:57.585027 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for user b9974643a17249f5a709f5d5170f2bd1 and project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:26:57.602510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:26:57.604963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:26:57.656135 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-276fbfaf-4592-47a5-a69c-cb779b8ce0b8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685488 Jun 16 19:26:57.656793 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3096/6303] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:26:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:26:57.667425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb6c1efe-9a34-4d23-896e-94c070283c54 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:57.668196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb6c1efe-9a34-4d23-896e-94c070283c54 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:57.736087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb6c1efe-9a34-4d23-896e-94c070283c54 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:57.745938 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb6c1efe-9a34-4d23-896e-94c070283c54 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1237 microversion: 2.1 time: 0.082997 Jun 16 19:26:57.746522 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3208/6304] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:57 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:58.765553 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:58.766318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:58.774312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:58.774767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:58.777505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:58.778295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:58.857882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:26:58.865507 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d9c0cb3-cb76-456f-af6b-2634d7eac48e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1295 microversion: 2.1 time: 0.106122 Jun 16 19:26:58.866110 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3097/6305] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:58 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:26:59.884026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:26:59.884825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:26:59.893045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:59.893524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:26:59.894574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:26:59.895042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:00.138944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-911e69b2-9cf2-4bb5-a6ae-33619008c111 req-7503b779-a11e-46a6-a128-477f58db2dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f5999c-3101-4f68-a082-d906c648448f", "tag": "b567529e-3e8f-4447-9120-cfb91b151127"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:27:00.141036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:00.153402 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d489fb28-6ab6-4deb-8824-f469d29cbb9b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1363 microversion: 2.1 time: 0.273450 Jun 16 19:27:00.154020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-911e69b2-9cf2-4bb5-a6ae-33619008c111 req-7503b779-a11e-46a6-a128-477f58db2dd0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:00.155466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-911e69b2-9cf2-4bb5-a6ae-33619008c111 req-7503b779-a11e-46a6-a128-477f58db2dd0 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:00.164491 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3209/6306] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:26:59 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:00.171740 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-911e69b2-9cf2-4bb5-a6ae-33619008c111 req-7503b779-a11e-46a6-a128-477f58db2dd0 service nova] Creating event network-changed:b567529e-3e8f-4447-9120-cfb91b151127 for instance 22f5999c-3101-4f68-a082-d906c648448f on n-h1-846209-2 Jun 16 19:27:00.178004 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-911e69b2-9cf2-4bb5-a6ae-33619008c111 req-7503b779-a11e-46a6-a128-477f58db2dd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042980 Jun 16 19:27:00.179245 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3098/6307] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:27:01.171619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:01.172246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:01.179440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:01.179901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:01.180673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:01.181126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:01.321372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:01.329804 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bfaa3157-709f-4a3b-94f8-08aa232f0c0f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1363 microversion: 2.1 time: 0.162401 Jun 16 19:27:01.330410 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3210/6308] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:01 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:02.350785 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:02.351502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:02.358770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:02.359231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:02.360012 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:02.360460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:02.538993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:02.546803 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-257ae7ee-3cf3-4294-bb3f-7c63ae73a152 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1363 microversion: 2.1 time: 0.200217 Jun 16 19:27:02.547444 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3099/6309] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:02 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:03.564579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:03.565208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:03.568222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=45 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:03.574323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:03.574798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:03.575595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:03.576053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:03.709653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:03.718522 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-056d5a88-a19a-4b81-8231-07497a3e18b1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1363 microversion: 2.1 time: 0.157911 Jun 16 19:27:03.719099 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3211/6310] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:03 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:04.736356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:04.736971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:04.741980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:04.747732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:04.748294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:04.749202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:04.749642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:04.886927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:04.894731 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ab48c7e1-8180-45d3-9e09-dd0dfd4f9374 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1363 microversion: 2.1 time: 0.162299 Jun 16 19:27:04.895308 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3100/6311] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:04 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:05.201110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-bcaf8cf1-8574-4c80-9f3f-f13f3a41cd15 req-3d7455a0-723f-406f-ad70-1237963dc6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5999c-3101-4f68-a082-d906c648448f", "name": "network-vif-plugged", "status": "completed", "tag": "b567529e-3e8f-4447-9120-cfb91b151127"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:27:05.210279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bcaf8cf1-8574-4c80-9f3f-f13f3a41cd15 req-3d7455a0-723f-406f-ad70-1237963dc6f2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:05.210863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-bcaf8cf1-8574-4c80-9f3f-f13f3a41cd15 req-3d7455a0-723f-406f-ad70-1237963dc6f2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:05.225294 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-bcaf8cf1-8574-4c80-9f3f-f13f3a41cd15 req-3d7455a0-723f-406f-ad70-1237963dc6f2 service nova] Creating event network-vif-plugged:b567529e-3e8f-4447-9120-cfb91b151127 for instance 22f5999c-3101-4f68-a082-d906c648448f on n-h1-846209-2 Jun 16 19:27:05.230518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-bcaf8cf1-8574-4c80-9f3f-f13f3a41cd15 req-3d7455a0-723f-406f-ad70-1237963dc6f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034059 Jun 16 19:27:05.231129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3212/6312] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:27:05.911920 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:05.912545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:05.920194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:05.920656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:05.921429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:05.921876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:06.056373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:06.063893 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-73d195b7-c5f3-440f-94da-a0afe047ba0d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1363 microversion: 2.1 time: 0.155956 Jun 16 19:27:06.064456 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3101/6313] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:05 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:06.110449 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:27:06.110657 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:27:07.082016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:07.082764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:07.092997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:07.093468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:07.094277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:07.094728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:07.227266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:07.235080 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9fa76aec-eddb-4baa-98ac-3fc07568605b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1550 microversion: 2.1 time: 0.157417 Jun 16 19:27:07.235647 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3213/6314] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:07 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:07.255584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fcf56b22-1132-4fce-b250-d8d81542c274 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:07.256137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fcf56b22-1132-4fce-b250-d8d81542c274 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:07.263775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf56b22-1132-4fce-b250-d8d81542c274 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:07.264237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf56b22-1132-4fce-b250-d8d81542c274 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:07.265011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf56b22-1132-4fce-b250-d8d81542c274 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:07.265456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fcf56b22-1132-4fce-b250-d8d81542c274 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:07.347670 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fcf56b22-1132-4fce-b250-d8d81542c274 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098547 Jun 16 19:27:07.348281 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3102/6315] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 19:27:07 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:27:08.295773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-0efa1a5d-b19b-411a-aaf2-d8d7b480d73d req-20678749-84ec-48c1-bc2f-c0d473962999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f5999c-3101-4f68-a082-d906c648448f", "tag": "b567529e-3e8f-4447-9120-cfb91b151127"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:27:08.299589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:08.308351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0efa1a5d-b19b-411a-aaf2-d8d7b480d73d req-20678749-84ec-48c1-bc2f-c0d473962999 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:08.309049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-0efa1a5d-b19b-411a-aaf2-d8d7b480d73d req-20678749-84ec-48c1-bc2f-c0d473962999 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:08.321235 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-0efa1a5d-b19b-411a-aaf2-d8d7b480d73d req-20678749-84ec-48c1-bc2f-c0d473962999 service nova] Creating event network-changed:b567529e-3e8f-4447-9120-cfb91b151127 for instance 22f5999c-3101-4f68-a082-d906c648448f on n-h1-846209-2 Jun 16 19:27:08.327128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-0efa1a5d-b19b-411a-aaf2-d8d7b480d73d req-20678749-84ec-48c1-bc2f-c0d473962999 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035254 Jun 16 19:27:08.328350 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3214/6316] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:27:43.290876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:43.291675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:43.293554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=5 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:43.294270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=44 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:43.299774 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7501c6c3-f41c-427b-949c-4d6284f99be8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:27:43.307194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7501c6c3-f41c-427b-949c-4d6284f99be8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:43.307646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7501c6c3-f41c-427b-949c-4d6284f99be8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:43.330788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7501c6c3-f41c-427b-949c-4d6284f99be8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Going to try to stop instance {{(pid=119207) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 19:27:43.374442 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7501c6c3-f41c-427b-949c-4d6284f99be8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action" status: 202 len: 0 microversion: 2.1 time: 0.083360 Jun 16 19:27:43.375044 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3103/6317] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:27:43 2022] POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:27:43.381660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=7 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:43.382496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=31 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:27:43.386915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:43.387739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:43.395231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:43.395788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:43.396573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:43.397020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:43.537838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:43.546220 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-37d65ba8-8acd-4baa-accf-eb9e9ac45b38 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.166647 Jun 16 19:27:43.546719 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3215/6318] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:43 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:44.566325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:44.567096 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:44.573430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:44.573892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:44.574689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:44.575136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:44.718712 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:44.726179 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91ae844d-eaf9-4444-83bf-7bffcd115e24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.165106 Jun 16 19:27:44.726755 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3104/6319] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:44 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:45.743983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:45.744644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:45.752073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:45.752545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:45.753394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:45.753934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:45.888526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:45.896444 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3a77ba28-e230-4e39-bb13-8e83fe849c61 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.156587 Jun 16 19:27:45.897023 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3216/6320] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:45 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:46.914304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:46.914918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:46.922059 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:46.922518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:46.923305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:46.923758 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:47.059963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:47.067786 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27e951e1-0337-4af9-adaa-eea98a357943 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.157402 Jun 16 19:27:47.068353 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3105/6321] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:46 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:48.085972 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:48.086530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:48.093717 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:48.094230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:48.095025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:48.095482 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:48.229275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:48.238247 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ba850ec6-3eb9-46bb-8c48-6c574778cdeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.156495 Jun 16 19:27:48.238839 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3217/6322] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:48 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:49.255982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:49.256595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:49.263390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:49.263843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:49.264611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:49.265052 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:49.803357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:49.812589 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5739636b-5482-4995-afeb-080aaea3f9d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.560520 Jun 16 19:27:49.813189 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3106/6323] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:49 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:50.830775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:50.831405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:50.838442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:50.838909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:50.839692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:50.840150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:50.978704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:50.986320 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a27d8c0-890e-4366-a6b5-93e861486444 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.160144 Jun 16 19:27:50.986887 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3218/6324] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:50 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:52.003048 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:52.003668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:52.010673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:52.011125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:52.011883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:52.012325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:52.143947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:52.151541 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32a776a8-926e-4606-8e11-249cf71a275d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.152615 Jun 16 19:27:52.152108 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3107/6325] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:51 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:53.168783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:53.169319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:53.177179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:53.177637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:53.178436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:53.178883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:53.312230 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:53.319804 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1528919b-dede-49e5-aba1-f0345cc6a210 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.155094 Jun 16 19:27:53.320365 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3219/6326] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:53 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:54.336922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:54.337567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:54.345233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:54.345686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:54.346487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:54.346924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:54.482669 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:54.490881 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6bc943c7-6cc7-4b9a-9c6b-bfa6b6bfb4be tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.158025 Jun 16 19:27:54.491474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3108/6327] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:54 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:55.508705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:55.509487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:55.517354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:55.517827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:55.518656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:55.519117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:55.652304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:55.660077 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-27327c96-2583-43d6-9428-783a5a35fb6d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.155361 Jun 16 19:27:55.660650 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3220/6328] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:55 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:56.677589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:56.678162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:56.685079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:56.685537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:56.686335 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:56.686782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:56.820931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:56.829173 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c7fda726-9c5c-4f51-95d0-0922f04b2059 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.155829 Jun 16 19:27:56.829729 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3109/6329] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:56 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:57.847041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:57.847678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:57.854766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:57.855260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:57.856035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:57.856496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:57.991225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:57.998883 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3016d4d8-7a78-4901-aa7b-3c4f1775f6d3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.156535 Jun 16 19:27:57.999466 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3221/6330] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:57 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:59.015640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:59.016373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:59.023293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:59.023749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:59.024508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:59.024947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:59.159878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:59.167522 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-de03de7c-5d0e-45fc-b2d7-c13a39a9cd5b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1656 microversion: 2.1 time: 0.155834 Jun 16 19:27:59.168103 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3110/6331] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:59 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:27:59.184788 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:27:59.185772 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:59.192981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:59.193447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:59.194271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:59.194728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:59.222401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:59.228576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:27:59.235392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:27:59.235824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:27:59.236309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:27:59.236730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:27:59.237151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:27:59.306295 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4188ea3b-cea3-4169-b3cf-bc20f9ba4d08 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action" status: 202 len: 0 microversion: 2.1 time: 0.125254 Jun 16 19:27:59.306837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3222/6332] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:27:59 2022] POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:27:59.315143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:27:59.315908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:27:59.322199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:59.322651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:59.323424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:27:59.323857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:27:59.468485 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:27:59.477564 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2d3789a1-7740-4471-b94f-ae2af9e9dc83 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.166551 Jun 16 19:27:59.478289 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3111/6333] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:27:59 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:00.496995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:00.497752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:00.508787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:00.509299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:00.510192 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:00.510721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:00.646597 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:00.654271 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04f0a72e-fb48-499a-8c1d-597c00a41b65 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.162051 Jun 16 19:28:00.654855 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3223/6334] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:00 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:01.671797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:01.673273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:01.680527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:01.680980 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:01.681751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:01.682222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:01.813189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:01.824230 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e848c972-2fbc-4904-ba27-2942d6e75f17 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1679 microversion: 2.1 time: 0.156320 Jun 16 19:28:01.824890 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3112/6335] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:01 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:02.842943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:02.844194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:02.851300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:02.851770 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:02.852558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:02.853016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:02.991558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:02.999312 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-afb76696-d362-4e1d-a1ff-a405545183a0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1684 microversion: 2.1 time: 0.160364 Jun 16 19:28:03.000640 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3224/6336] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:02 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:04.021018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:04.022313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:04.028885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:04.029339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:04.030139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:04.030573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:04.178061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:04.185656 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dfce9eca-56f8-4662-971b-d8cad8a63d68 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1683 microversion: 2.1 time: 0.169013 Jun 16 19:28:04.186272 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3113/6337] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:04 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:28:04.447168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2709d8f0-a649-4b5b-9b83-a1584623c82c req-c3d0a831-a50a-4550-8e82-6dc28483f766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5999c-3101-4f68-a082-d906c648448f", "name": "network-vif-unplugged", "status": "completed", "tag": "b567529e-3e8f-4447-9120-cfb91b151127"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:04.456946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2709d8f0-a649-4b5b-9b83-a1584623c82c req-c3d0a831-a50a-4550-8e82-6dc28483f766 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:04.457417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2709d8f0-a649-4b5b-9b83-a1584623c82c req-c3d0a831-a50a-4550-8e82-6dc28483f766 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:04.470233 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2709d8f0-a649-4b5b-9b83-a1584623c82c req-c3d0a831-a50a-4550-8e82-6dc28483f766 service nova] Creating event network-vif-unplugged:b567529e-3e8f-4447-9120-cfb91b151127 for instance 22f5999c-3101-4f68-a082-d906c648448f on n-h2-846209-2 Jun 16 19:28:04.476023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-2709d8f0-a649-4b5b-9b83-a1584623c82c req-c3d0a831-a50a-4550-8e82-6dc28483f766 service nova] Instance 22f5999c-3101-4f68-a082-d906c648448f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:28:04.487626 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2709d8f0-a649-4b5b-9b83-a1584623c82c req-c3d0a831-a50a-4550-8e82-6dc28483f766 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045095 Jun 16 19:28:04.488426 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3225/6338] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:28:05.203995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:05.204600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:05.211918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:05.212372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:05.213142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:05.213581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:05.352521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:05.361351 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-30cd2842-2927-4102-a7bd-a3f7c3b53d7d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1683 microversion: 2.1 time: 0.161537 Jun 16 19:28:05.361960 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3114/6339] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:05 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:06.381140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:06.381861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:06.388114 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:06.388579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:06.389346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:06.389793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:06.503333 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-66a61457-037f-4b93-9a24-a6a91adb3d13 req-5a059daf-fd79-4588-84ed-a8550f4d937e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f5999c-3101-4f68-a082-d906c648448f", "tag": "b567529e-3e8f-4447-9120-cfb91b151127"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:06.512305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-66a61457-037f-4b93-9a24-a6a91adb3d13 req-5a059daf-fd79-4588-84ed-a8550f4d937e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:06.513118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-66a61457-037f-4b93-9a24-a6a91adb3d13 req-5a059daf-fd79-4588-84ed-a8550f4d937e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:06.523250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:06.528607 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-66a61457-037f-4b93-9a24-a6a91adb3d13 req-5a059daf-fd79-4588-84ed-a8550f4d937e service nova] Creating event network-changed:b567529e-3e8f-4447-9120-cfb91b151127 for instance 22f5999c-3101-4f68-a082-d906c648448f on n-h2-846209-2 Jun 16 19:28:06.530921 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-df67f478-9ec2-4ef4-89de-a99843465325 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1681 microversion: 2.1 time: 0.155845 Jun 16 19:28:06.532138 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3226/6340] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:06 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:06.535742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-66a61457-037f-4b93-9a24-a6a91adb3d13 req-5a059daf-fd79-4588-84ed-a8550f4d937e service nova] Instance 22f5999c-3101-4f68-a082-d906c648448f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:28:06.548430 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-66a61457-037f-4b93-9a24-a6a91adb3d13 req-5a059daf-fd79-4588-84ed-a8550f4d937e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049376 Jun 16 19:28:06.549046 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3115/6341] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:28:07.550509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:07.551145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:07.558129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:07.558604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:07.559387 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:07.559841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:07.698358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:07.706465 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d56a9e9d-301e-4830-a12c-842341a60fdb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1677 microversion: 2.1 time: 0.161149 Jun 16 19:28:07.707076 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3227/6342] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:07 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:28:07.725112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae8f4b85-7699-41e4-bb72-df1ec566b0fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:07.725739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ae8f4b85-7699-41e4-bb72-df1ec566b0fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:07.732067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae8f4b85-7699-41e4-bb72-df1ec566b0fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:07.732520 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae8f4b85-7699-41e4-bb72-df1ec566b0fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:07.733297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae8f4b85-7699-41e4-bb72-df1ec566b0fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:07.733738 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae8f4b85-7699-41e4-bb72-df1ec566b0fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:07.795924 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae8f4b85-7699-41e4-bb72-df1ec566b0fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action" status: 204 len: 0 microversion: 2.1 time: 0.076152 Jun 16 19:28:07.796632 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3116/6343] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:28:07 2022] POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:28:07.805707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:07.806508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:07.813754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:07.814362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:07.815369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:07.815851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:08.044000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:08.052759 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3c905db6-780c-4635-b056-3862ce2168ab tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1677 microversion: 2.1 time: 0.251066 Jun 16 19:28:08.053540 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3228/6344] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:07 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:09.071707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:09.072423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:09.078856 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:09.079314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:09.080086 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:09.080535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:09.219314 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:09.221963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:28:09.228705 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-708fab9f-9082-46e8-b436-4ce3ca96e181 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1677 microversion: 2.1 time: 0.162240 Jun 16 19:28:09.229285 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3117/6345] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:09 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:09.875713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b4216504-d5e2-45cb-b67c-ea9694707f8b req-4ea8ae88-2454-45f8-8c3d-806084dba4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5999c-3101-4f68-a082-d906c648448f", "name": "network-vif-plugged", "status": "completed", "tag": "b567529e-3e8f-4447-9120-cfb91b151127"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:09.885837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b4216504-d5e2-45cb-b67c-ea9694707f8b req-4ea8ae88-2454-45f8-8c3d-806084dba4e5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:09.886379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b4216504-d5e2-45cb-b67c-ea9694707f8b req-4ea8ae88-2454-45f8-8c3d-806084dba4e5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:09.900899 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b4216504-d5e2-45cb-b67c-ea9694707f8b req-4ea8ae88-2454-45f8-8c3d-806084dba4e5 service nova] Creating event network-vif-plugged:b567529e-3e8f-4447-9120-cfb91b151127 for instance 22f5999c-3101-4f68-a082-d906c648448f on n-h2-846209-2 Jun 16 19:28:09.905734 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b4216504-d5e2-45cb-b67c-ea9694707f8b req-4ea8ae88-2454-45f8-8c3d-806084dba4e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034136 Jun 16 19:28:09.907196 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3229/6346] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:28:10.247854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:10.248464 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:10.256767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:10.257228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:10.258041 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:10.258484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:10.397495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:10.405115 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ba4f24c7-400d-4132-9123-9ae5abd35bc7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1656 microversion: 2.1 time: 0.161894 Jun 16 19:28:10.405691 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3118/6347] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:10 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:10.422728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:10.423451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:10.430058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:10.430532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:10.431317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:10.431777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:10.568370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:10.580203 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8b549744-b660-46eb-a848-3423a7a795ca tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1656 microversion: 2.1 time: 0.161715 Jun 16 19:28:10.580783 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3230/6348] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:10 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:10.596589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6e4694b4-da8e-4337-b9be-bd249e1bca56 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:10.602734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e4694b4-da8e-4337-b9be-bd249e1bca56 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:10.603193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6e4694b4-da8e-4337-b9be-bd249e1bca56 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:10.628579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6e4694b4-da8e-4337-b9be-bd249e1bca56 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Going to try to start instance {{(pid=119207) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 19:28:10.670513 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6e4694b4-da8e-4337-b9be-bd249e1bca56 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action" status: 202 len: 0 microversion: 2.1 time: 0.077950 Jun 16 19:28:10.671362 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3119/6349] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:28:10 2022] POST /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:28:10.679929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:10.680564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:10.688734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:10.689300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:10.690515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:10.691540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:10.697079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:28:10.831894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:10.839499 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71f93723-b770-467a-b29d-dee0b953d264 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1665 microversion: 2.1 time: 0.163477 Jun 16 19:28:10.840081 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3231/6350] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:10 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:11.857316 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:11.858085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:11.865934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:11.866411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:11.867191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:11.867634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:12.005134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:12.012745 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6b9583a6-e9cd-4b16-b500-d255570b0896 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1669 microversion: 2.1 time: 0.159863 Jun 16 19:28:12.013310 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3120/6351] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:11 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:12.029276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:12.029836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:12.037410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:12.037885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:12.038710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:12.039600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:12.065733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:28:12.144390 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6f0020a3-b95a-4ace-9959-6d1e2f3c7573 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 204 len: 0 microversion: 2.1 time: 0.118557 Jun 16 19:28:12.144989 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3232/6352] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:28:12 2022] DELETE /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:28:12.153179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:12.153802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:12.160029 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:12.160493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:12.161265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:12.161708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:12.295582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:12.304489 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d37a6dec-cd82-406b-8c38-9464f1185493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1675 microversion: 2.1 time: 0.155176 Jun 16 19:28:12.305072 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3121/6353] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:12 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:13.323502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:13.324297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:13.331753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:13.332228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:13.333021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:13.333478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:13.471271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:13.479884 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1718dc3-2f2b-4328-9260-b8a5ca8bf51f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 200 len: 1675 microversion: 2.1 time: 0.160717 Jun 16 19:28:13.480468 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3233/6354] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:13 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:14.210749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-a8d34e36-c924-4952-87ac-7a4702b8a18c req-48d9081f-7643-4223-8a77-ed8e53d8588d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5999c-3101-4f68-a082-d906c648448f", "name": "network-vif-deleted", "tag": "b567529e-3e8f-4447-9120-cfb91b151127"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:14.216298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=39 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:28:14.225397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a8d34e36-c924-4952-87ac-7a4702b8a18c req-48d9081f-7643-4223-8a77-ed8e53d8588d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:14.225851 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-a8d34e36-c924-4952-87ac-7a4702b8a18c req-48d9081f-7643-4223-8a77-ed8e53d8588d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:14.240389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-a8d34e36-c924-4952-87ac-7a4702b8a18c req-48d9081f-7643-4223-8a77-ed8e53d8588d service nova] Creating event network-vif-deleted:b567529e-3e8f-4447-9120-cfb91b151127 for instance 22f5999c-3101-4f68-a082-d906c648448f on n-h2-846209-2 Jun 16 19:28:14.245865 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-a8d34e36-c924-4952-87ac-7a4702b8a18c req-48d9081f-7643-4223-8a77-ed8e53d8588d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038262 Jun 16 19:28:14.246858 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3122/6355] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:28:14.498534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:14.499142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:14.502623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:28:14.508936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:14.509407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:14.510226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:14.510676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:14.525068 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f HTTP/1.1 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '22f5999c-3101-4f68-a082-d906c648448f'} Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:28:14.526891 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1cfc4a18-e063-41c2-8d8b-f3e2f4e7ef79 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 404 len: 111 microversion: 2.1 time: 0.033779 Jun 16 19:28:14.530941 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3234/6356] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:14 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:28:14.543297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:14.544449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:14.551955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:14.552467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:14.553313 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:14.553817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:14.568513 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f HTTP/1.1 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '22f5999c-3101-4f68-a082-d906c648448f'} Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:28:14.570240 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4886901f-ec6c-4033-bf49-65f7175c6572 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 404 len: 111 microversion: 2.1 time: 0.032601 Jun 16 19:28:14.573806 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3123/6357] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:14 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:28:14.619223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2071260044", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "38f38477-4fc3-4d27-ac8e-5ff14334cf2c"}], "security_groups": [{"name": "tempest-securitygroup--1377102978"}], "key_name": "tempest-keypair-194723681", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:14.743102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] validate_networks() for [('38f38477-4fc3-4d27-ac8e-5ff14334cf2c', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:28:15.238396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:28:15.238861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:28:15.239358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:28:15.239784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:28:15.240237 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:28:15.250036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:15.250500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:15.251314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:15.251775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:15.271839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:28:15.278312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for user b9974643a17249f5a709f5d5170f2bd1 and project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:28:15.293107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:28:15.295461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:28:15.345490 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b854e344-19fc-4140-abe3-5672f4f3e09e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730186 Jun 16 19:28:15.349980 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3235/6358] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:28:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:28:15.356338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7f8c8e2b-d203-47c5-9081-72582e3c3d4f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:15.356952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7f8c8e2b-d203-47c5-9081-72582e3c3d4f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:15.416906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7f8c8e2b-d203-47c5-9081-72582e3c3d4f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:15.430722 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7f8c8e2b-d203-47c5-9081-72582e3c3d4f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1238 microversion: 2.1 time: 0.077876 Jun 16 19:28:15.431320 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3124/6359] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:15 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:16.449603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:16.450404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:16.458280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:16.458856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:16.459749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:16.460211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:16.527713 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:16.536848 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f05dfde9-16d5-46b1-bd99-83de98672acf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1308 microversion: 2.1 time: 0.092067 Jun 16 19:28:16.537434 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3236/6360] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:16 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:17.555620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:17.556239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:17.564065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:17.564513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:17.565291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:17.565726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:17.709852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:17.719081 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c48d2848-c9ee-40ef-86ab-6bd6ad0f571f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1364 microversion: 2.1 time: 0.166681 Jun 16 19:28:17.719808 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3125/6361] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:17 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:18.065281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-341a77c4-a4ed-4f00-8d25-dfb1505bbc9d req-53cf928a-fe4f-4015-87ab-cd6ec7211e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:18.082760 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-341a77c4-a4ed-4f00-8d25-dfb1505bbc9d req-53cf928a-fe4f-4015-87ab-cd6ec7211e0f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:18.083379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-341a77c4-a4ed-4f00-8d25-dfb1505bbc9d req-53cf928a-fe4f-4015-87ab-cd6ec7211e0f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:18.112816 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-341a77c4-a4ed-4f00-8d25-dfb1505bbc9d req-53cf928a-fe4f-4015-87ab-cd6ec7211e0f service nova] Creating event network-changed:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h2-846209-2 Jun 16 19:28:18.117889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-341a77c4-a4ed-4f00-8d25-dfb1505bbc9d req-53cf928a-fe4f-4015-87ab-cd6ec7211e0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057212 Jun 16 19:28:18.118700 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3237/6362] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:28:18.736652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:18.737312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:18.744512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:18.744971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:18.745750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:18.746226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:18.880743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:18.888461 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1ca211a5-17e1-4eda-bf53-3fc2e1f7452d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1364 microversion: 2.1 time: 0.155732 Jun 16 19:28:18.889039 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3126/6363] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:18 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:19.910901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:19.911545 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:19.917848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:19.918389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:19.919157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:19.919603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:20.058370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:20.067049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7298e339-beb3-47d7-917d-994d6df08b7b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1364 microversion: 2.1 time: 0.161536 Jun 16 19:28:20.067623 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3238/6364] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:19 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:21.084786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:21.085390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:21.092309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:21.092755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:21.093531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:21.093983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:21.225653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:21.233234 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3c77c2f0-ea8c-4597-8f31-980e970b69f8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1364 microversion: 2.1 time: 0.152349 Jun 16 19:28:21.233804 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3127/6365] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:21 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:22.250814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:22.251702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:22.259473 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:22.259947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:22.260742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:22.261196 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:22.396706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:22.404216 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-40af9a05-dd69-46fb-b663-9f478b17380b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1364 microversion: 2.1 time: 0.157353 Jun 16 19:28:22.404786 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3239/6366] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:22 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:23.421752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:23.422401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:23.430558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:23.431026 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:23.431800 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:23.432246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:23.563022 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:23.572051 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-249eaa2b-3dda-4c8c-9d77-a1f9d775b5ad tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1364 microversion: 2.1 time: 0.154341 Jun 16 19:28:23.572664 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3128/6367] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:23 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:23.920106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-6a3c8a9f-6d27-4a4d-809c-4649e3b226f4 req-61113952-34da-47b1-99c4-c88cc4c33de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "name": "network-vif-plugged", "status": "completed", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:23.931529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6a3c8a9f-6d27-4a4d-809c-4649e3b226f4 req-61113952-34da-47b1-99c4-c88cc4c33de7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:23.931997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-6a3c8a9f-6d27-4a4d-809c-4649e3b226f4 req-61113952-34da-47b1-99c4-c88cc4c33de7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:23.944215 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-6a3c8a9f-6d27-4a4d-809c-4649e3b226f4 req-61113952-34da-47b1-99c4-c88cc4c33de7 service nova] Creating event network-vif-plugged:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h2-846209-2 Jun 16 19:28:23.949176 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-6a3c8a9f-6d27-4a4d-809c-4649e3b226f4 req-61113952-34da-47b1-99c4-c88cc4c33de7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032840 Jun 16 19:28:23.949988 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3240/6368] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:28:24.590537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:24.591309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:24.599137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:24.599585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:24.600505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:24.601016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:24.735547 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:24.743751 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-643636e1-9171-4d1a-b2f4-fafc6e9c817d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1364 microversion: 2.1 time: 0.157952 Jun 16 19:28:24.744337 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3129/6369] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:24 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:25.758797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:28:25.759575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:28:25.763837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:25.764553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:25.774434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:25.774995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:25.775874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:25.776325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:25.919870 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:28:25.928103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4cfddc2-b057-4299-ac2f-93be1127304b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1552 microversion: 2.1 time: 0.171144 Jun 16 19:28:25.928682 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3241/6370] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:28:25 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:28:25.944863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-81b3d31d-3d90-4894-b685-b63b484263a1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:28:25.945413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-81b3d31d-3d90-4894-b685-b63b484263a1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:28:25.947430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:28:25.953823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81b3d31d-3d90-4894-b685-b63b484263a1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:25.954312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81b3d31d-3d90-4894-b685-b63b484263a1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:25.955098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81b3d31d-3d90-4894-b685-b63b484263a1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:25.955551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-81b3d31d-3d90-4894-b685-b63b484263a1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:26.037121 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-81b3d31d-3d90-4894-b685-b63b484263a1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096227 Jun 16 19:28:26.037725 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3130/6371] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 19:28:25 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:28:26.964564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a1a36e7b-cc55-4dee-9384-b26102d946ba req-e6e6d43d-b218-450d-8561-ed57ccf2dfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:28:26.974204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a1a36e7b-cc55-4dee-9384-b26102d946ba req-e6e6d43d-b218-450d-8561-ed57ccf2dfb8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:28:26.974703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a1a36e7b-cc55-4dee-9384-b26102d946ba req-e6e6d43d-b218-450d-8561-ed57ccf2dfb8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:28:26.985849 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a1a36e7b-cc55-4dee-9384-b26102d946ba req-e6e6d43d-b218-450d-8561-ed57ccf2dfb8 service nova] Creating event network-changed:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h2-846209-2 Jun 16 19:28:26.991565 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a1a36e7b-cc55-4dee-9384-b26102d946ba req-e6e6d43d-b218-450d-8561-ed57ccf2dfb8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030823 Jun 16 19:28:26.992161 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3242/6372] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:28:44.527868 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:28:44.528436 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:28:46.581756 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:28:46.582442 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:28:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:29:02.161584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=19 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:02.162476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:02.168093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:02.169074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:02.176585 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:02.177038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:02.177810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:02.178285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:02.206766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:02.213716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:29:02.220021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:29:02.220448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:29:02.220929 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:29:02.221366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:29:02.221780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:29:02.285017 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-78da34b3-c09b-44c4-8ffc-f0d9113bf880 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.126161 Jun 16 19:29:02.285618 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3131/6373] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:29:02 2022] POST /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:29:02.292708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:02.293471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:02.298037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:02.298849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:02.309591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:02.310238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:02.311111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:02.311674 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:02.493738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:02.508835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-35620eae-e961-46da-8251-30d8db9b107e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1680 microversion: 2.1 time: 0.218037 Jun 16 19:29:02.509578 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3243/6374] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:02 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:03.528360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:03.528988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:03.535076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:03.535532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:03.537511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:03.538016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:03.673570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:03.701872 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16559e5f-5a75-4b3a-9e87-a646310550e1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1680 microversion: 2.1 time: 0.178200 Jun 16 19:29:03.702588 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3132/6375] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:03 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:04.720669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:04.721309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:04.728913 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:04.729391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:04.730205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:04.730672 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:05.212175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:05.219874 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4496858-22e2-4960-940f-05a4c6f488d0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.503147 Jun 16 19:29:05.220458 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3244/6376] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:04 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:06.238169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:06.238794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:06.245891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:06.246373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:06.247140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:06.247578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:06.378125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:06.386359 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-95935d53-0585-4248-86b2-bba1ea0d5e34 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.152086 Jun 16 19:29:06.386922 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3133/6377] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:06 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:07.404200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:07.404861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:07.412528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:07.413000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:07.413779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:07.414261 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:07.547014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:07.555420 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fd1b7753-d450-4fc1-b682-5bc110fd7c3b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.155207 Jun 16 19:29:07.555984 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3245/6378] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:07 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:08.573610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:08.574257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:08.581427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:08.581877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:08.583957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:08.584402 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:08.714076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:08.721603 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dcb5d41f-3df2-49ab-97a2-aa0823851039 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.152115 Jun 16 19:29:08.722229 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3134/6379] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:08 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:09.738970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:09.739875 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:09.747179 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:09.747646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:09.748429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:09.749440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:09.882601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:09.890261 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-df6cafe3-46ab-41b5-a046-da666f43f6f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.155368 Jun 16 19:29:09.890836 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3246/6380] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:09 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:10.908655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:10.909274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:10.916895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:10.917389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:10.918202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:10.918645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:11.056474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:11.064058 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d04382a9-ae44-41bb-aa58-78f409f70d98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.159384 Jun 16 19:29:11.064625 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3135/6381] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:10 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:12.080700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:12.081353 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:12.088803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:12.089271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:12.090073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:12.090522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:12.220112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:12.228510 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-38e41af0-e34a-4a60-8a7e-492ea32ead6f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.151720 Jun 16 19:29:12.229281 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3247/6382] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:12 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:13.245855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:13.246511 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:13.253529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:13.254024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:13.255434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:13.255875 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:13.391063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:13.399166 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0b7c5283-34ea-4cfd-b992-a389a6ce68f1 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.157251 Jun 16 19:29:13.399738 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3136/6383] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:13 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:14.416965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:14.417655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:14.425165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:14.425627 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:14.426498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:14.427129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:14.562044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:14.570564 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e98fa86c-f67c-4bc0-9e70-a679ab2f09db tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.157933 Jun 16 19:29:14.571147 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3248/6384] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:14 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:15.587686 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:15.588305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:15.595254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:15.595706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:15.596469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:15.596911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:15.727767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:15.735399 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a129a522-39ab-4a77-abad-a249c80e7543 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1685 microversion: 2.1 time: 0.151592 Jun 16 19:29:15.735984 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3137/6385] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:15 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:16.609178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f804dd78-3026-426e-bde7-9a45d0b4d620 req-aa05339b-85b0-423e-86a7-f505dd17aa14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "name": "network-vif-unplugged", "status": "completed", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:16.618949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f804dd78-3026-426e-bde7-9a45d0b4d620 req-aa05339b-85b0-423e-86a7-f505dd17aa14 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:16.619431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f804dd78-3026-426e-bde7-9a45d0b4d620 req-aa05339b-85b0-423e-86a7-f505dd17aa14 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:16.632714 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f804dd78-3026-426e-bde7-9a45d0b4d620 req-aa05339b-85b0-423e-86a7-f505dd17aa14 service nova] Creating event network-vif-unplugged:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h1-846209-2 Jun 16 19:29:16.638305 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-f804dd78-3026-426e-bde7-9a45d0b4d620 req-aa05339b-85b0-423e-86a7-f505dd17aa14 service nova] Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:29:16.650959 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f804dd78-3026-426e-bde7-9a45d0b4d620 req-aa05339b-85b0-423e-86a7-f505dd17aa14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044950 Jun 16 19:29:16.650959 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3249/6386] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:29:16.752865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:16.753483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:16.763139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:16.763586 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:16.764363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:16.765005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:16.984336 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:16.994049 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50e5e6e6-16ec-4f2b-a400-063d2153cbcb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1684 microversion: 2.1 time: 0.244910 Jun 16 19:29:16.994647 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3138/6387] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:16 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1684 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:18.014498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:18.015224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:18.022502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:18.022974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:18.023755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:18.024209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:18.161095 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:18.169231 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5c524984-f9c8-4419-9ea6-8c81926f6057 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1682 microversion: 2.1 time: 0.160007 Jun 16 19:29:18.169882 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3250/6388] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:18 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:18.665071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-96a9ef4f-cdd3-438e-ab14-585aa98ef892 req-4bb8d7dc-5526-42e4-8e4d-52218b8b6ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:18.674021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-96a9ef4f-cdd3-438e-ab14-585aa98ef892 req-4bb8d7dc-5526-42e4-8e4d-52218b8b6ec2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:18.674478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-96a9ef4f-cdd3-438e-ab14-585aa98ef892 req-4bb8d7dc-5526-42e4-8e4d-52218b8b6ec2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:18.686941 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-96a9ef4f-cdd3-438e-ab14-585aa98ef892 req-4bb8d7dc-5526-42e4-8e4d-52218b8b6ec2 service nova] Creating event network-changed:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h1-846209-2 Jun 16 19:29:18.693011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-96a9ef4f-cdd3-438e-ab14-585aa98ef892 req-4bb8d7dc-5526-42e4-8e4d-52218b8b6ec2 service nova] Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:29:18.703700 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-96a9ef4f-cdd3-438e-ab14-585aa98ef892 req-4bb8d7dc-5526-42e4-8e4d-52218b8b6ec2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042478 Jun 16 19:29:18.704295 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3139/6389] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:29:19.187467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:19.188102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:19.195712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:19.196415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:19.197206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:19.197827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:19.404425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:19.413274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-721cb722-563c-4964-b520-0a486b2fda8e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1682 microversion: 2.1 time: 0.229675 Jun 16 19:29:19.413875 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3251/6390] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:19 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:20.432952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:20.433660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:20.439900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.440352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:20.441102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.441599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:20.578885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:20.586980 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2325841c-ac1c-489d-b6d1-4cfea6cb4f69 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1679 microversion: 2.1 time: 0.159244 Jun 16 19:29:20.587488 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3140/6391] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:20 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:29:20.603563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:20.604116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:20.611121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.611591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:20.612377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.612837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:20.650345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.650816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:20.651634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.652090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:20.673297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:29:20.679474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for user b9974643a17249f5a709f5d5170f2bd1 and project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:29:20.783629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-88597614-880b-487d-816e-be8646e8c575 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.183689 Jun 16 19:29:20.784237 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3252/6392] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:29:20 2022] POST /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:29:20.794037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:20.794755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:20.802145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.802897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:20.803901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:20.804474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:21.003170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:21.012629 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-89fdcb25-3fc0-4f50-b621-2118e9851ae6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1678 microversion: 2.1 time: 0.223566 Jun 16 19:29:21.013600 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3141/6393] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:20 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:21.914434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a223b4db-e960-41da-ba85-6882e7df4164 req-6a2df833-f0e1-4945-8552-65e82605d9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "name": "network-vif-plugged", "status": "completed", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:21.925466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a223b4db-e960-41da-ba85-6882e7df4164 req-6a2df833-f0e1-4945-8552-65e82605d9a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:21.925981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a223b4db-e960-41da-ba85-6882e7df4164 req-6a2df833-f0e1-4945-8552-65e82605d9a7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:21.937850 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a223b4db-e960-41da-ba85-6882e7df4164 req-6a2df833-f0e1-4945-8552-65e82605d9a7 service nova] Creating event network-vif-plugged:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h1-846209-2 Jun 16 19:29:21.943833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-a223b4db-e960-41da-ba85-6882e7df4164 req-6a2df833-f0e1-4945-8552-65e82605d9a7 service nova] Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:29:21.954732 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a223b4db-e960-41da-ba85-6882e7df4164 req-6a2df833-f0e1-4945-8552-65e82605d9a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044727 Jun 16 19:29:21.955529 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3253/6394] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:29:22.030990 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:22.031537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:22.039283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:22.039749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:22.040535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:22.040984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:22.178695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:22.186207 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0a25bee1-fee5-44f0-825f-178ef032cf6c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1678 microversion: 2.1 time: 0.159179 Jun 16 19:29:22.186778 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3142/6395] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:22 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:23.206191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:23.206912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:23.214262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:23.214723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:23.215502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:23.215957 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:23.355867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:23.367390 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e45f67fe-5da7-4c65-bae7-95b096e646b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1678 microversion: 2.1 time: 0.165922 Jun 16 19:29:23.367989 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3254/6396] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:23 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:24.010117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-14aa5630-7008-4638-bfc8-266fbe6a0e9d req-9b82ed53-3861-45d9-8205-eb19931f1d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "name": "network-vif-unplugged", "status": "completed", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:24.020068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-14aa5630-7008-4638-bfc8-266fbe6a0e9d req-9b82ed53-3861-45d9-8205-eb19931f1d10 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:24.020612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-14aa5630-7008-4638-bfc8-266fbe6a0e9d req-9b82ed53-3861-45d9-8205-eb19931f1d10 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:24.033140 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-14aa5630-7008-4638-bfc8-266fbe6a0e9d req-9b82ed53-3861-45d9-8205-eb19931f1d10 service nova] Creating event network-vif-unplugged:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h2-846209-2 Jun 16 19:29:24.039301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-14aa5630-7008-4638-bfc8-266fbe6a0e9d req-9b82ed53-3861-45d9-8205-eb19931f1d10 service nova] Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:29:24.051714 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-14aa5630-7008-4638-bfc8-266fbe6a0e9d req-9b82ed53-3861-45d9-8205-eb19931f1d10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044865 Jun 16 19:29:24.052609 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3143/6397] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:29:24.385443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:24.386373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:24.394019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:24.396064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:24.397069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:24.397551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:24.547719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:24.557795 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8bc8d65c-1699-44c4-a0ed-2d2279e6839e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1678 microversion: 2.1 time: 0.176907 Jun 16 19:29:24.558526 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3255/6398] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:24 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:25.577343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:25.578084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:25.585207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:25.585668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:25.586473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:25.586922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:25.723296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:25.731165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-56a6a4b3-5c80-47d4-b906-68b09a4d3c76 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1678 microversion: 2.1 time: 0.159007 Jun 16 19:29:25.731736 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3144/6399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:25 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:26.067070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2dae165f-d553-4b75-9b7b-7701c072c094 req-7f6ac5ec-6947-4adf-b19e-5618109f7064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:26.076111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2dae165f-d553-4b75-9b7b-7701c072c094 req-7f6ac5ec-6947-4adf-b19e-5618109f7064 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:26.076584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2dae165f-d553-4b75-9b7b-7701c072c094 req-7f6ac5ec-6947-4adf-b19e-5618109f7064 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:26.088972 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2dae165f-d553-4b75-9b7b-7701c072c094 req-7f6ac5ec-6947-4adf-b19e-5618109f7064 service nova] Creating event network-changed:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h2-846209-2 Jun 16 19:29:26.094446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-2dae165f-d553-4b75-9b7b-7701c072c094 req-7f6ac5ec-6947-4adf-b19e-5618109f7064 service nova] Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:29:26.105703 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2dae165f-d553-4b75-9b7b-7701c072c094 req-7f6ac5ec-6947-4adf-b19e-5618109f7064 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042560 Jun 16 19:29:26.106325 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3256/6400] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:29:26.748308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:26.748922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:26.756588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:26.757042 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:26.757810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:26.758271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:26.891749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:26.899436 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-12892e16-45b6-4f1f-a730-1f442b782772 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1671 microversion: 2.1 time: 0.155026 Jun 16 19:29:26.900010 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3145/6401] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:26 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:26.916602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:26.917316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:26.923829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:26.924236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:26.925268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:26.926304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:26.945310 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:27.070714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:27.079279 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ab8f728b-3a00-40e1-ada4-7a0ece55bcee tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1671 microversion: 2.1 time: 0.166975 Jun 16 19:29:27.079856 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3257/6402] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:26 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:27.095280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:27.095907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:27.102676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:27.103138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:27.103925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:27.104365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:27.240206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:27.243870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:27.249135 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3c2d7434-2c0e-428d-93a7-33ab367c6143 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1671 microversion: 2.1 time: 0.157833 Jun 16 19:29:27.249709 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3146/6403] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:27 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:27.265319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:27.265837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:27.272263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:27.272732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:27.273511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:27.274000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:27.299325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:29:27.377983 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b41f02ba-f559-4a46-902b-a30f003ecedf tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 204 len: 0 microversion: 2.1 time: 0.116179 Jun 16 19:29:27.378773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3258/6404] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:29:27 2022] DELETE /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:29:27.390604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:27.391392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:27.400075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:27.400531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:27.401294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:27.401732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:27.532663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:27.541054 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a105e9c0-7b27-4d20-b19f-5c2a33fa4991 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1677 microversion: 2.1 time: 0.156821 Jun 16 19:29:27.541627 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3147/6405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:27 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:28.559612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:28.560339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:28.567351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:28.568547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:28.569351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:28.569809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:28.710854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:28.718760 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-901fa0b8-f1c8-48e1-b406-eb0d004e1fdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1677 microversion: 2.1 time: 0.163382 Jun 16 19:29:28.719347 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3259/6406] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:28 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:29.738174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:29.738798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:29.746551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:29.747165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:29.748035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:29.748480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:29.815947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-aa510fcf-e792-411b-9f04-f5337788b374 req-7b980082-f952-4926-ad20-f1618303f5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf7783-8384-4117-8e8f-1373aef1f4b0", "name": "network-vif-deleted", "tag": "da4b8e90-c9c5-4449-a3fb-94376ee1f04d"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:29.818109 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:29.827580 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2bca9347-b2e3-4cd3-9e30-f93466a93e21 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 200 len: 1609 microversion: 2.1 time: 0.093377 Jun 16 19:29:29.828149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-aa510fcf-e792-411b-9f04-f5337788b374 req-7b980082-f952-4926-ad20-f1618303f5b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:29.828676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-aa510fcf-e792-411b-9f04-f5337788b374 req-7b980082-f952-4926-ad20-f1618303f5b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:29.839265 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3148/6407] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:29 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 1609 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:29.841798 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-aa510fcf-e792-411b-9f04-f5337788b374 req-7b980082-f952-4926-ad20-f1618303f5b2 service nova] Creating event network-vif-deleted:da4b8e90-c9c5-4449-a3fb-94376ee1f04d for instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 on n-h2-846209-2 Jun 16 19:29:29.846796 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-aa510fcf-e792-411b-9f04-f5337788b374 req-7b980082-f952-4926-ad20-f1618303f5b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035254 Jun 16 19:29:29.847456 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3260/6408] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:29:30.846222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:30.846864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:30.854357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:30.854803 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:30.855560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:30.855995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:30.872372 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 HTTP/1.1 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2faf7783-8384-4117-8e8f-1373aef1f4b0'} Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:29:30.874044 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-08d989f0-f401-4070-af83-e6637cc700a4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 404 len: 111 microversion: 2.1 time: 0.033089 Jun 16 19:29:30.877845 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3149/6409] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:30 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:29:30.888601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:30.893859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:30.894681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:30.901589 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:30.902026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:30.902815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:30.903277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:30.917550 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 HTTP/1.1 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2faf7783-8384-4117-8e8f-1373aef1f4b0'} Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:29:30.919252 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8afeacfe-ed30-497c-a07e-ffc5bb0a2c5f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 404 len: 111 microversion: 2.1 time: 0.033071 Jun 16 19:29:30.923698 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3261/6410] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:30 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:29:30.968018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2130054650", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "38f38477-4fc3-4d27-ac8e-5ff14334cf2c"}], "security_groups": [{"name": "tempest-securitygroup--1377102978"}], "key_name": "tempest-keypair-194723681", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:31.071009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] validate_networks() for [('38f38477-4fc3-4d27-ac8e-5ff14334cf2c', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:29:31.445280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:29:31.445944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:29:31.446430 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:29:31.446847 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:29:31.447272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:29:31.456229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:31.456684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:31.457489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:31.458064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:31.476239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:29:31.481487 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for user b9974643a17249f5a709f5d5170f2bd1 and project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:29:31.494826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:29:31.497104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:29:31.543737 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f238aef5-8597-492d-9a9f-7815e67b87e6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.579529 Jun 16 19:29:31.544407 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3150/6411] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:29:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:29:31.555752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ad9e5590-2f96-444d-bc79-61a3b15422d7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:31.556389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ad9e5590-2f96-444d-bc79-61a3b15422d7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:31.617334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ad9e5590-2f96-444d-bc79-61a3b15422d7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:31.624134 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ad9e5590-2f96-444d-bc79-61a3b15422d7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1238 microversion: 2.1 time: 0.073226 Jun 16 19:29:31.624714 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3262/6412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:31 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:32.643829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:32.645417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:32.648156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:32.657360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:32.658095 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:32.659069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:32.659561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:32.746050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:32.753892 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-256e8b9b-1bec-4028-a722-19a3391d850c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1296 microversion: 2.1 time: 0.116693 Jun 16 19:29:32.754679 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3151/6413] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:32 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:33.772623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:33.773350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:33.777406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:33.784830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:33.785553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:33.787918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:33.788507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:33.982738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:33.993654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-71e234ae-073c-43ef-be56-627db4c978d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1364 microversion: 2.1 time: 0.225196 Jun 16 19:29:33.994727 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3263/6414] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:33 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:29:34.068397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ce71c74b-cb3b-4cdf-b2f0-3f9dd05c5a44 req-5cf6ce8f-2720-4dd9-a49e-41217b8b850c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:34.079940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ce71c74b-cb3b-4cdf-b2f0-3f9dd05c5a44 req-5cf6ce8f-2720-4dd9-a49e-41217b8b850c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:34.080533 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ce71c74b-cb3b-4cdf-b2f0-3f9dd05c5a44 req-5cf6ce8f-2720-4dd9-a49e-41217b8b850c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:34.095001 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ce71c74b-cb3b-4cdf-b2f0-3f9dd05c5a44 req-5cf6ce8f-2720-4dd9-a49e-41217b8b850c service nova] Creating event network-changed:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h1-846209-2 Jun 16 19:29:34.100552 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ce71c74b-cb3b-4cdf-b2f0-3f9dd05c5a44 req-5cf6ce8f-2720-4dd9-a49e-41217b8b850c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036611 Jun 16 19:29:34.101159 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3152/6415] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:29:35.012366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:35.013031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:35.020006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:35.020964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:35.022379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:35.022838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:35.160404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:35.168788 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2583044b-2f93-413a-92bd-f8be4a4ca468 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1364 microversion: 2.1 time: 0.160520 Jun 16 19:29:35.169370 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3264/6416] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:35 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:36.188014 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:36.188943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:36.196245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:36.196696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:36.197475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:36.197930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:36.389219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:36.396759 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d3ada96-4901-43b1-a13c-16a803616562 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1364 microversion: 2.1 time: 0.213965 Jun 16 19:29:36.397327 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3153/6417] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:36 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:37.413622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:37.414283 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:37.421295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:37.421767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:37.422588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:37.423043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:37.556338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:37.564067 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-09ad2687-21ce-48cd-a23e-356c339b3496 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1364 microversion: 2.1 time: 0.154343 Jun 16 19:29:37.564644 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3265/6418] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:37 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:38.582489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:38.583073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:38.590257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:38.590719 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:38.591483 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:38.591923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:38.729071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:38.736710 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fa7b3ecb-9e01-4f4a-9bb8-a009476d9215 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1364 microversion: 2.1 time: 0.158291 Jun 16 19:29:38.737287 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3154/6419] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:38 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:39.755376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:39.756006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:39.764563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:39.765027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:39.765805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:39.766279 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:39.904303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:39.911962 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12d8a883-0103-496d-a6ed-f9ad5c4446d4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1364 microversion: 2.1 time: 0.160725 Jun 16 19:29:39.912572 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3266/6420] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:39 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:40.000870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9c582940-4400-464f-8240-6a952dadff23 req-6b1a0a4f-17ac-4073-9054-205347593e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "name": "network-vif-plugged", "status": "completed", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:40.009862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9c582940-4400-464f-8240-6a952dadff23 req-6b1a0a4f-17ac-4073-9054-205347593e86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:40.010342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9c582940-4400-464f-8240-6a952dadff23 req-6b1a0a4f-17ac-4073-9054-205347593e86 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:40.022010 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9c582940-4400-464f-8240-6a952dadff23 req-6b1a0a4f-17ac-4073-9054-205347593e86 service nova] Creating event network-vif-plugged:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h1-846209-2 Jun 16 19:29:40.027204 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9c582940-4400-464f-8240-6a952dadff23 req-6b1a0a4f-17ac-4073-9054-205347593e86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Jun 16 19:29:40.028226 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3155/6421] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:29:40.931080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:40.931659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:40.938719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:40.939198 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:40.939987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:40.940447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:41.081406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:41.089632 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e3e462e-c15e-4f75-a1c2-f553fed893b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1364 microversion: 2.1 time: 0.163187 Jun 16 19:29:41.089632 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3267/6422] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:40 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:42.105015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:42.105790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:42.110312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:42.111047 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:42.118180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:42.118642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:42.119425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:42.119860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:42.251068 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:29:42.258707 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6cb605bc-9da3-4584-9dcd-f9d89576bb8a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1551 microversion: 2.1 time: 0.155650 Jun 16 19:29:42.259273 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3156/6423] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:29:42 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:29:42.275490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a313b33d-d39d-44ef-aa91-30b92249ff1b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:29:42.276018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a313b33d-d39d-44ef-aa91-30b92249ff1b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:29:42.277949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:29:42.284226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313b33d-d39d-44ef-aa91-30b92249ff1b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:42.284697 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313b33d-d39d-44ef-aa91-30b92249ff1b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:42.285490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313b33d-d39d-44ef-aa91-30b92249ff1b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:42.285990 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a313b33d-d39d-44ef-aa91-30b92249ff1b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:42.369561 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a313b33d-d39d-44ef-aa91-30b92249ff1b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098000 Jun 16 19:29:42.370206 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3268/6424] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jun 16 19:29:42 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:29:43.323821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-58476c7a-d7ac-406d-9ada-091cdbc6090a req-fb061bdb-cc6a-4ac4-8e19-7e7ad204ffb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:29:43.333006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-58476c7a-d7ac-406d-9ada-091cdbc6090a req-fb061bdb-cc6a-4ac4-8e19-7e7ad204ffb8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:29:43.333461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-58476c7a-d7ac-406d-9ada-091cdbc6090a req-fb061bdb-cc6a-4ac4-8e19-7e7ad204ffb8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:29:43.347502 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-58476c7a-d7ac-406d-9ada-091cdbc6090a req-fb061bdb-cc6a-4ac4-8e19-7e7ad204ffb8 service nova] Creating event network-changed:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h1-846209-2 Jun 16 19:29:43.353210 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-58476c7a-d7ac-406d-9ada-091cdbc6090a req-fb061bdb-cc6a-4ac4-8e19-7e7ad204ffb8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032938 Jun 16 19:29:43.353923 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3157/6425] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:30:25.561715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=11 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:25.562590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:25.566461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:25.567094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:25.575551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:25.576032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:25.576823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:25.577282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:25.774494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:25.782468 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d0055e0-16cf-4f52-b364-bb8cce7961a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1670 microversion: 2.1 time: 0.222817 Jun 16 19:30:25.783066 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3269/6426] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:25 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1670 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:25.797454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=13 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:25.798218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=46 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:25.803477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f3c8bc5-a5b3-4f56-8ec3-f1a804fc9651 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96a3df26-bbb1-4f2a-9198-224ffb45cd69"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:30:25.804802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f3c8bc5-a5b3-4f56-8ec3-f1a804fc9651 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:25.812521 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bc5-a5b3-4f56-8ec3-f1a804fc9651 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:25.812975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bc5-a5b3-4f56-8ec3-f1a804fc9651 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:25.813737 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bc5-a5b3-4f56-8ec3-f1a804fc9651 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:25.814219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f3c8bc5-a5b3-4f56-8ec3-f1a804fc9651 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:26.250360 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f3c8bc5-a5b3-4f56-8ec3-f1a804fc9651 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454758 Jun 16 19:30:26.250974 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3158/6427] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 19:30:25 2022] POST /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:30:36.917113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:30:36.918151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:36.921661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:36.922420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:36.929574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:36.930082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:36.930871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:36.931325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:36.960952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:36.967357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Old instance type m1.heat2, new instance type m1.heat {{(pid=119206) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:30:36.974090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:30:36.974532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:30:36.975025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:30:36.975451 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:30:36.975881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:30:37.042562 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4811b02e-c5a2-411a-9ee6-290533cd1cd4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/action" status: 202 len: 0 microversion: 2.1 time: 0.129643 Jun 16 19:30:37.043684 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3270/6428] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:30:36 2022] POST /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:30:37.052926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:37.053723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:37.057821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:37.058688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:30:37.063796 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:37.064263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:37.065038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:37.065512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:37.227252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:37.236191 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ced86c1e-ee8e-4deb-98a4-969120542b24 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1725 microversion: 2.1 time: 0.188041 Jun 16 19:30:37.236821 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3159/6429] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:37 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:38.256643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:38.257278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:38.265705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:38.266207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:38.267004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:38.267459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:38.467312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:38.475574 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3f7cef6f-0002-4b6d-972d-4f32f363204d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1725 microversion: 2.1 time: 0.224499 Jun 16 19:30:38.476268 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3271/6430] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:38 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:39.493964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:39.494798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:39.502699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:39.503155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:39.503925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:39.504368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:39.639607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:39.647595 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6fb4057e-f81b-4fa9-a707-4f2d4482a3b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.157537 Jun 16 19:30:39.648161 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3160/6431] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:39 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:40.665779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:40.666427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:40.674190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:40.674667 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:40.675720 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:40.676176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:40.815089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:40.823555 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-608a2212-d9b9-4560-9d8d-36a6bc7ff1d6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.161788 Jun 16 19:30:40.824370 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3272/6432] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:40 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:41.890346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:41.891177 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:41.897442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:41.897900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:41.898704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:41.899150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:42.034292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:42.042698 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4f4500f5-edbc-4eea-bd4f-05a2d3d5fda0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.204491 Jun 16 19:30:42.043274 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3161/6433] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:41 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:43.061403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:43.062176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:43.068995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:43.069456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:43.070293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:43.070808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:43.199645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:43.208633 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ba7ce6fb-c38c-493c-9659-ae6b2e557ebd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.151827 Jun 16 19:30:43.209246 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3273/6434] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:43 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:44.227125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:44.227751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:44.235740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:44.236191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:44.236959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:44.237401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:44.374806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:44.382986 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3eef00d9-ba7b-4ae3-b991-cb8213459c80 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.161132 Jun 16 19:30:44.383551 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3162/6435] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:44 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:45.400249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:45.401122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:45.408045 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:45.408519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:45.409296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:45.409752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:45.540616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:45.549477 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a1b1184-ffd3-4ed4-b9fb-882da67b1641 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.153931 Jun 16 19:30:45.550326 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3274/6436] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:45 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:46.569528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:46.570179 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:46.578063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:46.578538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:46.579321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:46.579778 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:46.714478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:46.722734 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dbbd610e-0c1d-4510-a5d6-cea50326a513 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.157117 Jun 16 19:30:46.723312 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3163/6437] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:46 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:47.740423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:47.741511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:47.748546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:47.749008 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:47.749786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:47.750372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:47.886214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:47.896051 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fdb344f5-e83a-4e1b-b885-bcf89823712c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.159867 Jun 16 19:30:47.896634 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3275/6438] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:47 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:48.913652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:48.914297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:48.921297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:48.921743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:48.923301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:48.923734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:49.053899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:49.061996 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3de616a9-e353-40c1-ac1e-f02dca2b9486 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.152294 Jun 16 19:30:49.062565 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3164/6439] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:48 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:50.080069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:50.080742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:50.088493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:50.088960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:50.089765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:50.090250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:50.647067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:50.656614 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c484f725-673d-439c-9486-ed50cfeba59f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.580624 Jun 16 19:30:50.657424 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3276/6440] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:50 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:51.675424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:51.675967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:51.683178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:51.683664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:51.684460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:51.684902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:51.818471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:51.826605 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-40d4b0a0-f33c-44d1-877a-bbc169756dea tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.156010 Jun 16 19:30:51.827175 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3165/6441] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:51 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:52.846515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:52.847149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:52.854148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:52.854618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:52.855395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:52.855849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:52.991284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:52.999292 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50dfa852-1862-494d-92d9-982f8cbb28f6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.157893 Jun 16 19:30:52.999884 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3277/6442] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:52 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:54.017088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:54.017762 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:54.027112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:54.027573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:54.028359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:54.028815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:54.159654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:54.167728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8cf6577f-3fd9-462e-95e1-58319a528b89 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.154911 Jun 16 19:30:54.168321 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3166/6443] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:54 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:55.184803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:55.185438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:55.193275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:55.193751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:55.194573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:55.195260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:55.329987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:55.338191 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-08757939-eff2-4f2e-9e40-9e8c55585493 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.157262 Jun 16 19:30:55.338687 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3278/6444] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:55 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:56.356225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:56.356837 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:56.366161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:56.366609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:56.367406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:56.367843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:56.511792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:56.520480 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f13cff12-4ec8-4b48-8563-4829e55b0f93 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.168062 Jun 16 19:30:56.521237 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3167/6445] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:56 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:57.538920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:57.539732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:57.546996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:57.547526 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:57.548364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:57.548820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:57.699830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:57.709248 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-efbb604d-1280-4674-8b35-303156cd510f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1730 microversion: 2.1 time: 0.174704 Jun 16 19:30:57.709838 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3279/6446] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:57 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:58.456802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-1180d99a-2968-4f18-a355-1b0e79b2e808 req-46c2db58-f01f-43e4-aa08-2fa7b2b6d71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "name": "network-vif-unplugged", "status": "completed", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:30:58.466186 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1180d99a-2968-4f18-a355-1b0e79b2e808 req-46c2db58-f01f-43e4-aa08-2fa7b2b6d71d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:58.466821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-1180d99a-2968-4f18-a355-1b0e79b2e808 req-46c2db58-f01f-43e4-aa08-2fa7b2b6d71d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:58.481598 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-1180d99a-2968-4f18-a355-1b0e79b2e808 req-46c2db58-f01f-43e4-aa08-2fa7b2b6d71d service nova] Creating event network-vif-unplugged:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h2-846209-2 Jun 16 19:30:58.488387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-1180d99a-2968-4f18-a355-1b0e79b2e808 req-46c2db58-f01f-43e4-aa08-2fa7b2b6d71d service nova] Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:30:58.499708 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-1180d99a-2968-4f18-a355-1b0e79b2e808 req-46c2db58-f01f-43e4-aa08-2fa7b2b6d71d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116328 Jun 16 19:30:58.500325 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3168/6447] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:30:58.727211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:58.727845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:58.735511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:58.736066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:58.736853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:58.737304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:58.877241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:30:58.885463 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-434a0376-99f0-46c5-9062-42296cd422fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1729 microversion: 2.1 time: 0.162910 Jun 16 19:30:58.886068 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3280/6448] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:58 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:30:59.579289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0b15c916-184f-4d4a-8a57-6fa1f7f7fe56 req-628eb77c-9abe-4f13-a77a-d6a8c1262ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:30:59.593367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0b15c916-184f-4d4a-8a57-6fa1f7f7fe56 req-628eb77c-9abe-4f13-a77a-d6a8c1262ebc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:59.593821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0b15c916-184f-4d4a-8a57-6fa1f7f7fe56 req-628eb77c-9abe-4f13-a77a-d6a8c1262ebc service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:59.607330 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0b15c916-184f-4d4a-8a57-6fa1f7f7fe56 req-628eb77c-9abe-4f13-a77a-d6a8c1262ebc service nova] Creating event network-changed:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h2-846209-2 Jun 16 19:30:59.614306 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-0b15c916-184f-4d4a-8a57-6fa1f7f7fe56 req-628eb77c-9abe-4f13-a77a-d6a8c1262ebc service nova] Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:30:59.625699 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0b15c916-184f-4d4a-8a57-6fa1f7f7fe56 req-628eb77c-9abe-4f13-a77a-d6a8c1262ebc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127002 Jun 16 19:30:59.627301 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3169/6449] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:30:59.903899 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:30:59.904524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:30:59.920480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:59.920946 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:30:59.921933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:30:59.922397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:00.151620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:00.162538 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a98dcdf3-6a88-4fac-a1e7-93b528beebeb tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1729 microversion: 2.1 time: 0.262503 Jun 16 19:31:00.173472 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3281/6450] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:30:59 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:01.181882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:01.182542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:01.189134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:01.189558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:01.190372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:01.190817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:01.332768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:01.341021 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-95f00898-ef96-49c6-839f-b2924930d8b4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.164386 Jun 16 19:31:01.341689 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3170/6451] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:01 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:02.359213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:02.359966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:02.368315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:02.368829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:02.369611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:02.370094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:02.506128 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:02.514371 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1f98ef31-0f64-45e8-9c02-d375bed30f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.159058 Jun 16 19:31:02.514952 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3282/6452] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:02 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:03.531961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:03.532745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:03.540397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:03.540852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:03.541625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:03.542098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:03.681770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:03.690107 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27e1b8a3-a74f-432b-859c-0140eb9ed4af tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.162593 Jun 16 19:31:03.690692 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3171/6453] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:03 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:04.709257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:04.710070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:04.717988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:04.718460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:04.719274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:04.719729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:04.858797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:04.868735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7fbdae32-95c0-477f-826b-79f47e4c5791 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.165184 Jun 16 19:31:04.869213 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3283/6454] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:04 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:05.886999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:05.887617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:05.895713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:05.896088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:05.896921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:05.897317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:06.036371 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:06.044549 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4c85d632-69b7-4a70-b2f2-bfb509adb661 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.161439 Jun 16 19:31:06.045129 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3172/6455] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:05 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:07.062689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:07.063325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:07.066166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=33 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:07.071857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:07.072333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:07.073124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:07.073579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:07.077624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:07.215903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:07.224980 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-84ee7d62-416e-4169-a4ab-f7d8995f303d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.166295 Jun 16 19:31:07.225568 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3284/6456] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:07 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:08.243264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:08.243884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:08.246493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=29 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:08.251918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:08.252838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:08.253658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:08.254138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:08.256907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=81 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:08.392282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:08.401109 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f69c00af-e801-438d-afda-e1363036c255 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.161852 Jun 16 19:31:08.401690 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3173/6457] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:08 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:31:09.419160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:09.419794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:09.427848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:09.428323 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:09.429113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:09.429571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:09.566318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:09.575741 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d35c1632-424a-4069-8214-22bb8770f6c3 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.160558 Jun 16 19:31:09.576339 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3285/6458] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:09 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:10.593662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:10.594429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:10.601876 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:10.602358 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:10.603123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:10.603558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:10.737390 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:10.746226 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d1c1fda2-d6ec-4ca5-b7c6-eb8ac46349f4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.156359 Jun 16 19:31:10.746920 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3174/6459] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:10 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:11.763887 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:11.764550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:11.773755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:11.774723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:11.775533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:11.776102 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:11.919330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:11.929691 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c97d6478-1fc1-4334-af03-ebd7b86b9d91 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1727 microversion: 2.1 time: 0.169729 Jun 16 19:31:11.930317 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3286/6460] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:11 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:31:12.946649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:12.947181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:12.954174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:12.954639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:12.955409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:12.955854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:13.088874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:13.097594 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0d21937e-9641-4995-b3a2-dbb6d5be22e8 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1724 microversion: 2.1 time: 0.154629 Jun 16 19:31:13.098340 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3175/6461] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:12 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:13.115588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:31:13.116148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:13.123084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:13.123551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:13.124336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:13.124794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:13.163515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:13.163980 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:13.164793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:13.165247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:13.187200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:31:13.193499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Getting quotas for user b9974643a17249f5a709f5d5170f2bd1 and project d6ca4f06ca32406cb2e566384d4d5c61. Resources: {'cores', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:31:13.297444 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3402b1a2-a7cc-4dce-bf5f-c8c67ae25217 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "POST /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/action" status: 202 len: 0 microversion: 2.1 time: 0.186657 Jun 16 19:31:13.298108 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3287/6462] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:31:13 2022] POST /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:31:13.307112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:13.307746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:13.313953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:13.314304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:13.315331 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:13.315810 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:13.457054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:13.465457 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-04bc16a3-651e-489f-bf78-775377f34ac6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.162177 Jun 16 19:31:13.466391 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3176/6463] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:13 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:14.485168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:14.485892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:14.494692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:14.495163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:14.495953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:14.496411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:14.636295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:14.645519 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a75ac4c7-88fa-4b63-a071-74342ce8708b tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.165601 Jun 16 19:31:14.646137 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3288/6464] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:14 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:14.960690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-aa6d76ed-623f-431e-b297-ccb4062f7339 req-8e0ca2b6-1129-417e-8986-16e5d390e44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "name": "network-vif-plugged", "status": "completed", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:31:14.970058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-aa6d76ed-623f-431e-b297-ccb4062f7339 req-8e0ca2b6-1129-417e-8986-16e5d390e44e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:14.970507 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-aa6d76ed-623f-431e-b297-ccb4062f7339 req-8e0ca2b6-1129-417e-8986-16e5d390e44e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:14.984708 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-aa6d76ed-623f-431e-b297-ccb4062f7339 req-8e0ca2b6-1129-417e-8986-16e5d390e44e service nova] Creating event network-vif-plugged:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h2-846209-2 Jun 16 19:31:14.991021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-aa6d76ed-623f-431e-b297-ccb4062f7339 req-8e0ca2b6-1129-417e-8986-16e5d390e44e service nova] Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:31:15.002018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-aa6d76ed-623f-431e-b297-ccb4062f7339 req-8e0ca2b6-1129-417e-8986-16e5d390e44e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045740 Jun 16 19:31:15.002824 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3177/6465] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:31:15.664141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:15.664778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:15.670958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:15.671434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:15.672226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:15.672682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:15.811467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:15.820531 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-66ba07ab-b27f-4fb0-98a6-8dd5c8c13ad7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.161526 Jun 16 19:31:15.821114 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3289/6466] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:15 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:16.839363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:16.840102 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:16.847531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:16.847991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:16.848766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:16.849206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:16.989439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:16.997628 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f15635aa-543c-415e-bc7c-d5238a61d8ef tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.163529 Jun 16 19:31:16.998236 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3178/6467] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:16 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:18.015732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:18.016369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:18.023584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:18.024125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:18.024927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:18.025384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:18.236935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:18.245315 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-27c52435-7c39-4ad6-891a-846b48fc87c4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.233469 Jun 16 19:31:18.246017 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3290/6468] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:18 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:18.532926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c86aef7c-605c-4e5a-b61e-75d126153f25 req-cf27f727-d441-4993-ad3a-b6003388b17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "name": "network-vif-unplugged", "status": "completed", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:31:18.542729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c86aef7c-605c-4e5a-b61e-75d126153f25 req-cf27f727-d441-4993-ad3a-b6003388b17d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:18.543365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c86aef7c-605c-4e5a-b61e-75d126153f25 req-cf27f727-d441-4993-ad3a-b6003388b17d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:18.558223 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c86aef7c-605c-4e5a-b61e-75d126153f25 req-cf27f727-d441-4993-ad3a-b6003388b17d service nova] Creating event network-vif-unplugged:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h1-846209-2 Jun 16 19:31:18.564468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-c86aef7c-605c-4e5a-b61e-75d126153f25 req-cf27f727-d441-4993-ad3a-b6003388b17d service nova] Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:31:18.578286 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c86aef7c-605c-4e5a-b61e-75d126153f25 req-cf27f727-d441-4993-ad3a-b6003388b17d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108597 Jun 16 19:31:18.579618 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3179/6469] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:31:19.263082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:19.263748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:19.271263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:19.271738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:19.272538 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:19.272998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:19.497704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:19.506416 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5498743f-91d7-48e0-a0de-14a450ccd32d tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.247164 Jun 16 19:31:19.507591 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3291/6470] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:19 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:20.526449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:20.527162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:20.533499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:20.534020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:20.535462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:20.535902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:20.609084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b3bf0ebf-93cf-4ce7-b00d-86daee5c2012 req-85e38fce-ee99-4d67-816f-89d475a3e98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:31:20.618809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b3bf0ebf-93cf-4ce7-b00d-86daee5c2012 req-85e38fce-ee99-4d67-816f-89d475a3e98f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:20.619391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b3bf0ebf-93cf-4ce7-b00d-86daee5c2012 req-85e38fce-ee99-4d67-816f-89d475a3e98f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:20.632548 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b3bf0ebf-93cf-4ce7-b00d-86daee5c2012 req-85e38fce-ee99-4d67-816f-89d475a3e98f service nova] Creating event network-changed:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h1-846209-2 Jun 16 19:31:20.638712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-b3bf0ebf-93cf-4ce7-b00d-86daee5c2012 req-85e38fce-ee99-4d67-816f-89d475a3e98f service nova] Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:31:20.651013 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b3bf0ebf-93cf-4ce7-b00d-86daee5c2012 req-85e38fce-ee99-4d67-816f-89d475a3e98f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045611 Jun 16 19:31:20.651963 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3292/6471] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:31:20.703535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:20.713501 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-595a30a1-23ff-48a2-b605-7882e3632c5a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.192537 Jun 16 19:31:20.714496 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3180/6472] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:20 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:21.732302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:21.733026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:21.740125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:21.740588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:21.741375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:21.741836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:21.884016 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:21.892453 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c8c4b9f-d315-4aba-ae0c-fab73d30acdd tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.165101 Jun 16 19:31:21.892949 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3293/6473] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:21 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:22.911114 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:22.911676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:22.918976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:22.919354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:22.920124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:22.920556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:23.058409 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:23.067032 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6c922090-9120-4654-a09b-d44a2f88f5ff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.159860 Jun 16 19:31:23.067619 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3181/6474] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:22 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:24.085615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:24.086277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:24.089125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:24.095141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:24.095610 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:24.096442 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:24.096909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:24.234917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:24.244125 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9ba94287-b953-43e5-8901-a0a743d69ee7 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.163481 Jun 16 19:31:24.244766 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3294/6475] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:24 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:25.261849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:25.262479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:25.269696 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:25.270301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:25.271105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:25.271555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:25.410449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:25.418577 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d088907b-3f49-4a19-88e0-a6a1a2c215e4 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.160624 Jun 16 19:31:25.419149 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3182/6476] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:25 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:26.436337 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:26.437033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:26.445200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:26.445669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:26.446560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:26.447023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:26.584712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:26.594825 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2ece2b62-c3f4-4a94-a468-a02dd9bc9fff tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.162552 Jun 16 19:31:26.595443 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3295/6477] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:26 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:27.614744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:27.615387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:27.622978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:27.623374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:27.624240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:27.624681 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:27.761935 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:27.770297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-25ce89c9-219c-470c-ba18-b7e845f18830 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.160164 Jun 16 19:31:27.770743 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3183/6478] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:27 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:28.787270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:28.787908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:28.794987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:28.795466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:28.796260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:28.796723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:28.934993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:28.944089 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2c987ac3-74ff-4d4a-9e2b-117f837a27ba tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.161374 Jun 16 19:31:28.944676 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3296/6479] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:28 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:29.961667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:29.962320 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:29.969472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:29.969944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:29.970732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:29.971166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:30.114777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:30.123186 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83e07844-00ab-41a7-bfe6-23bd0904e4c6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.166436 Jun 16 19:31:30.123969 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3184/6480] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:29 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:31.141025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:31.141669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:31.149370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:31.149834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:31.150631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:31.151098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:31.286654 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:31.294830 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-78798089-d492-469d-86e8-9cfe5a5bc1c0 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1723 microversion: 2.1 time: 0.157725 Jun 16 19:31:31.295402 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3297/6481] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:31 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:32.312255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:32.312879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:32.319584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.320044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.320816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.321263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.449698 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:32.457855 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a9374f71-de54-4c0e-a3b3-579af40e26b2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1716 microversion: 2.1 time: 0.149800 Jun 16 19:31:32.458463 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3185/6482] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:32 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:32.474623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:32.476232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:32.483209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.483678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.484458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.484915 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.487507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:32.621633 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:32.629888 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4be43480-805b-425f-ba6b-aff2d4ea53b9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1716 microversion: 2.1 time: 0.159298 Jun 16 19:31:32.630499 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3298/6483] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:32 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:32.647389 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:32.647871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:32.654173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.654634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.655415 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.655863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.788243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:32.796572 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-06534940-d8fd-4179-8fe2-5d5954dedf23 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1716 microversion: 2.1 time: 0.153789 Jun 16 19:31:32.797164 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3186/6484] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:32 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:32.812902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:32.813411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:32.820251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.820642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.821413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.821861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.847255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:31:32.928971 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e115ebc0-04a9-4c98-891f-4086df6a7e27 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 204 len: 0 microversion: 2.1 time: 0.119703 Jun 16 19:31:32.929572 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3299/6485] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:31:32 2022] DELETE /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:31:32.938291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:32.938910 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:32.945788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.946273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:32.947044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:32.947484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:33.081565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:33.091563 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e6fee974-7c4f-404d-9a30-9ca1dfb302d2 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1722 microversion: 2.1 time: 0.157468 Jun 16 19:31:33.092143 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3187/6486] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:32 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:34.110818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:34.111619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:34.119377 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:34.119838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:34.120603 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:34.121049 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:34.256889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:34.264988 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cbeb7ad0-378f-4844-949d-1e9e9c75d2f9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1722 microversion: 2.1 time: 0.158715 Jun 16 19:31:34.265567 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3300/6487] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:34 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:34.664931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-08175ada-a42b-4c9d-8c56-dc6f34c3a2d0 req-edc79e24-2471-429c-b932-183a935ed13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "name": "network-vif-plugged", "status": "completed", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:31:34.676379 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-08175ada-a42b-4c9d-8c56-dc6f34c3a2d0 req-edc79e24-2471-429c-b932-183a935ed13e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:34.677499 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-08175ada-a42b-4c9d-8c56-dc6f34c3a2d0 req-edc79e24-2471-429c-b932-183a935ed13e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:34.692074 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-08175ada-a42b-4c9d-8c56-dc6f34c3a2d0 req-edc79e24-2471-429c-b932-183a935ed13e service nova] Creating event network-vif-plugged:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h1-846209-2 Jun 16 19:31:34.698053 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-08175ada-a42b-4c9d-8c56-dc6f34c3a2d0 req-edc79e24-2471-429c-b932-183a935ed13e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037290 Jun 16 19:31:34.698877 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3188/6488] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:31:35.283527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:35.284250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:35.292836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:35.293592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:35.294754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:35.295407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:35.397783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:35.405892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-757208ec-d4dc-465d-8aa5-142b83040725 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1654 microversion: 2.1 time: 0.126840 Jun 16 19:31:35.406572 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3301/6489] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:35 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1654 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:31:35.513103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-96122315-3ea2-425c-855a-3bb6de6c9fad req-a78d964c-27e1-43fd-9cf9-1f6b2ca8b269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531ca98-b2fd-4a9a-bf89-ffe143183f79", "name": "network-vif-deleted", "tag": "af2df132-dbf9-4d7e-95ba-2dfca67da5db"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:31:35.522581 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-96122315-3ea2-425c-855a-3bb6de6c9fad req-a78d964c-27e1-43fd-9cf9-1f6b2ca8b269 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:35.523441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-96122315-3ea2-425c-855a-3bb6de6c9fad req-a78d964c-27e1-43fd-9cf9-1f6b2ca8b269 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:35.535262 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-96122315-3ea2-425c-855a-3bb6de6c9fad req-a78d964c-27e1-43fd-9cf9-1f6b2ca8b269 service nova] Creating event network-vif-deleted:af2df132-dbf9-4d7e-95ba-2dfca67da5db for instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 on n-h1-846209-2 Jun 16 19:31:35.540744 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-96122315-3ea2-425c-855a-3bb6de6c9fad req-a78d964c-27e1-43fd-9cf9-1f6b2ca8b269 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 Jun 16 19:31:35.541744 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3189/6490] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:31:36.424060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:36.424859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:36.433097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:36.433570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:36.434480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:36.435165 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:36.507842 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:36.516184 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-be3b17e9-dcad-4d1e-8f35-f654e878eb98 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1369 microversion: 2.1 time: 0.096263 Jun 16 19:31:36.516769 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3302/6491] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:36 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:37.534538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:37.535134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:37.542768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:37.543230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:37.544045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:37.544491 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:37.611069 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:37.619505 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d317bad3-cfb8-4510-ab7c-1c4ea89eaee6 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1369 microversion: 2.1 time: 0.090116 Jun 16 19:31:37.620093 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3190/6492] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:37 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:31:38.636928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:38.637485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:38.644678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:38.647369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:38.648057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:38.650183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:38.650645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:38.716426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:38.724773 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-75a53a72-94ab-494f-a2d7-2c9e7d5d3f1c tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1369 microversion: 2.1 time: 0.091830 Jun 16 19:31:38.725402 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3303/6493] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:38 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:31:39.742833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:39.743523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:39.747174 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=36 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:39.752535 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:39.752995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:39.753781 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:39.754266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:39.759339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:39.791107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:39.791565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:39.792144 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lazy-loading 'fault' on Instance uuid 5531ca98-b2fd-4a9a-bf89-ffe143183f79 {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:31:40.211845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9974643a17249f5a709f5d5170f2bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ca4f06ca32406cb2e566384d4d5c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:40.218867 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4268dcc8-dd43-4a0e-adcc-dc9e0ee3226e tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 200 len: 1328 microversion: 2.1 time: 0.480942 Jun 16 19:31:40.219439 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3191/6494] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:39 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 1328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:41.236648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:41.237288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:41.245076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:41.245551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:41.246375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:41.246836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:41.261246 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 HTTP/1.1 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5531ca98-b2fd-4a9a-bf89-ffe143183f79'} Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:41.262951 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bdede558-b070-474d-9e60-bd0271993854 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 404 len: 111 microversion: 2.1 time: 0.031642 Jun 16 19:31:41.267380 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3304/6495] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:41 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:31:41.320770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:41.325123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:41.332937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:41.333399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:41.334304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:41.334782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:41.347498 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/os-volume_attachments HTTP/1.1 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': '5531ca98-b2fd-4a9a-bf89-ffe143183f79'} Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:41.349202 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b5c72a24-cfe0-4352-a27c-1e213f111810 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034748 Jun 16 19:31:41.353392 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3192/6496] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:31:41 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:31:44.656912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.657419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.665141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.665824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.666673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.667132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.682242 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 HTTP/1.1 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '5531ca98-b2fd-4a9a-bf89-ffe143183f79'} Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.683889 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6f561408-8888-49e4-84c1-344d24dae018 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 404 len: 111 microversion: 2.1 time: 0.032498 Jun 16 19:31:44.687845 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3305/6497] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:31:44 2022] DELETE /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:31:44.694551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.695227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 5531ca98-b2fd-4a9a-bf89-ffe143183f79] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.703056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.703445 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.704505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.704961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.720848 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 HTTP/1.1 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '5531ca98-b2fd-4a9a-bf89-ffe143183f79'} Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.722486 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 5531ca98-b2fd-4a9a-bf89-ffe143183f79 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f0008ce-9701-49a0-b6e4-5210ea699f64 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79" status: 404 len: 111 microversion: 2.1 time: 0.033968 Jun 16 19:31:44.726710 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3193/6498] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:44 2022] GET /compute/v2.1/servers/5531ca98-b2fd-4a9a-bf89-ffe143183f79 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:31:44.733208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.733723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.740033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.740549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.741397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.741855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.756629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 HTTP/1.1 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '2faf7783-8384-4117-8e8f-1373aef1f4b0'} Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.758360 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-04d987b1-55e5-4ad7-96ab-447aa367e0a9 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 404 len: 111 microversion: 2.1 time: 0.030609 Jun 16 19:31:44.765825 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3306/6499] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:31:44 2022] DELETE /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:31:44.768764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.769396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 2faf7783-8384-4117-8e8f-1373aef1f4b0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.776857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.777506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.778369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.778802 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.793827 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 HTTP/1.1 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '2faf7783-8384-4117-8e8f-1373aef1f4b0'} Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.795436 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 2faf7783-8384-4117-8e8f-1373aef1f4b0 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.799848 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2e814bdf-5e4b-4cc1-857c-1bcb94b3d28a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0" status: 404 len: 111 microversion: 2.1 time: 0.032010 Jun 16 19:31:44.801191 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3194/6500] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:44 2022] GET /compute/v2.1/servers/2faf7783-8384-4117-8e8f-1373aef1f4b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:31:44.806573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.807186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.813806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.814522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.815513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.815761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.831277 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f HTTP/1.1 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '22f5999c-3101-4f68-a082-d906c648448f'} Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.832991 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.838082 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-89ebf88a-7946-4a96-8ecb-d37a61db8021 tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 404 len: 111 microversion: 2.1 time: 0.033886 Jun 16 19:31:44.839591 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3307/6501] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:31:44 2022] DELETE /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:31:44.846624 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.847271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: 22f5999c-3101-4f68-a082-d906c648448f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.853751 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.854247 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.855023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.855472 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.869326 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f HTTP/1.1 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '22f5999c-3101-4f68-a082-d906c648448f'} Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.870971 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance 22f5999c-3101-4f68-a082-d906c648448f could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9779a3f0-fc35-412e-a2f3-b9abc88ac9fc tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f" status: 404 len: 111 microversion: 2.1 time: 0.029647 Jun 16 19:31:44.877957 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3195/6502] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:44 2022] GET /compute/v2.1/servers/22f5999c-3101-4f68-a082-d906c648448f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:31:44.881666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.882118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.888273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.888739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.889511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.889985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.904654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 HTTP/1.1 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'f6f91b78-77a9-448c-b89e-e24ee83b8545'} Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.906351 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3fe3d7b3-0c31-4d65-ac7e-7fc53e9cd09f tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 404 len: 111 microversion: 2.1 time: 0.030799 Jun 16 19:31:44.910366 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3308/6503] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:31:44 2022] DELETE /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:31:44.917104 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.917730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] [instance: f6f91b78-77a9-448c-b89e-e24ee83b8545] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:44.923986 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.924446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.925466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:44.925943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:44.939980 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] HTTP exception thrown: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Request method failure captured: Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 HTTP/1.1 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4O2X804WiRd9YVkbJL5gI0eCZyEu8EvwdUnrczM4GIZqj-S-rDx6TbsjxBOti_YhMQGvuqEtrD1y7ULOmObw5E3at8BBB11ObzqVulXMF72qdLHiSza_CVQ6bvXLmLl37GFHZjW7XYlbwuoUkoE-99TyLdf7fW_b4j4w_t4jfrpSkI Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6ca4f06ca32406cb2e566384d4d5c61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6ca4f06ca32406cb2e566384d4d5c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: d6ca4f06ca32406cb2e566384d4d5c61 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871117197 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: b9974643a17249f5a709f5d5170f2bd1 Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServerActionsTestJSON-1871117197-project Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'f6f91b78-77a9-448c-b89e-e24ee83b8545'} Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:31:44.941565 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Returning 404 to user: Instance f6f91b78-77a9-448c-b89e-e24ee83b8545 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8badd061-e0c2-4d0b-a7ce-194d2a6728fe tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545" status: 404 len: 111 microversion: 2.1 time: 0.030033 Jun 16 19:31:44.946672 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3196/6504] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:44 2022] GET /compute/v2.1/servers/f6f91b78-77a9-448c-b89e-e24ee83b8545 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:31:44.952566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bbb49f88-d299-4d31-aa2d-c3c1f6ba268a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] Calling method '.version_select at 0x7f866ed59c10>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:44.976529 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bbb49f88-d299-4d31-aa2d-c3c1f6ba268a tempest-ServerActionsTestJSON-1871117197 tempest-ServerActionsTestJSON-1871117197-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194723681" status: 202 len: 0 microversion: 2.1 time: 0.027703 Jun 16 19:31:44.977118 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3309/6505] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jun 16 19:31:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194723681 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:31:54.339928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865853365", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "7a6c6d85-5a9d-494c-9dba-1d945a63633a"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:31:54.397515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] validate_networks() for [('7a6c6d85-5a9d-494c-9dba-1d945a63633a', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:31:54.779723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:31:54.780160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:31:54.780645 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:31:54.781064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:31:54.781484 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:31:54.791206 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:54.791664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:54.792475 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:31:54.792918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:31:54.809932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Getting quotas for project 2e06a3a337bf4955b2c135f82ae93a90. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:31:54.815261 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Getting quotas for user e1a3df1193c045ac80d55d1f67400cfe and project 2e06a3a337bf4955b2c135f82ae93a90. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:31:54.829423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:31:54.831766 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:31:54.877482 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:31:55.890496 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39012. Jun 16 19:31:55.895308 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-22b119e8-540b-4435-915e-e48d92a5c423 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715260 Jun 16 19:31:55.905943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:55.907861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:31:55.922491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-216b6ea3-1ee8-43b2-9538-a7fcf23944b7 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:55.927296 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3197/6506] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:31:55.928696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-216b6ea3-1ee8-43b2-9538-a7fcf23944b7 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:56.039344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-216b6ea3-1ee8-43b2-9538-a7fcf23944b7 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:56.050812 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-216b6ea3-1ee8-43b2-9538-a7fcf23944b7 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1217 microversion: 2.1 time: 0.146872 Jun 16 19:31:56.051411 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3310/6507] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:55 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:57.070966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45cec0e0-3755-4aa0-81be-5a7096f3dc12 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:57.070966 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-45cec0e0-3755-4aa0-81be-5a7096f3dc12 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:57.127276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-45cec0e0-3755-4aa0-81be-5a7096f3dc12 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:57.135506 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-45cec0e0-3755-4aa0-81be-5a7096f3dc12 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1217 microversion: 2.1 time: 0.070870 Jun 16 19:31:57.136116 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3198/6508] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:57 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:58.153459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-477fa827-282b-4bc9-97aa-aa1eebc2a068 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:58.154931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-477fa827-282b-4bc9-97aa-aa1eebc2a068 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:58.216846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-477fa827-282b-4bc9-97aa-aa1eebc2a068 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:58.227298 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-477fa827-282b-4bc9-97aa-aa1eebc2a068 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1217 microversion: 2.1 time: 0.077793 Jun 16 19:31:58.227882 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3311/6509] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:58 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:31:59.246423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-11ec11cd-0b05-45ee-899b-d3991fd4cc74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:31:59.247166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-11ec11cd-0b05-45ee-899b-d3991fd4cc74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:31:59.308571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-11ec11cd-0b05-45ee-899b-d3991fd4cc74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:31:59.330262 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-11ec11cd-0b05-45ee-899b-d3991fd4cc74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1217 microversion: 2.1 time: 0.087667 Jun 16 19:31:59.338365 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3199/6510] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:31:59 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:32:00.348029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:00.348663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:00.357522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:00.358022 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:00.358816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:00.359272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:00.422416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:00.433715 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0be55a7d-eb0e-4f5f-b73f-7c6d94bf7c75 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1221 microversion: 2.1 time: 0.089542 Jun 16 19:32:00.434383 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3312/6511] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:00 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:01.452356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:01.453020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:01.460716 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:01.461347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:01.462181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:01.462630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:01.604901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:01.613390 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-695e0d85-2ce3-4ce8-9f6f-c8053e98a34f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1317 microversion: 2.1 time: 0.165909 Jun 16 19:32:01.614012 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3200/6512] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:01 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:02.546587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-da67d2d2-75f1-46c1-9005-89cf05938600 req-29867641-0970-4746-bb6a-497d3a628480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93df7ae-f756-4aa7-a2c8-58ee36e756db", "tag": "eb395e8d-d85f-41c1-a4c9-bdfec0181765"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:02.557537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-da67d2d2-75f1-46c1-9005-89cf05938600 req-29867641-0970-4746-bb6a-497d3a628480 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:02.558035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-da67d2d2-75f1-46c1-9005-89cf05938600 req-29867641-0970-4746-bb6a-497d3a628480 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:02.584084 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-da67d2d2-75f1-46c1-9005-89cf05938600 req-29867641-0970-4746-bb6a-497d3a628480 service nova] Creating event network-changed:eb395e8d-d85f-41c1-a4c9-bdfec0181765 for instance b93df7ae-f756-4aa7-a2c8-58ee36e756db on n-h2-846209-2 Jun 16 19:32:02.589493 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-da67d2d2-75f1-46c1-9005-89cf05938600 req-29867641-0970-4746-bb6a-497d3a628480 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046624 Jun 16 19:32:02.590673 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3313/6513] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:32:02.633365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:02.634016 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:02.640890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:02.641573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:02.642382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:02.642982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:02.796468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:02.805110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-947939c7-a4b6-4d56-b0a8-e88fb066b972 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1317 microversion: 2.1 time: 0.178102 Jun 16 19:32:02.805704 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3201/6514] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:02 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:03.824017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:03.824892 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:03.831584 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:03.832066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:03.832864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:03.833381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:03.970967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:03.979770 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-99208b01-fefc-476b-b77a-bb1e48e41d03 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1317 microversion: 2.1 time: 0.161613 Jun 16 19:32:03.980371 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3314/6515] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:03 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:04.537972 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:32:04.538558 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:32:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:32:04.996956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:04.997611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:05.000450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:05.006065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:05.006524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:05.007301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:05.007743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:05.143852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:05.151600 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26a4bfbc-b46e-4482-b08a-a627a92c7a6a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1317 microversion: 2.1 time: 0.158548 Jun 16 19:32:05.152176 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3202/6516] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:04 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:06.169090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:06.169762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:06.177163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:06.178030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:06.178468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:06.178925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:06.314189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:06.322197 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ca729dc1-fbbf-4526-a7ee-1cf4d7948455 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1317 microversion: 2.1 time: 0.157019 Jun 16 19:32:06.322770 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3315/6517] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:06 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:07.115548 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7db46874-78d7-48db-8616-a2ed27aefdeb req-94ddccd0-711a-46eb-bb37-86890859df7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93df7ae-f756-4aa7-a2c8-58ee36e756db", "name": "network-vif-plugged", "status": "completed", "tag": "eb395e8d-d85f-41c1-a4c9-bdfec0181765"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:07.124789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7db46874-78d7-48db-8616-a2ed27aefdeb req-94ddccd0-711a-46eb-bb37-86890859df7e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:07.125474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7db46874-78d7-48db-8616-a2ed27aefdeb req-94ddccd0-711a-46eb-bb37-86890859df7e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:07.137660 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7db46874-78d7-48db-8616-a2ed27aefdeb req-94ddccd0-711a-46eb-bb37-86890859df7e service nova] Creating event network-vif-plugged:eb395e8d-d85f-41c1-a4c9-bdfec0181765 for instance b93df7ae-f756-4aa7-a2c8-58ee36e756db on n-h2-846209-2 Jun 16 19:32:07.142700 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7db46874-78d7-48db-8616-a2ed27aefdeb req-94ddccd0-711a-46eb-bb37-86890859df7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031099 Jun 16 19:32:07.143303 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3203/6518] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:32:07.339917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:07.340578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:07.347938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:07.348406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:07.349381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:07.349878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:07.482020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:07.490111 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e82d232c-6e96-4217-868e-08a71f3b6736 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1317 microversion: 2.1 time: 0.153594 Jun 16 19:32:07.490791 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3316/6519] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:07 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:08.508563 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:08.509276 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:08.515625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:08.516087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:08.516862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:08.517304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:08.653083 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:08.660616 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dac77330-2d22-4c16-9f21-b16710cb5ea3 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1505 microversion: 2.1 time: 0.157258 Jun 16 19:32:08.661183 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3204/6520] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:08 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:08.716281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-279112129", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "7a6c6d85-5a9d-494c-9dba-1d945a63633a"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:08.723072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:08.771027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] validate_networks() for [('7a6c6d85-5a9d-494c-9dba-1d945a63633a', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:32:09.164470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:32:09.164470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:32:09.164470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:32:09.164470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:32:09.164470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:32:09.167748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:09.168219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:09.169044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:09.169494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:09.186959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Getting quotas for project 2e06a3a337bf4955b2c135f82ae93a90. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:32:09.192266 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Getting quotas for user e1a3df1193c045ac80d55d1f67400cfe and project 2e06a3a337bf4955b2c135f82ae93a90. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:32:09.205070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:32:09.207371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:32:09.253102 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2e954177-2658-4a04-90b4-e018494115ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540675 Jun 16 19:32:09.253762 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3317/6521] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:32:09.263782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b41eef0c-3a28-48e7-bce3-f949006a01ca tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:09.264412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b41eef0c-3a28-48e7-bce3-f949006a01ca tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:09.317455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b41eef0c-3a28-48e7-bce3-f949006a01ca tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:09.324877 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b41eef0c-3a28-48e7-bce3-f949006a01ca tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1216 microversion: 2.1 time: 0.064879 Jun 16 19:32:09.325474 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3205/6522] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:09 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:10.343806 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:10.344787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:10.355113 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:10.356263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:10.357253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:10.357729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:10.442160 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:10.450128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cca8fb0b-a1b3-4b09-a340-b41c6ec59800 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1286 microversion: 2.1 time: 0.111138 Jun 16 19:32:10.450714 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3318/6523] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:10 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:11.467470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:11.468203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:11.471155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:11.478608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:11.480071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:11.480795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:11.481345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:11.498329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=46 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:11.696231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:11.703735 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0b376568-1009-4ab9-8d1a-1f9ac6ff113a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1316 microversion: 2.1 time: 0.240180 Jun 16 19:32:11.704305 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3206/6524] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:11 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:11.806019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7a1fc86f-6bf9-4429-9718-52fdc749f288 req-d362ff2d-7822-4b84-a1cc-28656d11eae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e987cd-fd88-4133-b595-bf66d9fd3cd6", "tag": "5172eecb-7037-4166-a233-8fd8f14d2372"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:11.815415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7a1fc86f-6bf9-4429-9718-52fdc749f288 req-d362ff2d-7822-4b84-a1cc-28656d11eae8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:11.816158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7a1fc86f-6bf9-4429-9718-52fdc749f288 req-d362ff2d-7822-4b84-a1cc-28656d11eae8 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:11.840532 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7a1fc86f-6bf9-4429-9718-52fdc749f288 req-d362ff2d-7822-4b84-a1cc-28656d11eae8 service nova] Creating event network-changed:5172eecb-7037-4166-a233-8fd8f14d2372 for instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 on n-h1-846209-2 Jun 16 19:32:11.848730 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7a1fc86f-6bf9-4429-9718-52fdc749f288 req-d362ff2d-7822-4b84-a1cc-28656d11eae8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046806 Jun 16 19:32:11.850147 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3319/6525] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:32:12.720899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:12.721608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:12.729079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:12.729602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:12.730419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:12.730865 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:12.975768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:12.984136 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ae72ee83-ff06-4d4e-a4d8-ece7fe89f0e5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1316 microversion: 2.1 time: 0.267187 Jun 16 19:32:12.984720 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3207/6526] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:12 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:14.002263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:14.003309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:14.011061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:14.011562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:14.012360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:14.012808 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:14.146458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:14.153993 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9cd49f44-5d39-4337-9d16-d5157a032450 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1316 microversion: 2.1 time: 0.156901 Jun 16 19:32:14.154564 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3320/6527] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:13 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:32:15.171273 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:15.171894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:15.179777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:15.180301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:15.181084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:15.181527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:15.321792 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:15.329230 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5c99f578-65d4-43a2-8d3b-1ec2ffa63fc9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1316 microversion: 2.1 time: 0.161861 Jun 16 19:32:15.329784 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3208/6528] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:15 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:16.346858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:16.347494 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:16.356030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:16.357797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:16.357797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:16.357797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:16.492200 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:16.499883 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-09462280-75c8-4d47-bd72-f2618afafb0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1316 microversion: 2.1 time: 0.157211 Jun 16 19:32:16.500470 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3321/6529] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:16 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:16.916625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-44ca910a-cfd1-478e-86fb-078cb13105fc req-cc984dd4-61a8-42b8-af15-706d65935e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e987cd-fd88-4133-b595-bf66d9fd3cd6", "name": "network-vif-plugged", "status": "completed", "tag": "5172eecb-7037-4166-a233-8fd8f14d2372"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:16.926228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-44ca910a-cfd1-478e-86fb-078cb13105fc req-cc984dd4-61a8-42b8-af15-706d65935e9c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:16.926706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-44ca910a-cfd1-478e-86fb-078cb13105fc req-cc984dd4-61a8-42b8-af15-706d65935e9c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:16.941815 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-44ca910a-cfd1-478e-86fb-078cb13105fc req-cc984dd4-61a8-42b8-af15-706d65935e9c service nova] Creating event network-vif-plugged:5172eecb-7037-4166-a233-8fd8f14d2372 for instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 on n-h1-846209-2 Jun 16 19:32:16.947712 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-44ca910a-cfd1-478e-86fb-078cb13105fc req-cc984dd4-61a8-42b8-af15-706d65935e9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034790 Jun 16 19:32:16.948324 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3209/6530] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:32:17.517783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:17.518463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:17.525623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:17.526195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:17.527056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:17.527560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:17.662661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:17.670879 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f7e2395-684e-4c60-886e-c28e5cd29da9 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1316 microversion: 2.1 time: 0.157033 Jun 16 19:32:17.671473 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3322/6531] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:17 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:18.687956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:18.688574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:18.697202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:18.697653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:18.698454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:18.698898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:18.831893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:18.839562 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72531b02-d940-462b-a548-e2b11ddfcf55 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1505 microversion: 2.1 time: 0.155902 Jun 16 19:32:18.840139 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3210/6532] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:18 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:18.855908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:18.856459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:18.863431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:18.863909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:18.864699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:18.865159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:18.891026 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:32:18.967676 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-441584b4-db59-4e51-9280-8d9d64b6586a tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 204 len: 0 microversion: 2.1 time: 0.115279 Jun 16 19:32:18.968245 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3323/6533] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:32:18 2022] DELETE /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:32:18.977103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:18.977742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:18.984077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:18.984525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:18.985287 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:18.985723 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:19.118741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:19.126388 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dc217675-59c5-4fd4-bf44-f6d685e90fd0 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1511 microversion: 2.1 time: 0.153847 Jun 16 19:32:19.126961 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3211/6534] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:18 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:20.144051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:20.144796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:20.146796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:20.147479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:20.155974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:20.156449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:20.157245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:20.157703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:20.291030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:20.298766 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-79ee3be3-7cc8-463c-8dc3-dbcac6e89e69 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 200 len: 1511 microversion: 2.1 time: 0.159011 Jun 16 19:32:20.299339 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3324/6535] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:20 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:20.816742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-fd91c50d-2e8a-4ab0-98f1-19cca4eb92d3 req-d614193d-5ea4-4ac2-8e83-c8303b52a81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e987cd-fd88-4133-b595-bf66d9fd3cd6", "name": "network-vif-deleted", "tag": "5172eecb-7037-4166-a233-8fd8f14d2372"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:20.826540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:20.830152 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fd91c50d-2e8a-4ab0-98f1-19cca4eb92d3 req-d614193d-5ea4-4ac2-8e83-c8303b52a81a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:20.830938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-fd91c50d-2e8a-4ab0-98f1-19cca4eb92d3 req-d614193d-5ea4-4ac2-8e83-c8303b52a81a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:20.852823 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-fd91c50d-2e8a-4ab0-98f1-19cca4eb92d3 req-d614193d-5ea4-4ac2-8e83-c8303b52a81a service nova] Creating event network-vif-deleted:5172eecb-7037-4166-a233-8fd8f14d2372 for instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 on n-h1-846209-2 Jun 16 19:32:20.858893 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-fd91c50d-2e8a-4ab0-98f1-19cca4eb92d3 req-d614193d-5ea4-4ac2-8e83-c8303b52a81a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045646 Jun 16 19:32:20.860138 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3212/6536] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:32:21.317171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:21.317944 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:21.326226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.326705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.327522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.327984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.343520 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] HTTP exception thrown: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Request method failure captured: Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 HTTP/1.1 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4Uql3u3dSOmtFtO-sLRFK2RbMWPv-dOjz27OfdIQgfBCUnI57Jijy_-WL4WDWCq1XFertEAQmKOn7zm6anAz2DlxEN6W_LSBeINJ42p51MPaJyMt74zF0xsomOB3TThWxGjLXh1tuujLDEXB_gOvXeyske117IkA0De4dETZX4CzQw Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e06a3a337bf4955b2c135f82ae93a90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: e1a3df1193c045ac80d55d1f67400cfe Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '40e987cd-fd88-4133-b595-bf66d9fd3cd6'} Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:21.345253 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.349149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.349149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:21.349149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:21.349149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:32:21.349149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:32:21.349149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:21.349149 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.350474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Returning 404 to user: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:32:21.351898 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0f178e3d-8e78-414d-88ec-9169c94367f8 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 404 len: 111 microversion: 2.1 time: 0.039145 Jun 16 19:32:21.353129 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3325/6537] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:21 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:32:21.362761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:21.363503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:21.370640 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.371004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.371777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.372220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.517525 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:21.526576 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-770619d8-dc3c-405a-aebe-382e9abdee0b tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1505 microversion: 2.1 time: 0.167990 Jun 16 19:32:21.527155 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3213/6538] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:21 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:21.543729 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f9a102a5-1840-4937-8e69-357c6d67737f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:21.544724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f9a102a5-1840-4937-8e69-357c6d67737f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 92a115e9-118a-4f84-9b1c-fac18caa33a9] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:21.550255 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-f9a102a5-1840-4937-8e69-357c6d67737f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] HTTP exception thrown: Instance 92a115e9-118a-4f84-9b1c-fac18caa33a9 could not be found. Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f9a102a5-1840-4937-8e69-357c6d67737f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Request method failure captured: Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/92a115e9-118a-4f84-9b1c-fac18caa33a9/action HTTP/1.1 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 32 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4Uql3u3dSOmtFtO-sLRFK2RbMWPv-dOjz27OfdIQgfBCUnI57Jijy_-WL4WDWCq1XFertEAQmKOn7zm6anAz2DlxEN6W_LSBeINJ42p51MPaJyMt74zF0xsomOB3TThWxGjLXh1tuujLDEXB_gOvXeyske117IkA0De4dETZX4CzQw Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e06a3a337bf4955b2c135f82ae93a90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: e1a3df1193c045ac80d55d1f67400cfe Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: {"resize": {"flavorRef": "452"}} Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 92a115e9-118a-4f84-9b1c-fac18caa33a9 could not be found. Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '92a115e9-118a-4f84-9b1c-fac18caa33a9', 'body': {'resize': {'flavorRef': '452'}}} Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a115e9-118a-4f84-9b1c-fac18caa33a9 could not be found. Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:32:21.552084 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a115e9-118a-4f84-9b1c-fac18caa33a9 could not be found. Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a115e9-118a-4f84-9b1c-fac18caa33a9 could not be found. Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f9a102a5-1840-4937-8e69-357c6d67737f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Returning 404 to user: Instance 92a115e9-118a-4f84-9b1c-fac18caa33a9 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f9a102a5-1840-4937-8e69-357c6d67737f tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "POST /compute/v2.1/servers/92a115e9-118a-4f84-9b1c-fac18caa33a9/action" status: 404 len: 111 microversion: 2.1 time: 0.014750 Jun 16 19:32:21.556909 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3326/6539] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:32:21 2022] POST /compute/v2.1/servers/92a115e9-118a-4f84-9b1c-fac18caa33a9/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:32:21.562292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:21.562985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:21.569076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.569534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.570492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.570909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.702834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:21.711324 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c1237571-c69e-4723-8be7-8b8cc2b9bade tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1505 microversion: 2.1 time: 0.152156 Jun 16 19:32:21.711921 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3214/6540] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:21 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:21.729123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:21.729747 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:21.736702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.737171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.737970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.738427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.880281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:21.888754 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3d4e6a6-b6e1-4111-9092-e959cef320ce tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1505 microversion: 2.1 time: 0.163739 Jun 16 19:32:21.889340 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3327/6541] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:21 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:21.906838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "244105e9-4ca7-4405-b19a-704e0ef3e5be"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:21.907746 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:21.915232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.915682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.916446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.916881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.947148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:21.952030 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] HTTP exception thrown: Flavor 244105e9-4ca7-4405-b19a-704e0ef3e5be could not be found. Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Request method failure captured: Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: request: POST /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db/action HTTP/1.1 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 65 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4Uql3u3dSOmtFtO-sLRFK2RbMWPv-dOjz27OfdIQgfBCUnI57Jijy_-WL4WDWCq1XFertEAQmKOn7zm6anAz2DlxEN6W_LSBeINJ42p51MPaJyMt74zF0xsomOB3TThWxGjLXh1tuujLDEXB_gOvXeyske117IkA0De4dETZX4CzQw Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e06a3a337bf4955b2c135f82ae93a90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: e1a3df1193c045ac80d55d1f67400cfe Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: {"resize": {"flavorRef": "244105e9-4ca7-4405-b19a-704e0ef3e5be"}} Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: exception: Flavor 244105e9-4ca7-4405-b19a-704e0ef3e5be could not be found. Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'b93df7ae-f756-4aa7-a2c8-58ee36e756db', 'body': {'resize': {'flavorRef': '244105e9-4ca7-4405-b19a-704e0ef3e5be'}}} Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 19:32:21.953988 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 244105e9-4ca7-4405-b19a-704e0ef3e5be could not be found. Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 244105e9-4ca7-4405-b19a-704e0ef3e5be could not be found. Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 244105e9-4ca7-4405-b19a-704e0ef3e5be could not be found. Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Returning 400 to user: Flavor 244105e9-4ca7-4405-b19a-704e0ef3e5be could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-37036db4-84f3-4573-849c-c7a789fa6c57 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "POST /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db/action" status: 400 len: 107 microversion: 2.1 time: 0.052621 Jun 16 19:32:21.957575 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3215/6542] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:32:21 2022] POST /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:32:21.964932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:21.965568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:21.971704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.972181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:21.972970 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:21.973432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.109458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:22.118446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2ebcddf8-e058-4248-bf52-9bb0832486b5 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1505 microversion: 2.1 time: 0.158025 Jun 16 19:32:22.119032 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3328/6543] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:21 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:22.135790 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:22.136405 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:22.142356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.142804 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.143555 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.144007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.279364 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:22.287006 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2eb4fba7-7d3a-46e8-bd3a-ee84689e0250 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1505 microversion: 2.1 time: 0.155753 Jun 16 19:32:22.287578 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3216/6544] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:22 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:22.303746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54212f51-dc82-4ea9-91e7-57faee74ab83 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54212f51-dc82-4ea9-91e7-57faee74ab83 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Request method failure captured: Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: request: POST /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db/action HTTP/1.1 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 29 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4Uql3u3dSOmtFtO-sLRFK2RbMWPv-dOjz27OfdIQgfBCUnI57Jijy_-WL4WDWCq1XFertEAQmKOn7zm6anAz2DlxEN6W_LSBeINJ42p51MPaJyMt74zF0xsomOB3TThWxGjLXh1tuujLDEXB_gOvXeyske117IkA0De4dETZX4CzQw Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e06a3a337bf4955b2c135f82ae93a90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: e1a3df1193c045ac80d55d1f67400cfe Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: {"resize": {"flavorRef": ""}} Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b93df7ae-f756-4aa7-a2c8-58ee36e756db', 'body': {'resize': {'flavorRef': ''}}} Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi On instance['resize']: Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi '' Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.306753 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54212f51-dc82-4ea9-91e7-57faee74ab83 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54212f51-dc82-4ea9-91e7-57faee74ab83 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "POST /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db/action" status: 400 len: 113 microversion: 2.1 time: 0.008804 Jun 16 19:32:22.311240 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3329/6545] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:32:22 2022] POST /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:32:22.316953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:22.317572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:22.324926 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.325374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.326210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.326651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.460444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:22.468058 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-05fcc373-1d77-4798-aafc-47abd43c95fa tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1505 microversion: 2.1 time: 0.154881 Jun 16 19:32:22.468631 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3217/6546] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:22 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:22.489150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:22.489694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:22.497145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.497611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.498416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.498864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.511995 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] HTTP exception thrown: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Request method failure captured: Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: request: DELETE /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 HTTP/1.1 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4Uql3u3dSOmtFtO-sLRFK2RbMWPv-dOjz27OfdIQgfBCUnI57Jijy_-WL4WDWCq1XFertEAQmKOn7zm6anAz2DlxEN6W_LSBeINJ42p51MPaJyMt74zF0xsomOB3TThWxGjLXh1tuujLDEXB_gOvXeyske117IkA0De4dETZX4CzQw Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e06a3a337bf4955b2c135f82ae93a90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: e1a3df1193c045ac80d55d1f67400cfe Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '40e987cd-fd88-4133-b595-bf66d9fd3cd6'} Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:32:22.513549 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Returning 404 to user: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1b564d9-b0f9-4330-bc91-3070dec58f74 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 404 len: 111 microversion: 2.1 time: 0.030710 Jun 16 19:32:22.518060 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3330/6547] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:32:22 2022] DELETE /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:32:22.523981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:22.524612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: 40e987cd-fd88-4133-b595-bf66d9fd3cd6] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:22.530735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.531189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.531956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.532398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.546634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] HTTP exception thrown: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Request method failure captured: Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 HTTP/1.1 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4Uql3u3dSOmtFtO-sLRFK2RbMWPv-dOjz27OfdIQgfBCUnI57Jijy_-WL4WDWCq1XFertEAQmKOn7zm6anAz2DlxEN6W_LSBeINJ42p51MPaJyMt74zF0xsomOB3TThWxGjLXh1tuujLDEXB_gOvXeyske117IkA0De4dETZX4CzQw Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e06a3a337bf4955b2c135f82ae93a90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: e1a3df1193c045ac80d55d1f67400cfe Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '40e987cd-fd88-4133-b595-bf66d9fd3cd6'} Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:22.548157 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Returning 404 to user: Instance 40e987cd-fd88-4133-b595-bf66d9fd3cd6 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7114995b-dd5a-45d1-b7f7-06710225a348 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6" status: 404 len: 111 microversion: 2.1 time: 0.029743 Jun 16 19:32:22.552904 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3218/6548] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:22 2022] GET /compute/v2.1/servers/40e987cd-fd88-4133-b595-bf66d9fd3cd6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:32:22.559120 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:22.559768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:22.565868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.566364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.567134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.567580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.592205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:32:22.606184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:22.668087 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0a61de3e-37c3-4381-b99f-462f0d316857 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 204 len: 0 microversion: 2.1 time: 0.113316 Jun 16 19:32:22.668691 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3331/6549] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:32:22 2022] DELETE /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:32:22.677849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:22.678508 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:22.685890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.686376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.687147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:22.687589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:22.826046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:22.833953 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-64fbab2f-d8d2-41e2-b30a-8322dde89c3e tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1511 microversion: 2.1 time: 0.160548 Jun 16 19:32:22.834665 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3219/6550] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:22 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:23.854553 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:23.855634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:23.863644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:23.864284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:23.865143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:23.866059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:23.999529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a3df1193c045ac80d55d1f67400cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e06a3a337bf4955b2c135f82ae93a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:24.009154 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5426825d-f034-478f-9464-66f80f8ce512 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 200 len: 1511 microversion: 2.1 time: 0.160097 Jun 16 19:32:24.009984 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3332/6551] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:23 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:24.461293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6bc5bd0d-50d8-499b-bfe4-8debb2953176 req-c04bc145-d500-4cd1-9341-fcdc3aa32eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93df7ae-f756-4aa7-a2c8-58ee36e756db", "name": "network-vif-deleted", "tag": "eb395e8d-d85f-41c1-a4c9-bdfec0181765"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:24.473996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6bc5bd0d-50d8-499b-bfe4-8debb2953176 req-c04bc145-d500-4cd1-9341-fcdc3aa32eb3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:24.474435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6bc5bd0d-50d8-499b-bfe4-8debb2953176 req-c04bc145-d500-4cd1-9341-fcdc3aa32eb3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:24.492210 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6bc5bd0d-50d8-499b-bfe4-8debb2953176 req-c04bc145-d500-4cd1-9341-fcdc3aa32eb3 service nova] Creating event network-vif-deleted:eb395e8d-d85f-41c1-a4c9-bdfec0181765 for instance b93df7ae-f756-4aa7-a2c8-58ee36e756db on n-h2-846209-2 Jun 16 19:32:24.499054 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6bc5bd0d-50d8-499b-bfe4-8debb2953176 req-c04bc145-d500-4cd1-9341-fcdc3aa32eb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041949 Jun 16 19:32:24.499673 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3220/6552] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:32:25.027918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:25.028561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] [instance: b93df7ae-f756-4aa7-a2c8-58ee36e756db] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:25.035702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:25.036194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:25.037015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:25.037472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:25.051880 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] HTTP exception thrown: Instance b93df7ae-f756-4aa7-a2c8-58ee36e756db could not be found. Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Request method failure captured: Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db HTTP/1.1 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4Uql3u3dSOmtFtO-sLRFK2RbMWPv-dOjz27OfdIQgfBCUnI57Jijy_-WL4WDWCq1XFertEAQmKOn7zm6anAz2DlxEN6W_LSBeINJ42p51MPaJyMt74zF0xsomOB3TThWxGjLXh1tuujLDEXB_gOvXeyske117IkA0De4dETZX4CzQw Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e06a3a337bf4955b2c135f82ae93a90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e06a3a337bf4955b2c135f82ae93a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2e06a3a337bf4955b2c135f82ae93a90 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1140819614 Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: e1a3df1193c045ac80d55d1f67400cfe Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-ServersNegativeTestJSON-1140819614-project Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance b93df7ae-f756-4aa7-a2c8-58ee36e756db could not be found. Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'b93df7ae-f756-4aa7-a2c8-58ee36e756db'} Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93df7ae-f756-4aa7-a2c8-58ee36e756db could not be found. Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93df7ae-f756-4aa7-a2c8-58ee36e756db could not be found. Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:32:25.053475 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93df7ae-f756-4aa7-a2c8-58ee36e756db could not be found. Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] Returning 404 to user: Instance b93df7ae-f756-4aa7-a2c8-58ee36e756db could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e8ec1b2b-87e9-472c-8586-2bd52b68dae1 tempest-ServersNegativeTestJSON-1140819614 tempest-ServersNegativeTestJSON-1140819614-project] 10.222.0.27 "GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db" status: 404 len: 111 microversion: 2.1 time: 0.032130 Jun 16 19:32:25.058390 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3333/6553] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:25 2022] GET /compute/v2.1/servers/b93df7ae-f756-4aa7-a2c8-58ee36e756db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:32:56.014275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=31 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:56.016771 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=71 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:56.341979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2552ab7f-2fe4-4706-993f-e34b92912329 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Action: 'create', calling method: .version_select at 0x7f866d67f040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-67885630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjQiuMHdJLlSW+t7A3gnnQbErb25WmSUHt2ZavnXTQP4iTm6r1CmT85KIgYAiQAYE3VXtrqAmBrC04BRL1fWD7ThMtGX794apfAN6RqnpPTKTDrxr+vPeC+9CWiijvjMQ=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:56.360350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-2552ab7f-2fe4-4706-993f-e34b92912329 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:32:56.365848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-2552ab7f-2fe4-4706-993f-e34b92912329 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for user 9390213bb17b42a897c4649bcd227ec1 and project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:32:56.404082 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2552ab7f-2fe4-4706-993f-e34b92912329 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.402911 Jun 16 19:32:56.404789 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3221/6554] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:32:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:32:56.462600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2123121083", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-67885630", "networks": [{"uuid": "cbb82ac4-4435-403c-b82a-ad83d4d88f00"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:56.471958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:56.472805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:32:56.540749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] validate_networks() for [('cbb82ac4-4435-403c-b82a-ad83d4d88f00', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:32:57.011238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:32:57.011793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:32:57.012472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:32:57.013116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:32:57.013920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:32:57.025571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:57.026295 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:57.027427 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:57.027981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:57.049345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:32:57.058904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for user 9390213bb17b42a897c4649bcd227ec1 and project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:32:57.077044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:32:57.079544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:32:57.129689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ec1c1ff2-f73f-4946-b620-41f77ae5aeac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671882 Jun 16 19:32:57.130467 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3334/6555] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:32:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:32:57.141155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cd376758-e161-4948-b0ac-bb611b7bcc63 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:57.141836 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cd376758-e161-4948-b0ac-bb611b7bcc63 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:57.201775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cd376758-e161-4948-b0ac-bb611b7bcc63 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:57.210702 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cd376758-e161-4948-b0ac-bb611b7bcc63 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1261 microversion: 2.1 time: 0.073480 Jun 16 19:32:57.211419 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3222/6556] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:57 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1261 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:58.230943 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:58.232224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:58.252031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:58.252773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:58.254254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:58.254254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:58.390191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:58.402151 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eefa2f34-8a4f-479b-b06a-4d03fe386c00 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1331 microversion: 2.1 time: 0.176057 Jun 16 19:32:58.413883 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3335/6557] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:58 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:59.422617 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:32:59.423874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:32:59.433257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:59.433859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:59.435050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:59.435497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:59.663777 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:32:59.673093 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d53adfa-7316-4aae-a645-4a78eb32b19c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.256146 Jun 16 19:32:59.674124 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3223/6558] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:32:59 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:32:59.920452 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-817208bb-fd37-4676-b4de-7d05b6aa7a47 req-c439374a-b46f-469e-a1bd-9423429bb433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde1e2e9-8be5-4fa8-a820-52c8d62b2a35", "tag": "d1efda37-93cd-419d-82bb-f67cc9ba8ac7"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:32:59.931487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-817208bb-fd37-4676-b4de-7d05b6aa7a47 req-c439374a-b46f-469e-a1bd-9423429bb433 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:32:59.932823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-817208bb-fd37-4676-b4de-7d05b6aa7a47 req-c439374a-b46f-469e-a1bd-9423429bb433 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:32:59.964745 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-817208bb-fd37-4676-b4de-7d05b6aa7a47 req-c439374a-b46f-469e-a1bd-9423429bb433 service nova] Creating event network-changed:d1efda37-93cd-419d-82bb-f67cc9ba8ac7 for instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 on n-h1-846209-2 Jun 16 19:32:59.981502 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-817208bb-fd37-4676-b4de-7d05b6aa7a47 req-c439374a-b46f-469e-a1bd-9423429bb433 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065498 Jun 16 19:32:59.982749 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3336/6559] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:33:00.693993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:00.695222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:00.703701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:00.704158 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:00.704936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:00.705374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:00.840808 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:00.848634 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c689268e-8b39-488b-86e3-45d1e5d0ff5c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.160750 Jun 16 19:33:00.849216 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3224/6560] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:00 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:01.866416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:01.867138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:01.874413 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:01.874880 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:01.875659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:01.876110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:02.050083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:02.058273 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aeb4ec2f-35c7-40d6-9098-e49b4c7cb4a6 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.195924 Jun 16 19:33:02.058857 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3337/6561] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:01 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:03.075922 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:03.076538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:03.083119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:03.083576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:03.084338 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:03.084782 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:03.571210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:03.578794 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-df410da0-1220-44aa-a45b-529a9de296d5 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.507574 Jun 16 19:33:03.579369 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3225/6562] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:03 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:04.594995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:04.595693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:04.602985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:04.603453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:04.605325 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:04.605530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:04.737790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:04.745925 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-27e6a072-c291-47d3-a0e6-1271d1828007 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.154844 Jun 16 19:33:04.746489 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3338/6563] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:04 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:05.762718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:05.763342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:05.770449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:05.770909 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:05.771700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:05.772134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:05.910227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:05.917856 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-64aa03d2-02cc-42c1-9876-e1c9faaa198f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.158861 Jun 16 19:33:05.918833 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3226/6564] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:05 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:06.936441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:06.937101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:06.944340 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:06.944810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:06.945620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:06.946224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:07.038338 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:07.069954 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:07.088698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:07.091981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b5127137-f105-4075-8df0-2ddba352f2ef req-1dc03723-d958-4381-8e33-72dc335663b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde1e2e9-8be5-4fa8-a820-52c8d62b2a35", "name": "network-vif-plugged", "status": "completed", "tag": "d1efda37-93cd-419d-82bb-f67cc9ba8ac7"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:07.097521 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e20d505f-055e-46b1-b9f6-29c93b9c1d8a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.165751 Jun 16 19:33:07.098132 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3339/6565] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:06 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:07.103439 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b5127137-f105-4075-8df0-2ddba352f2ef req-1dc03723-d958-4381-8e33-72dc335663b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:07.103928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b5127137-f105-4075-8df0-2ddba352f2ef req-1dc03723-d958-4381-8e33-72dc335663b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:07.115923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b5127137-f105-4075-8df0-2ddba352f2ef req-1dc03723-d958-4381-8e33-72dc335663b2 service nova] Creating event network-vif-plugged:d1efda37-93cd-419d-82bb-f67cc9ba8ac7 for instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 on n-h1-846209-2 Jun 16 19:33:07.120869 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b5127137-f105-4075-8df0-2ddba352f2ef req-1dc03723-d958-4381-8e33-72dc335663b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033846 Jun 16 19:33:07.121712 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3227/6566] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:08.115740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:08.116374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:08.123349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:08.123821 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:08.124605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:08.125062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:08.256454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:08.264539 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb1f6e64-f7e2-4639-99f7-282566e48b72 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1361 microversion: 2.1 time: 0.152744 Jun 16 19:33:08.265124 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3340/6567] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:08 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:09.278728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:09.283991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:09.284692 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:09.291251 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:09.291702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:09.292460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:09.292891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:09.422757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:09.430813 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92420ed1-d436-40b9-9509-83b6f0e57479 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1550 microversion: 2.1 time: 0.153084 Jun 16 19:33:09.431384 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3228/6568] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:09 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:09.447303 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:09.447936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:09.455512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:09.455974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:09.456748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:09.457199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:09.590588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:09.598243 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-62795730-11be-4e75-874f-2aab8191e803 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1550 microversion: 2.1 time: 0.154771 Jun 16 19:33:09.598829 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3341/6569] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:09 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:11.188091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-fd10f938-da41-4d63-ac88-be727ef8a71d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6095f2a1-80e5-4d9f-8572-57bb1f799e1e"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:11.189171 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-fd10f938-da41-4d63-ac88-be727ef8a71d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:11.196147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd10f938-da41-4d63-ac88-be727ef8a71d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:11.196604 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd10f938-da41-4d63-ac88-be727ef8a71d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:11.197374 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd10f938-da41-4d63-ac88-be727ef8a71d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:11.197817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-fd10f938-da41-4d63-ac88-be727ef8a71d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:11.443906 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-fd10f938-da41-4d63-ac88-be727ef8a71d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "POST /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260426 Jun 16 19:33:11.444769 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3229/6570] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 19:33:11 2022] POST /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:22.094490 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:22.095019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:22.097140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:22.098025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=40 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:22.104233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:22.104698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:22.105477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:22.105947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:22.188224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lazy-loading 'services' on Instance uuid cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:33:22.262951 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-145f81b2-4250-4c5c-8dfd-f00e41c91e1d tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments/6095f2a1-80e5-4d9f-8572-57bb1f799e1e" status: 202 len: 0 microversion: 2.1 time: 0.172606 Jun 16 19:33:22.263548 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3342/6571] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:33:22 2022] DELETE /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments/6095f2a1-80e5-4d9f-8572-57bb1f799e1e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:33:22.270592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:22.271461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:22.276289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a0211c5-79e5-48ea-bf5b-43d96cf46963 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:22.277382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a0211c5-79e5-48ea-bf5b-43d96cf46963 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:22.286212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a0211c5-79e5-48ea-bf5b-43d96cf46963 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:22.286718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a0211c5-79e5-48ea-bf5b-43d96cf46963 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:22.287505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a0211c5-79e5-48ea-bf5b-43d96cf46963 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:22.287952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a0211c5-79e5-48ea-bf5b-43d96cf46963 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:22.322699 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a0211c5-79e5-48ea-bf5b-43d96cf46963 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054061 Jun 16 19:33:22.323280 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3230/6572] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:22 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:23.336386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e070441d-16b1-4e7e-b3c3-0711d8e380dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:23.337410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e070441d-16b1-4e7e-b3c3-0711d8e380dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:23.344609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e070441d-16b1-4e7e-b3c3-0711d8e380dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:23.345075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e070441d-16b1-4e7e-b3c3-0711d8e380dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:23.345868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e070441d-16b1-4e7e-b3c3-0711d8e380dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:23.346346 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e070441d-16b1-4e7e-b3c3-0711d8e380dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:23.377407 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e070441d-16b1-4e7e-b3c3-0711d8e380dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046171 Jun 16 19:33:23.378041 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3343/6573] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:23 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:24.389053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bab0cc29-20bf-43e8-9f8d-aa1797f216ac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:24.390161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bab0cc29-20bf-43e8-9f8d-aa1797f216ac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:24.398140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab0cc29-20bf-43e8-9f8d-aa1797f216ac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:24.398599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab0cc29-20bf-43e8-9f8d-aa1797f216ac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:24.399401 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab0cc29-20bf-43e8-9f8d-aa1797f216ac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:24.399891 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bab0cc29-20bf-43e8-9f8d-aa1797f216ac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:24.432195 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bab0cc29-20bf-43e8-9f8d-aa1797f216ac tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047198 Jun 16 19:33:24.432788 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3231/6574] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:24 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:25.444057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d3827018-bfde-4891-a08e-bcb9a81f17f0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:25.445093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d3827018-bfde-4891-a08e-bcb9a81f17f0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:25.452435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3827018-bfde-4891-a08e-bcb9a81f17f0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:25.453447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3827018-bfde-4891-a08e-bcb9a81f17f0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:25.454334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3827018-bfde-4891-a08e-bcb9a81f17f0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:25.454876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d3827018-bfde-4891-a08e-bcb9a81f17f0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:25.485635 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d3827018-bfde-4891-a08e-bcb9a81f17f0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Jun 16 19:33:25.486356 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3344/6575] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:25 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:26.499113 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7a083221-3669-41cb-836e-33b961037b66 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:26.503182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7a083221-3669-41cb-836e-33b961037b66 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:26.528406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a083221-3669-41cb-836e-33b961037b66 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:26.528863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a083221-3669-41cb-836e-33b961037b66 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:26.529658 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a083221-3669-41cb-836e-33b961037b66 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:26.530127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a083221-3669-41cb-836e-33b961037b66 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:26.561793 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7a083221-3669-41cb-836e-33b961037b66 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066639 Jun 16 19:33:26.563220 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3232/6576] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:26 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:27.573530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-639db956-098c-476d-83aa-30597a0bae62 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:27.574504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-639db956-098c-476d-83aa-30597a0bae62 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:27.582576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-639db956-098c-476d-83aa-30597a0bae62 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:27.583068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-639db956-098c-476d-83aa-30597a0bae62 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:27.583838 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-639db956-098c-476d-83aa-30597a0bae62 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:27.584297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-639db956-098c-476d-83aa-30597a0bae62 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:27.614027 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-639db956-098c-476d-83aa-30597a0bae62 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044479 Jun 16 19:33:27.614614 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3345/6577] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:27 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:33:27.624456 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:27.625065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:27.632190 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:27.632641 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:27.633397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:27.633832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:27.713238 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] HTTP exception thrown: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 is not attached to volume 6095f2a1-80e5-4d9f-8572-57bb1f799e1e Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Request method failure captured: Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments/6095f2a1-80e5-4d9f-8572-57bb1f799e1e HTTP/1.1 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4ViMg4KE9AIDrLX1E82jDLhmCxvZzCuVu3cNvMRm8eDafkNR2tNFQ29ZIEyeAOEabTMLkhiGtmbkd5hzCEzvqKbmo6Uh1u4bowwCFv_gD5sYq-7NOCkhbdfL0HNzPtTYazU3EmDR6FS9uoyQqZypd9YJpn0lKXhYUvd8khLJiDRWD0 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2555cec2b1a14c89838a5fa3f75e92c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9390213bb17b42a897c4649bcd227ec1 Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 is not attached to volume 6095f2a1-80e5-4d9f-8572-57bb1f799e1e Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': 'cde1e2e9-8be5-4fa8-a820-52c8d62b2a35', 'id': '6095f2a1-80e5-4d9f-8572-57bb1f799e1e'} Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6095f2a1-80e5-4d9f-8572-57bb1f799e1e. Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 is not attached to volume 6095f2a1-80e5-4d9f-8572-57bb1f799e1e Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:33:27.720885 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:33:27.728198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:33:27.728198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:33:27.728198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 is not attached to volume 6095f2a1-80e5-4d9f-8572-57bb1f799e1e Jun 16 19:33:27.728198 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:27.728198 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Returning 404 to user: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 is not attached to volume 6095f2a1-80e5-4d9f-8572-57bb1f799e1e {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:33:27.728198 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2160df93-56b7-4aaa-8b21-0dce10b92a3a tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments/6095f2a1-80e5-4d9f-8572-57bb1f799e1e" status: 404 len: 154 microversion: 2.1 time: 0.102021 Jun 16 19:33:27.728198 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3233/6578] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:33:27 2022] DELETE /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35/os-volume_attachments/6095f2a1-80e5-4d9f-8572-57bb1f799e1e => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:33:31.049235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:31.049759 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:31.056952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:31.057416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:31.058221 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:31.058670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:31.085663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:33:31.168615 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b6c26d8b-c2b9-4aef-a658-2da981b6de8b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 204 len: 0 microversion: 2.1 time: 0.122895 Jun 16 19:33:31.169562 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3346/6579] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:33:31 2022] DELETE /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:33:31.178969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:31.179671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:31.186902 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:31.187357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:31.188873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:31.189414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:31.328811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:31.337586 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-880ba96d-3cc5-46e2-8969-41a6056f7eb2 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1556 microversion: 2.1 time: 0.163186 Jun 16 19:33:31.338183 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3234/6580] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:31 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:32.356484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:32.357213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:32.365109 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:32.365590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:32.366487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:32.366955 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:32.502598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:32.510257 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7167f016-cc21-40ad-8193-c00110b8ba49 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1556 microversion: 2.1 time: 0.158113 Jun 16 19:33:32.510841 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3347/6581] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:32 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:33.335844 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-b44bf1ee-23af-4987-bec0-a8210c18babd req-8510b617-ac34-466e-831f-042e2874a32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde1e2e9-8be5-4fa8-a820-52c8d62b2a35", "name": "network-vif-deleted", "tag": "d1efda37-93cd-419d-82bb-f67cc9ba8ac7"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:33.345957 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b44bf1ee-23af-4987-bec0-a8210c18babd req-8510b617-ac34-466e-831f-042e2874a32c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:33.346742 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-b44bf1ee-23af-4987-bec0-a8210c18babd req-8510b617-ac34-466e-831f-042e2874a32c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:33.362052 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-b44bf1ee-23af-4987-bec0-a8210c18babd req-8510b617-ac34-466e-831f-042e2874a32c service nova] Creating event network-vif-deleted:d1efda37-93cd-419d-82bb-f67cc9ba8ac7 for instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 on n-h1-846209-2 Jun 16 19:33:33.368728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-b44bf1ee-23af-4987-bec0-a8210c18babd req-8510b617-ac34-466e-831f-042e2874a32c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036485 Jun 16 19:33:33.369880 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3235/6582] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:33.528193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:33.528757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:33.537106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:33.537519 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:33.538350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:33.538801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:33.570767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:33.571235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:33.571718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lazy-loading 'fault' on Instance uuid cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:33:33.618086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:33.625891 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4abc5260-27a6-4128-9082-911400d53b55 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 200 len: 1351 microversion: 2.1 time: 0.101747 Jun 16 19:33:33.626531 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3348/6583] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:33 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:34.645162 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:34.645831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: cde1e2e9-8be5-4fa8-a820-52c8d62b2a35] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:34.652245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:34.652702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:34.653480 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:34.653955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:34.668329 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] HTTP exception thrown: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 could not be found. Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Request method failure captured: Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 HTTP/1.1 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4ViMg4KE9AIDrLX1E82jDLhmCxvZzCuVu3cNvMRm8eDafkNR2tNFQ29ZIEyeAOEabTMLkhiGtmbkd5hzCEzvqKbmo6Uh1u4bowwCFv_gD5sYq-7NOCkhbdfL0HNzPtTYazU3EmDR6FS9uoyQqZypd9YJpn0lKXhYUvd8khLJiDRWD0 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2555cec2b1a14c89838a5fa3f75e92c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9390213bb17b42a897c4649bcd227ec1 Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 could not be found. Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'cde1e2e9-8be5-4fa8-a820-52c8d62b2a35'} Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 could not be found. Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 could not be found. Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:33:34.670274 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 could not be found. Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Returning 404 to user: Instance cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6f34e667-4a47-4c5c-b26a-af7c2a93a1c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35" status: 404 len: 111 microversion: 2.1 time: 0.032408 Jun 16 19:33:34.674248 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3236/6584] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:34 2022] GET /compute/v2.1/servers/cde1e2e9-8be5-4fa8-a820-52c8d62b2a35 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:33:34.681532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-030b39b8-5104-42fb-a2c1-9d433bb898c7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '.version_select at 0x7f866de5e670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:34.701322 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-030b39b8-5104-42fb-a2c1-9d433bb898c7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-67885630" status: 202 len: 0 microversion: 2.1 time: 0.023619 Jun 16 19:33:34.701914 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3349/6585] 10.222.0.27 () {58 vars in 1271 bytes} [Thu Jun 16 19:33:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-67885630 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:33:34.721783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-42167544-d014-437f-98d0-ceb2f312bba3 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Action: 'create', calling method: .version_select at 0x7f866d65ba60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1290166094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGrLmYQ+KZVscE5dkkzqtTI/eEHPJC018yLCatl136SXsxt9AcyI4ySd4hg2aNgHrrPghzBL6vvVk8/N43x7qVeYywoiYA3NiOQAE0vuuJ3h3vwzPWDdbeTrSfiGkgELA=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:34.735898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-42167544-d014-437f-98d0-ceb2f312bba3 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:33:34.741150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-42167544-d014-437f-98d0-ceb2f312bba3 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for user 9390213bb17b42a897c4649bcd227ec1 and project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:33:34.765430 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-42167544-d014-437f-98d0-ceb2f312bba3 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048556 Jun 16 19:33:34.766067 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3237/6586] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:33:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:34.815951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-120845702", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1290166094", "networks": [{"uuid": "cbb82ac4-4435-403c-b82a-ad83d4d88f00"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:34.868290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] validate_networks() for [('cbb82ac4-4435-403c-b82a-ad83d4d88f00', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:33:35.343038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:33:35.343507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:33:35.344030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:33:35.344461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:33:35.344891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:33:35.355764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:35.356232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:35.357056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:35.357522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:35.378762 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:33:35.384555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Getting quotas for user 9390213bb17b42a897c4649bcd227ec1 and project 2555cec2b1a14c89838a5fa3f75e92c3. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:33:35.397107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:33:35.399438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:33:35.450446 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-311fd7e9-c31e-4a6b-ac55-7d641d0db821 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638886 Jun 16 19:33:35.451114 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3350/6587] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:33:35.461481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bbdf0555-774c-4495-8a9d-5986bbee2a86 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:35.462140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bbdf0555-774c-4495-8a9d-5986bbee2a86 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:35.520434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bbdf0555-774c-4495-8a9d-5986bbee2a86 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:35.527948 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bbdf0555-774c-4495-8a9d-5986bbee2a86 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1262 microversion: 2.1 time: 0.070658 Jun 16 19:33:35.528512 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3238/6588] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:35 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:36.546927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:36.547548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:36.554678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:36.555253 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:36.556101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:36.556742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:36.640439 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:36.649087 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3caff301-7c76-4fdd-b286-e5206eed6f7f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1332 microversion: 2.1 time: 0.107064 Jun 16 19:33:36.650030 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3351/6589] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:36 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:37.666668 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:37.668164 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:37.676677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:37.677140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:37.677984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:37.678411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:37.888781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-69fc65fe-0076-4ef6-818f-63b69735bcd6 req-2eac2f44-871c-49a0-b5ef-abc9277331c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572c1c8c-6b00-43e3-a6df-433bfde22ac2", "tag": "d9676b45-df10-41f0-b7d7-cccf72286673"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:37.902680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-69fc65fe-0076-4ef6-818f-63b69735bcd6 req-2eac2f44-871c-49a0-b5ef-abc9277331c6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:37.903571 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-69fc65fe-0076-4ef6-818f-63b69735bcd6 req-2eac2f44-871c-49a0-b5ef-abc9277331c6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:37.912516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:37.920243 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-dbb547aa-bcde-44a2-9b90-2bbde9d6b040 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1362 microversion: 2.1 time: 0.257475 Jun 16 19:33:37.920841 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3239/6590] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:37 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:37.929797 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-69fc65fe-0076-4ef6-818f-63b69735bcd6 req-2eac2f44-871c-49a0-b5ef-abc9277331c6 service nova] Creating event network-changed:d9676b45-df10-41f0-b7d7-cccf72286673 for instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 on n-h1-846209-2 Jun 16 19:33:37.937614 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-69fc65fe-0076-4ef6-818f-63b69735bcd6 req-2eac2f44-871c-49a0-b5ef-abc9277331c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052648 Jun 16 19:33:37.938327 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3352/6591] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:38.938822 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:38.939435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:38.947429 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:38.947877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:38.948637 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:38.949066 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:39.077765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:39.085738 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eb691f10-1000-48fb-a2ea-28a1271a7e8c tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1362 microversion: 2.1 time: 0.150839 Jun 16 19:33:39.086348 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3240/6592] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:38 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:40.104408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:40.105252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:40.111903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:40.112406 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:40.113543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:40.114036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:40.246995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:40.255246 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da75cf3a-4d1c-4c5a-9abc-cc399eed5a26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1362 microversion: 2.1 time: 0.156107 Jun 16 19:33:40.255832 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3353/6593] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:40 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:41.272639 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:41.273255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:41.280621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:41.281073 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:41.281852 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:41.282305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:41.426744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:41.434333 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ffae51a-0169-4b7b-a756-a9911591f353 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1362 microversion: 2.1 time: 0.165970 Jun 16 19:33:41.434904 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3241/6594] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:41 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:42.452188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:42.452822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:42.460586 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:42.461055 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:42.461840 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:42.462321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:42.591241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:42.599762 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fabb48ef-c693-419d-9e1f-0e40b3161e0b tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1362 microversion: 2.1 time: 0.151581 Jun 16 19:33:42.600358 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3354/6595] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:42 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:43.272903 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-8856ed3a-a461-4450-ac0a-4bec4ef0ca45 req-f4517785-d353-457b-809c-045dcbde76f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572c1c8c-6b00-43e3-a6df-433bfde22ac2", "name": "network-vif-plugged", "status": "completed", "tag": "d9676b45-df10-41f0-b7d7-cccf72286673"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:43.283110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8856ed3a-a461-4450-ac0a-4bec4ef0ca45 req-f4517785-d353-457b-809c-045dcbde76f1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:43.284330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-8856ed3a-a461-4450-ac0a-4bec4ef0ca45 req-f4517785-d353-457b-809c-045dcbde76f1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:43.298918 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-8856ed3a-a461-4450-ac0a-4bec4ef0ca45 req-f4517785-d353-457b-809c-045dcbde76f1 service nova] Creating event network-vif-plugged:d9676b45-df10-41f0-b7d7-cccf72286673 for instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 on n-h1-846209-2 Jun 16 19:33:43.305431 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-8856ed3a-a461-4450-ac0a-4bec4ef0ca45 req-f4517785-d353-457b-809c-045dcbde76f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036235 Jun 16 19:33:43.306117 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3242/6596] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:43.617782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:43.618462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:43.625399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:43.625809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:43.626615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:43.627064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:43.760339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:43.768014 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-989bcbe9-60b8-4e46-b2ee-55e47ac8bcf7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1362 microversion: 2.1 time: 0.154225 Jun 16 19:33:43.768668 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3355/6597] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:43 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:44.785867 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:44.786595 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:44.793763 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:44.794246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:44.795002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:44.795434 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:44.933265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:44.941120 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4571c287-c499-466c-8c92-0d453a629648 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1552 microversion: 2.1 time: 0.160044 Jun 16 19:33:44.941679 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3243/6598] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:44 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:44.957773 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:44.958418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:44.965371 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:44.965846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:44.966676 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:44.967157 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:45.100208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:33:45.107925 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-933508fd-a7bc-40e0-9cd5-bbb6978d86c8 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1552 microversion: 2.1 time: 0.154665 Jun 16 19:33:45.108506 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3356/6599] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:33:44 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:33:46.579055 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-df1d1dc2-5686-4320-869e-48af3120df2f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae5b7514-2727-49ed-aaa8-d90e978ad149"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:33:46.580039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-df1d1dc2-5686-4320-869e-48af3120df2f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:46.582193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:46.588597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df1d1dc2-5686-4320-869e-48af3120df2f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:46.589046 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df1d1dc2-5686-4320-869e-48af3120df2f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:46.589806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df1d1dc2-5686-4320-869e-48af3120df2f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:46.590267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-df1d1dc2-5686-4320-869e-48af3120df2f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:46.835093 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-df1d1dc2-5686-4320-869e-48af3120df2f tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "POST /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259844 Jun 16 19:33:46.835639 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3244/6600] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 19:33:46 2022] POST /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:57.488493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:57.489708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:57.491652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:57.492419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:57.493650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:57.494327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:57.501421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:57.501890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:57.502700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:57.503153 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:57.590030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lazy-loading 'services' on Instance uuid 572c1c8c-6b00-43e3-a6df-433bfde22ac2 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:33:57.662013 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d0aabf16-9b68-4de2-a5fd-17f287df08c0 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments/ae5b7514-2727-49ed-aaa8-d90e978ad149" status: 202 len: 0 microversion: 2.1 time: 0.176219 Jun 16 19:33:57.662628 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3357/6601] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:33:57 2022] DELETE /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments/ae5b7514-2727-49ed-aaa8-d90e978ad149 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:33:57.669127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:57.670145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:33:57.675004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-15a7fd26-272c-455e-9d57-5e538b0c3d79 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:57.676576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-15a7fd26-272c-455e-9d57-5e538b0c3d79 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:57.685090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a7fd26-272c-455e-9d57-5e538b0c3d79 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:57.685660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a7fd26-272c-455e-9d57-5e538b0c3d79 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:57.686461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a7fd26-272c-455e-9d57-5e538b0c3d79 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:57.686895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-15a7fd26-272c-455e-9d57-5e538b0c3d79 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:57.719980 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-15a7fd26-272c-455e-9d57-5e538b0c3d79 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052741 Jun 16 19:33:57.720639 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3245/6602] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:57 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:33:58.734433 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8f953725-06c2-4bdb-8b42-757742586dbc tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:58.735470 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8f953725-06c2-4bdb-8b42-757742586dbc tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:58.742623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f953725-06c2-4bdb-8b42-757742586dbc tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:58.743097 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f953725-06c2-4bdb-8b42-757742586dbc tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:58.743890 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f953725-06c2-4bdb-8b42-757742586dbc tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:58.744349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8f953725-06c2-4bdb-8b42-757742586dbc tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:58.775319 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8f953725-06c2-4bdb-8b42-757742586dbc tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046192 Jun 16 19:33:58.776092 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3358/6603] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:58 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:33:59.786622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f117a906-596b-4ab1-ab53-10cc7d0ee1dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:33:59.787573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f117a906-596b-4ab1-ab53-10cc7d0ee1dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:33:59.795107 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f117a906-596b-4ab1-ab53-10cc7d0ee1dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:59.795534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f117a906-596b-4ab1-ab53-10cc7d0ee1dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:59.796266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f117a906-596b-4ab1-ab53-10cc7d0ee1dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:33:59.796706 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f117a906-596b-4ab1-ab53-10cc7d0ee1dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:33:59.841790 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f117a906-596b-4ab1-ab53-10cc7d0ee1dd tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058992 Jun 16 19:33:59.842796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3246/6604] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:33:59 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:34:00.855336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cdb8dd1e-df1f-4010-8069-f6517e204c25 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:00.856207 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cdb8dd1e-df1f-4010-8069-f6517e204c25 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:00.863992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdb8dd1e-df1f-4010-8069-f6517e204c25 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:00.864460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdb8dd1e-df1f-4010-8069-f6517e204c25 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:00.865601 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdb8dd1e-df1f-4010-8069-f6517e204c25 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:00.866083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cdb8dd1e-df1f-4010-8069-f6517e204c25 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:00.898835 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cdb8dd1e-df1f-4010-8069-f6517e204c25 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047557 Jun 16 19:34:00.899429 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3359/6605] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:34:00 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:34:01.910662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06e13ab0-b72b-4ec2-801b-d0ec225c4c29 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:01.912214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-06e13ab0-b72b-4ec2-801b-d0ec225c4c29 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:01.919493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06e13ab0-b72b-4ec2-801b-d0ec225c4c29 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:01.919946 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06e13ab0-b72b-4ec2-801b-d0ec225c4c29 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:01.920724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06e13ab0-b72b-4ec2-801b-d0ec225c4c29 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:01.921163 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06e13ab0-b72b-4ec2-801b-d0ec225c4c29 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:01.951686 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-06e13ab0-b72b-4ec2-801b-d0ec225c4c29 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Jun 16 19:34:01.952256 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3247/6606] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:34:01 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:34:02.963695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e1067e9-2910-4c4a-80ac-2e9acfe01f8e tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:02.964556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e1067e9-2910-4c4a-80ac-2e9acfe01f8e tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:02.971554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e1067e9-2910-4c4a-80ac-2e9acfe01f8e tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:02.972021 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e1067e9-2910-4c4a-80ac-2e9acfe01f8e tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:02.972801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e1067e9-2910-4c4a-80ac-2e9acfe01f8e tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:02.973254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e1067e9-2910-4c4a-80ac-2e9acfe01f8e tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:03.002892 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e1067e9-2910-4c4a-80ac-2e9acfe01f8e tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043217 Jun 16 19:34:03.003450 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3360/6607] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:34:02 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 19:34:03.014225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:03.014776 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:03.022501 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:03.022807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:03.023576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:03.024019 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:03.120633 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] HTTP exception thrown: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 is not attached to volume ae5b7514-2727-49ed-aaa8-d90e978ad149 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Request method failure captured: Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments/ae5b7514-2727-49ed-aaa8-d90e978ad149 HTTP/1.1 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4ViMg4KE9AIDrLX1E82jDLhmCxvZzCuVu3cNvMRm8eDafkNR2tNFQ29ZIEyeAOEabTMLkhiGtmbkd5hzCEzvqKbmo6Uh1u4bowwCFv_gD5sYq-7NOCkhbdfL0HNzPtTYazU3EmDR6FS9uoyQqZypd9YJpn0lKXhYUvd8khLJiDRWD0 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2555cec2b1a14c89838a5fa3f75e92c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 9390213bb17b42a897c4649bcd227ec1 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 is not attached to volume ae5b7514-2727-49ed-aaa8-d90e978ad149 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': '572c1c8c-6b00-43e3-a6df-433bfde22ac2', 'id': 'ae5b7514-2727-49ed-aaa8-d90e978ad149'} Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ae5b7514-2727-49ed-aaa8-d90e978ad149. Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 is not attached to volume ae5b7514-2727-49ed-aaa8-d90e978ad149 Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:34:03.122342 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:34:03.127450 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:34:03.127450 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:34:03.127450 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 is not attached to volume ae5b7514-2727-49ed-aaa8-d90e978ad149 Jun 16 19:34:03.127450 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:34:03.127450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Returning 404 to user: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 is not attached to volume ae5b7514-2727-49ed-aaa8-d90e978ad149 {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:34:03.127450 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-404e2c5f-dfe3-4ca0-9397-4f42cc0c0771 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments/ae5b7514-2727-49ed-aaa8-d90e978ad149" status: 404 len: 154 microversion: 2.1 time: 0.113649 Jun 16 19:34:03.127450 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3248/6608] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:34:03 2022] DELETE /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2/os-volume_attachments/ae5b7514-2727-49ed-aaa8-d90e978ad149 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:34:06.467388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:06.467902 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:06.475050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:06.475507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:06.476288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:06.476736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:06.503122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:34:06.582021 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c3d3c53-f5a6-459d-afa1-ce8b1f93a493 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 204 len: 0 microversion: 2.1 time: 0.117978 Jun 16 19:34:06.582751 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3361/6609] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:34:06 2022] DELETE /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:34:06.591098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:06.591743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:06.599655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:06.599976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:06.600775 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:06.601217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:06.742101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:06.749901 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b16e9ea7-7759-42bf-9a22-a972709da4cf tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1558 microversion: 2.1 time: 0.162701 Jun 16 19:34:06.750496 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3249/6610] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:06 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:07.767923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:07.768648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:07.776546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:07.777013 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:07.777791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:07.778275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:07.916392 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:07.924023 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f4016ec0-002a-4fdd-bf82-b2839ae9b702 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1558 microversion: 2.1 time: 0.160409 Jun 16 19:34:07.924961 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3362/6611] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:07 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:08.942255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:08.943032 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:08.950228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:08.950688 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:08.951466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:08.951908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:09.153271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-526334dd-6217-480d-8276-ef39d43d2f3d req-731deaf0-5414-406c-a3d5-a385889c2185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572c1c8c-6b00-43e3-a6df-433bfde22ac2", "name": "network-vif-deleted", "tag": "d9676b45-df10-41f0-b7d7-cccf72286673"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:34:09.164849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-526334dd-6217-480d-8276-ef39d43d2f3d req-731deaf0-5414-406c-a3d5-a385889c2185 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:09.165461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-526334dd-6217-480d-8276-ef39d43d2f3d req-731deaf0-5414-406c-a3d5-a385889c2185 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:09.175916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390213bb17b42a897c4649bcd227ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2555cec2b1a14c89838a5fa3f75e92c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:09.178540 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-526334dd-6217-480d-8276-ef39d43d2f3d req-731deaf0-5414-406c-a3d5-a385889c2185 service nova] Creating event network-vif-deleted:d9676b45-df10-41f0-b7d7-cccf72286673 for instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 on n-h1-846209-2 Jun 16 19:34:09.183716 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-526334dd-6217-480d-8276-ef39d43d2f3d req-731deaf0-5414-406c-a3d5-a385889c2185 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034313 Jun 16 19:34:09.184329 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3363/6612] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:34:09.185847 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-736a13d6-e917-423f-a4f8-78022dec6193 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 200 len: 1558 microversion: 2.1 time: 0.247584 Jun 16 19:34:09.187615 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3250/6613] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:08 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 1558 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:10.205722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:10.206455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] [instance: 572c1c8c-6b00-43e3-a6df-433bfde22ac2] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:10.213359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:10.213820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:10.214616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:10.215062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:10.229181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] HTTP exception thrown: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 could not be found. Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Request method failure captured: Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 HTTP/1.1 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4ViMg4KE9AIDrLX1E82jDLhmCxvZzCuVu3cNvMRm8eDafkNR2tNFQ29ZIEyeAOEabTMLkhiGtmbkd5hzCEzvqKbmo6Uh1u4bowwCFv_gD5sYq-7NOCkhbdfL0HNzPtTYazU3EmDR6FS9uoyQqZypd9YJpn0lKXhYUvd8khLJiDRWD0 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2555cec2b1a14c89838a5fa3f75e92c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2555cec2b1a14c89838a5fa3f75e92c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 2555cec2b1a14c89838a5fa3f75e92c3 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1935798393 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 9390213bb17b42a897c4649bcd227ec1 Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestEncryptedCinderVolumes-1935798393-project Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 could not be found. Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '572c1c8c-6b00-43e3-a6df-433bfde22ac2'} Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 could not be found. Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 could not be found. Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:34:10.230857 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 could not be found. Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Returning 404 to user: Instance 572c1c8c-6b00-43e3-a6df-433bfde22ac2 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5483a614-a642-40aa-9c9e-e2e7021f1eb7 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2" status: 404 len: 111 microversion: 2.1 time: 0.031647 Jun 16 19:34:10.235222 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3364/6614] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:10 2022] GET /compute/v2.1/servers/572c1c8c-6b00-43e3-a6df-433bfde22ac2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:34:10.241116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3d00315d-2000-4014-860f-8e07ab2f0e26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] Calling method '.version_select at 0x7f866d9c1a60>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:10.260795 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3d00315d-2000-4014-860f-8e07ab2f0e26 tempest-TestEncryptedCinderVolumes-1935798393 tempest-TestEncryptedCinderVolumes-1935798393-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1290166094" status: 202 len: 0 microversion: 2.1 time: 0.023572 Jun 16 19:34:10.261361 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3251/6615] 10.222.0.27 () {58 vars in 1277 bytes} [Thu Jun 16 19:34:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1290166094 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:34:37.794472 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c62ca6c5-f335-41ca-aced-03caf1304d9d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Action: 'create', calling method: .version_select at 0x7f866f4fa160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-716045917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP99dePBt8dtZLA2KAD2pDZ+cGJ9u1QDtWZL0cyml451AD8ftKyNluB/ANB/QBZ46Xd0g53VtF/1ofD7SsHEYcDSQ/cNkUKV3QVu4J6z1o76Rgk3VoS34r5vsA17A5e7qQ=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:34:37.798814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:34:37.799477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:34:37.814210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c62ca6c5-f335-41ca-aced-03caf1304d9d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Getting quotas for project 83c75b8bbad84e08b224820bec326e24. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:34:37.819851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-c62ca6c5-f335-41ca-aced-03caf1304d9d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Getting quotas for user 5ea4acba99ef4aa6a89476132728f336 and project 83c75b8bbad84e08b224820bec326e24. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:34:37.843721 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c62ca6c5-f335-41ca-aced-03caf1304d9d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053524 Jun 16 19:34:37.844394 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3365/6616] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:34:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:34:37.892116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=36 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:34:37.892868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:34:37.897759 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2123559801", "imageRef": "29de5c0d-db97-4358-bd8e-eb4cb16b9134", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-716045917", "networks": [{"uuid": "1771fe3e-d009-4689-b2af-eccb5e5a266e"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:34:37.952319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] validate_networks() for [('1771fe3e-d009-4689-b2af-eccb5e5a266e', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:34:38.424784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:34:38.425267 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:34:38.426618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:34:38.427079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:34:38.427505 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:34:38.436551 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:38.437008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:38.437815 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:38.438302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:38.455208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Getting quotas for project 83c75b8bbad84e08b224820bec326e24. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:34:38.461337 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Getting quotas for user 5ea4acba99ef4aa6a89476132728f336 and project 83c75b8bbad84e08b224820bec326e24. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:34:38.474610 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:34:38.476862 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='29de5c0d-db97-4358-bd8e-eb4cb16b9134',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:34:38.522274 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1e785603-316c-4fa3-ba56-fcdb1a846196 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631738 Jun 16 19:34:38.523113 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3252/6617] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:34:38.533018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-567990e7-e97a-441a-bbce-339fd0243ecf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:38.533657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-567990e7-e97a-441a-bbce-339fd0243ecf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:38.591043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-567990e7-e97a-441a-bbce-339fd0243ecf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:38.597877 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-567990e7-e97a-441a-bbce-339fd0243ecf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1258 microversion: 2.1 time: 0.068895 Jun 16 19:34:38.599016 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3366/6618] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:38 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:34:39.616142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:39.616702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:39.624879 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:39.625343 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:39.626150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:39.626598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:39.722918 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:39.731367 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a0360025-e34e-4356-9b75-88ae74968129 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1318 microversion: 2.1 time: 0.119355 Jun 16 19:34:39.741041 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3253/6619] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:39 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1318 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:40.750270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:40.751855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:40.764780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:40.765776 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:40.767348 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:40.768301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:40.992723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:41.002032 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e37f45b2-13a5-4db9-a55a-274789b85a93 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.255584 Jun 16 19:34:41.002553 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3367/6620] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:40 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:42.022359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:42.024274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:42.033578 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:42.034685 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:42.036381 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:42.037067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:42.187143 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:42.195626 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83f2b260-4f54-457a-a513-af20d011f357 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.179812 Jun 16 19:34:42.196203 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3254/6621] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:42 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:43.213866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:43.214592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:43.222010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:43.222525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:43.223662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:43.224140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:43.376069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:43.384582 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f695bbf8-a483-4e57-aa5c-ddfb751cc79d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.174753 Jun 16 19:34:43.385168 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3368/6622] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:43 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:44.407254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:44.407254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:44.423151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:44.424274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:44.425403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:44.428677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:44.603884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:44.613080 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-02c59c91-69ce-4ef4-a403-7fa829b45fe4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.214397 Jun 16 19:34:44.613881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3255/6623] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:44 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:45.633681 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:45.634411 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:45.641032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:45.641499 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:45.642634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:45.642765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:45.788291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:45.796368 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-94e9651e-cd54-4abe-9581-06841e171e7d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.169025 Jun 16 19:34:45.805065 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3369/6624] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:45 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:46.817931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:46.818561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:46.826239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:46.826703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:46.827489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:46.827936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:46.979546 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:46.987264 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e19e3d32-ce4c-431a-b389-61ddb4779db8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.176550 Jun 16 19:34:46.987851 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3256/6625] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:46 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:48.004333 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:48.005299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:48.012187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:48.012736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:48.013621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:48.014181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:48.244516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:48.253385 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0055a40e-39d5-4a74-9e41-08e7e18bd416 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.253049 Jun 16 19:34:48.254228 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3370/6626] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:47 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:48.263365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ceef220d-0cbf-41e7-bcdd-e1c9b20c696a req-d9bc8acd-950f-4404-940b-eaf0afe5d3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13783c99-9c31-4128-8984-83b536348af0", "tag": "a2e51156-7363-4fc6-8a8d-d2da290cf73e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:34:48.273408 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ceef220d-0cbf-41e7-bcdd-e1c9b20c696a req-d9bc8acd-950f-4404-940b-eaf0afe5d3d9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:48.273899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ceef220d-0cbf-41e7-bcdd-e1c9b20c696a req-d9bc8acd-950f-4404-940b-eaf0afe5d3d9 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:48.298061 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ceef220d-0cbf-41e7-bcdd-e1c9b20c696a req-d9bc8acd-950f-4404-940b-eaf0afe5d3d9 service nova] Creating event network-changed:a2e51156-7363-4fc6-8a8d-d2da290cf73e for instance 13783c99-9c31-4128-8984-83b536348af0 on n-h1-846209-2 Jun 16 19:34:48.306890 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ceef220d-0cbf-41e7-bcdd-e1c9b20c696a req-d9bc8acd-950f-4404-940b-eaf0afe5d3d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050065 Jun 16 19:34:48.307495 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3257/6627] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:34:49.271491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:49.272115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:49.274018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:34:49.280312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:49.280774 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:49.281543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:49.282025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:49.414449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:49.422041 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f77ee3ce-5544-47d1-bd8d-ba6619f5b779 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.155111 Jun 16 19:34:49.422617 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3371/6628] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:49 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:50.436857 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:34:50.437630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:34:50.442518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:50.443732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:50.450955 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:50.451411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:50.452178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:50.452619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:50.585705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:50.593247 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7d6651c4-2b22-4525-af67-e0210510d7a1 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.157302 Jun 16 19:34:50.593750 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3258/6629] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:50 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:51.611988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:51.612450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:51.619459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:51.620503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:51.620722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:51.621183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:51.756422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:51.764034 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a1424292-fe63-4d42-a968-7ecffd29ce49 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.156578 Jun 16 19:34:51.764617 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3372/6630] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:51 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:52.780674 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:52.781274 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:52.788680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:52.789159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:52.790156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:52.790593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:52.920427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:52.929383 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3f3ed94e-1527-4a05-a03e-e7a2c5bc7de5 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.152598 Jun 16 19:34:52.929966 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3259/6631] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:52 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:53.531234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-94b8b5e8-626d-4078-9228-2aaf15c305bb req-a8f04b06-1cbd-4f2b-b6c0-4b5418606644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13783c99-9c31-4128-8984-83b536348af0", "name": "network-vif-plugged", "status": "completed", "tag": "a2e51156-7363-4fc6-8a8d-d2da290cf73e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:34:53.541315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-94b8b5e8-626d-4078-9228-2aaf15c305bb req-a8f04b06-1cbd-4f2b-b6c0-4b5418606644 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:53.541796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-94b8b5e8-626d-4078-9228-2aaf15c305bb req-a8f04b06-1cbd-4f2b-b6c0-4b5418606644 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:53.554735 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-94b8b5e8-626d-4078-9228-2aaf15c305bb req-a8f04b06-1cbd-4f2b-b6c0-4b5418606644 service nova] Creating event network-vif-plugged:a2e51156-7363-4fc6-8a8d-d2da290cf73e for instance 13783c99-9c31-4128-8984-83b536348af0 on n-h1-846209-2 Jun 16 19:34:53.559669 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-94b8b5e8-626d-4078-9228-2aaf15c305bb req-a8f04b06-1cbd-4f2b-b6c0-4b5418606644 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Jun 16 19:34:53.560274 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3373/6632] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:34:53.946425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:53.946977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:53.954166 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:53.954724 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:53.955614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:53.956075 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:54.089582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:54.097937 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bc93c4d4-4edf-4120-8d4d-dce5ab881cc0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1358 microversion: 2.1 time: 0.155619 Jun 16 19:34:54.098506 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3260/6633] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:53 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:55.118755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:55.119416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:55.126036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.126614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.127408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.127865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.262324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:55.269963 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d99a6f2-38f9-4cd9-98dc-f2acd61b5406 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1548 microversion: 2.1 time: 0.157520 Jun 16 19:34:55.270539 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3374/6634] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:55 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:55.287255 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:55.287969 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:55.294006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.294454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.295212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.295644 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.429704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:55.437323 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-416b99dd-08bf-495e-84c2-18777512050d tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1548 microversion: 2.1 time: 0.154904 Jun 16 19:34:55.437889 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3261/6635] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:55 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:55.454373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:55.457699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:55.458503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Searching by: {'deleted': False, 'project_id': '83c75b8bbad84e08b224820bec326e24'} {{(pid=119206) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 19:34:55.464267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.464734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.465547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.466032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.491947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.multi_cell_list [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119206) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 19:34:55.518657 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3eaaeb25-bc5e-4523-938a-bdfe6a4ead50 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068159 Jun 16 19:34:55.519243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3375/6636] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jun 16 19:34:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:34:55.529473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:55.530148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:55.536210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.536660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.537982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:55.538459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:55.672600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:34:55.681161 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3cf96e85-3796-4bd8-9ae3-242026415d80 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1548 microversion: 2.1 time: 0.155552 Jun 16 19:34:55.681725 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3262/6637] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:34:55 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:34:57.218225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3e26c689-5d0a-4e9a-afb9-d0a51f87b019 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12913573-a476-427a-9022-d478bd218345"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:34:57.219314 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3e26c689-5d0a-4e9a-afb9-d0a51f87b019 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:34:57.226587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e26c689-5d0a-4e9a-afb9-d0a51f87b019 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:57.227060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e26c689-5d0a-4e9a-afb9-d0a51f87b019 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:57.227844 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e26c689-5d0a-4e9a-afb9-d0a51f87b019 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:57.228301 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3e26c689-5d0a-4e9a-afb9-d0a51f87b019 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:57.470949 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3e26c689-5d0a-4e9a-afb9-d0a51f87b019 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256552 Jun 16 19:34:57.471619 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3376/6638] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jun 16 19:34:57 2022] POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:35:08.189727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:08.190369 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:08.192817 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:08.193478 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=58 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:08.200207 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:08.200664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:08.201436 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:08.201878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:08.623528 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:08.631827 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b83d8ba2-f75e-412a-8662-6ed82d497862 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1594 microversion: 2.1 time: 0.445940 Jun 16 19:35:08.632922 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3263/6639] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:08 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1594 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:10.605588 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:10.606163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:10.606867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:10.611294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-782bee58-85d7-4bba-952f-8c4003c3f501 req-d6d08562-2139-4f44-a69e-3c6470383283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13783c99-9c31-4128-8984-83b536348af0", "tag": "a2e51156-7363-4fc6-8a8d-d2da290cf73e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:35:10.622849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-782bee58-85d7-4bba-952f-8c4003c3f501 req-d6d08562-2139-4f44-a69e-3c6470383283 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:10.623276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-782bee58-85d7-4bba-952f-8c4003c3f501 req-d6d08562-2139-4f44-a69e-3c6470383283 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:10.638586 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-782bee58-85d7-4bba-952f-8c4003c3f501 req-d6d08562-2139-4f44-a69e-3c6470383283 service nova] Creating event network-changed:a2e51156-7363-4fc6-8a8d-d2da290cf73e for instance 13783c99-9c31-4128-8984-83b536348af0 on n-h1-846209-2 Jun 16 19:35:10.643779 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-782bee58-85d7-4bba-952f-8c4003c3f501 req-d6d08562-2139-4f44-a69e-3c6470383283 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040321 Jun 16 19:35:10.644397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3377/6640] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:35:11.916711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-221860696"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:35:11.917237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:11.924896 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:11.925356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:11.926423 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:11.926868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:12.067987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.network.security_group_api [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Adding security group ba0c8cfe-1d14-4c70-b636-8e48154278ab to port a2e51156-7363-4fc6-8a8d-d2da290cf73e Jun 16 19:35:12.437586 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-20e67cc1-d36e-4963-a26f-6c4d2bbf2288 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/action" status: 202 len: 0 microversion: 2.1 time: 0.526029 Jun 16 19:35:12.441432 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3264/6641] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:35:11 2022] POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:35:12.450987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:12.452489 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:12.462966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:12.463983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:12.464903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:12.466522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:12.636093 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:12.644538 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-551ddc07-212c-4f14-ac95-88f3715dd983 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1759 microversion: 2.1 time: 0.201555 Jun 16 19:35:12.645150 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3378/6642] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:12 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1759 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:12.661151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f30bba11-b341-4ddf-baa6-3658cadb85b9 req-765fc2f9-6a28-4860-80ed-33665d4b3838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13783c99-9c31-4128-8984-83b536348af0", "tag": "a2e51156-7363-4fc6-8a8d-d2da290cf73e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:35:12.669232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f30bba11-b341-4ddf-baa6-3658cadb85b9 req-765fc2f9-6a28-4860-80ed-33665d4b3838 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:12.669675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f30bba11-b341-4ddf-baa6-3658cadb85b9 req-765fc2f9-6a28-4860-80ed-33665d4b3838 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:12.681569 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f30bba11-b341-4ddf-baa6-3658cadb85b9 req-765fc2f9-6a28-4860-80ed-33665d4b3838 service nova] Creating event network-changed:a2e51156-7363-4fc6-8a8d-d2da290cf73e for instance 13783c99-9c31-4128-8984-83b536348af0 on n-h1-846209-2 Jun 16 19:35:12.686599 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f30bba11-b341-4ddf-baa6-3658cadb85b9 req-765fc2f9-6a28-4860-80ed-33665d4b3838 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 Jun 16 19:35:12.687181 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3265/6643] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:35:35.375636 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c74c7a3-a774-4407-b4d6-960dc2203586 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:35:35.376651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c74c7a3-a774-4407-b4d6-960dc2203586 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:35.379327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:35.380134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:35.386461 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c74c7a3-a774-4407-b4d6-960dc2203586 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:35.386865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c74c7a3-a774-4407-b4d6-960dc2203586 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:35.388256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c74c7a3-a774-4407-b4d6-960dc2203586 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:35.388702 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c74c7a3-a774-4407-b4d6-960dc2203586 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:35.462054 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c74c7a3-a774-4407-b4d6-960dc2203586 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/action" status: 202 len: 0 microversion: 2.1 time: 0.090189 Jun 16 19:35:35.462682 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3379/6644] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:35:35 2022] POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:35:35.470735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:35.471552 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:35:35.475813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:35.476534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:35.484302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:35.484765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:35.485549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:35.486031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:35.840757 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:35.849500 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ed3a1d67-3b19-496f-b3ea-6e47d2f931bf tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1751 microversion: 2.1 time: 0.380777 Jun 16 19:35:35.850399 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3266/6645] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:35 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1751 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:36.871415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:36.873602 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:36.880809 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:36.881268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:36.882087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:36.882541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:37.083369 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:37.093090 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-77eeff08-6ab2-4494-992c-353c3910b2d9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.227698 Jun 16 19:35:37.093742 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3380/6646] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:36 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:38.110593 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:38.111188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:38.117814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:38.118295 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:38.119053 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:38.119488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:38.263098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:38.272022 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4fe0cfd7-6700-4c38-a22c-29f1e9f29d27 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.165638 Jun 16 19:35:38.272580 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3267/6647] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:38 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:39.289928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:39.290568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:39.297648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:39.298150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:39.298916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:39.299362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:39.449653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:39.458689 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a8516f3-f621-483d-8797-afb02052b018 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.172633 Jun 16 19:35:39.459265 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3381/6648] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:39 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:40.475544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:40.476317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:40.484015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:40.484680 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:40.485479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:40.485938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:40.650718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:40.659596 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-45bc2364-6bab-4c07-bd88-66b5b8a784db tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.188018 Jun 16 19:35:40.660167 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3268/6649] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:40 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:41.676982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:41.677604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:41.684938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:41.685412 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:41.686850 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:41.687316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:41.835804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:41.844317 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-493ad1d9-7d0a-45e9-898c-f16310b19ece tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.171416 Jun 16 19:35:41.844902 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3382/6650] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:41 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:42.861370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:42.862036 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:42.868845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:42.869298 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:42.870099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:42.870540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:43.018693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:43.026734 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d383a0ec-f0dd-4f32-a8c4-14c0b7d56f5e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.169321 Jun 16 19:35:43.027294 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3269/6651] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:42 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:44.043327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:44.043934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:44.051849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:44.052312 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:44.053087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:44.053551 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:44.212743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:44.221081 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9ea5781f-f1e7-43ac-b13c-bb733e2f2617 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.181725 Jun 16 19:35:44.221663 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3383/6652] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:44 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:45.238225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:45.238842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:45.245655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:45.246136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:45.246897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:45.247332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:45.400034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:45.409018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ca97c0bf-86be-4a6f-8036-f51004a251fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.175400 Jun 16 19:35:45.409589 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3270/6653] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:45 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:46.427347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:46.428127 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:46.435318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:46.435781 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:46.436554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:46.436999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:46.584544 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:46.593238 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cba8f21b-42e1-43ea-a3c8-855a0e827d29 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.170514 Jun 16 19:35:46.594635 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3384/6654] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:46 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:47.613188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:47.613959 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:47.622193 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:47.622676 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:47.626001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:47.629271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:47.775318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:47.784005 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27e883b7-fa8d-4986-bb01-8efff6bdbce9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.176438 Jun 16 19:35:47.784559 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3271/6655] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:47 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:48.802197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:48.802960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:48.810894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:48.811379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:48.812341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:48.812871 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:48.959810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:48.967860 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-af43ec18-e9fb-4cdf-8f87-6f91b00db6d0 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.170506 Jun 16 19:35:48.968445 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3385/6656] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:48 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:49.984772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:49.985399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:49.992654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:49.993115 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:49.993895 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:49.994373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:50.145233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:50.153259 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8688ad93-cdd3-4df9-9bf8-d28613e0f5aa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.172458 Jun 16 19:35:50.153837 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3272/6657] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:49 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:51.171580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:51.172121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:51.179342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:51.179807 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:51.180578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:51.181025 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:51.324994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:51.334587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1540b094-904d-4650-bbca-61d9244fb738 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1756 microversion: 2.1 time: 0.166951 Jun 16 19:35:51.335171 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3386/6658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:51 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:35:52.353461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:35:52.354127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:35:52.361135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:52.361592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:52.362466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:35:52.362908 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:35:52.518039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:35:52.526843 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1513c497-3aa0-455c-ad7d-7146d244ad6e tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1759 microversion: 2.1 time: 0.178799 Jun 16 19:35:52.527412 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3273/6659] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:35:52 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:36:25.850686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-221860696"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:25.851285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:25.853400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:25.854215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:25.859927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:25.860399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:25.861189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:25.861645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:25.995260 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.network.security_group_api [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Removing security group ba0c8cfe-1d14-4c70-b636-8e48154278ab from port a2e51156-7363-4fc6-8a8d-d2da290cf73e Jun 16 19:36:26.338658 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-cd617545-8892-4502-b939-74890bb058d8 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/action" status: 202 len: 0 microversion: 2.1 time: 0.492512 Jun 16 19:36:26.339464 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3387/6660] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:36:25 2022] POST /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:36:26.352304 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=16 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:26.353451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=48 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:26.448697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4d9a74e7-0c45-4547-a44f-51d92ab29b93 req-3126afe6-e9ca-44fc-8c9d-10af992506d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13783c99-9c31-4128-8984-83b536348af0", "tag": "a2e51156-7363-4fc6-8a8d-d2da290cf73e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:26.457661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4d9a74e7-0c45-4547-a44f-51d92ab29b93 req-3126afe6-e9ca-44fc-8c9d-10af992506d5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:26.458590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4d9a74e7-0c45-4547-a44f-51d92ab29b93 req-3126afe6-e9ca-44fc-8c9d-10af992506d5 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:26.472297 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4d9a74e7-0c45-4547-a44f-51d92ab29b93 req-3126afe6-e9ca-44fc-8c9d-10af992506d5 service nova] Creating event network-changed:a2e51156-7363-4fc6-8a8d-d2da290cf73e for instance 13783c99-9c31-4128-8984-83b536348af0 on n-h1-846209-2 Jun 16 19:36:26.481175 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4d9a74e7-0c45-4547-a44f-51d92ab29b93 req-3126afe6-e9ca-44fc-8c9d-10af992506d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134646 Jun 16 19:36:26.485354 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3274/6661] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:27.494407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:27.494932 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:27.503225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:27.503767 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:27.504634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:27.505218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:27.556134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-88a03f93-501b-4088-97e4-7b82871ebdb3 req-93e07145-0712-431f-aa61-99647533c86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13783c99-9c31-4128-8984-83b536348af0", "tag": "a2e51156-7363-4fc6-8a8d-d2da290cf73e"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:27.566600 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-88a03f93-501b-4088-97e4-7b82871ebdb3 req-93e07145-0712-431f-aa61-99647533c86e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:27.568057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-88a03f93-501b-4088-97e4-7b82871ebdb3 req-93e07145-0712-431f-aa61-99647533c86e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:27.579987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-88a03f93-501b-4088-97e4-7b82871ebdb3 req-93e07145-0712-431f-aa61-99647533c86e service nova] Creating event network-changed:a2e51156-7363-4fc6-8a8d-d2da290cf73e for instance 13783c99-9c31-4128-8984-83b536348af0 on n-h1-846209-2 Jun 16 19:36:27.595355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lazy-loading 'services' on Instance uuid 13783c99-9c31-4128-8984-83b536348af0 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:36:27.598110 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-88a03f93-501b-4088-97e4-7b82871ebdb3 req-93e07145-0712-431f-aa61-99647533c86e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093059 Jun 16 19:36:27.599757 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3275/6662] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:27.684170 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5e83af3f-0c8f-47d9-a2cb-b0acef124056 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments/12913573-a476-427a-9022-d478bd218345" status: 202 len: 0 microversion: 2.1 time: 0.195217 Jun 16 19:36:27.687993 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3388/6663] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:36:27 2022] DELETE /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments/12913573-a476-427a-9022-d478bd218345 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:36:27.697580 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f87922f7-846a-4a24-b223-5132f164ceed tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:27.699634 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f87922f7-846a-4a24-b223-5132f164ceed tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:27.710010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f87922f7-846a-4a24-b223-5132f164ceed tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:27.711200 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f87922f7-846a-4a24-b223-5132f164ceed tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:27.712500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f87922f7-846a-4a24-b223-5132f164ceed tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:27.713264 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f87922f7-846a-4a24-b223-5132f164ceed tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:27.758566 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f87922f7-846a-4a24-b223-5132f164ceed tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067684 Jun 16 19:36:27.762262 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3276/6664] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:36:27 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:28.773159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-545aa162-e06c-4282-aade-ed8328dd7ca9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:28.774458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-545aa162-e06c-4282-aade-ed8328dd7ca9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:28.781618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-545aa162-e06c-4282-aade-ed8328dd7ca9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:28.782119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-545aa162-e06c-4282-aade-ed8328dd7ca9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:28.782903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-545aa162-e06c-4282-aade-ed8328dd7ca9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:28.783355 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-545aa162-e06c-4282-aade-ed8328dd7ca9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:28.814060 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-545aa162-e06c-4282-aade-ed8328dd7ca9 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Jun 16 19:36:28.814636 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3389/6665] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:36:28 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:29.826380 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-18fba868-63ec-41ca-b48a-7939738de0b4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:29.827339 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-18fba868-63ec-41ca-b48a-7939738de0b4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:29.835183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18fba868-63ec-41ca-b48a-7939738de0b4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:29.836035 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18fba868-63ec-41ca-b48a-7939738de0b4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:29.836845 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18fba868-63ec-41ca-b48a-7939738de0b4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:29.837288 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-18fba868-63ec-41ca-b48a-7939738de0b4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:29.868227 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-18fba868-63ec-41ca-b48a-7939738de0b4 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Jun 16 19:36:29.868796 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3277/6666] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:36:29 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:30.880256 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9aad9be4-2a84-4770-8cdc-6f8f806d8133 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:30.881144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9aad9be4-2a84-4770-8cdc-6f8f806d8133 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:30.888282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9aad9be4-2a84-4770-8cdc-6f8f806d8133 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:30.888752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9aad9be4-2a84-4770-8cdc-6f8f806d8133 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:30.889540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9aad9be4-2a84-4770-8cdc-6f8f806d8133 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:30.890040 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9aad9be4-2a84-4770-8cdc-6f8f806d8133 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:30.921021 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9aad9be4-2a84-4770-8cdc-6f8f806d8133 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Jun 16 19:36:30.921965 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3390/6667] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:36:30 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:31.934089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9bc55fab-e06d-4226-84d6-dbccad511b14 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:31.935020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9bc55fab-e06d-4226-84d6-dbccad511b14 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:31.942232 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bc55fab-e06d-4226-84d6-dbccad511b14 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:31.942752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bc55fab-e06d-4226-84d6-dbccad511b14 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:31.943550 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bc55fab-e06d-4226-84d6-dbccad511b14 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:31.943996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9bc55fab-e06d-4226-84d6-dbccad511b14 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:31.973146 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9bc55fab-e06d-4226-84d6-dbccad511b14 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Jun 16 19:36:31.973717 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3278/6668] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:36:31 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:32.985503 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-afb31283-88ee-47be-92da-53e4f4966f63 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:32.986474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-afb31283-88ee-47be-92da-53e4f4966f63 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:32.994015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb31283-88ee-47be-92da-53e4f4966f63 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:32.994487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb31283-88ee-47be-92da-53e4f4966f63 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:32.995272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb31283-88ee-47be-92da-53e4f4966f63 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:32.995725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-afb31283-88ee-47be-92da-53e4f4966f63 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:33.027049 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-afb31283-88ee-47be-92da-53e4f4966f63 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045574 Jun 16 19:36:33.027625 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3391/6669] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jun 16 19:36:32 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:36:33.037710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:33.038394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:33.044975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:33.045426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:33.046219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:33.046654 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:33.122976 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] HTTP exception thrown: Instance 13783c99-9c31-4128-8984-83b536348af0 is not attached to volume 12913573-a476-427a-9022-d478bd218345 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Request method failure captured: Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: request: DELETE /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments/12913573-a476-427a-9022-d478bd218345 HTTP/1.1 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4W-ixcK677E5DWKdUGmp8y_UkccDTEon55u_bRijOYOMRGnE5dUaQT1LFd7-o_T_YYfGrlPhXHg7UX8O3K1fTaDr_LlDqIeRYSoOeEo4YTxYDK7sOVBzAtTLjclHtujHaRKdkdF8N-NemnR0LWboripbkz-3tFiTMKWggLi_IhjL0E Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 83c75b8bbad84e08b224820bec326e24 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestMinimumBasicScenario-414810276 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83c75b8bbad84e08b224820bec326e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/83c75b8bbad84e08b224820bec326e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_83c75b8bbad84e08b224820bec326e24", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83c75b8bbad84e08b224820bec326e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestMinimumBasicScenario-414810276 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 83c75b8bbad84e08b224820bec326e24 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestMinimumBasicScenario-414810276 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestMinimumBasicScenario-414810276-project Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 5ea4acba99ef4aa6a89476132728f336 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestMinimumBasicScenario-414810276-project Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 13783c99-9c31-4128-8984-83b536348af0 is not attached to volume 12913573-a476-427a-9022-d478bd218345 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'server_id': '13783c99-9c31-4128-8984-83b536348af0', 'id': '12913573-a476-427a-9022-d478bd218345'} Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12913573-a476-427a-9022-d478bd218345. Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13783c99-9c31-4128-8984-83b536348af0 is not attached to volume 12913573-a476-427a-9022-d478bd218345 Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:36:33.124616 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:36:33.128809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:36:33.128809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:36:33.128809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13783c99-9c31-4128-8984-83b536348af0 is not attached to volume 12913573-a476-427a-9022-d478bd218345 Jun 16 19:36:33.128809 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:36:33.128809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Returning 404 to user: Instance 13783c99-9c31-4128-8984-83b536348af0 is not attached to volume 12913573-a476-427a-9022-d478bd218345 {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:36:33.128809 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-16a462ac-06b3-41e8-853a-09ad580cc4fe tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments/12913573-a476-427a-9022-d478bd218345" status: 404 len: 154 microversion: 2.1 time: 0.092652 Jun 16 19:36:33.128809 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3279/6670] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jun 16 19:36:33 2022] DELETE /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0/os-volume_attachments/12913573-a476-427a-9022-d478bd218345 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:36:36.364180 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:36.364703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:36.372579 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:36.373054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:36.373868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:36.374358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:36.401182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:36:36.479958 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9ba68d58-b60a-42e9-b08b-3041e6bb50bc tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 204 len: 0 microversion: 2.1 time: 0.119317 Jun 16 19:36:36.481055 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3392/6671] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:36:36 2022] DELETE /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:36:36.489791 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:36.492431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:36.501239 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:36.501699 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:36.502545 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:36.502987 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:36.641741 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:36:36.650347 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-33541e7c-b46f-4a8e-b218-fab7b64b81ac tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1554 microversion: 2.1 time: 0.164700 Jun 16 19:36:36.650941 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3280/6672] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:36:36 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:37.668423 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:37.669397 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:37.676552 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:37.677018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:37.678815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:37.679374 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:37.813835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:36:37.821639 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-688e357a-bcf4-47bb-870e-ea6098b3e044 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1554 microversion: 2.1 time: 0.157861 Jun 16 19:36:37.822248 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3393/6673] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:36:37 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:38.839532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:38.840161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:38.847023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:38.847496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:38.848284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:38.848750 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:38.864924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-4adce304-82bd-4daa-8824-b5f219130219 req-dcb1532c-5ba2-4e3c-bf09-d54aae33c12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13783c99-9c31-4128-8984-83b536348af0", "name": "network-vif-deleted", "tag": "a2e51156-7363-4fc6-8a8d-d2da290cf73e"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:38.875394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4adce304-82bd-4daa-8824-b5f219130219 req-dcb1532c-5ba2-4e3c-bf09-d54aae33c12c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:38.875859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-4adce304-82bd-4daa-8824-b5f219130219 req-dcb1532c-5ba2-4e3c-bf09-d54aae33c12c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:38.888760 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-4adce304-82bd-4daa-8824-b5f219130219 req-dcb1532c-5ba2-4e3c-bf09-d54aae33c12c service nova] Creating event network-vif-deleted:a2e51156-7363-4fc6-8a8d-d2da290cf73e for instance 13783c99-9c31-4128-8984-83b536348af0 on n-h1-846209-2 Jun 16 19:36:38.894331 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-4adce304-82bd-4daa-8824-b5f219130219 req-dcb1532c-5ba2-4e3c-bf09-d54aae33c12c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034038 Jun 16 19:36:38.895018 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3394/6674] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:38.925608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea4acba99ef4aa6a89476132728f336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c75b8bbad84e08b224820bec326e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:36:38.934975 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-38f6cda0-57d6-4197-86c6-61005830a5fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 200 len: 1512 microversion: 2.1 time: 0.100251 Jun 16 19:36:38.935555 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3281/6675] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:36:38 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 1512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:39.954190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:39.954983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] [instance: 13783c99-9c31-4128-8984-83b536348af0] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:39.961815 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:39.962311 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:39.963094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:39.963542 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:39.977731 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] HTTP exception thrown: Instance 13783c99-9c31-4128-8984-83b536348af0 could not be found. Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Request method failure captured: Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 HTTP/1.1 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4W-ixcK677E5DWKdUGmp8y_UkccDTEon55u_bRijOYOMRGnE5dUaQT1LFd7-o_T_YYfGrlPhXHg7UX8O3K1fTaDr_LlDqIeRYSoOeEo4YTxYDK7sOVBzAtTLjclHtujHaRKdkdF8N-NemnR0LWboripbkz-3tFiTMKWggLi_IhjL0E Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 83c75b8bbad84e08b224820bec326e24 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestMinimumBasicScenario-414810276 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83c75b8bbad84e08b224820bec326e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/83c75b8bbad84e08b224820bec326e24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_83c75b8bbad84e08b224820bec326e24", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/83c75b8bbad84e08b224820bec326e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestMinimumBasicScenario-414810276 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 83c75b8bbad84e08b224820bec326e24 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestMinimumBasicScenario-414810276 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestMinimumBasicScenario-414810276-project Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 5ea4acba99ef4aa6a89476132728f336 Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestMinimumBasicScenario-414810276-project Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 13783c99-9c31-4128-8984-83b536348af0 could not be found. Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '13783c99-9c31-4128-8984-83b536348af0'} Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13783c99-9c31-4128-8984-83b536348af0 could not be found. Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13783c99-9c31-4128-8984-83b536348af0 could not be found. Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:36:39.979414 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13783c99-9c31-4128-8984-83b536348af0 could not be found. Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Returning 404 to user: Instance 13783c99-9c31-4128-8984-83b536348af0 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c866d0aa-e70e-4684-a91e-2b9b41ba09b2 tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0" status: 404 len: 111 microversion: 2.1 time: 0.031939 Jun 16 19:36:39.984073 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3395/6676] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:36:39 2022] GET /compute/v2.1/servers/13783c99-9c31-4128-8984-83b536348af0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:36:39.990005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8f58ffdb-76ea-489e-8a89-231ffb08a9fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] Calling method '.version_select at 0x7f866d6a71f0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:40.012371 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8f58ffdb-76ea-489e-8a89-231ffb08a9fa tempest-TestMinimumBasicScenario-414810276 tempest-TestMinimumBasicScenario-414810276-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-716045917" status: 202 len: 0 microversion: 2.1 time: 0.026544 Jun 16 19:36:40.012956 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3282/6677] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jun 16 19:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-716045917 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:36:49.427434 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9817b1de-ad6e-4562-aa61-b139d4ef1859 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: .version_select at 0x7f866e3a4ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1210860123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBd7sFWWcCbTFJI+vMG8kU+/+GZOklnzTJisf2RO1RNliPFrfV1wdLh48jjspVlPOwaP6p02fiA302JduSEEf1Ft4K411gXBeSEkTeAI25mgyRfnG38yem/ZoVIPRpA2bA=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:49.442276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-9817b1de-ad6e-4562-aa61-b139d4ef1859 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:36:49.448068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-9817b1de-ad6e-4562-aa61-b139d4ef1859 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:36:49.461832 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9817b1de-ad6e-4562-aa61-b139d4ef1859 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [f56d8058-c723-40bc-a4c2-cfb002f8a101] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:36:49.968466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:50.468840 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [None req-9817b1de-ad6e-4562-aa61-b139d4ef1859 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [f56d8058-c723-40bc-a4c2-cfb002f8a101] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40262. Jun 16 19:36:50.485149 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9817b1de-ad6e-4562-aa61-b139d4ef1859 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.223380 Jun 16 19:36:50.485746 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3396/6678] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:36:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:56.423220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1070267657", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "351bd49a-45b8-4e99-b90b-22e48f579827"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1210860123", "security_groups": [{"name": "tempest-secgroup-smoke-1003573604"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:56.436072 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=40 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:56.436730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:56.567834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] validate_networks() for [('351bd49a-45b8-4e99-b90b-22e48f579827', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:36:57.112297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:36:57.113294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:36:57.113420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:36:57.113892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:36:57.114454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:36:57.130424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:57.131557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:57.132975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:57.136363 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:57.158726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:36:57.166219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:36:57.181559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:36:57.183890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:36:57.232515 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:36:58.243300 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [b1e96d8f-d361-485f-b99c-e07a73c4d8b6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40310. Jun 16 19:36:58.247893 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-77d39017-c9d4-4b9e-b4e1-e167cc4468e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.828683 Jun 16 19:36:58.248551 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3283/6679] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:36:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:36:58.260501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-95a4841a-2ac3-410f-9c59-b2cc446a6bf9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:58.261247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-95a4841a-2ac3-410f-9c59-b2cc446a6bf9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:58.263537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:58.337562 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-95a4841a-2ac3-410f-9c59-b2cc446a6bf9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:36:58.348100 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-95a4841a-2ac3-410f-9c59-b2cc446a6bf9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1267 microversion: 2.1 time: 0.093183 Jun 16 19:36:58.354437 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3397/6680] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:36:58 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:59.368352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:59.370609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:36:59.379208 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:59.379675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:59.380809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:36:59.381764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:36:59.465106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:36:59.473357 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-97700d83-81d2-401b-a9a6-5d50ed1a8db0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1319 microversion: 2.1 time: 0.110312 Jun 16 19:36:59.475967 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3284/6681] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:36:59 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1319 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:00.492647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:00.493441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:00.501435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:00.501938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:00.502739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:00.503204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:00.730894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:00.741326 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-65c1aef6-b32b-435e-8502-19213a7d7486 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1393 microversion: 2.1 time: 0.253199 Jun 16 19:37:00.742365 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3398/6682] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:00 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1393 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:00.967011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f046f002-1d8f-4a71-bc4b-35bdbde915a6 req-9f4251cb-5e9e-40b9-86fa-5a9c51967e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1fab4b-b87b-4c6e-8d21-7049ab15ba56", "tag": "2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:00.977830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f046f002-1d8f-4a71-bc4b-35bdbde915a6 req-9f4251cb-5e9e-40b9-86fa-5a9c51967e21 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:00.978308 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f046f002-1d8f-4a71-bc4b-35bdbde915a6 req-9f4251cb-5e9e-40b9-86fa-5a9c51967e21 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:00.993879 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f046f002-1d8f-4a71-bc4b-35bdbde915a6 req-9f4251cb-5e9e-40b9-86fa-5a9c51967e21 service nova] Creating event network-changed:2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67 for instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 on n-h1-846209-2 Jun 16 19:37:00.999742 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f046f002-1d8f-4a71-bc4b-35bdbde915a6 req-9f4251cb-5e9e-40b9-86fa-5a9c51967e21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036147 Jun 16 19:37:01.000595 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3285/6683] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:01.758733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:01.759389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:01.767075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:01.767535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:01.768302 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:01.768752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:01.905748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:01.913720 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-074a8822-931c-4c68-998c-8196e5cbb5a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1393 microversion: 2.1 time: 0.159068 Jun 16 19:37:01.914367 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3399/6684] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:01 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:37:02.933827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:02.934689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:02.940894 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:02.941351 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:02.942132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:02.942567 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:03.163407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:03.171353 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8f1b890e-1d8e-451a-9aa0-0eb540ab7276 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1393 microversion: 2.1 time: 0.243819 Jun 16 19:37:03.171955 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3286/6685] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:02 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1393 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:37:04.188745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:04.189362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:04.196454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:04.196916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:04.197696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:04.198171 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:04.349235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:04.357532 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e0954afe-2ad2-4d35-ad51-bc9e09c790ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1393 microversion: 2.1 time: 0.172830 Jun 16 19:37:04.358150 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3400/6686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:04 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:05.375270 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:05.375890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:05.382839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:05.383293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:05.384060 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:05.384556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:05.523721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:05.532479 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0fbe7eb1-f909-4f09-b142-7adbb1de3cdf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1393 microversion: 2.1 time: 0.161153 Jun 16 19:37:05.533082 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3287/6687] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:05 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:06.324558 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-459b4310-c00f-4740-a817-323018b5f33f req-bd998080-f247-4143-9ff0-fb5801b21e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1fab4b-b87b-4c6e-8d21-7049ab15ba56", "name": "network-vif-plugged", "status": "completed", "tag": "2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:06.336583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-459b4310-c00f-4740-a817-323018b5f33f req-bd998080-f247-4143-9ff0-fb5801b21e6a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:06.336583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-459b4310-c00f-4740-a817-323018b5f33f req-bd998080-f247-4143-9ff0-fb5801b21e6a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:06.349936 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-459b4310-c00f-4740-a817-323018b5f33f req-bd998080-f247-4143-9ff0-fb5801b21e6a service nova] Creating event network-vif-plugged:2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67 for instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 on n-h1-846209-2 Jun 16 19:37:06.356751 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-459b4310-c00f-4740-a817-323018b5f33f req-bd998080-f247-4143-9ff0-fb5801b21e6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096131 Jun 16 19:37:06.357369 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3401/6688] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:37:06.549449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:06.550099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:06.558466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:06.558964 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:06.559788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:06.560175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:06.697233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:06.705636 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9f26e29d-3139-4844-bc24-0ecbbea18851 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1393 microversion: 2.1 time: 0.160306 Jun 16 19:37:06.706264 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3288/6689] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:06 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:07.724104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:07.724834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:07.731290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:07.731766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:07.732564 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:07.733028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:07.870525 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:07.878140 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-de8cf42e-fc48-46e9-8cdd-20b6de27de81 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1393 microversion: 2.1 time: 0.159204 Jun 16 19:37:07.878721 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3402/6690] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:07 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:08.895653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:08.896284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:08.898268 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:08.899063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:08.905704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:08.906219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:08.907004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:08.907451 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:09.043596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:09.051412 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-41d9cea6-3ffc-415b-9a99-52ced6d243df tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1565 microversion: 2.1 time: 0.159588 Jun 16 19:37:09.051984 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3289/6691] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:08 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:09.068367 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:09.068997 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:09.071036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:09.077728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:09.078223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:09.078999 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:09.079449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:09.224318 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:09.232888 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-12a48178-cea3-4223-9d44-ee237784b1f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1565 microversion: 2.1 time: 0.168450 Jun 16 19:37:09.233462 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3403/6692] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:09 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:10.841948 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:10.847216 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-fc230f0a-3a3d-4f18-b055-12d0f0f0f19c req-b95b9c68-5809-4359-854b-bdb65611b0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1fab4b-b87b-4c6e-8d21-7049ab15ba56", "tag": "2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:10.852978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:10.861297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fc230f0a-3a3d-4f18-b055-12d0f0f0f19c req-b95b9c68-5809-4359-854b-bdb65611b0f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:10.861768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-fc230f0a-3a3d-4f18-b055-12d0f0f0f19c req-b95b9c68-5809-4359-854b-bdb65611b0f6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:10.866006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:10.866471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:10.867257 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:10.867700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:10.883880 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-fc230f0a-3a3d-4f18-b055-12d0f0f0f19c req-b95b9c68-5809-4359-854b-bdb65611b0f6 service nova] Creating event network-changed:2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67 for instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 on n-h1-846209-2 Jun 16 19:37:10.890044 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-fc230f0a-3a3d-4f18-b055-12d0f0f0f19c req-b95b9c68-5809-4359-854b-bdb65611b0f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046046 Jun 16 19:37:10.890993 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3404/6693] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:11.109128 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:11.117943 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90a82469-edce-4db4-b6d7-e33c89e988b6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1565 microversion: 2.1 time: 0.280358 Jun 16 19:37:11.118644 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3290/6694] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:10 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1565 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:34.358716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-497142ff-8a4c-4380-a114-c3cdf78c8b37 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:34.362737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-497142ff-8a4c-4380-a114-c3cdf78c8b37 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:34.365363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=17 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:34.366134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=34 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:34.379174 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-497142ff-8a4c-4380-a114-c3cdf78c8b37 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:34.379873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-497142ff-8a4c-4380-a114-c3cdf78c8b37 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:34.380682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-497142ff-8a4c-4380-a114-c3cdf78c8b37 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:34.381137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-497142ff-8a4c-4380-a114-c3cdf78c8b37 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:34.442286 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-497142ff-8a4c-4380-a114-c3cdf78c8b37 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action" status: 200 len: 24566 microversion: 2.1 time: 0.089357 Jun 16 19:37:34.442977 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3405/6695] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:37:34 2022] POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action => generated 24566 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:37:45.156923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-92b9447f-9eba-4ce1-852b-affd47098aeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:45.157516 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-92b9447f-9eba-4ce1-852b-affd47098aeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:45.159858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:45.160523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=40 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:45.167739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b9447f-9eba-4ce1-852b-affd47098aeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:45.168216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b9447f-9eba-4ce1-852b-affd47098aeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:45.169001 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b9447f-9eba-4ce1-852b-affd47098aeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:45.169447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-92b9447f-9eba-4ce1-852b-affd47098aeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:45.241450 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-92b9447f-9eba-4ce1-852b-affd47098aeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action" status: 202 len: 0 microversion: 2.1 time: 0.088339 Jun 16 19:37:45.242127 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3291/6696] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:37:45 2022] POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:37:45.251956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:45.252678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:45.255224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:45.255982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:45.262749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:45.263223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:45.264099 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:45.264561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:45.402646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:45.410612 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-145ae8fc-19e6-4e6a-8305-0837f7dd23aa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1688 microversion: 2.1 time: 0.162920 Jun 16 19:37:45.411194 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3406/6697] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:45 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:46.429794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:46.430524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:46.438431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:46.438884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:46.439652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:46.440087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:46.577301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:46.584964 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7542c9b7-bf69-4ce8-8985-cc8b613ef9ef tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1668 microversion: 2.1 time: 0.159581 Jun 16 19:37:46.585535 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3292/6698] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:46 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:47.673953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-43df0fe5-e342-4e82-8053-6c1974bc843c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:47.674836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-43df0fe5-e342-4e82-8053-6c1974bc843c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:47.685835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43df0fe5-e342-4e82-8053-6c1974bc843c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:47.686465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43df0fe5-e342-4e82-8053-6c1974bc843c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:47.687267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43df0fe5-e342-4e82-8053-6c1974bc843c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:47.687728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-43df0fe5-e342-4e82-8053-6c1974bc843c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:47.746406 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-43df0fe5-e342-4e82-8053-6c1974bc843c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action" status: 200 len: 32634 microversion: 2.1 time: 0.076210 Jun 16 19:37:47.747311 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3407/6699] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:37:47 2022] POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action => generated 32634 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:37:47.757981 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afd9bc69-795c-49fc-9e60-da662f7a9dd0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:47.758529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afd9bc69-795c-49fc-9e60-da662f7a9dd0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:47.766147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd9bc69-795c-49fc-9e60-da662f7a9dd0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:47.766607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd9bc69-795c-49fc-9e60-da662f7a9dd0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:47.767372 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd9bc69-795c-49fc-9e60-da662f7a9dd0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:47.767813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afd9bc69-795c-49fc-9e60-da662f7a9dd0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:47.834626 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afd9bc69-795c-49fc-9e60-da662f7a9dd0 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action" status: 202 len: 0 microversion: 2.1 time: 0.080420 Jun 16 19:37:47.838362 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3293/6700] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:37:47 2022] POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:37:47.846229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:47.847065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:47.854768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:47.856110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:47.857038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:47.857566 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:47.998914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:48.006580 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-995805c3-bbfd-42d3-ba7c-bddbd419a04b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1675 microversion: 2.1 time: 0.166690 Jun 16 19:37:48.007170 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3408/6701] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:47 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:49.026105 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:49.026818 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:49.033438 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:49.033900 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:49.034700 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:49.035154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:49.171923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:49.179811 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-57ec75bc-7f96-42c7-9b5f-cb3aab672df8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1683 microversion: 2.1 time: 0.158856 Jun 16 19:37:49.180387 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3294/6702] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:49 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:49.270260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-558d29c4-392a-411a-9c80-5c6c6565656d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:49.271213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-558d29c4-392a-411a-9c80-5c6c6565656d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:49.279147 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558d29c4-392a-411a-9c80-5c6c6565656d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:49.279540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558d29c4-392a-411a-9c80-5c6c6565656d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:49.280308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558d29c4-392a-411a-9c80-5c6c6565656d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:49.280755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-558d29c4-392a-411a-9c80-5c6c6565656d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:49.331889 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-558d29c4-392a-411a-9c80-5c6c6565656d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action" status: 200 len: 38421 microversion: 2.1 time: 0.065390 Jun 16 19:37:49.332558 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3409/6703] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:37:49 2022] POST /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56/action => generated 38421 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:37:50.333653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:50.334188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:50.336219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1c035fe2-85bc-4894-a691-e96b74a65087 req-7aa43272-4388-4c93-bf3f-469b74d5bbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1fab4b-b87b-4c6e-8d21-7049ab15ba56", "tag": "2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:50.341726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:50.342440 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:50.343431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:50.344058 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:50.349951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1c035fe2-85bc-4894-a691-e96b74a65087 req-7aa43272-4388-4c93-bf3f-469b74d5bbb2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:50.349951 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1c035fe2-85bc-4894-a691-e96b74a65087 req-7aa43272-4388-4c93-bf3f-469b74d5bbb2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:50.360957 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1c035fe2-85bc-4894-a691-e96b74a65087 req-7aa43272-4388-4c93-bf3f-469b74d5bbb2 service nova] Creating event network-changed:2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67 for instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 on n-h1-846209-2 Jun 16 19:37:50.366081 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1c035fe2-85bc-4894-a691-e96b74a65087 req-7aa43272-4388-4c93-bf3f-469b74d5bbb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033678 Jun 16 19:37:50.370084 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3410/6704] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:37:50.377577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:37:50.476322 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9ae64747-c505-4eba-b5f8-435c06b6ec2a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 204 len: 0 microversion: 2.1 time: 0.144801 Jun 16 19:37:50.481557 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3295/6705] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:37:50 2022] DELETE /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:37:50.487185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:50.487945 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:50.495107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:50.495580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:50.497399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:50.497868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:50.661322 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:50.669085 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1e6b9e29-dce6-409e-a703-59d98ffb8e51 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1689 microversion: 2.1 time: 0.186506 Jun 16 19:37:50.669759 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3411/6706] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:50 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:51.688394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:51.689101 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:51.696417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:51.697559 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:51.698425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:51.698883 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:51.832285 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:51.839995 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a1c31e3c-8dc7-4645-9baf-3e5e5025288e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1689 microversion: 2.1 time: 0.156628 Jun 16 19:37:51.841086 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3296/6707] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:51 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:52.858357 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:52.858911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:52.865882 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:52.866380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:52.867163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:52.867614 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:52.939858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:37:52.947623 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1221032-81ef-43e1-b6f1-fbc8737a1935 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 200 len: 1503 microversion: 2.1 time: 0.093894 Jun 16 19:37:52.955060 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3412/6708] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:52 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 1503 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:52.986921 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c70104c9-0249-4696-949f-4d3925acff06 req-09378364-5896-4e3a-b243-0684107ef298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1fab4b-b87b-4c6e-8d21-7049ab15ba56", "name": "network-vif-deleted", "tag": "2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:52.997527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c70104c9-0249-4696-949f-4d3925acff06 req-09378364-5896-4e3a-b243-0684107ef298 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:52.998024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c70104c9-0249-4696-949f-4d3925acff06 req-09378364-5896-4e3a-b243-0684107ef298 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:53.014114 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c70104c9-0249-4696-949f-4d3925acff06 req-09378364-5896-4e3a-b243-0684107ef298 service nova] Creating event network-vif-deleted:2ba5b3d5-d95c-48e8-9aa7-3c1dc59cfc67 for instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 on n-h1-846209-2 Jun 16 19:37:53.019055 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c70104c9-0249-4696-949f-4d3925acff06 req-09378364-5896-4e3a-b243-0684107ef298 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035899 Jun 16 19:37:53.019694 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3297/6709] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:37:53.965536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:53.966169 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: eb1fab4b-b87b-4c6e-8d21-7049ab15ba56] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:37:53.973166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:53.973635 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:53.974447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:37:53.974910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:37:53.988582 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] HTTP exception thrown: Instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 could not be found. Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Request method failure captured: Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 HTTP/1.1 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4ZQ3-HcFTbJlryGqO81Si_D7lmY08a9-tZq53qjTz338x_1rjo0u3Y4RZlYQlrK1O5Gseag5h9aIUWT7irG8rKdevwcxTIlD-v6WZOvwjembOcpGQ7JgDOdGi6j5NTGAgeulVhkpo4vvlZ5fGkPcWY-vJRcrfu--lBnqKuJ3NGcolA Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_479a1e88e5dd499cb33e7e2ef2164511", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d70dfa781674fc9bcda4bee6edff40e Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 could not be found. Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'eb1fab4b-b87b-4c6e-8d21-7049ab15ba56'} Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 could not be found. Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 could not be found. Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:53.990272 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 could not be found. Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Returning 404 to user: Instance eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d219f67b-f5d8-439b-9e73-42c0ec8dbcf1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56" status: 404 len: 111 microversion: 2.1 time: 0.030861 Jun 16 19:37:53.994578 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3413/6710] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:37:53 2022] GET /compute/v2.1/servers/eb1fab4b-b87b-4c6e-8d21-7049ab15ba56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:37:57.087044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-aa8e924e-4e64-48fc-8f5b-fe18b59796bc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '.version_select at 0x7f866db149d0>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:57.110173 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-aa8e924e-4e64-48fc-8f5b-fe18b59796bc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1210860123" status: 202 len: 0 microversion: 2.1 time: 0.029428 Jun 16 19:37:57.110722 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3298/6711] 10.222.0.27 () {58 vars in 1283 bytes} [Thu Jun 16 19:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1210860123 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:37:57.136015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b727624-babd-453f-8c67-1b303a3a6329 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: .version_select at 0x7f866de5e9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-833374305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXzxJRCBYdzndZxHJmESB6Z+ydWEsTPdZ8Crwi4mOrY3DndoSR6oDCMlmpDO43KOYkc2mUxTVaJbp4I4mv0BEr7TBUW6rsqZGCQmPwNAgXDnmtet+cNjM5WQ/bc59pexg=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:57.157656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5b727624-babd-453f-8c67-1b303a3a6329 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:37:57.162873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5b727624-babd-453f-8c67-1b303a3a6329 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:37:57.187005 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b727624-babd-453f-8c67-1b303a3a6329 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055053 Jun 16 19:37:57.187552 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3414/6712] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:37:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:38:02.786030 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2129813900", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "3a45903d-7589-43d4-b207-79e2f03f51e0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-833374305", "security_groups": [{"name": "tempest-secgroup-smoke-825496778"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:38:02.912992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] validate_networks() for [('3a45903d-7589-43d4-b207-79e2f03f51e0', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:38:03.003495 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:03.328403 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:38:03.328827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:38:03.329312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:38:03.329721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:38:03.330194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:38:03.339656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:03.340474 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:03.341216 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:03.341653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:03.361138 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:38:03.366718 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:38:03.381231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:38:03.384045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:38:03.434422 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-32e22dc5-5935-4467-8ee6-2b271cc6a9ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.652497 Jun 16 19:38:03.440076 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3299/6713] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:38:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:38:03.446385 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3a3b1f66-d861-4da2-aa9f-ead885b92c13 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:03.447018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3a3b1f66-d861-4da2-aa9f-ead885b92c13 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:03.507804 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3a3b1f66-d861-4da2-aa9f-ead885b92c13 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:03.528672 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3a3b1f66-d861-4da2-aa9f-ead885b92c13 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1266 microversion: 2.1 time: 0.087001 Jun 16 19:38:03.538449 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3415/6714] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:03 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:04.548549 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:04.549181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:04.565071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:04.565779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:04.566823 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:04.568137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:04.663677 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:04.675987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e1960fe-c41e-457c-b63b-b84a1c1beb64 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1326 microversion: 2.1 time: 0.133230 Jun 16 19:38:04.679685 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3300/6715] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:04 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:05.700349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:05.700982 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:05.703275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=36 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:05.716241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:05.716714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:05.717517 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:05.717984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:06.022568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:06.033213 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-491181ae-10bf-4a89-bd33-24f4266464ca tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.336615 Jun 16 19:38:06.033979 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3416/6716] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:05 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:06.304536 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0f012a06-c5fb-4aa3-879c-513442ebd69f req-2f0e3927-49d9-4f71-a540-87b891d9ae16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9aa02c-e1de-4651-a280-e79a533aaac8", "tag": "d7bb559d-28ed-4143-86e4-7666098d88c7"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:38:06.334204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0f012a06-c5fb-4aa3-879c-513442ebd69f req-2f0e3927-49d9-4f71-a540-87b891d9ae16 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:06.334657 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0f012a06-c5fb-4aa3-879c-513442ebd69f req-2f0e3927-49d9-4f71-a540-87b891d9ae16 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:06.357864 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0f012a06-c5fb-4aa3-879c-513442ebd69f req-2f0e3927-49d9-4f71-a540-87b891d9ae16 service nova] Creating event network-changed:d7bb559d-28ed-4143-86e4-7666098d88c7 for instance be9aa02c-e1de-4651-a280-e79a533aaac8 on n-h1-846209-2 Jun 16 19:38:06.367409 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0f012a06-c5fb-4aa3-879c-513442ebd69f req-2f0e3927-49d9-4f71-a540-87b891d9ae16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078314 Jun 16 19:38:06.368237 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3301/6717] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:38:07.051064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:07.051886 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:07.059328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:07.059803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:07.063994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:07.064467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:07.206005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:07.213542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4e7051e3-15f5-4493-a217-2157639ca412 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.166682 Jun 16 19:38:07.214773 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3417/6718] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:07 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:08.233173 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:08.233940 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:08.240476 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:08.240939 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:08.241727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:08.242202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:08.398811 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:08.406347 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7a53968a-deb9-4e5a-9aeb-f749f2a25ebe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.178826 Jun 16 19:38:08.406930 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3302/6719] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:08 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:09.423291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:09.423928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:09.431365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:09.431834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:09.432679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:09.433817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:09.565478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:09.573128 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f3504906-09ee-4472-8898-56eec1789cfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.153759 Jun 16 19:38:09.574431 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3418/6720] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:09 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:10.592417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:10.593446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:10.600904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:10.601370 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:10.602192 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:10.602667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:10.740227 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:10.748737 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d81a7be9-5368-4f43-b43c-5f39837c4222 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.161018 Jun 16 19:38:10.749327 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3303/6721] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:10 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:11.765768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:11.766430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:11.773382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:11.773856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:11.774669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:11.775130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:11.908801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:11.916350 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7bba90cd-9348-42e0-8af0-65937daa8359 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.154585 Jun 16 19:38:11.916921 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3419/6722] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:11 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:12.538743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-167a5aad-5a74-45d9-a058-7b3d8c6af4ce req-a5f63acf-dd99-40e4-903b-949b76fcd9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9aa02c-e1de-4651-a280-e79a533aaac8", "name": "network-vif-plugged", "status": "completed", "tag": "d7bb559d-28ed-4143-86e4-7666098d88c7"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:38:12.547994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-167a5aad-5a74-45d9-a058-7b3d8c6af4ce req-a5f63acf-dd99-40e4-903b-949b76fcd9d3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:12.548441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-167a5aad-5a74-45d9-a058-7b3d8c6af4ce req-a5f63acf-dd99-40e4-903b-949b76fcd9d3 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:12.561348 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-167a5aad-5a74-45d9-a058-7b3d8c6af4ce req-a5f63acf-dd99-40e4-903b-949b76fcd9d3 service nova] Creating event network-vif-plugged:d7bb559d-28ed-4143-86e4-7666098d88c7 for instance be9aa02c-e1de-4651-a280-e79a533aaac8 on n-h1-846209-2 Jun 16 19:38:12.566460 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-167a5aad-5a74-45d9-a058-7b3d8c6af4ce req-a5f63acf-dd99-40e4-903b-949b76fcd9d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031447 Jun 16 19:38:12.567075 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3304/6723] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:38:12.933687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:12.934403 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:12.941468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:12.942014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:12.942799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:12.943252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:13.081282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:13.088706 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-90ea3b08-fc6a-40bb-8b30-c80970f6feb6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.159685 Jun 16 19:38:13.089442 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3420/6724] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:12 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:14.106146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:14.106983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:14.109119 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:14.109873 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:14.117721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:14.118218 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:14.119011 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:14.119492 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:14.261117 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:14.268857 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-59db580b-fb95-4e13-b3ff-2237dd84fe43 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1391 microversion: 2.1 time: 0.167697 Jun 16 19:38:14.269631 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3305/6725] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:14 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:15.286027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:15.286658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:15.288752 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:15.289879 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:15.297317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:15.297793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:15.298611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:15.299069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:15.439958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:15.447474 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-514296c4-663b-4d47-9672-013e13b2aa49 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1562 microversion: 2.1 time: 0.165464 Jun 16 19:38:15.448063 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3421/6726] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:15 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:15.463789 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:15.465116 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:15.467941 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:15.475020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:15.475489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:15.476282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:15.476735 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:15.614359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:15.621854 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c41627fe-a355-49c5-af5e-993343efdef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1562 microversion: 2.1 time: 0.162021 Jun 16 19:38:15.622485 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3306/6727] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:15 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:17.586802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:17.587446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:17.590448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4ce86ee1-0082-44a2-b38d-45a858d47fe6 req-e14f13ac-b105-40cd-bed7-331939efad60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9aa02c-e1de-4651-a280-e79a533aaac8", "tag": "d7bb559d-28ed-4143-86e4-7666098d88c7"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:38:17.595716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:17.596195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:17.597235 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:17.597721 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:17.600246 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4ce86ee1-0082-44a2-b38d-45a858d47fe6 req-e14f13ac-b105-40cd-bed7-331939efad60 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:17.600691 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4ce86ee1-0082-44a2-b38d-45a858d47fe6 req-e14f13ac-b105-40cd-bed7-331939efad60 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:17.613686 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4ce86ee1-0082-44a2-b38d-45a858d47fe6 req-e14f13ac-b105-40cd-bed7-331939efad60 service nova] Creating event network-changed:d7bb559d-28ed-4143-86e4-7666098d88c7 for instance be9aa02c-e1de-4651-a280-e79a533aaac8 on n-h1-846209-2 Jun 16 19:38:17.620938 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4ce86ee1-0082-44a2-b38d-45a858d47fe6 req-e14f13ac-b105-40cd-bed7-331939efad60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034940 Jun 16 19:38:17.622243 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3307/6728] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:38:17.826078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:17.834526 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7c5f60f5-02a8-4893-8a0c-99fa7f63dbfa tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1562 microversion: 2.1 time: 0.251904 Jun 16 19:38:17.846566 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3422/6729] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:17 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1562 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:41.072899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:41.075625 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=38 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:41.079952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-585136d7-3f82-4b07-84aa-40b2682547a9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:38:41.080976 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-585136d7-3f82-4b07-84aa-40b2682547a9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:41.088442 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-585136d7-3f82-4b07-84aa-40b2682547a9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:41.088899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-585136d7-3f82-4b07-84aa-40b2682547a9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:41.090441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-585136d7-3f82-4b07-84aa-40b2682547a9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:41.090899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-585136d7-3f82-4b07-84aa-40b2682547a9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:41.142967 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-585136d7-3f82-4b07-84aa-40b2682547a9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8/action" status: 200 len: 24568 microversion: 2.1 time: 0.071841 Jun 16 19:38:41.143615 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3308/6730] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:38:41 2022] POST /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:38:46.128445 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:38:46.129038 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:38:52.219689 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1357a3b8-7757-4afb-b38f-b46c2b9eee8c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:38:52.220766 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1357a3b8-7757-4afb-b38f-b46c2b9eee8c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:52.223294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:52.223983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=42 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:52.230794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1357a3b8-7757-4afb-b38f-b46c2b9eee8c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:52.231291 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1357a3b8-7757-4afb-b38f-b46c2b9eee8c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:52.232092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1357a3b8-7757-4afb-b38f-b46c2b9eee8c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:52.232622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1357a3b8-7757-4afb-b38f-b46c2b9eee8c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:52.313083 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1357a3b8-7757-4afb-b38f-b46c2b9eee8c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8/action" status: 202 len: 0 microversion: 2.1 time: 0.097194 Jun 16 19:38:52.316807 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3423/6731] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:38:52 2022] POST /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:38:52.323281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:52.324562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:52.327890 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:52.328560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:38:52.336244 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:52.337342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:52.338175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:52.338813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:52.581461 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:52.589075 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3a102285-45d4-4031-b970-74a518ddf1c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1673 microversion: 2.1 time: 0.270761 Jun 16 19:38:52.590945 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3309/6732] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:52 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1673 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:53.609751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:53.610521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:53.616869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:53.617327 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:53.618133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:53.618582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:53.754350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:53.762655 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-80c114f4-30c4-48fa-b0bc-412ef2676ada tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.158886 Jun 16 19:38:53.763240 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3424/6733] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:53 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:54.780871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:54.781598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:54.789460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:54.789947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:54.790729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:54.791178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:54.929070 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:54.938455 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-72c9c2ae-df1e-410f-b402-0d91009c5104 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.162106 Jun 16 19:38:54.939050 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3310/6734] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:54 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:55.956220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:55.956847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:55.963782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:55.964243 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:55.965076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:55.965520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:56.099065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:56.107532 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-41e22671-3fef-463a-8224-76175e6a13ae tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.155164 Jun 16 19:38:56.108118 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3425/6735] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:55 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:57.125350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:57.126002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:57.133123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:57.133582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:57.134463 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:57.134917 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:57.349530 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:57.358160 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ad941781-bae0-45d2-94d7-24797a7ba0d8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.237375 Jun 16 19:38:57.358748 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3311/6736] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:57 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:38:58.375914 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:58.376547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:58.383518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:58.383988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:58.384764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:58.385218 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:58.524262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:58.532431 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f15c3e7f-8cd8-4940-9013-8dab34c244b7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.161500 Jun 16 19:38:58.533005 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3426/6737] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:58 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:38:59.549956 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:38:59.550616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:38:59.557772 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:59.558258 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:59.559020 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:38:59.559459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:38:59.689407 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:38:59.697054 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3258bfd1-ef76-4813-a4f8-f40f242f4e26 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.151035 Jun 16 19:38:59.697633 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3312/6738] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:38:59 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:00.714848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:00.715530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:00.722384 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:00.722857 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:00.723648 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:00.724107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:00.863264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:00.872347 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-706258ef-0377-45cd-9c6c-ef5ec1e9af4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.161192 Jun 16 19:39:00.872955 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3427/6739] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:00 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:01.890376 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:01.890998 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:01.897985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:01.898447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:01.899833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:01.900286 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:02.035431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:02.043788 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e5d0baa6-22cd-43ff-bb04-2c709dcc1ca7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.158266 Jun 16 19:39:02.044376 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3313/6740] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:01 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:03.063133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:03.063797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:03.070942 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:03.071415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:03.072269 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:03.072744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:03.207456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:03.215821 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1d628960-2ca6-42ca-b697-7a70557939f2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.156558 Jun 16 19:39:03.216397 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3428/6741] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:03 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:04.232807 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:04.233427 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:04.240542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:04.241002 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:04.241761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:04.242225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:04.384952 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:04.392787 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7c45cebc-b246-4c89-a9fb-96be1e0f1403 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.164896 Jun 16 19:39:04.393357 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3314/6742] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:04 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:05.409609 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:05.410271 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:05.417712 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:05.418213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:05.419006 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:05.419455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:05.558686 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:05.566393 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e740a5ee-1327-4c92-bb48-5aa49ddc4488 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.160629 Jun 16 19:39:05.566969 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3429/6743] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:05 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:06.584914 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:06.585711 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:06.593710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:06.594202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:06.594988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:06.595431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:06.736454 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:06.744445 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-48b5ca70-4fb3-4621-ab5f-949d5df6e42c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.163947 Jun 16 19:39:06.744956 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3315/6744] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:06 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:07.762509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:07.763141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:07.770126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:07.770595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:07.771373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:07.771826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:07.911245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:07.919740 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e805f23d-7dd5-4666-adaa-6a48264e51a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1678 microversion: 2.1 time: 0.161746 Jun 16 19:39:07.920316 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3430/6745] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:07 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:08.938385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:08.939007 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:08.946470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:08.946924 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:08.947713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:08.948170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:09.083606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:09.092255 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-06ae4dca-1baf-4e42-a954-e47261ac1c10 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1681 microversion: 2.1 time: 0.159262 Jun 16 19:39:09.092836 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3316/6746] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:08 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:35.280927 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b14e4106-64cb-4454-860f-d34512226075 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:39:35.281891 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b14e4106-64cb-4454-860f-d34512226075 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:35.284304 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:39:35.285104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:39:35.290874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b14e4106-64cb-4454-860f-d34512226075 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:35.291343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b14e4106-64cb-4454-860f-d34512226075 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:35.292133 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b14e4106-64cb-4454-860f-d34512226075 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:35.292592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b14e4106-64cb-4454-860f-d34512226075 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:35.351107 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b14e4106-64cb-4454-860f-d34512226075 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8/action" status: 200 len: 69081 microversion: 2.1 time: 0.074937 Jun 16 19:39:35.352087 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3431/6747] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:39:35 2022] POST /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8/action => generated 69081 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:39:42.433180 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:42.433707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:42.435328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e76cb1a6-7c98-4f4f-bad8-f23b270fe3e0 req-efe0b059-6ead-4c5d-8815-e7491a0a6521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9aa02c-e1de-4651-a280-e79a533aaac8", "tag": "d7bb559d-28ed-4143-86e4-7666098d88c7"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:39:42.437172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=16 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:39:42.438149 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=48 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:39:42.445422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:42.445733 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:42.446205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e76cb1a6-7c98-4f4f-bad8-f23b270fe3e0 req-efe0b059-6ead-4c5d-8815-e7491a0a6521 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:42.446655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:42.446859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e76cb1a6-7c98-4f4f-bad8-f23b270fe3e0 req-efe0b059-6ead-4c5d-8815-e7491a0a6521 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:42.447142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:42.460207 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e76cb1a6-7c98-4f4f-bad8-f23b270fe3e0 req-efe0b059-6ead-4c5d-8815-e7491a0a6521 service nova] Creating event network-changed:d7bb559d-28ed-4143-86e4-7666098d88c7 for instance be9aa02c-e1de-4651-a280-e79a533aaac8 on n-h1-846209-2 Jun 16 19:39:42.466103 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e76cb1a6-7c98-4f4f-bad8-f23b270fe3e0 req-efe0b059-6ead-4c5d-8815-e7491a0a6521 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034960 Jun 16 19:39:42.466998 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3432/6748] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:39:42.477982 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:39:42.575624 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-27a73b1d-84a2-4953-b8d7-d9416b2e2b4b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 204 len: 0 microversion: 2.1 time: 0.146846 Jun 16 19:39:42.578123 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3317/6749] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:39:42 2022] DELETE /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:39:42.587922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:42.588746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:42.595939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:42.596486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:42.597368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:42.598036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:42.749569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:42.757086 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b8eee84d-1e03-4bb0-9651-d4be08344fb3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1687 microversion: 2.1 time: 0.174073 Jun 16 19:39:42.757668 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3433/6750] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:42 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:43.776172 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:43.776888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:43.784826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:43.785282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:43.786076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:43.786519 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:43.927360 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:43.935172 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d798cb4b-b48a-4075-a983-a0d7ec18a211 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1687 microversion: 2.1 time: 0.163337 Jun 16 19:39:43.935750 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3318/6751] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:43 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:44.954079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:44.954716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:44.961860 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:44.962359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:44.963150 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:44.963592 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:45.225132 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-9159ac6d-3b2e-410d-b9ba-99260f38952f req-b05004ed-24c7-42a2-a407-4eded0b0425d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9aa02c-e1de-4651-a280-e79a533aaac8", "name": "network-vif-deleted", "tag": "d7bb559d-28ed-4143-86e4-7666098d88c7"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:39:45.225831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:45.235931 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a684221a-6f0a-4b60-abda-8bc3b8785843 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 200 len: 1568 microversion: 2.1 time: 0.285507 Jun 16 19:39:45.236353 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9159ac6d-3b2e-410d-b9ba-99260f38952f req-b05004ed-24c7-42a2-a407-4eded0b0425d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:45.236798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-9159ac6d-3b2e-410d-b9ba-99260f38952f req-b05004ed-24c7-42a2-a407-4eded0b0425d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:45.245929 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3434/6752] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:44 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 1568 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:45.251577 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-9159ac6d-3b2e-410d-b9ba-99260f38952f req-b05004ed-24c7-42a2-a407-4eded0b0425d service nova] Creating event network-vif-deleted:d7bb559d-28ed-4143-86e4-7666098d88c7 for instance be9aa02c-e1de-4651-a280-e79a533aaac8 on n-h1-846209-2 Jun 16 19:39:45.257202 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-9159ac6d-3b2e-410d-b9ba-99260f38952f req-b05004ed-24c7-42a2-a407-4eded0b0425d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036793 Jun 16 19:39:45.257837 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3319/6753] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:39:46.255087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:46.256059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: be9aa02c-e1de-4651-a280-e79a533aaac8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:46.263432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:46.263911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:46.264705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:46.265158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:46.278644 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] HTTP exception thrown: Instance be9aa02c-e1de-4651-a280-e79a533aaac8 could not be found. Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Request method failure captured: Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 HTTP/1.1 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4ZQ3-HcFTbJlryGqO81Si_D7lmY08a9-tZq53qjTz338x_1rjo0u3Y4RZlYQlrK1O5Gseag5h9aIUWT7irG8rKdevwcxTIlD-v6WZOvwjembOcpGQ7JgDOdGi6j5NTGAgeulVhkpo4vvlZ5fGkPcWY-vJRcrfu--lBnqKuJ3NGcolA Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_479a1e88e5dd499cb33e7e2ef2164511", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 6d70dfa781674fc9bcda4bee6edff40e Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance be9aa02c-e1de-4651-a280-e79a533aaac8 could not be found. Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'be9aa02c-e1de-4651-a280-e79a533aaac8'} Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9aa02c-e1de-4651-a280-e79a533aaac8 could not be found. Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9aa02c-e1de-4651-a280-e79a533aaac8 could not be found. Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:39:46.280388 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9aa02c-e1de-4651-a280-e79a533aaac8 could not be found. Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Returning 404 to user: Instance be9aa02c-e1de-4651-a280-e79a533aaac8 could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bf0032dd-fe29-463c-ad8b-e9d1321a7088 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8" status: 404 len: 111 microversion: 2.1 time: 0.030752 Jun 16 19:39:46.284665 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3435/6754] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:46 2022] GET /compute/v2.1/servers/be9aa02c-e1de-4651-a280-e79a533aaac8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:39:49.290651 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bc0475a6-eab3-4c4a-a065-05d7075fc2ff tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '.version_select at 0x7f866f150550>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:49.315148 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bc0475a6-eab3-4c4a-a065-05d7075fc2ff tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-833374305" status: 202 len: 0 microversion: 2.1 time: 0.028786 Jun 16 19:39:49.315693 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3320/6755] 10.222.0.27 () {58 vars in 1280 bytes} [Thu Jun 16 19:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-833374305 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:39:49.339591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e31b1e82-d208-4ce6-bc57-ed5630c32626 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: .version_select at 0x7f866c41cdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1741703526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwXXysrQEMmR42Q/QXgFANRkVMoePeOnSWDZDiC7X4JbDFS2B4CUXom6zRxLF6MzWnB74Q/1XZqdUIWgtmrOlrw/t2FcESCQ54IEmoBVh9zjf6wwDBOYKPwSFahWmqfJw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:39:49.358863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e31b1e82-d208-4ce6-bc57-ed5630c32626 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:39:49.364948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-e31b1e82-d208-4ce6-bc57-ed5630c32626 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:39:49.389324 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e31b1e82-d208-4ce6-bc57-ed5630c32626 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053595 Jun 16 19:39:49.394116 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3436/6756] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:39:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:39:55.275219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:39:55.280462 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-798171811", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "1ce11e7e-f3d4-4645-b33d-c059df588015"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1741703526", "security_groups": [{"name": "tempest-secgroup-smoke-1023931128"}]}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:39:55.409473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.network.neutron [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] validate_networks() for [('1ce11e7e-f3d4-4645-b33d-c059df588015', None, None, None, None, None)] {{(pid=119207) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:39:55.917527 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:39:55.918057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:39:55.918566 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:39:55.918911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:39:55.919342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:39:55.935217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:55.936703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:55.938318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:55.939212 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:55.974367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:39:55.980477 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:39:55.996630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Going to run 1 instances... {{(pid=119207) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:39:55.999997 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119207) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:39:56.049744 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5b254d2c-2c3e-4db6-8500-6a3c76bbbebc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.776323 Jun 16 19:39:56.056080 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3321/6757] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:39:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:39:56.063801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2125e76f-5977-4751-a813-e2df82d232c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:56.064438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2125e76f-5977-4751-a813-e2df82d232c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:56.145000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2125e76f-5977-4751-a813-e2df82d232c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:56.152642 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2125e76f-5977-4751-a813-e2df82d232c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1266 microversion: 2.1 time: 0.095392 Jun 16 19:39:56.162254 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3437/6758] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:56 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:57.174394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:57.175832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:57.184468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:57.185284 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:57.186971 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:57.192100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:57.385620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:57.397464 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-74377106-c42f-478c-8f2c-80c7dfe5f812 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1326 microversion: 2.1 time: 0.228517 Jun 16 19:39:57.398388 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3322/6759] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:57 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1326 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:58.416053 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:58.416685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:58.419017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=20 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:39:58.427740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:58.428209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:58.429182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:58.429985 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:58.646111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:58.655123 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c9383e04-3f6e-4206-8a34-3573c8ca98b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1392 microversion: 2.1 time: 0.243069 Jun 16 19:39:58.656827 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3438/6760] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:58 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:39:58.956626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-f48be4b8-17b2-4a8d-ab7e-d95f3ff76739 req-772fad50-9f5f-4eb2-927c-3e047a1af383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:39:58.985399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f48be4b8-17b2-4a8d-ab7e-d95f3ff76739 req-772fad50-9f5f-4eb2-927c-3e047a1af383 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:58.985842 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-f48be4b8-17b2-4a8d-ab7e-d95f3ff76739 req-772fad50-9f5f-4eb2-927c-3e047a1af383 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:59.015791 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-f48be4b8-17b2-4a8d-ab7e-d95f3ff76739 req-772fad50-9f5f-4eb2-927c-3e047a1af383 service nova] Creating event network-changed:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h1-846209-2 Jun 16 19:39:59.021225 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-f48be4b8-17b2-4a8d-ab7e-d95f3ff76739 req-772fad50-9f5f-4eb2-927c-3e047a1af383 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068918 Jun 16 19:39:59.021849 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3323/6761] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:39:59.673765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:39:59.674350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:39:59.681492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:59.682001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:59.682787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:39:59.683234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:39:59.820251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:39:59.828556 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6b3abab3-d01d-4faf-8120-005b85d2cbc5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1392 microversion: 2.1 time: 0.159855 Jun 16 19:39:59.829134 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3439/6762] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:39:59 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:00.846486 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:00.847329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:00.853619 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:00.854124 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:00.854927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:00.855367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:00.995140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:01.003159 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f0315605-ecbf-476b-9476-b9fcebc7face tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1392 microversion: 2.1 time: 0.162356 Jun 16 19:40:01.003750 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3324/6763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:00 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:02.020379 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:02.021018 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:02.028023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:02.028498 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:02.029341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:02.029796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:02.165432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:02.173450 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0d63cc1-d548-4d4e-ab0a-893b344ab14d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1392 microversion: 2.1 time: 0.157218 Jun 16 19:40:02.174046 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3440/6764] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:02 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:03.191229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:03.191907 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:03.199702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:03.200281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:03.201021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:03.201832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:03.238996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a09caa48-4e43-407a-8d65-e186c5892a14 req-d32a1366-ed88-43cc-bdbd-df2290abe7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "name": "network-vif-plugged", "status": "completed", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:40:03.252037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a09caa48-4e43-407a-8d65-e186c5892a14 req-d32a1366-ed88-43cc-bdbd-df2290abe7f1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:03.252814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a09caa48-4e43-407a-8d65-e186c5892a14 req-d32a1366-ed88-43cc-bdbd-df2290abe7f1 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:03.265807 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a09caa48-4e43-407a-8d65-e186c5892a14 req-d32a1366-ed88-43cc-bdbd-df2290abe7f1 service nova] Creating event network-vif-plugged:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h1-846209-2 Jun 16 19:40:03.271258 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a09caa48-4e43-407a-8d65-e186c5892a14 req-d32a1366-ed88-43cc-bdbd-df2290abe7f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036633 Jun 16 19:40:03.271887 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3441/6765] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:40:03.368933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:03.377018 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-49f83677-87f0-4af0-a8ec-78d81c104604 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1392 microversion: 2.1 time: 0.190045 Jun 16 19:40:03.377605 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3325/6766] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:03 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:04.395742 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:04.396501 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:04.402858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:04.403320 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:04.404138 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:04.404737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:04.547919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:04.555872 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fe024504-9a2f-4aa4-9126-afba1602e327 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1392 microversion: 2.1 time: 0.165184 Jun 16 19:40:04.556457 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3442/6767] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:04 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:05.574623 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:05.575266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:05.584855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:05.585514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:05.586396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:05.587188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:05.730347 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:05.739039 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-879c4b83-f409-4077-9010-6ad639ef2e0e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1565 microversion: 2.1 time: 0.168844 Jun 16 19:40:05.739643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3326/6768] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:05 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:05.756569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:05.757227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:05.760069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:05.766718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:05.767183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:05.767974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:05.768420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:05.912624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:05.920870 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4b6a973f-be41-405e-bccd-02fbc6ca8213 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1565 microversion: 2.1 time: 0.168130 Jun 16 19:40:05.921445 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3443/6769] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:05 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:07.559513 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:07.560250 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:07.562365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:07.563044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:07.563280 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b84cd604-8e1d-4b39-b2d8-0e26798c4007 req-f36f5148-dd5c-4261-8d34-0244da4c099f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:40:07.567382 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:07.574145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b84cd604-8e1d-4b39-b2d8-0e26798c4007 req-f36f5148-dd5c-4261-8d34-0244da4c099f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:07.574934 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b84cd604-8e1d-4b39-b2d8-0e26798c4007 req-f36f5148-dd5c-4261-8d34-0244da4c099f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:07.577386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:07.577858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:07.578863 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:07.579498 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:07.588180 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b84cd604-8e1d-4b39-b2d8-0e26798c4007 req-f36f5148-dd5c-4261-8d34-0244da4c099f service nova] Creating event network-changed:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h1-846209-2 Jun 16 19:40:07.595315 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b84cd604-8e1d-4b39-b2d8-0e26798c4007 req-f36f5148-dd5c-4261-8d34-0244da4c099f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036884 Jun 16 19:40:07.596193 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3444/6770] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:40:07.835632 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:07.852456 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9766f195-d572-44d0-8236-18e63d256519 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1565 microversion: 2.1 time: 0.296420 Jun 16 19:40:07.853564 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3327/6771] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:07 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1565 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:31.117000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:31.117829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=34 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:31.122010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-83f2b4db-765c-4e4f-bff3-231fc415d117 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:40:31.123532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-83f2b4db-765c-4e4f-bff3-231fc415d117 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:31.130655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83f2b4db-765c-4e4f-bff3-231fc415d117 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:31.131118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83f2b4db-765c-4e4f-bff3-231fc415d117 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:31.131895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83f2b4db-765c-4e4f-bff3-231fc415d117 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:31.132339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-83f2b4db-765c-4e4f-bff3-231fc415d117 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:31.189318 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-83f2b4db-765c-4e4f-bff3-231fc415d117 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action" status: 200 len: 24559 microversion: 2.1 time: 0.074044 Jun 16 19:40:31.189973 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3445/6772] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:40:31 2022] POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action => generated 24559 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:40:42.221432 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:40:42.223056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:42.225332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:42.226187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=34 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:42.232300 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:42.232748 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:42.233512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:42.233968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:42.276291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:42.282633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Old instance type m1.heat2, new instance type m1.heat {{(pid=119207) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 19:40:42.289592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:40:42.290079 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image limits 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:40:42.290562 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:40:42.290970 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image pref 0:0:0 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:40:42.291383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.virt.hardware [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119207) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:40:42.355838 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-63b8ee66-d4e7-491c-bae9-9bc90978bf9d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action" status: 202 len: 0 microversion: 2.1 time: 0.138328 Jun 16 19:40:42.356757 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3328/6773] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:40:42 2022] POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:40:42.365618 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:42.366362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:42.369549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:42.370653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:40:42.378111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:42.378669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:42.379546 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:42.380074 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:42.598777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:42.606728 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-663bcfd5-4c01-4d2b-8185-e8ff95c30f66 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1693 microversion: 2.1 time: 0.245461 Jun 16 19:40:42.608579 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3446/6774] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:42 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1693 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:43.626518 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:43.627045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:43.634305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:43.634769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:43.635538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:43.635984 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:43.823412 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:43.832036 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7a3bd453-223e-42ae-97b2-1739cccf21f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1693 microversion: 2.1 time: 0.210248 Jun 16 19:40:43.832577 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3329/6775] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:43 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:40:44.850480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:44.851012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:44.858785 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:44.859254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:44.860061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:44.860511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:44.993272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:45.001181 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ba97a500-30a8-4dcb-86b0-e7c45fefb53b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.155612 Jun 16 19:40:45.001754 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3447/6776] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:44 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:46.019703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:46.020330 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:46.027383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:46.027838 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:46.028608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:46.029084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:46.168294 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:46.175987 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f3071f7c-ce97-4a2d-a43c-a7491e16c47e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.160704 Jun 16 19:40:46.176820 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3330/6777] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:46 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:47.194550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:47.195175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:47.201670 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:47.202163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:47.202935 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:47.203409 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:47.335506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:47.343190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b4ed66f-eac9-4049-8d71-a27ed1aa2731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.153783 Jun 16 19:40:47.343763 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3448/6778] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:47 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:48.360643 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:48.361271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:48.369118 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:48.369710 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:48.370656 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:48.371005 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:48.510612 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:48.518254 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d73173cb-3121-42de-a605-526b72bf1cbc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.161527 Jun 16 19:40:48.519079 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3331/6779] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:48 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:40:49.536118 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:49.536740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:49.543684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:49.544145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:49.544918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:49.545368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:49.685366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:49.693020 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-329e2e7e-1bcb-4984-a1e1-eaf20e74d55e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.161378 Jun 16 19:40:49.693596 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3449/6780] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:49 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:50.710266 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:50.710933 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:50.717888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:50.718386 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:50.719169 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:50.719616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:50.851226 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:50.858863 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-53b5f229-8251-44aa-8037-952e43332aaf tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.152526 Jun 16 19:40:50.859422 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3332/6781] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:50 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:51.875634 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:51.876270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:51.884334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:51.884837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:51.885631 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:51.886123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:52.023637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:52.031636 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e91c6609-07a8-4670-b4f9-cea115376137 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.159935 Jun 16 19:40:52.032217 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3450/6782] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:51 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:53.048614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:53.049272 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:53.057219 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:53.057684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:53.058496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:53.058947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:53.199147 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:53.207046 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cf8544d4-fc1e-4a16-b2bd-5943a4bb6da3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.162344 Jun 16 19:40:53.207624 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3333/6783] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:53 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:54.224315 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:54.224948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:54.232134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:54.232606 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:54.233395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:54.233852 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:54.372078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:54.380462 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0190da48-47fd-47eb-9525-d415f8a60322 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.160449 Jun 16 19:40:54.381042 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3451/6784] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:54 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:55.398471 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:55.399094 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:55.406204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:55.406661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:55.407435 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:55.407878 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:55.546726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:55.555354 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b7535809-8c3b-465d-a540-1174e94f9236 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.160785 Jun 16 19:40:55.555951 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3334/6785] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:55 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:56.576745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:56.577368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:56.585330 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:56.585800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:56.586613 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:56.587069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:56.724217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:56.731790 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-28b6d7f1-8f56-439c-8679-668ee01f8814 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.158951 Jun 16 19:40:56.732354 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3452/6786] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:56 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:57.749344 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:57.750033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:57.757659 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:57.758137 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:57.758906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:57.759355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:57.891135 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:57.899250 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-810cf9ac-cbb7-4514-accd-13d0462c3988 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.153800 Jun 16 19:40:57.899849 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3335/6787] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:57 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:40:58.920445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:40:58.921082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:40:58.929523 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:58.930031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:58.930820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:40:58.931277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:40:59.063580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:40:59.071890 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-85f8e16e-99b2-4e25-bd38-cccfd386723e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.155330 Jun 16 19:40:59.072466 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3453/6788] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:40:58 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:00.089092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:00.089720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:00.096693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:00.097721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:00.099089 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:00.099538 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:00.234188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:00.243066 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2a273af7-2ff1-4906-a6f6-75a69182019d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.157966 Jun 16 19:41:00.243651 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3336/6789] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:00 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:41:01.260550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:01.261188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:01.268203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:01.268677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:01.269569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:01.270065 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:01.405220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:01.413540 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-54914131-e786-4ac1-bc1d-e40065a153ba tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1698 microversion: 2.1 time: 0.156893 Jun 16 19:41:01.414153 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3454/6790] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:01 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:02.110912 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-6423c904-0248-46f2-b543-9a7bda8064ef req-138762a9-e6d7-4a91-b48d-9ce90fa9b99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "name": "network-vif-unplugged", "status": "completed", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:02.123570 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6423c904-0248-46f2-b543-9a7bda8064ef req-138762a9-e6d7-4a91-b48d-9ce90fa9b99c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:02.124034 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-6423c904-0248-46f2-b543-9a7bda8064ef req-138762a9-e6d7-4a91-b48d-9ce90fa9b99c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:02.137181 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-6423c904-0248-46f2-b543-9a7bda8064ef req-138762a9-e6d7-4a91-b48d-9ce90fa9b99c service nova] Creating event network-vif-unplugged:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h2-846209-2 Jun 16 19:41:02.142607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [req-6423c904-0248-46f2-b543-9a7bda8064ef req-138762a9-e6d7-4a91-b48d-9ce90fa9b99c service nova] Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119207) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:41:02.154172 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-6423c904-0248-46f2-b543-9a7bda8064ef req-138762a9-e6d7-4a91-b48d-9ce90fa9b99c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047296 Jun 16 19:41:02.154790 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3337/6791] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:02.432402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:02.433504 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:02.439768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:02.440389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:02.441183 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:02.441864 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:02.591368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:02.600316 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8d2fca8a-6e81-43aa-bf4b-4cb1fb7657c2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1697 microversion: 2.1 time: 0.172747 Jun 16 19:41:02.600911 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3455/6792] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:02 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:41:03.620446 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:03.621071 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:03.627458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:03.627932 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:03.629588 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:03.630084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:03.764481 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:03.772793 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-50592a11-953c-4e28-8c1a-d08225ebc7b1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1695 microversion: 2.1 time: 0.157788 Jun 16 19:41:03.773371 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3338/6793] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:03 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:04.175548 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-ab250d3a-7593-4645-9712-3b8d1ec2d5a1 req-e03cedc6-cc66-4bc9-84ba-598161c42298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:04.184727 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ab250d3a-7593-4645-9712-3b8d1ec2d5a1 req-e03cedc6-cc66-4bc9-84ba-598161c42298 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:04.185193 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-ab250d3a-7593-4645-9712-3b8d1ec2d5a1 req-e03cedc6-cc66-4bc9-84ba-598161c42298 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:04.196727 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-ab250d3a-7593-4645-9712-3b8d1ec2d5a1 req-e03cedc6-cc66-4bc9-84ba-598161c42298 service nova] Creating event network-changed:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h2-846209-2 Jun 16 19:41:04.202215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [req-ab250d3a-7593-4645-9712-3b8d1ec2d5a1 req-e03cedc6-cc66-4bc9-84ba-598161c42298 service nova] Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846209-2', 'n-h2-846209-2'} {{(pid=119206) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 19:41:04.214051 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-ab250d3a-7593-4645-9712-3b8d1ec2d5a1 req-e03cedc6-cc66-4bc9-84ba-598161c42298 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042337 Jun 16 19:41:04.214682 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3456/6794] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:04.791210 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:04.791983 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:04.801031 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:04.801754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:04.802730 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:04.803187 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:05.039701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:05.049437 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c6a19cdc-a74c-47f9-8d47-39566194aff9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1695 microversion: 2.1 time: 0.262155 Jun 16 19:41:05.060647 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3339/6795] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:04 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1695 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:06.069195 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:06.069938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:06.076164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.076632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.077410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.077862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.212450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:06.220006 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fca4c2d1-05b4-43f1-9bf8-256868764557 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1692 microversion: 2.1 time: 0.156156 Jun 16 19:41:06.220578 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3457/6796] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:06 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:06.237153 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-7cbcd7ca-2529-4e1c-a364-3b8f5b502865 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:06.238448 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-7cbcd7ca-2529-4e1c-a364-3b8f5b502865 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:06.245506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cbcd7ca-2529-4e1c-a364-3b8f5b502865 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.245899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cbcd7ca-2529-4e1c-a364-3b8f5b502865 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.246690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cbcd7ca-2529-4e1c-a364-3b8f5b502865 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.247156 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-7cbcd7ca-2529-4e1c-a364-3b8f5b502865 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.306127 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-7cbcd7ca-2529-4e1c-a364-3b8f5b502865 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action" status: 204 len: 0 microversion: 2.1 time: 0.072630 Jun 16 19:41:06.307053 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3340/6797] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:41:06 2022] POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:41:06.315046 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:06.315787 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:06.322248 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.322979 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.323790 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.324239 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.538949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:06.546733 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f383e205-ad74-46b1-90a8-3a7175c6468a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1692 microversion: 2.1 time: 0.235482 Jun 16 19:41:06.547659 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3458/6798] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:06 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1692 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:41:06.564292 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:06.565015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:06.571532 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.571994 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.572783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:06.573231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:06.802995 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:06.810839 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3cd64c0d-c995-4a26-8c83-a2c89ae0ec28 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1692 microversion: 2.1 time: 0.250878 Jun 16 19:41:06.811427 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3341/6799] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:06 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1692 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:07.766643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-67fa3a40-f76b-43db-b693-ac8248586ce4 req-68b80e25-26d8-4a73-ab09-c8a52b8eb8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "name": "network-vif-plugged", "status": "completed", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:07.778831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67fa3a40-f76b-43db-b693-ac8248586ce4 req-68b80e25-26d8-4a73-ab09-c8a52b8eb8b7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:07.779849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-67fa3a40-f76b-43db-b693-ac8248586ce4 req-68b80e25-26d8-4a73-ab09-c8a52b8eb8b7 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:07.794934 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-67fa3a40-f76b-43db-b693-ac8248586ce4 req-68b80e25-26d8-4a73-ab09-c8a52b8eb8b7 service nova] Creating event network-vif-plugged:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h2-846209-2 Jun 16 19:41:07.802297 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-67fa3a40-f76b-43db-b693-ac8248586ce4 req-68b80e25-26d8-4a73-ab09-c8a52b8eb8b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040118 Jun 16 19:41:07.803506 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3459/6800] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:07.831739 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:07.833653 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:07.842345 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:07.843421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:07.844391 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:07.844993 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:07.869265 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:08.014437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:08.023160 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d5c8e7f4-7273-4a63-945d-be0d4732f438 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1684 microversion: 2.1 time: 0.198366 Jun 16 19:41:08.023736 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3342/6801] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:07 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1684 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:30.203644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=28 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:30.204410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=78 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:30.209391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-403a260b-ce5c-4632-9fa9-a9270524c0a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:30.210478 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-403a260b-ce5c-4632-9fa9-a9270524c0a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:30.217536 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-403a260b-ce5c-4632-9fa9-a9270524c0a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:30.218050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-403a260b-ce5c-4632-9fa9-a9270524c0a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:30.218830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-403a260b-ce5c-4632-9fa9-a9270524c0a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:30.219288 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-403a260b-ce5c-4632-9fa9-a9270524c0a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:30.270900 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-403a260b-ce5c-4632-9fa9-a9270524c0a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action" status: 200 len: 24574 microversion: 2.1 time: 0.069081 Jun 16 19:41:30.271537 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3460/6802] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:41:30 2022] POST /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95/action => generated 24574 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:41:37.360259 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:37.360843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:37.363382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=34 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:37.369673 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:37.376621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:37.377222 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:37.378217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:37.379732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:37.407167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Going to try to terminate instance {{(pid=119207) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:41:37.438791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f4d23a71-2c96-40ee-b94a-dc278397a0e6 req-efa384f4-03ea-4c30-9947-63451dd150ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:37.450522 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f4d23a71-2c96-40ee-b94a-dc278397a0e6 req-efa384f4-03ea-4c30-9947-63451dd150ad service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:37.450988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f4d23a71-2c96-40ee-b94a-dc278397a0e6 req-efa384f4-03ea-4c30-9947-63451dd150ad service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:37.465369 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f4d23a71-2c96-40ee-b94a-dc278397a0e6 req-efa384f4-03ea-4c30-9947-63451dd150ad service nova] Creating event network-changed:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h2-846209-2 Jun 16 19:41:37.471694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f4d23a71-2c96-40ee-b94a-dc278397a0e6 req-efa384f4-03ea-4c30-9947-63451dd150ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112900 Jun 16 19:41:37.472656 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3461/6803] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:37.505233 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a4019be-1556-49b8-97fa-68ab51375fde tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 204 len: 0 microversion: 2.1 time: 0.147396 Jun 16 19:41:37.506319 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3343/6804] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:41:37 2022] DELETE /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:41:37.517092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:37.517856 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:37.525249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:37.525715 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:37.526570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:37.527030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:37.669443 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:37.677759 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c19524b5-4c20-480b-b089-3223c7736ef3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1690 microversion: 2.1 time: 0.166404 Jun 16 19:41:37.678372 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3462/6805] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:37 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:38.695821 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:38.696524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:38.703141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:38.703591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:38.704355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:38.704788 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:38.843175 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:38.851648 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9304240c-ca4c-4349-802b-123f7ddcb73b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 200 len: 1690 microversion: 2.1 time: 0.159986 Jun 16 19:41:38.852254 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3344/6806] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:38 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:39.533994 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9bd94e29-dcb1-4f7c-a5fa-c3cb8294740e req-d8220e58-ccaa-4fd5-b724-5ab6d89782d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9309dd-eccc-4b2f-bd4c-0812cfeefa95", "name": "network-vif-deleted", "tag": "6894d212-c344-4907-acbd-db7d6ee8657a"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:39.542251 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9bd94e29-dcb1-4f7c-a5fa-c3cb8294740e req-d8220e58-ccaa-4fd5-b724-5ab6d89782d4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:39.542743 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9bd94e29-dcb1-4f7c-a5fa-c3cb8294740e req-d8220e58-ccaa-4fd5-b724-5ab6d89782d4 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:39.557058 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9bd94e29-dcb1-4f7c-a5fa-c3cb8294740e req-d8220e58-ccaa-4fd5-b724-5ab6d89782d4 service nova] Creating event network-vif-deleted:6894d212-c344-4907-acbd-db7d6ee8657a for instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 on n-h2-846209-2 Jun 16 19:41:39.562450 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9bd94e29-dcb1-4f7c-a5fa-c3cb8294740e req-d8220e58-ccaa-4fd5-b724-5ab6d89782d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094021 Jun 16 19:41:39.563069 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3463/6807] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:39.869368 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:39.870225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:39.877582 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:39.878160 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:39.879843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:39.880319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:39.894649 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] HTTP exception thrown: Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 could not be found. Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Request method failure captured: Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 HTTP/1.1 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4ZQ3-HcFTbJlryGqO81Si_D7lmY08a9-tZq53qjTz338x_1rjo0u3Y4RZlYQlrK1O5Gseag5h9aIUWT7irG8rKdevwcxTIlD-v6WZOvwjembOcpGQ7JgDOdGi6j5NTGAgeulVhkpo4vvlZ5fGkPcWY-vJRcrfu--lBnqKuJ3NGcolA Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_479a1e88e5dd499cb33e7e2ef2164511", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6d70dfa781674fc9bcda4bee6edff40e Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 could not be found. Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '0b9309dd-eccc-4b2f-bd4c-0812cfeefa95'} Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 could not be found. Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 could not be found. Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:41:39.896452 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 could not be found. Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Returning 404 to user: Instance 0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6fbab717-9e3a-49cb-97dc-068d5886e976 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95" status: 404 len: 111 microversion: 2.1 time: 0.032490 Jun 16 19:41:39.900642 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3345/6808] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:39 2022] GET /compute/v2.1/servers/0b9309dd-eccc-4b2f-bd4c-0812cfeefa95 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:41:42.921550 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d78c0f41-70b7-4535-a18b-9a1e51e1a985 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '.version_select at 0x7f866deac940>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:42.947502 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d78c0f41-70b7-4535-a18b-9a1e51e1a985 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1741703526" status: 202 len: 0 microversion: 2.1 time: 0.030459 Jun 16 19:41:42.949263 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3464/6809] 10.222.0.27 () {58 vars in 1283 bytes} [Thu Jun 16 19:41:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1741703526 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:41:42.975846 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f1f7441e-61d2-4474-be89-9037e03a9757 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: .version_select at 0x7f866df80820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2124249039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ZEC0R0I/jK4Etaac7Cv6AWDpwalx9de47HxeMHpBcDuuKVbf7I97iAvii63E9V1UZmsEUextpsiGvUeMN0liX9km0vkidznXPQptNTElWH2CJimBrFCg4DBCtbVESew=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:42.991813 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f1f7441e-61d2-4474-be89-9037e03a9757 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:41:43.000564 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-f1f7441e-61d2-4474-be89-9037e03a9757 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:41:43.031204 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f1f7441e-61d2-4474-be89-9037e03a9757 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059778 Jun 16 19:41:43.039899 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3346/6810] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:41:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:48.606543 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1138152499", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "bf6a7622-320e-48bf-81df-341f76764e01"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2124249039", "security_groups": [{"name": "tempest-secgroup-smoke-863262301"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:49.083209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] validate_networks() for [('bf6a7622-320e-48bf-81df-341f76764e01', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:41:49.548050 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=14 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:49.556814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:41:49.557441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:41:49.558012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:41:49.558438 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:41:49.558865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:41:49.568560 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:49.569024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:49.570047 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:49.570505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:49.589036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:41:49.594744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:41:49.610066 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:41:49.612530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:41:49.658043 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [1f6630a6-ae38-4c1e-9e41-30073d0003c2] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:41:50.667753 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [1f6630a6-ae38-4c1e-9e41-30073d0003c2] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40936. Jun 16 19:41:50.672875 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2769d871-090e-4a37-a3af-5df3baf317cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.071363 Jun 16 19:41:50.680463 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3465/6811] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:41:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:41:50.687252 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:50.756720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-01b3cfb6-18db-45b0-bdb2-871bcbe65bfd tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:50.757557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-01b3cfb6-18db-45b0-bdb2-871bcbe65bfd tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:50.823394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01b3cfb6-18db-45b0-bdb2-871bcbe65bfd tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:50.830842 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-01b3cfb6-18db-45b0-bdb2-871bcbe65bfd tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1267 microversion: 2.1 time: 0.149564 Jun 16 19:41:50.831603 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3347/6812] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:50 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:41:51.849745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:51.851037 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:51.857858 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:51.858938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:51.860106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:51.861080 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:51.945339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:51.954273 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e1d1487a-86de-42b7-969a-97be96adeae3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1337 microversion: 2.1 time: 0.109674 Jun 16 19:41:51.955053 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3466/6813] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:51 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:52.972522 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:52.973420 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:52.981605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:52.982189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:52.983044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:52.983497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:53.251188 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:53.259956 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-063d8c8f-a0cf-4fc7-bef6-c1ecff8830c9 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1392 microversion: 2.1 time: 0.292048 Jun 16 19:41:53.260538 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3348/6814] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:52 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:53.627134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-28bbb0d8-2296-49b3-a373-82f99c13496c req-f075162c-eb12-4d3c-9304-15daf32add72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed032364-e610-41b3-a050-b600d718c5e8", "tag": "8f427b2a-0e78-41b4-b263-845b0f0977c1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:53.637189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-28bbb0d8-2296-49b3-a373-82f99c13496c req-f075162c-eb12-4d3c-9304-15daf32add72 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:53.637973 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-28bbb0d8-2296-49b3-a373-82f99c13496c req-f075162c-eb12-4d3c-9304-15daf32add72 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:53.665274 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-28bbb0d8-2296-49b3-a373-82f99c13496c req-f075162c-eb12-4d3c-9304-15daf32add72 service nova] Creating event network-changed:8f427b2a-0e78-41b4-b263-845b0f0977c1 for instance ed032364-e610-41b3-a050-b600d718c5e8 on n-h1-846209-2 Jun 16 19:41:53.671747 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-28bbb0d8-2296-49b3-a373-82f99c13496c req-f075162c-eb12-4d3c-9304-15daf32add72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048705 Jun 16 19:41:53.673026 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3467/6815] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:54.276721 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:54.277377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:54.285074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:54.285497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:54.286302 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:54.286755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:54.422958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:54.431688 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ed289f36-24f6-46fe-931f-29f2da489423 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1392 microversion: 2.1 time: 0.158889 Jun 16 19:41:54.432506 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3349/6816] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:54 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:55.450448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:55.451827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:55.459044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:55.459647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:55.460455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:55.460947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:55.675732 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:55.684893 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1a8a06a-faf3-4415-883e-f55cfcdf8983 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1392 microversion: 2.1 time: 0.239707 Jun 16 19:41:55.685480 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3468/6817] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:55 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:56.701860 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:56.702455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:56.710829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:56.711289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:56.712077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:56.712526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:56.849727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:56.857486 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-79707d8b-bff6-4d38-bc48-6194ebeb80fe tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1392 microversion: 2.1 time: 0.159687 Jun 16 19:41:56.858082 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3350/6818] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:56 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:57.874818 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:57.875444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:57.882471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:57.882881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:57.883706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:57.884166 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:57.900515 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-c3e19ceb-1836-4462-ab6e-153cd5a91f79 req-b4c2fe55-1c9e-448e-b73c-24d428b0acf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed032364-e610-41b3-a050-b600d718c5e8", "name": "network-vif-plugged", "status": "completed", "tag": "8f427b2a-0e78-41b4-b263-845b0f0977c1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:41:57.911093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c3e19ceb-1836-4462-ab6e-153cd5a91f79 req-b4c2fe55-1c9e-448e-b73c-24d428b0acf6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:57.912129 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-c3e19ceb-1836-4462-ab6e-153cd5a91f79 req-b4c2fe55-1c9e-448e-b73c-24d428b0acf6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:57.925880 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-c3e19ceb-1836-4462-ab6e-153cd5a91f79 req-b4c2fe55-1c9e-448e-b73c-24d428b0acf6 service nova] Creating event network-vif-plugged:8f427b2a-0e78-41b4-b263-845b0f0977c1 for instance ed032364-e610-41b3-a050-b600d718c5e8 on n-h1-846209-2 Jun 16 19:41:57.931546 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-c3e19ceb-1836-4462-ab6e-153cd5a91f79 req-b4c2fe55-1c9e-448e-b73c-24d428b0acf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035994 Jun 16 19:41:57.932321 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3351/6819] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:41:58.063705 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:58.072237 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3086dbb4-7fef-4129-b5c1-d0c6183bf932 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1392 microversion: 2.1 time: 0.201570 Jun 16 19:41:58.072804 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3469/6820] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:57 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:59.090503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:59.091215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:41:59.099458 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:59.099919 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:59.100701 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:59.101146 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:59.243667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:41:59.251389 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1a876e4a-1a03-487f-b851-cb37e4b086ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1392 microversion: 2.1 time: 0.165355 Jun 16 19:41:59.251963 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3352/6821] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:41:59 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:00.267876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:00.268518 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:00.271496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:00.272316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:00.272930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:00.279143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:00.279652 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:00.280485 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:00.280996 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:00.423001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:00.430907 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c1ca34fd-7d81-458c-b2c8-c9b21f4b76ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1564 microversion: 2.1 time: 0.167057 Jun 16 19:42:00.431479 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3470/6822] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:00 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:00.447384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:00.448044 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:00.455243 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:00.455703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:00.457062 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:00.457503 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:00.589362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:00.597994 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cc1146f0-91eb-4f3a-afb3-dbb17e1e508a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1564 microversion: 2.1 time: 0.154451 Jun 16 19:42:00.598584 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3353/6823] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:00 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:02.271145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:02.271793 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:02.279133 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0793e341-cd14-4539-be4c-d884e0a6573e req-4c9ec23e-d1ed-42c9-a360-625949022385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed032364-e610-41b3-a050-b600d718c5e8", "tag": "8f427b2a-0e78-41b4-b263-845b0f0977c1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:42:02.282872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:02.291435 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:02.291907 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:02.292606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0793e341-cd14-4539-be4c-d884e0a6573e req-4c9ec23e-d1ed-42c9-a360-625949022385 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:02.292869 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:02.293074 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0793e341-cd14-4539-be4c-d884e0a6573e req-4c9ec23e-d1ed-42c9-a360-625949022385 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:02.293492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:02.309033 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0793e341-cd14-4539-be4c-d884e0a6573e req-4c9ec23e-d1ed-42c9-a360-625949022385 service nova] Creating event network-changed:8f427b2a-0e78-41b4-b263-845b0f0977c1 for instance ed032364-e610-41b3-a050-b600d718c5e8 on n-h1-846209-2 Jun 16 19:42:02.314315 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0793e341-cd14-4539-be4c-d884e0a6573e req-4c9ec23e-d1ed-42c9-a360-625949022385 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039030 Jun 16 19:42:02.315164 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3354/6824] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:42:02.535986 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:02.544241 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a9d2cbf-4304-4867-a393-54e8a3461476 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1564 microversion: 2.1 time: 0.277136 Jun 16 19:42:02.545066 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3471/6825] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:02 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1564 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:25.796726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4ad2a425-0967-4171-8172-cd47793fe69d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:42:25.797752 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4ad2a425-0967-4171-8172-cd47793fe69d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:25.800705 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:25.801557 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=34 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:25.809460 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad2a425-0967-4171-8172-cd47793fe69d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:25.809944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad2a425-0967-4171-8172-cd47793fe69d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:25.810743 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad2a425-0967-4171-8172-cd47793fe69d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:25.811184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4ad2a425-0967-4171-8172-cd47793fe69d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:25.862022 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4ad2a425-0967-4171-8172-cd47793fe69d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action" status: 200 len: 24564 microversion: 2.1 time: 0.069388 Jun 16 19:42:25.862714 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3355/6826] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:42:25 2022] POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action => generated 24564 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:42:32.300768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-94bc3d57-0b45-44ce-b3b8-e3299afbd331 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:42:32.304300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:32.304969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=34 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:42:32.311273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94bc3d57-0b45-44ce-b3b8-e3299afbd331 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:32.311740 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-94bc3d57-0b45-44ce-b3b8-e3299afbd331 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:32.335001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-94bc3d57-0b45-44ce-b3b8-e3299afbd331 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Going to try to stop instance {{(pid=119206) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 19:42:32.380579 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-94bc3d57-0b45-44ce-b3b8-e3299afbd331 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action" status: 202 len: 0 microversion: 2.1 time: 0.083697 Jun 16 19:42:32.381199 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3472/6827] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:42:32 2022] POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:42:32.390064 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:32.390826 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:32.398936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:32.399398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:32.400191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:32.400628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:32.535965 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:32.543627 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5f1db1ba-5325-49f3-ba28-81884740e0a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.157986 Jun 16 19:42:32.544198 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3356/6828] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:32 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:33.563559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:33.564287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:33.572124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:33.572595 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:33.573386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:33.573843 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:33.713145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:33.720949 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a3ee3546-72e2-496f-b04d-63de4490977c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.162890 Jun 16 19:42:33.721520 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3473/6829] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:33 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:34.738271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:34.738947 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:34.746056 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:34.746517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:34.747296 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:34.747745 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:34.878616 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:34.887169 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-edfd119e-4f97-48fa-9f23-742bad001f1d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.152939 Jun 16 19:42:34.887735 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3357/6830] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:34 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:35.905249 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:35.905865 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:35.913998 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:35.914476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:35.915260 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:35.915716 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:36.049486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:36.057976 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ea0e63cb-58a0-4439-82bd-4ffdbae9f9c1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.156598 Jun 16 19:42:36.058554 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3474/6831] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:35 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:37.074913 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:37.075537 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:37.082618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:37.083015 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:37.083783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:37.084214 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:37.226992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:37.234760 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2bde9db8-6cd5-4598-8410-e98716a82731 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.163762 Jun 16 19:42:37.235338 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3358/6832] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:37 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:38.252598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:38.253226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:38.260750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:38.261224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:38.262030 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:38.262492 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:38.397101 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:38.405126 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3ce0e2eb-808c-4a15-839b-71a3c9e7bb40 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.156470 Jun 16 19:42:38.405711 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3475/6833] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:38 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:39.422679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:39.423305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:39.430633 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:39.431093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:39.431868 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:39.432319 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:39.567467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:39.575082 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-82751bdf-be82-4abd-af29-c93c8c2274d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.156413 Jun 16 19:42:39.575657 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3359/6834] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:39 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:40.592349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:40.592989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:40.601317 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:40.601796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:40.602638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:40.603090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:40.744903 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:40.752730 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d82e900d-60b5-43e7-8e93-a3fd4f6a52a1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.164359 Jun 16 19:42:40.753303 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3476/6835] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:40 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:41.771575 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:41.772398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:41.779317 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:41.779783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:41.780576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:41.781033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:41.919524 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:41.928927 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-83b40c0f-f9ce-43cc-98a3-38c0c2ecd781 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1693 microversion: 2.1 time: 0.160928 Jun 16 19:42:41.928927 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3360/6836] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:41 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:42.945395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:42.946178 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:42.953246 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:42.953780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:42.954707 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:42.955349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:43.089995 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:43.097540 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-069810c1-90b0-45b3-8827-3df8633921f8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1670 microversion: 2.1 time: 0.156113 Jun 16 19:42:43.098267 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3477/6837] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:42 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:44.185092 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f549d825-02c8-43bc-b9eb-02428126c3a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:42:44.186141 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f549d825-02c8-43bc-b9eb-02428126c3a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:44.193377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f549d825-02c8-43bc-b9eb-02428126c3a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:44.193835 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f549d825-02c8-43bc-b9eb-02428126c3a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:44.194636 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f549d825-02c8-43bc-b9eb-02428126c3a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:44.195078 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f549d825-02c8-43bc-b9eb-02428126c3a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:44.249599 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f549d825-02c8-43bc-b9eb-02428126c3a7 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action" status: 200 len: 35225 microversion: 2.1 time: 0.068238 Jun 16 19:42:44.250380 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3361/6838] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:42:44 2022] POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action => generated 35225 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:42:44.261559 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fecb07f8-208e-4da4-b4fe-a2a662be5280 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:42:44.268467 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fecb07f8-208e-4da4-b4fe-a2a662be5280 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:44.268928 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fecb07f8-208e-4da4-b4fe-a2a662be5280 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:44.291789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fecb07f8-208e-4da4-b4fe-a2a662be5280 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Going to try to start instance {{(pid=119206) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 19:42:44.334502 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fecb07f8-208e-4da4-b4fe-a2a662be5280 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action" status: 202 len: 0 microversion: 2.1 time: 0.076555 Jun 16 19:42:44.335108 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3478/6839] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:42:44 2022] POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:42:44.343812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:44.344630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:44.352512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:44.352992 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:44.353809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:44.354422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:44.534622 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:44.543672 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-394b3e23-9391-446e-87fb-4e3c5d66b8b3 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1679 microversion: 2.1 time: 0.203933 Jun 16 19:42:44.544259 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3362/6840] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:44 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:42:45.562515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:42:45.563173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:42:45.569964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:45.570444 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:45.571232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:45.571694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:45.706252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:42:45.714108 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-457624b9-a53d-4ee6-ad08-c2b0c67886a2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1683 microversion: 2.1 time: 0.156892 Jun 16 19:42:45.714674 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3479/6841] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:42:45 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:11.909573 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-64687f5f-fd9e-4424-8c9d-14120ec279a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:11.910587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-64687f5f-fd9e-4424-8c9d-14120ec279a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:11.914021 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=16 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:11.914697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=44 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:11.920620 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64687f5f-fd9e-4424-8c9d-14120ec279a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:11.921084 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64687f5f-fd9e-4424-8c9d-14120ec279a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:11.921871 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64687f5f-fd9e-4424-8c9d-14120ec279a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:11.922373 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-64687f5f-fd9e-4424-8c9d-14120ec279a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:11.979122 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-64687f5f-fd9e-4424-8c9d-14120ec279a8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action" status: 200 len: 59783 microversion: 2.1 time: 0.073482 Jun 16 19:43:11.979816 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3363/6842] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:43:11 2022] POST /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8/action => generated 59783 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:43:19.050481 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:19.051004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:19.054603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4a82c00a-2d8d-45cc-9c2d-e20133a41f93 req-a871b2bf-bd6c-49a1-87a3-738630a912fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed032364-e610-41b3-a050-b600d718c5e8", "tag": "8f427b2a-0e78-41b4-b263-845b0f0977c1"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:19.067188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=16 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:19.067188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:19.067188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:19.067188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:19.067188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:19.067188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:19.067944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4a82c00a-2d8d-45cc-9c2d-e20133a41f93 req-a871b2bf-bd6c-49a1-87a3-738630a912fb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:19.067944 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4a82c00a-2d8d-45cc-9c2d-e20133a41f93 req-a871b2bf-bd6c-49a1-87a3-738630a912fb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:19.081967 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4a82c00a-2d8d-45cc-9c2d-e20133a41f93 req-a871b2bf-bd6c-49a1-87a3-738630a912fb service nova] Creating event network-changed:8f427b2a-0e78-41b4-b263-845b0f0977c1 for instance ed032364-e610-41b3-a050-b600d718c5e8 on n-h1-846209-2 Jun 16 19:43:19.087321 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4a82c00a-2d8d-45cc-9c2d-e20133a41f93 req-a871b2bf-bd6c-49a1-87a3-738630a912fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037997 Jun 16 19:43:19.088206 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3364/6843] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:19.114176 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:43:19.200266 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-74d59133-6ec3-4371-be6d-1d46a744fef8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 204 len: 0 microversion: 2.1 time: 0.153602 Jun 16 19:43:19.200802 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3480/6844] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:43:19 2022] DELETE /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:43:19.210329 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:19.211085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:19.217531 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:19.218004 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:19.218830 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:19.219275 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:19.358577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:19.369575 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-87347d4d-c3e0-4822-a9de-4860bae336ac tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1689 microversion: 2.1 time: 0.162738 Jun 16 19:43:19.369575 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3365/6845] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:19 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:20.385878 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:20.386639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:20.393515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:20.394067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:20.394862 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:20.395321 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:20.533161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:20.541215 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-780ad88b-7c36-4ed6-a0f7-c8154d7d43cc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1689 microversion: 2.1 time: 0.160203 Jun 16 19:43:20.541793 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3481/6846] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:20 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:21.559411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:21.560023 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:21.566882 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:21.567340 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:21.568110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:21.568576 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:21.845112 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:21.853896 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e9f1abab-3684-4e20-998c-8c33e63523b2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 200 len: 1689 microversion: 2.1 time: 0.298639 Jun 16 19:43:21.854794 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3366/6847] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:21 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 1689 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:21.995407 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-e153eeb9-7901-42eb-872c-8c276e14609b req-4fc6ec6a-abea-44d2-8a12-910e4bee5ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed032364-e610-41b3-a050-b600d718c5e8", "name": "network-vif-deleted", "tag": "8f427b2a-0e78-41b4-b263-845b0f0977c1"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:22.005825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e153eeb9-7901-42eb-872c-8c276e14609b req-4fc6ec6a-abea-44d2-8a12-910e4bee5ca6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:22.007090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-e153eeb9-7901-42eb-872c-8c276e14609b req-4fc6ec6a-abea-44d2-8a12-910e4bee5ca6 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:22.019011 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-e153eeb9-7901-42eb-872c-8c276e14609b req-4fc6ec6a-abea-44d2-8a12-910e4bee5ca6 service nova] Creating event network-vif-deleted:8f427b2a-0e78-41b4-b263-845b0f0977c1 for instance ed032364-e610-41b3-a050-b600d718c5e8 on n-h1-846209-2 Jun 16 19:43:22.026217 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-e153eeb9-7901-42eb-872c-8c276e14609b req-4fc6ec6a-abea-44d2-8a12-910e4bee5ca6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 Jun 16 19:43:22.026924 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3482/6848] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:22.870734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:22.871396 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: ed032364-e610-41b3-a050-b600d718c5e8] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:22.878587 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:22.879057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:22.879839 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:22.880289 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:22.894048 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] HTTP exception thrown: Instance ed032364-e610-41b3-a050-b600d718c5e8 could not be found. Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Request method failure captured: Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 HTTP/1.1 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4ZQ3-HcFTbJlryGqO81Si_D7lmY08a9-tZq53qjTz338x_1rjo0u3Y4RZlYQlrK1O5Gseag5h9aIUWT7irG8rKdevwcxTIlD-v6WZOvwjembOcpGQ7JgDOdGi6j5NTGAgeulVhkpo4vvlZ5fGkPcWY-vJRcrfu--lBnqKuJ3NGcolA Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_479a1e88e5dd499cb33e7e2ef2164511", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6d70dfa781674fc9bcda4bee6edff40e Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance ed032364-e610-41b3-a050-b600d718c5e8 could not be found. Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': 'ed032364-e610-41b3-a050-b600d718c5e8'} Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed032364-e610-41b3-a050-b600d718c5e8 could not be found. Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed032364-e610-41b3-a050-b600d718c5e8 could not be found. Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:22.895678 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed032364-e610-41b3-a050-b600d718c5e8 could not be found. Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Returning 404 to user: Instance ed032364-e610-41b3-a050-b600d718c5e8 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-39109c0a-074e-40c6-bbe6-882cf6436774 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8" status: 404 len: 111 microversion: 2.1 time: 0.030627 Jun 16 19:43:22.900649 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3367/6849] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:22 2022] GET /compute/v2.1/servers/ed032364-e610-41b3-a050-b600d718c5e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:43:26.196660 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2651a697-49cb-4907-8e40-8aa25284713d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '.version_select at 0x7f866e11fee0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:26.221629 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2651a697-49cb-4907-8e40-8aa25284713d tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2124249039" status: 202 len: 0 microversion: 2.1 time: 0.030484 Jun 16 19:43:26.222206 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3483/6850] 10.222.0.27 () {58 vars in 1283 bytes} [Thu Jun 16 19:43:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2124249039 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:43:26.250419 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f82b609-2add-48f1-806c-a360dd18c2a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: .version_select at 0x7f866e1bf9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1729476465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGrNgkHA8tfyDIc4y0atHV2SZ5Fn/g/NlRig+amK6GWYx96JWJCkTv9Q4YebCWpydqhf5X7IZ6fkRFu/o81cUAB3r/DvNFvIFLe7I9s0q/1ddYqDUwrpK/vrR0339L1XA=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:26.266925 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1f82b609-2add-48f1-806c-a360dd18c2a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:26.272099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-1f82b609-2add-48f1-806c-a360dd18c2a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:26.296554 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f82b609-2add-48f1-806c-a360dd18c2a5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050223 Jun 16 19:43:26.297159 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3368/6851] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:43:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:43:32.045884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:32.053695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1527893641", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "networks": [{"uuid": "b668edcf-2cb5-4310-8870-93c170881e3d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1729476465", "security_groups": [{"name": "tempest-secgroup-smoke-1009698096"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:32.165993 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] validate_networks() for [('b668edcf-2cb5-4310-8870-93c170881e3d', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:43:32.653661 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:43:32.654466 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:43:32.655359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:43:32.657299 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:43:32.658624 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:43:32.677094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:32.677812 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:32.679487 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:32.680236 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:32.716475 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:32.727023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Getting quotas for user 6d70dfa781674fc9bcda4bee6edff40e and project 479a1e88e5dd499cb33e7e2ef2164511. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:32.747638 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:43:32.750375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:43:32.818448 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4be61389-3db0-4ec3-a444-63246812d94f tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774168 Jun 16 19:43:32.821956 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3484/6852] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:43:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:43:32.830321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a34c4420-3f8f-4efd-a8df-8ee2a20f880b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:32.831558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-a34c4420-3f8f-4efd-a8df-8ee2a20f880b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:32.885950 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=20 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:32.933050 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-a34c4420-3f8f-4efd-a8df-8ee2a20f880b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:32.941164 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a34c4420-3f8f-4efd-a8df-8ee2a20f880b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1267 microversion: 2.1 time: 0.114898 Jun 16 19:43:32.946680 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3369/6853] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:32 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:33.962447 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:33.963675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:33.978929 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:33.979704 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:33.981782 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:33.982296 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:34.545710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:34.553505 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-ee4d2149-e475-4ccc-9fa9-2b69fb1bf4d6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1327 microversion: 2.1 time: 0.598536 Jun 16 19:43:34.554472 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3485/6854] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:33 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1327 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:35.570931 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:35.571679 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:35.579662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:35.580215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:35.581103 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:35.581630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:35.794355 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:35.802528 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f243a44-666f-45f4-b1fb-4903579573e1 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1393 microversion: 2.1 time: 0.235586 Jun 16 19:43:35.804197 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3370/6855] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:35 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1393 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:36.077332 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-1912804b-c90b-47f3-9c12-bbe7aa953907 req-bae35144-c072-47ab-9f11-cf8b9220607e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403d0eb2-1932-44d0-982d-1fc8382df74a", "tag": "63579768-b0bd-4106-bd34-1884da200e6b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:36.091877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1912804b-c90b-47f3-9c12-bbe7aa953907 req-bae35144-c072-47ab-9f11-cf8b9220607e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:36.092365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-1912804b-c90b-47f3-9c12-bbe7aa953907 req-bae35144-c072-47ab-9f11-cf8b9220607e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:36.111434 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-1912804b-c90b-47f3-9c12-bbe7aa953907 req-bae35144-c072-47ab-9f11-cf8b9220607e service nova] Creating event network-changed:63579768-b0bd-4106-bd34-1884da200e6b for instance 403d0eb2-1932-44d0-982d-1fc8382df74a on n-h1-846209-2 Jun 16 19:43:36.117422 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-1912804b-c90b-47f3-9c12-bbe7aa953907 req-bae35144-c072-47ab-9f11-cf8b9220607e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043992 Jun 16 19:43:36.118141 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3486/6856] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:36.821305 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:36.821951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:36.828991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:36.829449 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:36.830249 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:36.830693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:36.966213 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:36.973743 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3af28fc7-d074-4f1e-85bd-2ffebce11703 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1393 microversion: 2.1 time: 0.157036 Jun 16 19:43:36.974338 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3371/6857] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:36 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:37.992768 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:37.993500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:38.001563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:38.001563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:38.002366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:38.002831 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:38.144797 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:38.152939 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9b124d68-4d62-495e-81a9-e797745dd4c6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1393 microversion: 2.1 time: 0.165897 Jun 16 19:43:38.153531 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3487/6858] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:37 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:39.169794 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:39.170431 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:39.177375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:39.177843 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:39.178901 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:39.179350 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:39.330202 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:39.338084 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-212a0339-36a4-421a-9dc0-4c1083845833 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1393 microversion: 2.1 time: 0.172194 Jun 16 19:43:39.338659 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3372/6859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:39 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:40.355603 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:40.356923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:40.363979 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:40.364874 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:40.365951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:40.367181 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:40.396805 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-9bac4e99-2fb1-49cb-a1a1-949ff31969d6 req-ba6455d3-1d2f-413e-8919-ddb4ec0df74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403d0eb2-1932-44d0-982d-1fc8382df74a", "name": "network-vif-plugged", "status": "completed", "tag": "63579768-b0bd-4106-bd34-1884da200e6b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:40.408428 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9bac4e99-2fb1-49cb-a1a1-949ff31969d6 req-ba6455d3-1d2f-413e-8919-ddb4ec0df74b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:40.409231 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-9bac4e99-2fb1-49cb-a1a1-949ff31969d6 req-ba6455d3-1d2f-413e-8919-ddb4ec0df74b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:40.423303 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-9bac4e99-2fb1-49cb-a1a1-949ff31969d6 req-ba6455d3-1d2f-413e-8919-ddb4ec0df74b service nova] Creating event network-vif-plugged:63579768-b0bd-4106-bd34-1884da200e6b for instance 403d0eb2-1932-44d0-982d-1fc8382df74a on n-h1-846209-2 Jun 16 19:43:40.429799 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-9bac4e99-2fb1-49cb-a1a1-949ff31969d6 req-ba6455d3-1d2f-413e-8919-ddb4ec0df74b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128018 Jun 16 19:43:40.431461 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3488/6860] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:40.561230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:40.569694 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-6ab8cb18-73fa-44ff-86b3-c6a551066a2c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1393 microversion: 2.1 time: 0.218892 Jun 16 19:43:40.570427 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3373/6861] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:40 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:41.588989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:41.589587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:41.595949 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:41.596410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:41.597181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:41.597632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:41.736761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:41.744671 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-44d6bf0d-35cc-4347-a67c-b5121a9ee94a tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1393 microversion: 2.1 time: 0.161714 Jun 16 19:43:41.745243 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3489/6862] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:41 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:42.761224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:42.761870 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:42.764556 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:42.769934 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:42.770397 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:42.771159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:42.771596 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:42.909325 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:42.917673 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8d0f3654-1f9a-489b-ac7d-fd25644c76d2 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1565 microversion: 2.1 time: 0.160484 Jun 16 19:43:42.918297 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3374/6863] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:42 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:42.934576 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:42.935189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:42.938004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:42.938679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:42.944647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:42.945615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:42.946394 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:42.946854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:43.078905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:43.087593 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b750b25f-0d39-4694-b161-a9e4363d007c tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1565 microversion: 2.1 time: 0.157686 Jun 16 19:43:43.088189 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3490/6864] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:42 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:44.549551 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:43:44.550181 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:43:44.717787 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:44.718502 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:44.721395 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:44.723202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-660d2409-e860-4613-94bc-70f84252280e req-2d43df8f-ace3-482b-aa43-fc24abda6e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403d0eb2-1932-44d0-982d-1fc8382df74a", "tag": "63579768-b0bd-4106-bd34-1884da200e6b"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:44.728281 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:44.728734 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:44.729517 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:44.729975 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:44.734540 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-660d2409-e860-4613-94bc-70f84252280e req-2d43df8f-ace3-482b-aa43-fc24abda6e05 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:44.735079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-660d2409-e860-4613-94bc-70f84252280e req-2d43df8f-ace3-482b-aa43-fc24abda6e05 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:44.750062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-660d2409-e860-4613-94bc-70f84252280e req-2d43df8f-ace3-482b-aa43-fc24abda6e05 service nova] Creating event network-changed:63579768-b0bd-4106-bd34-1884da200e6b for instance 403d0eb2-1932-44d0-982d-1fc8382df74a on n-h1-846209-2 Jun 16 19:43:44.755490 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-660d2409-e860-4613-94bc-70f84252280e req-2d43df8f-ace3-482b-aa43-fc24abda6e05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035948 Jun 16 19:43:44.756458 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3491/6865] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:43:44.958088 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:44.968657 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9539339b-6e34-4cbf-92d0-f7425ea7e9c5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1565 microversion: 2.1 time: 0.254629 Jun 16 19:43:44.969255 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3375/6866] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:44 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:08.215920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:08.216685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=32 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:08.221375 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f938c266-11e3-4f94-8641-cdec75b099f6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:08.222441 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f938c266-11e3-4f94-8641-cdec75b099f6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:08.233510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f938c266-11e3-4f94-8641-cdec75b099f6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.234064 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f938c266-11e3-4f94-8641-cdec75b099f6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.234931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f938c266-11e3-4f94-8641-cdec75b099f6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.235419 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f938c266-11e3-4f94-8641-cdec75b099f6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.287597 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f938c266-11e3-4f94-8641-cdec75b099f6 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action" status: 200 len: 24572 microversion: 2.1 time: 0.073465 Jun 16 19:44:08.288244 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3492/6867] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:44:08 2022] POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action => generated 24572 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:44:19.327831 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:19.328424 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:19.330678 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=3 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:19.331394 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=36 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:19.338254 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.338713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.339497 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.339943 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.364526 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.objects.instance [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lazy-loading 'flavor' on Instance uuid 403d0eb2-1932-44d0-982d-1fc8382df74a {{(pid=119207) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:44:19.435555 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-00675aa7-6d40-40a4-a377-f63a64ec9362 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action" status: 202 len: 0 microversion: 2.1 time: 0.111521 Jun 16 19:44:19.436194 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3376/6868] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:44:19 2022] POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:44:19.445072 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:19.445799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:19.448459 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:19.449116 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:19.455971 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.456462 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.457263 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.457726 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.599802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:19.608233 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e0b0502f-a486-4264-978a-38abe1d49eeb tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1692 microversion: 2.1 time: 0.167593 Jun 16 19:44:19.608809 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3493/6869] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:19 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:20.627773 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:20.628406 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:20.635638 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:20.636077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:20.636854 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:20.637297 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:20.776687 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:20.784474 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-26218565-3f35-41a4-bdb3-3c453ba66e21 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1675 microversion: 2.1 time: 0.162207 Jun 16 19:44:20.785046 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3377/6870] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:20 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:21.875202 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6c5f2c2f-9eec-4cbc-8a19-2ddd22b6db48 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:21.876156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6c5f2c2f-9eec-4cbc-8a19-2ddd22b6db48 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:21.883931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c5f2c2f-9eec-4cbc-8a19-2ddd22b6db48 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.884939 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c5f2c2f-9eec-4cbc-8a19-2ddd22b6db48 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.885730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c5f2c2f-9eec-4cbc-8a19-2ddd22b6db48 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.886219 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6c5f2c2f-9eec-4cbc-8a19-2ddd22b6db48 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.945829 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6c5f2c2f-9eec-4cbc-8a19-2ddd22b6db48 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action" status: 200 len: 38382 microversion: 2.1 time: 0.074501 Jun 16 19:44:21.946509 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3494/6871] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:44:21 2022] POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action => generated 38382 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:44:21.958614 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-faebddb6-1d00-43be-838a-c68cb6aa86c8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:21.959159 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-faebddb6-1d00-43be-838a-c68cb6aa86c8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:21.967189 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faebddb6-1d00-43be-838a-c68cb6aa86c8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.967649 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faebddb6-1d00-43be-838a-c68cb6aa86c8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.968425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faebddb6-1d00-43be-838a-c68cb6aa86c8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.968888 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-faebddb6-1d00-43be-838a-c68cb6aa86c8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.038311 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-faebddb6-1d00-43be-838a-c68cb6aa86c8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action" status: 202 len: 0 microversion: 2.1 time: 0.083383 Jun 16 19:44:22.038976 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3378/6872] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:44:21 2022] POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:44:22.048378 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:22.049186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:22.057019 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.058058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.058926 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.059372 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.601274 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:22.609747 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a2b38ff5-2996-46e8-b3ec-9e9e19957734 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1681 microversion: 2.1 time: 0.565735 Jun 16 19:44:22.610583 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3495/6873] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:22 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1681 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:23.629393 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:23.630085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:23.637740 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.638238 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.639009 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.639450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.775829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:23.784716 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cb1a8cf9-9ef1-4382-a833-4a7ed3489ea8 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1681 microversion: 2.1 time: 0.160513 Jun 16 19:44:23.785502 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3379/6874] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:23 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:24.801612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:24.802273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:24.810832 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.811307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.812090 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.812549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.950252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:24.958058 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2a529c12-3aa9-40b6-b292-4c71ac9cd380 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1684 microversion: 2.1 time: 0.160390 Jun 16 19:44:24.958626 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3496/6875] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:24 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:25.050715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b40dbf0c-a332-41e0-a28b-08d86a7975ec tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:25.051728 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b40dbf0c-a332-41e0-a28b-08d86a7975ec tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:25.059689 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b40dbf0c-a332-41e0-a28b-08d86a7975ec tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.060151 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b40dbf0c-a332-41e0-a28b-08d86a7975ec tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.060937 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b40dbf0c-a332-41e0-a28b-08d86a7975ec tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.061387 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b40dbf0c-a332-41e0-a28b-08d86a7975ec tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.106857 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b40dbf0c-a332-41e0-a28b-08d86a7975ec tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action" status: 200 len: 38382 microversion: 2.1 time: 0.059911 Jun 16 19:44:25.107545 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3380/6876] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:44:25 2022] POST /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a/action => generated 38382 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:44:26.124884 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:26.125643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:26.127469 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-ea223a34-87b5-4dc5-9081-3712371b9f9f req-2033ce19-1ff3-45de-8228-4e1b42d5eddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403d0eb2-1932-44d0-982d-1fc8382df74a", "tag": "63579768-b0bd-4106-bd34-1884da200e6b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:26.133124 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.133895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.135563 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.136343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.138221 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ea223a34-87b5-4dc5-9081-3712371b9f9f req-2033ce19-1ff3-45de-8228-4e1b42d5eddb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.138682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-ea223a34-87b5-4dc5-9081-3712371b9f9f req-2033ce19-1ff3-45de-8228-4e1b42d5eddb service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.150918 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-ea223a34-87b5-4dc5-9081-3712371b9f9f req-2033ce19-1ff3-45de-8228-4e1b42d5eddb service nova] Creating event network-changed:63579768-b0bd-4106-bd34-1884da200e6b for instance 403d0eb2-1932-44d0-982d-1fc8382df74a on n-h1-846209-2 Jun 16 19:44:26.156922 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-ea223a34-87b5-4dc5-9081-3712371b9f9f req-2033ce19-1ff3-45de-8228-4e1b42d5eddb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Jun 16 19:44:26.157929 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3381/6877] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:26.166463 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:44:26.262861 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-91d36924-e06c-4b99-84cd-a93a24ed9ddc tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 204 len: 0 microversion: 2.1 time: 0.141551 Jun 16 19:44:26.267740 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3497/6878] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:44:26 2022] DELETE /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:44:26.273889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:26.274635 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:26.282352 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.283123 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.284155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.284602 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.451229 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:26.459367 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0940abba-9e04-431f-b254-374fff3a46ea tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1690 microversion: 2.1 time: 0.190765 Jun 16 19:44:26.459949 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3382/6879] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:26 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:27.479156 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:27.479898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:27.486904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.487381 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.488168 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.488629 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.626069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:27.633668 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a9c29f67-7e1f-41b9-87b6-9d40e2666e8b tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1690 microversion: 2.1 time: 0.159482 Jun 16 19:44:27.634837 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3498/6880] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:27 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:28.599067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-92c04507-f0cc-4b20-bea0-a41e68dd317d req-a00d8f62-35d5-455b-9034-afc8978ef386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403d0eb2-1932-44d0-982d-1fc8382df74a", "name": "network-vif-deleted", "tag": "63579768-b0bd-4106-bd34-1884da200e6b"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:28.609534 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-92c04507-f0cc-4b20-bea0-a41e68dd317d req-a00d8f62-35d5-455b-9034-afc8978ef386 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.610318 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-92c04507-f0cc-4b20-bea0-a41e68dd317d req-a00d8f62-35d5-455b-9034-afc8978ef386 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.626844 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-92c04507-f0cc-4b20-bea0-a41e68dd317d req-a00d8f62-35d5-455b-9034-afc8978ef386 service nova] Creating event network-vif-deleted:63579768-b0bd-4106-bd34-1884da200e6b for instance 403d0eb2-1932-44d0-982d-1fc8382df74a on n-h1-846209-2 Jun 16 19:44:28.631662 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-92c04507-f0cc-4b20-bea0-a41e68dd317d req-a00d8f62-35d5-455b-9034-afc8978ef386 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036426 Jun 16 19:44:28.632282 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3383/6881] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:28.653336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:28.654125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:28.661110 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.661622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.662453 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.662912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.732933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d70dfa781674fc9bcda4bee6edff40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479a1e88e5dd499cb33e7e2ef2164511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:28.740538 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-aee579c9-9ff2-41c0-a960-9eed953175e5 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 200 len: 1352 microversion: 2.1 time: 0.091814 Jun 16 19:44:28.741106 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3499/6882] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:28 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:29.758840 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:29.760703 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] [instance: 403d0eb2-1932-44d0-982d-1fc8382df74a] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:29.767237 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:29.767693 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:29.768468 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:29.768911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:29.783731 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] HTTP exception thrown: Instance 403d0eb2-1932-44d0-982d-1fc8382df74a could not be found. Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Request method failure captured: Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a HTTP/1.1 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4ZQ3-HcFTbJlryGqO81Si_D7lmY08a9-tZq53qjTz338x_1rjo0u3Y4RZlYQlrK1O5Gseag5h9aIUWT7irG8rKdevwcxTIlD-v6WZOvwjembOcpGQ7JgDOdGi6j5NTGAgeulVhkpo4vvlZ5fGkPcWY-vJRcrfu--lBnqKuJ3NGcolA Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_479a1e88e5dd499cb33e7e2ef2164511", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/479a1e88e5dd499cb33e7e2ef2164511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 479a1e88e5dd499cb33e7e2ef2164511 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-15800090 Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 6d70dfa781674fc9bcda4bee6edff40e Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestNetworkAdvancedServerOps-15800090-project Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 403d0eb2-1932-44d0-982d-1fc8382df74a could not be found. Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '403d0eb2-1932-44d0-982d-1fc8382df74a'} Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403d0eb2-1932-44d0-982d-1fc8382df74a could not be found. Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403d0eb2-1932-44d0-982d-1fc8382df74a could not be found. Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:44:29.785377 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403d0eb2-1932-44d0-982d-1fc8382df74a could not be found. Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Returning 404 to user: Instance 403d0eb2-1932-44d0-982d-1fc8382df74a could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8bd426c2-26b0-41f5-98e9-47efcaef1d6e tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a" status: 404 len: 111 microversion: 2.1 time: 0.033268 Jun 16 19:44:29.789898 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3384/6883] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:29 2022] GET /compute/v2.1/servers/403d0eb2-1932-44d0-982d-1fc8382df74a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:44:32.760528 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-879e8819-bf51-40e2-86e2-1392d73eb529 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] Calling method '.version_select at 0x7f866c4573a0>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:32.792377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-879e8819-bf51-40e2-86e2-1392d73eb529 tempest-TestNetworkAdvancedServerOps-15800090 tempest-TestNetworkAdvancedServerOps-15800090-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1729476465" status: 202 len: 0 microversion: 2.1 time: 0.041436 Jun 16 19:44:32.793323 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3500/6884] 10.222.0.27 () {58 vars in 1283 bytes} [Thu Jun 16 19:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1729476465 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:44:44.549228 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=18 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:44.550467 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:44.785256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4b5a7592-5874-474d-b9fe-f446ae77f884 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'create', calling method: .version_select at 0x7f866de0d3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1531903718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUZOMOJ+cUNz9R7G1bZygwGYDSKBpEZ+jIFI51V81ohK85f9mmJnKU0o2zCyTC+3UhAtXdEKizL9upB2aCIdgUfEdwMELD4NLWGCrFYm5uYzudyuFWNRpPwuX1lpcdFvw=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:44.801572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4b5a7592-5874-474d-b9fe-f446ae77f884 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for project 692c2ff43bb74f99a80c815dde37b309. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:44:44.808013 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-4b5a7592-5874-474d-b9fe-f446ae77f884 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for user 725fb5b289d347c7acc01ce4ae5b2eec and project 692c2ff43bb74f99a80c815dde37b309. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:44:44.840246 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4b5a7592-5874-474d-b9fe-f446ae77f884 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.314132 Jun 16 19:44:44.841089 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3385/6885] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:44:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:45.876889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:45.877755 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:45.881953 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1616784470", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1531903718", "security_groups": [{"name": "tempest-secgroup-smoke-1851745467"}], "networks": [{"uuid": "7714c202-f419-4892-bc9d-3aa78f5300f8"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:46.356233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] validate_networks() for [('7714c202-f419-4892-bc9d-3aa78f5300f8', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:44:46.736659 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:44:46.737105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:44:46.737779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:44:46.738250 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:44:46.738696 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:44:46.748904 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.749650 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:46.750698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.751421 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:46.773828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for project 692c2ff43bb74f99a80c815dde37b309. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:44:46.779270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for user 725fb5b289d347c7acc01ce4ae5b2eec and project 692c2ff43bb74f99a80c815dde37b309. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:44:46.794795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:44:46.797175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:44:46.848473 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9af37c4e-9b7c-4825-b947-4ecc9dd00558 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.973290 Jun 16 19:44:46.849342 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3501/6886] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:44:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:44:46.859667 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1acfe6fe-5482-4219-b00e-66c8f75d426e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:46.860601 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1acfe6fe-5482-4219-b00e-66c8f75d426e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:46.924385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1acfe6fe-5482-4219-b00e-66c8f75d426e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:46.932952 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1acfe6fe-5482-4219-b00e-66c8f75d426e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1247 microversion: 2.1 time: 0.077472 Jun 16 19:44:46.933963 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3386/6887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:46 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:47.956673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:47.961000 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:47.973877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:47.974738 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:47.976483 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:47.977182 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:48.132418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:48.144474 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d744acff-a197-4178-9831-0edc8f2d188b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1307 microversion: 2.1 time: 0.196438 Jun 16 19:44:48.156105 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3502/6888] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:47 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:49.163399 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:49.164139 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:49.171204 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.171665 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.172452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.172899 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.407999 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:49.417269 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0bd13566-1d29-407c-902d-51d89fc595dd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1373 microversion: 2.1 time: 0.257789 Jun 16 19:44:49.417853 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3387/6889] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:49 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:49.674167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-460ebd3d-6ab8-4eb9-b7c5-7a60663c1571 req-cf10387e-bda7-4ad5-95d9-bc38d257ef3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:49.695234 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-460ebd3d-6ab8-4eb9-b7c5-7a60663c1571 req-cf10387e-bda7-4ad5-95d9-bc38d257ef3a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.696960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-460ebd3d-6ab8-4eb9-b7c5-7a60663c1571 req-cf10387e-bda7-4ad5-95d9-bc38d257ef3a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.715918 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-460ebd3d-6ab8-4eb9-b7c5-7a60663c1571 req-cf10387e-bda7-4ad5-95d9-bc38d257ef3a service nova] Creating event network-changed:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:44:49.722234 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-460ebd3d-6ab8-4eb9-b7c5-7a60663c1571 req-cf10387e-bda7-4ad5-95d9-bc38d257ef3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062021 Jun 16 19:44:49.723625 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3503/6890] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:50.442452 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:50.443077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:50.451136 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:50.451597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:50.452383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:50.452833 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:50.588690 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:50.596569 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-3dfe6846-439f-476a-b68d-4990b63e6992 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1373 microversion: 2.1 time: 0.158316 Jun 16 19:44:50.597172 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3388/6891] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:50 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:51.615622 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:51.616344 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:51.623607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:51.624070 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:51.624853 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:51.625307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:51.764004 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:51.771550 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e6f47b8d-3ca7-4522-b13b-c2bc2bf8bdbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1373 microversion: 2.1 time: 0.161127 Jun 16 19:44:51.772124 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3504/6892] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:51 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:52.788825 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:52.789444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:52.798540 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.799054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.799783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.800225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.937225 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:52.944776 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-90568535-4d28-40c7-b84e-0797c5d08ff2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1373 microversion: 2.1 time: 0.159936 Jun 16 19:44:52.945353 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3389/6893] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:52 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:53.961984 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:53.962619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:53.970448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:53.970917 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:53.971700 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:53.972181 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:54.107024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:54.114775 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c68bbae2-af2e-421a-8c92-50475918c05b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1373 microversion: 2.1 time: 0.156796 Jun 16 19:44:54.115364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3505/6894] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:53 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:54.729191 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-0f0b6265-41ae-4d8f-948c-e70b1fef3f52 req-cd4c34f6-0da9-4812-97e2-8550a33f0a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "name": "network-vif-plugged", "status": "completed", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:54.738834 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0f0b6265-41ae-4d8f-948c-e70b1fef3f52 req-cd4c34f6-0da9-4812-97e2-8550a33f0a3d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:54.739263 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-0f0b6265-41ae-4d8f-948c-e70b1fef3f52 req-cd4c34f6-0da9-4812-97e2-8550a33f0a3d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:54.751793 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-0f0b6265-41ae-4d8f-948c-e70b1fef3f52 req-cd4c34f6-0da9-4812-97e2-8550a33f0a3d service nova] Creating event network-vif-plugged:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:44:54.756923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-0f0b6265-41ae-4d8f-948c-e70b1fef3f52 req-cd4c34f6-0da9-4812-97e2-8550a33f0a3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031575 Jun 16 19:44:54.757554 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3390/6895] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:55.132285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:55.132908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:55.140649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:55.141115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:55.141893 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:55.142365 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:55.274722 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:55.282839 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e7482c89-2af8-4bb2-9465-7ce062c7b22e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1373 microversion: 2.1 time: 0.154403 Jun 16 19:44:55.283768 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3506/6896] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:55 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:56.301220 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:56.301954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:56.308893 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:56.309606 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:56.310413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:56.310859 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:56.449473 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:56.457165 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-9fd9b46c-17bb-4bd6-a1e9-4e49f212cdf8 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1557 microversion: 2.1 time: 0.161063 Jun 16 19:44:56.457671 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3391/6897] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:56 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:56.473188 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:56.473827 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:56.480837 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:56.481313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:56.482140 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:56.482599 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:56.613992 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:56.622804 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-06f0fa88-d177-4532-9f53-641941f65fea tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1557 microversion: 2.1 time: 0.153238 Jun 16 19:44:56.623822 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3507/6898] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:56 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:58.304065 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-06eb5d2e-4461-4151-9217-f3eb7eb0bf0d req-f969f66a-eec9-4a25-ac12-8e8fa1257a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:58.307684 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=6 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:58.314779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-06eb5d2e-4461-4151-9217-f3eb7eb0bf0d req-f969f66a-eec9-4a25-ac12-8e8fa1257a36 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:58.315279 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-06eb5d2e-4461-4151-9217-f3eb7eb0bf0d req-f969f66a-eec9-4a25-ac12-8e8fa1257a36 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:58.330238 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-06eb5d2e-4461-4151-9217-f3eb7eb0bf0d req-f969f66a-eec9-4a25-ac12-8e8fa1257a36 service nova] Creating event network-changed:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:44:58.335380 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-06eb5d2e-4461-4151-9217-f3eb7eb0bf0d req-f969f66a-eec9-4a25-ac12-8e8fa1257a36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035075 Jun 16 19:44:58.336084 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3392/6899] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:46:55.669572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:55.670297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=6 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:55.671238 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:55.671989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=34 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:55.677148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:55.677706 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:55.687352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:55.687822 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:55.688905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:55.689391 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:55.713575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lazy-loading 'flavor' on Instance uuid 4a4e0252-1142-4a6f-a754-9025ea982d92 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:46:56.185210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c42e8ac8-276a-468d-b08e-dac3557439d4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "POST /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92/action" status: 202 len: 0 microversion: 2.1 time: 0.517386 Jun 16 19:46:56.185791 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3508/6900] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:46:55 2022] POST /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:46:56.192900 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d850cb4b-337e-449d-ae6b-dcfb086f9369] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 16 19:46:56.193746 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54c4e0c1-6f36-4d70-8e14-cbf0f70863b9] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:46:56.194367 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:56.195671 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=28 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:56.200081 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:56.200806 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:56.208621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:56.209127 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:56.210479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:56.211321 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:56.407694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:56.416307 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-91ee8666-c030-430a-b70a-ea9815029655 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.225581 Jun 16 19:46:56.416881 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3393/6901] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:56 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:57.436300 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:57.437015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:57.443855 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:57.444319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:57.445126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:57.445583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:57.579468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:57.588869 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-14e698e8-bbb7-4f27-8a58-764b175aa38c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.158170 Jun 16 19:46:57.589449 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3509/6902] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:57 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:58.606240 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:58.606872 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:58.616106 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.616589 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:58.617470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.617930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:58.622703 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] [54c4e0c1-6f36-4d70-8e14-cbf0f70863b9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41472. Jun 16 19:46:58.625149 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] [d850cb4b-337e-449d-ae6b-dcfb086f9369] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41470. Jun 16 19:46:58.757615 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:58.765419 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-5ada3af9-4aa7-40a1-a45c-11eb75c38c44 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.163367 Jun 16 19:46:58.766018 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3394/6903] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:58 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:59.783502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:59.784144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:59.791938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:59.792417 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:59.793208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:59.793669 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:59.927425 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:59.936164 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-887349be-52f5-4a6f-9d34-8f9eb58d05d3 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.156657 Jun 16 19:46:59.936745 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3510/6904] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:59 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:00.953768 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:00.954417 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:00.961356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:00.961850 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:00.963061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:00.963504 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:01.097324 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:01.105506 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-eb948fcb-ff6e-44eb-bcd5-d3d0167bc82f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.155761 Jun 16 19:47:01.106132 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3395/6905] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:00 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:02.124104 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:02.124744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:02.131784 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:02.132267 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:02.133056 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:02.133513 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:02.272445 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:02.281385 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7b01c713-da91-42ee-9bad-eb332d38d9e9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.161277 Jun 16 19:47:02.281985 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3511/6906] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:02 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:03.298996 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:03.299609 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:03.307282 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:03.307754 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:03.308523 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:03.308961 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:03.443382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:03.451183 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-01103f69-fa73-4f4c-bdad-347cba29e1fa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.156161 Jun 16 19:47:03.451766 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3396/6907] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:03 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:04.468835 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:04.469477 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:04.476657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:04.477328 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:04.477933 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:04.479029 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:04.559946 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:47:04.560532 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:47:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:47:04.588296 n-d-846209-2 devstack@n-api.service[119207]: Traceback (most recent call last): Jun 16 19:47:04.588521 n-d-846209-2 devstack@n-api.service[119207]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 16 19:47:04.588521 n-d-846209-2 devstack@n-api.service[119207]: timer() Jun 16 19:47:04.588521 n-d-846209-2 devstack@n-api.service[119207]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 16 19:47:04.588521 n-d-846209-2 devstack@n-api.service[119207]: cb(*args, **kw) Jun 16 19:47:04.588521 n-d-846209-2 devstack@n-api.service[119207]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 16 19:47:04.588521 n-d-846209-2 devstack@n-api.service[119207]: waiter.switch() Jun 16 19:47:04.588521 n-d-846209-2 devstack@n-api.service[119207]: greenlet.error: cannot switch to a different thread Jun 16 19:47:04.685112 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:04.693199 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-da70a37a-d396-4db9-a381-7ca18889bfb5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.228303 Jun 16 19:47:04.693780 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3512/6908] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:04 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:05.711233 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:05.711779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:05.719927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:05.720377 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:05.721140 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:05.721577 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:05.857598 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:05.865147 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-afc6cd81-e8ff-4406-9929-79ecd90e0b61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.158076 Jun 16 19:47:05.865715 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3397/6909] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:05 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:06.141316 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:47:06.141882 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:47:06.606192 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:47:06.606397 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:47:06.883233 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:06.883829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:06.891889 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:06.892366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:06.893167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:06.893628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:07.028833 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:07.036719 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7e15349b-bcec-450b-bd0b-9794805fab45 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1701 microversion: 2.1 time: 0.157685 Jun 16 19:47:07.037301 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3513/6910] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:06 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:08.054590 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:08.055437 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:08.063167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:08.063626 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:08.064707 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:08.065155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:08.204024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:08.211647 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-701b4e3b-6381-451a-bc1f-e326b6c389d1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1701 microversion: 2.1 time: 0.161061 Jun 16 19:47:08.212222 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3398/6911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:08 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:09.228561 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:09.229861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:09.238044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.238664 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.239824 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.240354 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.396874 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:09.410694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f1f49578-d5e3-4a8d-b5b6-6969c9ed37c7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.184491 Jun 16 19:47:09.410800 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3514/6912] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:09 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:10.430797 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:10.431411 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:10.438783 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:10.439514 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:10.440283 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:10.440884 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:10.612628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:10.621834 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-419fa3b4-6697-43e4-a590-42df74e999e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.196922 Jun 16 19:47:10.622376 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3399/6913] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:10 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:11.356012 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c5610d9b-2c2e-499d-839f-f5c80b30f0a6 req-2c937165-5ddd-4443-bf9f-91723ea9073c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "name": "network-vif-plugged", "status": "completed", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:11.367685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c5610d9b-2c2e-499d-839f-f5c80b30f0a6 req-2c937165-5ddd-4443-bf9f-91723ea9073c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:11.368430 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c5610d9b-2c2e-499d-839f-f5c80b30f0a6 req-2c937165-5ddd-4443-bf9f-91723ea9073c service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.383256 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c5610d9b-2c2e-499d-839f-f5c80b30f0a6 req-2c937165-5ddd-4443-bf9f-91723ea9073c service nova] Creating event network-vif-plugged:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:47:11.391029 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c5610d9b-2c2e-499d-839f-f5c80b30f0a6 req-2c937165-5ddd-4443-bf9f-91723ea9073c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038865 Jun 16 19:47:11.391972 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3515/6914] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:11.648421 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:11.649702 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:11.658280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:11.659560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.659560 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:11.659967 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.832441 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:11.841533 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff98c5c7-70c9-4057-95ac-0cef1b8cdf74 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.204876 Jun 16 19:47:11.842741 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3400/6915] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:11 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:12.864254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:12.865086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:12.872791 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.873349 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:12.874272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.874795 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:13.031307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:13.039763 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b20aea2b-844c-4b79-9ded-555ac5db034a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.183150 Jun 16 19:47:13.040650 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3516/6916] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:12 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:14.057087 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:14.057930 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:14.066120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.066584 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:14.067365 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.067809 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:14.220618 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:14.228844 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-57fb6302-3b09-4a81-99a9-2ae60c8d2fab tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.175625 Jun 16 19:47:14.230313 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3401/6917] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:14 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:15.247775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:15.248376 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:15.255555 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:15.256262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:15.257257 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:15.257923 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:15.436678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:15.445169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a982ee5e-1b7b-4388-a8a8-a08d19bd9481 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.201679 Jun 16 19:47:15.445963 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3517/6918] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:15 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:16.463231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:16.464359 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:16.475091 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:16.476489 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:16.478682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:16.478682 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:16.667422 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:16.679124 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4a8b8fce-5162-4ecf-a923-933e0ed0899c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.219887 Jun 16 19:47:16.680282 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3402/6919] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:16 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:17.696938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:17.698905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:17.706615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.707931 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.709334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.710089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.865395 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:17.877192 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2169fdd2-7a8f-49b8-a43f-926132f87430 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1696 microversion: 2.1 time: 0.184001 Jun 16 19:47:17.881210 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3518/6920] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:17 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:18.894938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:18.895663 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:18.902816 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:18.903312 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:18.904076 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:18.904529 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:19.467864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:19.475466 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1c8397ec-0f1a-4a72-b736-6ad58d69fcbd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1678 microversion: 2.1 time: 0.584483 Jun 16 19:47:19.476042 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3403/6921] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:18 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1678 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:20.493401 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:20.494062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:20.501863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.502360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:20.503142 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.503593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:20.636532 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:20.644218 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-38d45507-84d0-4ba6-9106-9aeb83348bfc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1678 microversion: 2.1 time: 0.154767 Jun 16 19:47:20.644790 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3519/6922] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:20 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:21.661125 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:21.662008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:21.674866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:21.674866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:21.674866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:21.674866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:21.813579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:21.821516 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4599c83e-e297-44e1-9b47-6f425cf4982b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1681 microversion: 2.1 time: 0.164609 Jun 16 19:47:21.822132 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3404/6923] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:21 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:21.839130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9cfcc1c0-2d52-46bc-91e7-0b9a8cd6def4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:21.839825 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9cfcc1c0-2d52-46bc-91e7-0b9a8cd6def4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:21.846803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cfcc1c0-2d52-46bc-91e7-0b9a8cd6def4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:21.847275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cfcc1c0-2d52-46bc-91e7-0b9a8cd6def4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:21.848458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cfcc1c0-2d52-46bc-91e7-0b9a8cd6def4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:21.848918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9cfcc1c0-2d52-46bc-91e7-0b9a8cd6def4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:21.991190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9cfcc1c0-2d52-46bc-91e7-0b9a8cd6def4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "POST /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92/action" status: 202 len: 0 microversion: 2.1 time: 0.156098 Jun 16 19:47:21.992570 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3520/6924] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:47:21 2022] POST /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:47:22.001209 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:22.001824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:22.008542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.008991 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.009761 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.010230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.151063 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:22.160358 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e29482be-7d6d-4b97-a6cc-017864bd9049 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1629 microversion: 2.1 time: 0.163046 Jun 16 19:47:22.161316 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3405/6925] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:21 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1629 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:23.179440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:23.180023 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:23.186361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.186834 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.187611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.188068 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.347779 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-4ff3a5d3-821f-4440-8ea4-c13a9d902d2d req-769ce916-c55f-4651-b357-0b08d2e9e77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "name": "network-vif-unplugged", "status": "completed", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:23.361182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4ff3a5d3-821f-4440-8ea4-c13a9d902d2d req-769ce916-c55f-4651-b357-0b08d2e9e77b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.361662 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-4ff3a5d3-821f-4440-8ea4-c13a9d902d2d req-769ce916-c55f-4651-b357-0b08d2e9e77b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.372658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:23.374424 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-4ff3a5d3-821f-4440-8ea4-c13a9d902d2d req-769ce916-c55f-4651-b357-0b08d2e9e77b service nova] Creating event network-vif-unplugged:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:47:23.380049 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-4ff3a5d3-821f-4440-8ea4-c13a9d902d2d req-769ce916-c55f-4651-b357-0b08d2e9e77b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037222 Jun 16 19:47:23.380937 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3406/6926] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:23.381812 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bd792483-5967-4666-b152-0c56cec89a61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.207235 Jun 16 19:47:23.382418 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3521/6927] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:23 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:24.400646 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:24.402170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:24.408425 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:24.408889 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:24.409675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:24.410183 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:24.563110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:24.576979 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-2655c0de-c3df-404b-8b73-a5d649adc1af tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.180550 Jun 16 19:47:24.578417 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3407/6928] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:24 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:25.598020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:25.599465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:25.608568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:25.609259 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:25.610031 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:25.610496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:25.614965 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:25.779644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:25.787415 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b0492bcc-e297-4eaa-a5d8-aae9e2067f98 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.194571 Jun 16 19:47:25.788016 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3522/6929] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:25 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:26.804985 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:26.806571 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:26.811037 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=31 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:26.815150 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.815694 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.816574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.817093 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.820605 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=87 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:26.974148 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:26.984610 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d3ed1220-d496-4bb6-9ec6-2fe85613ccef tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.183694 Jun 16 19:47:26.985652 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3408/6930] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:26 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:28.002496 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:28.003137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:28.006132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=33 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:28.013132 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.013616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.014644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.015119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.163966 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:28.173509 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d694227d-971e-41be-a100-b3ac3686b5ff tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.174897 Jun 16 19:47:28.174314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3523/6931] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:27 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:29.192309 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:29.192928 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:29.201194 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.201655 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.202470 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.202911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.352727 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:29.361052 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-f9f811c3-a09d-4ef2-ad38-833d42eabfba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.173561 Jun 16 19:47:29.361640 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3409/6932] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:29 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:30.378590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:30.379277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:30.387925 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:30.388400 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.389292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:30.389817 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.543709 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:30.555327 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-294b5353-d64b-4350-b0b3-79b310c6c26a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.180294 Jun 16 19:47:30.556348 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3524/6933] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:30 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:31.575968 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:31.576554 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:31.583713 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.584165 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:31.584938 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.585414 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:31.728301 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:31.737607 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-17d78c27-ff7d-4848-9fcf-064e2e95ba55 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.167012 Jun 16 19:47:31.738245 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3410/6934] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:31 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:32.756424 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:32.757121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:32.764247 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:32.764710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:32.765486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:32.765960 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:32.899268 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:32.907366 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d8f5d22c-e495-493b-a86d-71812cf6dca2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.154954 Jun 16 19:47:32.907940 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3525/6935] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:32 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:33.924732 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:33.925354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:33.932958 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.933413 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:33.934262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.934704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:34.078182 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:34.085872 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c687e54b-e210-4304-b7ac-8fdd53c5a40c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.165116 Jun 16 19:47:34.086479 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3411/6936] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:33 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:35.103646 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:35.104223 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:35.112319 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.112792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.113575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.114069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.244366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:35.252442 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-2ce49825-22d4-4823-9288-8c08d71b662e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.152850 Jun 16 19:47:35.253024 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3526/6937] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:35 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:36.270328 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:36.270953 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:36.278217 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:36.278675 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:36.279444 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:36.279887 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:36.411085 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:36.419529 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-4e93873a-5300-452f-afc9-4bf2e865728d tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.153308 Jun 16 19:47:36.420105 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3412/6938] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:36 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:37.437749 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:37.438422 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:37.445725 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.446458 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.447041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.447500 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.590829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:37.598694 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6024807a-5c63-4dbc-b9b7-50726f323046 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.165979 Jun 16 19:47:37.599284 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3527/6939] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:37 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:38.616061 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:38.616697 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:38.623744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.624142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:38.624904 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.625341 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:38.756767 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:38.764989 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3209bbf-2afb-4651-a8b0-8bb02ad1e9c1 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.152933 Jun 16 19:47:38.765569 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3413/6940] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:38 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:39.482404 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-36dd48e8-9795-4040-9777-0d7093184650 req-e96cc3e8-28b7-44ab-9d6a-9121686d8f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "name": "network-vif-plugged", "status": "completed", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:39.491698 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-36dd48e8-9795-4040-9777-0d7093184650 req-e96cc3e8-28b7-44ab-9d6a-9121686d8f00 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.492209 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-36dd48e8-9795-4040-9777-0d7093184650 req-e96cc3e8-28b7-44ab-9d6a-9121686d8f00 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.504589 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-36dd48e8-9795-4040-9777-0d7093184650 req-e96cc3e8-28b7-44ab-9d6a-9121686d8f00 service nova] Creating event network-vif-plugged:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:47:39.509710 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-36dd48e8-9795-4040-9777-0d7093184650 req-e96cc3e8-28b7-44ab-9d6a-9121686d8f00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031718 Jun 16 19:47:39.510349 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3528/6941] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:39.782199 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:39.782832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:39.790142 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.790608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.791385 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.791855 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.926770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.934767 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-1f9bf8f8-92d2-490a-b11c-0f5cdebd0454 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.156535 Jun 16 19:47:39.935282 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3414/6942] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:39 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:40.954657 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:40.955507 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:40.962803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:40.963334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:40.964264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:40.964783 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:41.131051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:41.141676 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dc846742-2234-41c1-aabf-4c4991c6bbda tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1687 microversion: 2.1 time: 0.192277 Jun 16 19:47:41.142493 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3529/6943] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:40 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:42.160375 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:42.161033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:42.168098 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.168488 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.169262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.169708 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.305764 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:42.314331 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ea72c5a3-0569-4443-b68e-81aa8056a766 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1674 microversion: 2.1 time: 0.157864 Jun 16 19:47:42.314920 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3415/6944] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:42 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:56.176572 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=13 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:56.178841 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=42 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:56.180613 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=15 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:56.182100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=47 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:56.183687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:56.184262 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:56.193035 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.193516 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.194350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.194819 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.225264 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:48:56.240660 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-801e9681-7b05-4c2a-94bf-c43fd9f0968e req-12996ca0-3716-4d27-8a74-5694aea54b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:56.249256 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-801e9681-7b05-4c2a-94bf-c43fd9f0968e req-12996ca0-3716-4d27-8a74-5694aea54b20 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.249704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-801e9681-7b05-4c2a-94bf-c43fd9f0968e req-12996ca0-3716-4d27-8a74-5694aea54b20 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.261379 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-801e9681-7b05-4c2a-94bf-c43fd9f0968e req-12996ca0-3716-4d27-8a74-5694aea54b20 service nova] Creating event network-changed:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:48:56.270728 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-801e9681-7b05-4c2a-94bf-c43fd9f0968e req-12996ca0-3716-4d27-8a74-5694aea54b20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096221 Jun 16 19:48:56.272141 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3416/6945] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:56.316782 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e8b69460-3871-46ab-a872-ac08ec06bcbc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 204 len: 0 microversion: 2.1 time: 0.143658 Jun 16 19:48:56.318004 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3530/6946] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:48:56 2022] DELETE /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:48:56.327447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:56.328357 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:56.335145 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.335906 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.336832 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.337506 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.486178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:56.494027 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e9648cc4-fef1-4055-ae1d-6fcf83fc5037 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.171255 Jun 16 19:48:56.494865 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3417/6947] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:56 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:57.513098 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:57.514229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:57.522491 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:57.522967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:57.523771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:57.524410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:57.664293 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:57.674315 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-719a8694-78b4-4671-aa26-3be7b44503d2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1680 microversion: 2.1 time: 0.166435 Jun 16 19:48:57.674917 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3531/6948] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:57 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:58.513090 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-5b113c96-9d5c-42be-90fa-9ced79ab18bb req-561bb340-5f03-4f23-988e-066596b2fc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e0252-1142-4a6f-a754-9025ea982d92", "name": "network-vif-deleted", "tag": "06828ff7-f74e-4889-828f-55d7b4fda3f0"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:58.521170 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5b113c96-9d5c-42be-90fa-9ced79ab18bb req-561bb340-5f03-4f23-988e-066596b2fc15 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.521630 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-5b113c96-9d5c-42be-90fa-9ced79ab18bb req-561bb340-5f03-4f23-988e-066596b2fc15 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.534383 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-5b113c96-9d5c-42be-90fa-9ced79ab18bb req-561bb340-5f03-4f23-988e-066596b2fc15 service nova] Creating event network-vif-deleted:06828ff7-f74e-4889-828f-55d7b4fda3f0 for instance 4a4e0252-1142-4a6f-a754-9025ea982d92 on n-h1-846209-2 Jun 16 19:48:58.541569 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-5b113c96-9d5c-42be-90fa-9ced79ab18bb req-561bb340-5f03-4f23-988e-066596b2fc15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094972 Jun 16 19:48:58.542462 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3418/6949] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:58.694432 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:58.694981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:58.703061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.703533 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.704358 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.704816 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.738694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.739162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.739642 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lazy-loading 'fault' on Instance uuid 4a4e0252-1142-4a6f-a754-9025ea982d92 {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:48:58.782508 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:58.790410 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8a45a021-c4a0-4119-8055-482bab4e0c00 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 200 len: 1337 microversion: 2.1 time: 0.100257 Jun 16 19:48:58.791001 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3532/6950] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:58 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:59.809923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:59.810666 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 4a4e0252-1142-4a6f-a754-9025ea982d92] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:59.817033 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:59.817749 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:59.818558 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:59.819008 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:59.833033 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.wsgi [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] HTTP exception thrown: Instance 4a4e0252-1142-4a6f-a754-9025ea982d92 could not be found. Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Request method failure captured: Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: request: GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 HTTP/1.1 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: Accept: application/json Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: Accept-Encoding: identity Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: Connection: close Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: Content-Length: 0 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: Content-Type: application/json Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: Host: 10.222.0.27 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: Openstack-System-Scope: None Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: User-Agent: python-urllib3/1.26.9 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Auth-Token: gAAAAABiq4gnQBUkYSSsxgWwMQE1npUmHqKR4bPOiIQZuIG0s5218wGpB8W6Wd3vVOwXyu5YrSOlAO9aLHEx5WZ2aIslGT3Igmys-s_81oZcPd4CbroWKv_eAgGglx6IhCKFoMqFGavbqbzyat8UwcmWbiXyZkwX2qrHMv4m2nwuuWBHEi5sib8 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Id: None Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Domain-Name: None Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Identity-Status: Confirmed Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Is-Admin-Project: True Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Id: default Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Domain-Name: Default Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Id: 692c2ff43bb74f99a80c815dde37b309 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Project-Name: tempest-TestShelveInstance-163640775 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Role: member,reader Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Roles: member,reader Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692c2ff43bb74f99a80c815dde37b309"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/692c2ff43bb74f99a80c815dde37b309"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_692c2ff43bb74f99a80c815dde37b309", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692c2ff43bb74f99a80c815dde37b309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant: tempest-TestShelveInstance-163640775 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Id: 692c2ff43bb74f99a80c815dde37b309 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-Tenant-Name: tempest-TestShelveInstance-163640775 Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-User: tempest-TestShelveInstance-163640775-project Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Id: default Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-User-Domain-Name: Default Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-User-Id: 725fb5b289d347c7acc01ce4ae5b2eec Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: X-User-Name: tempest-TestShelveInstance-163640775-project Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: method: > Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: exception: Instance 4a4e0252-1142-4a6f-a754-9025ea982d92 could not be found. Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: action_args: {'id': '4a4e0252-1142-4a6f-a754-9025ea982d92'} Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a4e0252-1142-4a6f-a754-9025ea982d92 could not be found. Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a4e0252-1142-4a6f-a754-9025ea982d92 could not be found. Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:59.834729 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a4e0252-1142-4a6f-a754-9025ea982d92 could not be found. Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: ERROR nova.api.openstack.wsgi Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Returning 404 to user: Instance 4a4e0252-1142-4a6f-a754-9025ea982d92 could not be found. {{(pid=119207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-e3f72c1a-053c-46f3-808c-7c8873476229 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92" status: 404 len: 111 microversion: 2.1 time: 0.032150 Jun 16 19:48:59.839621 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3419/6951] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:59 2022] GET /compute/v2.1/servers/4a4e0252-1142-4a6f-a754-9025ea982d92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:49:00.026062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6e2b80f9-9340-4f63-82d2-67dc50b163cc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '.version_select at 0x7f866f617670>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:00.050720 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6e2b80f9-9340-4f63-82d2-67dc50b163cc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1531903718" status: 202 len: 0 microversion: 2.1 time: 0.028561 Jun 16 19:49:00.051608 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3533/6952] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jun 16 19:49:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1531903718 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:49:00.073892 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-a0707a62-924d-4b0d-98b6-d13b8cf829fc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'create', calling method: .version_select at 0x7f866e89c940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1781039754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtBYNNg8gU+B5bezhgf40wC+mH9h1B3ZHrERYpdVUGXxEf5T5oVY6RNQuuFbgQrj+CMy6hF1bKPzxSBrZGqBG4yCOhguei2bsTXlG8pT4snJ8DALqO5Cx4E5HLQ2BpT4Q=="}} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:00.088500 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a0707a62-924d-4b0d-98b6-d13b8cf829fc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for project 692c2ff43bb74f99a80c815dde37b309. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:49:00.094849 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.quota [None req-a0707a62-924d-4b0d-98b6-d13b8cf829fc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for user 725fb5b289d347c7acc01ce4ae5b2eec and project 692c2ff43bb74f99a80c815dde37b309. Resources: {'key_pairs'} {{(pid=119207) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:49:00.129447 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-a0707a62-924d-4b0d-98b6-d13b8cf829fc tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.059442 Jun 16 19:49:00.130158 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3420/6953] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:49:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:16.238189 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:16.239015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:16.244061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-439399039", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1781039754", "security_groups": [{"name": "tempest-secgroup-smoke-687914434"}], "networks": [{"uuid": "7714c202-f419-4892-bc9d-3aa78f5300f8"}], "block_device_mapping_v2": [{"uuid": "8b0347f0-498c-4290-afa0-f2983a910be7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:16.360159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] validate_networks() for [('7714c202-f419-4892-bc9d-3aa78f5300f8', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:49:16.731969 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:49:16.732415 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:49:16.732950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:49:16.733756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:49:16.734362 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:49:16.743656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:16.744126 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:16.744952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:16.745440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:16.762125 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for project 692c2ff43bb74f99a80c815dde37b309. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:49:16.768014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Getting quotas for user 725fb5b289d347c7acc01ce4ae5b2eec and project 692c2ff43bb74f99a80c815dde37b309. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:49:16.825991 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:49:16.829173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b0347f0-498c-4290-afa0-f2983a910be7',volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:49:16.956790 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5b11d01b-66cb-4e3a-bdea-e7b2cb4306e7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720379 Jun 16 19:49:16.957446 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3534/6954] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:49:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:49:16.965178 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=12 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:16.965978 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:16.966608 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:16.972607 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-cbd2935f-a632-4c8a-8200-1c038739c91c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:16.973230 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-cbd2935f-a632-4c8a-8200-1c038739c91c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:17.038652 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-cbd2935f-a632-4c8a-8200-1c038739c91c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:17.045560 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-cbd2935f-a632-4c8a-8200-1c038739c91c tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1088 microversion: 2.1 time: 0.082126 Jun 16 19:49:17.046157 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3421/6955] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:16 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:18.066069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a6837d8-bd56-4c42-b422-d7ca3b4e2bd5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:18.066719 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a6837d8-bd56-4c42-b422-d7ca3b4e2bd5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:18.124641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4a6837d8-bd56-4c42-b422-d7ca3b4e2bd5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:18.132428 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a6837d8-bd56-4c42-b422-d7ca3b4e2bd5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1088 microversion: 2.1 time: 0.072281 Jun 16 19:49:18.133416 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3535/6956] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:18 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:19.149769 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-41c556fa-caa4-493f-9879-03d3c6a72197 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:19.150346 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-41c556fa-caa4-493f-9879-03d3c6a72197 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:19.207382 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-41c556fa-caa4-493f-9879-03d3c6a72197 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:19.214170 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-41c556fa-caa4-493f-9879-03d3c6a72197 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1088 microversion: 2.1 time: 0.068474 Jun 16 19:49:19.214739 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3422/6957] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:19 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:20.231141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:20.231786 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:20.239673 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:20.240159 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:20.240964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:20.241612 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:20.317038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:20.325474 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-814c466e-fbbb-494b-ad39-42102d1720aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1204 microversion: 2.1 time: 0.098221 Jun 16 19:49:20.326527 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3536/6958] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:20 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:21.343231 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:21.343864 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:21.351927 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:21.352591 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:21.353542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:21.354184 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:21.587214 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-7a303495-fb45-404e-aec6-fb67241a12dc req-e021972a-23db-4e27-9025-bccfa8da9613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e22a30e-5168-4b6d-b3e0-a04994d6b37f", "tag": "f0e3d5e9-cb99-4f03-ba48-4c0e04957b26"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:21.605162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7a303495-fb45-404e-aec6-fb67241a12dc req-e021972a-23db-4e27-9025-bccfa8da9613 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:21.605637 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-7a303495-fb45-404e-aec6-fb67241a12dc req-e021972a-23db-4e27-9025-bccfa8da9613 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:21.607224 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:21.618524 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-d180b7dc-254d-49ed-b021-3cca8ecea7ba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1271 microversion: 2.1 time: 0.279066 Jun 16 19:49:21.630813 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3423/6959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:21 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:21.631458 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-7a303495-fb45-404e-aec6-fb67241a12dc req-e021972a-23db-4e27-9025-bccfa8da9613 service nova] Creating event network-changed:f0e3d5e9-cb99-4f03-ba48-4c0e04957b26 for instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f on n-h1-846209-2 Jun 16 19:49:21.636682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-7a303495-fb45-404e-aec6-fb67241a12dc req-e021972a-23db-4e27-9025-bccfa8da9613 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055747 Jun 16 19:49:21.637619 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3537/6960] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:49:22.636592 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:22.637271 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:22.645006 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:22.645466 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:22.646280 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:22.646731 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:23.144510 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:23.152482 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-96354b78-04af-4202-8b0b-31d373cea2aa tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1271 microversion: 2.1 time: 0.519814 Jun 16 19:49:23.153075 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3424/6961] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:22 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1271 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:24.172036 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:24.172796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:24.179213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:24.179745 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:24.180493 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:24.180938 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:24.319057 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:24.327659 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3757ac2e-5f55-4975-8b19-19883a4a4ac4 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1271 microversion: 2.1 time: 0.160657 Jun 16 19:49:24.328312 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3538/6962] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:24 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:25.345291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:25.345827 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:25.354010 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:25.354704 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:25.355628 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:25.355923 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:25.494911 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:25.503060 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-ff832e88-02fc-4daa-a192-87e86945de94 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.162347 Jun 16 19:49:25.503643 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3425/6963] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:25 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:26.520621 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:26.521252 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:26.528228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:26.528699 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:26.529479 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:26.529952 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:26.666918 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:26.674515 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8cf76724-c49c-463a-99aa-51c6e4086617 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.157832 Jun 16 19:49:26.675083 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3539/6964] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:26 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:27.690542 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:27.691100 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:27.699291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:27.699744 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:27.700512 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:27.700951 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:27.836057 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:27.843829 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-bfe2b832-47b4-49b8-9d7d-67848e9a1671 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.157357 Jun 16 19:49:27.844589 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3426/6965] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:27 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:28.861258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:28.861898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:28.863968 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:28.865623 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:28.871799 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:28.872282 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:28.873069 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:28.873535 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:29.014275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:29.022135 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d0e61435-0426-4a14-8cd5-391e80ddcf64 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.165434 Jun 16 19:49:29.022709 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3540/6966] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:28 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:30.040099 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:30.040795 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:30.042877 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell0:SELECT=4 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:30.048963 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:30.049496 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:30.050383 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:30.050866 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:30.193455 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:30.201246 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-8ccde5e9-21ae-41f6-975f-a074f0ad0cba tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.166058 Jun 16 19:49:30.201852 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3427/6967] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:30 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:49:31.217245 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:31.217794 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:31.225736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:31.226241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:31.227020 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:31.227476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:31.368294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:31.376436 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6d87cdc7-05c3-47d9-aea6-9cbef1156f9b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.163177 Jun 16 19:49:31.377006 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3541/6968] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:31 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:32.393161 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:32.393780 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:32.400829 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:32.401262 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:32.402039 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:32.402479 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:32.537154 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:32.544923 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-b8ea8c86-0813-49a6-81f9-0ad97dc66d77 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.155928 Jun 16 19:49:32.546553 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3428/6969] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:32 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:33.563092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:33.563733 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:33.571215 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:33.571628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:33.572420 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:33.572881 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:33.706800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:33.714396 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fed880bf-e1cd-468f-b705-1a3eb5926129 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.155262 Jun 16 19:49:33.714983 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3542/6970] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:33 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:34.731120 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:34.731770 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:34.739215 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:34.739661 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:34.740426 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:34.740858 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:34.882450 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:34.890729 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-995a8ef1-3a33-40e8-948d-15dd7c63a46e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.163456 Jun 16 19:49:34.891309 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3429/6971] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:34 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:35.909396 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:35.910172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:35.917324 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:35.917796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:35.918619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:35.919078 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:36.058651 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:36.066774 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-0955f0ef-f6b6-44a7-9a29-7909cfb24971 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.161937 Jun 16 19:49:36.067364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3543/6972] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:35 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:36.139459 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-44224d15-b1dd-4d39-a513-d624b3c84591 req-a4d627ed-7d3d-4e50-81ce-0278c3e46d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e22a30e-5168-4b6d-b3e0-a04994d6b37f", "name": "network-vif-plugged", "status": "completed", "tag": "f0e3d5e9-cb99-4f03-ba48-4c0e04957b26"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:36.148621 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-44224d15-b1dd-4d39-a513-d624b3c84591 req-a4d627ed-7d3d-4e50-81ce-0278c3e46d36 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:36.149067 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-44224d15-b1dd-4d39-a513-d624b3c84591 req-a4d627ed-7d3d-4e50-81ce-0278c3e46d36 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:36.160816 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-44224d15-b1dd-4d39-a513-d624b3c84591 req-a4d627ed-7d3d-4e50-81ce-0278c3e46d36 service nova] Creating event network-vif-plugged:f0e3d5e9-cb99-4f03-ba48-4c0e04957b26 for instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f on n-h1-846209-2 Jun 16 19:49:36.166037 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-44224d15-b1dd-4d39-a513-d624b3c84591 req-a4d627ed-7d3d-4e50-81ce-0278c3e46d36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088274 Jun 16 19:49:36.166627 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3430/6973] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:37.084693 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:37.085334 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:37.092450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:37.092866 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:37.093655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:37.094149 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:37.235405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:37.243158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c4f46260-099d-4a9f-8f1e-eedff79190a5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1259 microversion: 2.1 time: 0.162442 Jun 16 19:49:37.243734 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3544/6974] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:37 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:38.262642 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:38.263356 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:38.270203 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.270664 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:38.271447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.271897 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:38.417695 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:38.425410 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-200c6eea-9ab8-4af3-b13a-9cfe0b1e34c5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1443 microversion: 2.1 time: 0.168065 Jun 16 19:49:38.426606 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3431/6975] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:38 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:38.442480 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:38.443122 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:38.450388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.450854 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:38.451641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.452094 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:38.592710 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:38.601040 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e2def466-88bc-48e8-96c9-e7d31344c17f tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1443 microversion: 2.1 time: 0.163153 Jun 16 19:49:38.601625 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3545/6976] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:38 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:40.214134 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [req-7fd23c59-e1e4-4caf-829b-df8d6bfc6e75 req-2c27ca47-c356-4520-acaa-57d18571a94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e22a30e-5168-4b6d-b3e0-a04994d6b37f", "tag": "f0e3d5e9-cb99-4f03-ba48-4c0e04957b26"}]} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:40.225130 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7fd23c59-e1e4-4caf-829b-df8d6bfc6e75 req-2c27ca47-c356-4520-acaa-57d18571a94d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:40.225765 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [req-7fd23c59-e1e4-4caf-829b-df8d6bfc6e75 req-2c27ca47-c356-4520-acaa-57d18571a94d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:40.237960 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.compute.server_external_events [req-7fd23c59-e1e4-4caf-829b-df8d6bfc6e75 req-2c27ca47-c356-4520-acaa-57d18571a94d service nova] Creating event network-changed:f0e3d5e9-cb99-4f03-ba48-4c0e04957b26 for instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f on n-h1-846209-2 Jun 16 19:49:40.244785 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [req-7fd23c59-e1e4-4caf-829b-df8d6bfc6e75 req-2c27ca47-c356-4520-acaa-57d18571a94d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035631 Jun 16 19:49:40.245562 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3432/6977] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:37.844096 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b78890fc-fd1c-4287-9622-5aa46edf0932] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 19:51:37.845041 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30af6387-12f8-4c8d-96ae-4dd67e67ea9e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 19:51:37.846197 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:37.846898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=58 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:37.914983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:37.915534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:37.921639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:37.922139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:37.922911 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:37.923359 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:37.947839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lazy-loading 'flavor' on Instance uuid 0e22a30e-5168-4b6d-b3e0-a04994d6b37f {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:51:38.020953 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [1ef61b9a-0031-40ef-a211-a40721514b05] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:51:38.855060 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] [30af6387-12f8-4c8d-96ae-4dd67e67ea9e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42012. Jun 16 19:51:38.855823 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] [b78890fc-fd1c-4287-9622-5aa46edf0932] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42010. Jun 16 19:51:39.028199 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [1ef61b9a-0031-40ef-a211-a40721514b05] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42014. Jun 16 19:51:39.031495 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-98412a0c-942a-42a3-a4a3-d41a97e983c6 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "POST /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action" status: 202 len: 0 microversion: 2.1 time: 1.189457 Jun 16 19:51:39.032109 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3546/6978] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:51:37 2022] POST /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action => generated 0 bytes in 1191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:51:39.038370 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d850cb4b-337e-449d-ae6b-dcfb086f9369] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:51:39.039195 n-d-846209-2 devstack@n-api.service[119207]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54c4e0c1-6f36-4d70-8e14-cbf0f70863b9] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:51:39.039814 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_api:SELECT=28 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:39.040561 n-d-846209-2 devstack@n-api.service[119207]: DEBUG dbcounter [-] [119207] Writing DB stats nova_cell1:SELECT=52 {{(pid=119207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:39.045291 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:39.046054 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:39.053715 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:39.054293 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:39.055131 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:39.055611 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:39.190018 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:39.198828 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-c51731b3-78c9-4d16-a46f-10c3b2598713 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.162258 Jun 16 19:51:39.199422 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3433/6979] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:39 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:40.218151 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:40.218877 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:40.227363 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.227828 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.228619 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.229079 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.364679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:40.372682 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c2976bbd-1043-4763-8ca2-30723b38380e tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.159694 Jun 16 19:51:40.373281 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3547/6980] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:40 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:41.390303 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:41.390936 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:41.400881 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:41.401342 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:41.402155 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:41.402599 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:41.408757 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] [d850cb4b-337e-449d-ae6b-dcfb086f9369] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42024. Jun 16 19:51:41.420900 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] [54c4e0c1-6f36-4d70-8e14-cbf0f70863b9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42026. Jun 16 19:51:41.543720 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:41.551641 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-753525c9-5354-4454-89c2-c903a81d79bd tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.165337 Jun 16 19:51:41.552222 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3434/6981] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:41 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:42.569341 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:42.570015 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:42.577241 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:42.577708 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:42.578527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:42.578981 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:42.713861 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:42.721604 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1bd5b53b-7696-4452-a2fe-e5abf7fb8e34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.156828 Jun 16 19:51:42.722741 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3548/6982] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:42 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:43.739755 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:43.740384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:43.747362 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:43.747824 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:43.748597 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:43.749045 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:43.883574 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:43.891383 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-94f53864-0c18-4957-93c4-b77dfcbbf471 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.156147 Jun 16 19:51:43.891968 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3435/6983] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:43 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:44.909675 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:44.910846 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:44.917814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:44.918313 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:44.919119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:44.919583 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:45.056663 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:45.064344 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-68e1c7a5-7da4-4ecb-948b-c837c5539154 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.158692 Jun 16 19:51:45.064913 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3549/6984] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:44 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:46.084539 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:46.085253 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:46.093077 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:46.093579 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:46.094398 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:46.094848 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:46.227447 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:46.237414 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-89946da0-19e8-4db8-a99e-3cbc3807e79a tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.157476 Jun 16 19:51:46.239025 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3436/6985] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:46 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:47.260936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:47.261600 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:47.268741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:47.269212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:47.272272 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:47.272737 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:47.415495 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:47.423216 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f5ca3ee3-3a1e-412a-bfa4-5c5af77437f2 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.171623 Jun 16 19:51:47.423792 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3550/6986] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:47 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:48.441167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:48.441784 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:48.449544 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:48.450024 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:48.450798 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:48.451235 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:48.586954 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:48.594692 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-01ac6de4-642a-480f-844f-55624ee670f7 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.157463 Jun 16 19:51:48.595277 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3437/6987] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:48 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:49.612086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:49.612746 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:49.620959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:49.621436 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:49.622255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:49.622714 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:49.850604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:49.858731 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-201a2e44-afc3-45b1-9524-913fc0176c0b tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.250635 Jun 16 19:51:49.859314 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3551/6988] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:49 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:50.876726 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:50.877332 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:50.884786 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:50.885245 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:50.886049 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:50.886493 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:51.025465 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:51.033253 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-0e004181-2ec4-4b05-a5c4-52aded25ca34 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.160517 Jun 16 19:51:51.033846 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3438/6989] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:50 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:52.051948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:52.052573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:52.059810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:52.060278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:52.061051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:52.061505 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:52.195632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:52.203691 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-6a72962a-8be1-40ce-87e8-8d147ca4af61 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.156110 Jun 16 19:51:52.204271 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3552/6990] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:52 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:53.222167 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:53.222977 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:53.230354 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:53.230812 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:53.231594 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:53.232038 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:53.378973 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.policy [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119207) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:53.387609 n-d-846209-2 devstack@n-api.service[119207]: INFO nova.api.openstack.requestlog [None req-63a8ef49-27cd-4679-87a0-b71401bbf2a9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1568 microversion: 2.1 time: 0.169679 Jun 16 19:51:53.388116 n-d-846209-2 devstack@n-api.service[119207]: [pid: 119207|app: 0|req: 3439/6991] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:53 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:54.406275 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:54.406919 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:54.413141 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:54.413617 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:54.414437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:54.414922 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:54.547800 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725fb5b289d347c7acc01ce4ae5b2eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692c2ff43bb74f99a80c815dde37b309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:54.556306 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15304b62-517f-46bb-a5bf-b1aadbe7a1d9 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 200 len: 1509 microversion: 2.1 time: 0.155137 Jun 16 19:51:54.556929 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3553/6992] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:54 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:54.573366 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.api.openstack.wsgi [None req-67f9747a-0262-4f3a-840d-d45d65dc66e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:54.573988 n-d-846209-2 devstack@n-api.service[119207]: DEBUG nova.compute.api [None req-67f9747a-0262-4f3a-840d-d45d65dc66e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119207) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:54.581110 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67f9747a-0262-4f3a-840d-d45d65dc66e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:54.581572 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67f9747a-0262-4f3a-840d-d45d65dc66e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:54.582384 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67f9747a-0262-4f3a-840d-d45d65dc66e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:54.582916 n-d-846209-2 devstack@n-api.service[119207]: DEBUG oslo_concurrency.lockutils [None req-67f9747a-0262-4f3a-840d-d45d65dc66e5 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:54.693573 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a85c84a8-da11-409e-9be3-bd3ff6247b74 req-23b27283-0aed-4f3f-b7a3-c77d0436bae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e22a30e-5168-4b6d-b3e0-a04994d6b37f", "name": "network-vif-unplugged", "status": "completed", "tag": "f0e3d5e9-cb99-4f03-ba48-4c0e04957b26"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:54.704383 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a85c84a8-da11-409e-9be3-bd3ff6247b74 req-23b27283-0aed-4f3f-b7a3-c77d0436bae2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:54.704908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a85c84a8-da11-409e-9be3-bd3ff6247b74 req-23b27283-0aed-4f3f-b7a3-c77d0436bae2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:54.719718 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_external_events [req-a85c84a8-da11-409e-9be3-bd3ff6247b74 req-23b27283-0aed-4f3f-b7a3-c77d0436bae2 service nova] Unable to find a host for instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f. Dropping event network-vif-unplugged {{(pid=119206) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:51:54.720631 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a85c84a8-da11-409e-9be3-bd3ff6247b74 req-23b27283-0aed-4f3f-b7a3-c77d0436bae2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032533 Jun 16 19:51:54.721705 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3554/6993] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 19:52:04.596930 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:52:04.597476 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:52:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 19:52:06.151258 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:52:06.151802 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:52:06.616964 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:52:06.617178 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:52:14.819116 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:52:14.819734 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 19:52:55.859106 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=18 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:55.859898 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:55.864703 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:55.865225 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:55.874075 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:55.874547 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:55.875345 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:55.875803 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:55.903048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:52:55.909210 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Working on deleting snapshot None from shelved instance... Jun 16 19:52:56.025019 n-d-846209-2 devstack@n-api.service[119206]: WARNING nova.compute.api [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Failed to delete snapshot from shelved instance (Image None could not be found.).: nova.exception.ImageNotFound: Image None could not be found. Jun 16 19:52:56.071792 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Doing local delete in cell f0ed644d-d923-4936-abdc-156d87bd571f(cell1) {{(pid=119206) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 16 19:52:56.073402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:56.073894 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:56.074361 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.compute.api [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 16 19:52:56.081343 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] deallocate_for_instance() {{(pid=119206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 16 19:52:56.581802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Updating instance_info_cache with network_info: [] {{(pid=119206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 19:52:57.037428 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-36c95ab8-3d82-444e-b27e-a9ef91db9901 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 204 len: 0 microversion: 2.1 time: 1.180645 Jun 16 19:52:57.041176 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3555/6994] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:52:55 2022] DELETE /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 0 bytes in 1182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:52:57.046119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-797ebdf0-f4ae-45e8-8bf4-cde0f8e5e744 req-f7572d9a-0c5f-44f8-933e-6813dc90e7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e22a30e-5168-4b6d-b3e0-a04994d6b37f", "tag": "f0e3d5e9-cb99-4f03-ba48-4c0e04957b26"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:57.054270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-797ebdf0-f4ae-45e8-8bf4-cde0f8e5e744 req-f7572d9a-0c5f-44f8-933e-6813dc90e7b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:57.054736 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-797ebdf0-f4ae-45e8-8bf4-cde0f8e5e744 req-f7572d9a-0c5f-44f8-933e-6813dc90e7b2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:57.066258 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_external_events [req-797ebdf0-f4ae-45e8-8bf4-cde0f8e5e744 req-f7572d9a-0c5f-44f8-933e-6813dc90e7b2 service nova] Unable to find a host for instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f. Dropping event network-changed {{(pid=119206) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:52:57.067158 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-797ebdf0-f4ae-45e8-8bf4-cde0f8e5e744 req-f7572d9a-0c5f-44f8-933e-6813dc90e7b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 176 microversion: 2.1 time: 0.024882 Jun 16 19:52:57.067748 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3556/6995] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 176 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 19:52:57.072455 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:57.074211 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] [instance: 0e22a30e-5168-4b6d-b3e0-a04994d6b37f] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:57.081034 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:57.081460 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:57.082281 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:57.082750 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:57.096904 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] HTTP exception thrown: Instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f could not be found. Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Request method failure captured: Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f HTTP/1.1 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4gnQBUkYSSsxgWwMQE1npUmHqKR4bPOiIQZuIG0s5218wGpB8W6Wd3vVOwXyu5YrSOlAO9aLHEx5WZ2aIslGT3Igmys-s_81oZcPd4CbroWKv_eAgGglx6IhCKFoMqFGavbqbzyat8UwcmWbiXyZkwX2qrHMv4m2nwuuWBHEi5sib8 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: 692c2ff43bb74f99a80c815dde37b309 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestShelveInstance-163640775 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692c2ff43bb74f99a80c815dde37b309"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/692c2ff43bb74f99a80c815dde37b309"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_692c2ff43bb74f99a80c815dde37b309", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692c2ff43bb74f99a80c815dde37b309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestShelveInstance-163640775 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: 692c2ff43bb74f99a80c815dde37b309 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestShelveInstance-163640775 Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestShelveInstance-163640775-project Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 725fb5b289d347c7acc01ce4ae5b2eec Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestShelveInstance-163640775-project Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f could not be found. Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '0e22a30e-5168-4b6d-b3e0-a04994d6b37f'} Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f could not be found. Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f could not be found. Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:57.098649 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f could not be found. Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Returning 404 to user: Instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bb0b41ad-37e5-4e00-9c62-72a590557494 tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f" status: 404 len: 111 microversion: 2.1 time: 0.031405 Jun 16 19:52:57.103530 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3557/6996] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:57 2022] GET /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:52:57.274277 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-46ce8097-03bc-45fd-9102-9ae76d5a1fac tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] Calling method '.version_select at 0x7f866eac1a60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:57.296067 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-46ce8097-03bc-45fd-9102-9ae76d5a1fac tempest-TestShelveInstance-163640775 tempest-TestShelveInstance-163640775-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1781039754" status: 202 len: 0 microversion: 2.1 time: 0.026067 Jun 16 19:52:57.296842 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3558/6997] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jun 16 19:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1781039754 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:52:59.093227 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-919d7ef7-cb60-4a0e-9edc-b37dfca93886 req-c4eb501e-6c5c-4adc-af32-65fdc1e6b9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e22a30e-5168-4b6d-b3e0-a04994d6b37f", "name": "network-vif-deleted", "tag": "f0e3d5e9-cb99-4f03-ba48-4c0e04957b26"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:59.111054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-919d7ef7-cb60-4a0e-9edc-b37dfca93886 req-c4eb501e-6c5c-4adc-af32-65fdc1e6b9a2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:59.111810 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-919d7ef7-cb60-4a0e-9edc-b37dfca93886 req-c4eb501e-6c5c-4adc-af32-65fdc1e6b9a2 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:59.124765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.compute.server_external_events [req-919d7ef7-cb60-4a0e-9edc-b37dfca93886 req-c4eb501e-6c5c-4adc-af32-65fdc1e6b9a2 service nova] Unable to find a host for instance 0e22a30e-5168-4b6d-b3e0-a04994d6b37f. Dropping event network-vif-deleted {{(pid=119206) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:52:59.126044 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-919d7ef7-cb60-4a0e-9edc-b37dfca93886 req-c4eb501e-6c5c-4adc-af32-65fdc1e6b9a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.038568 Jun 16 19:52:59.127211 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3559/6998] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 19:53:15.112042 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:15.112796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:15.332254 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2fec6d0-c309-449e-ab91-a2748dffdcfc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Action: 'create', calling method: .version_select at 0x7f866ed308b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-500948264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdG9wLXuAQs0eNxxRRk01Lr/4YYa/FwlB/EJWCJit2w4uqL8ov/ItKOJs8nQYVGsiuumxVzPNpMwh+XCiR5BuxtHn5ohi3LHv0o5wyPLUhl4Crfb8z4iQCMFxHuTaAjbw=="}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:15.348741 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f2fec6d0-c309-449e-ab91-a2748dffdcfc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Getting quotas for project e6a99095fe7749f3890fcf6488348434. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:53:15.356164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-f2fec6d0-c309-449e-ab91-a2748dffdcfc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Getting quotas for user 0ee189b67a164531b2ab3bbf51e47019 and project e6a99095fe7749f3890fcf6488348434. Resources: {'key_pairs'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:53:15.390864 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2fec6d0-c309-449e-ab91-a2748dffdcfc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.279978 Jun 16 19:53:15.391684 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3560/6999] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jun 16 19:53:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:53:16.421607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1353197007", "imageRef": "d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-500948264", "security_groups": [{"name": "tempest-secgroup-smoke-207037094"}], "networks": [{"uuid": "f5e58c13-e554-405c-8ef7-bfaf54657d39"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:16.545351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] validate_networks() for [('f5e58c13-e554-405c-8ef7-bfaf54657d39', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:53:17.077071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:53:17.077567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:53:17.078089 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:53:17.078515 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:53:17.079051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:53:17.088829 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:17.090226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:17.090226 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:17.090590 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:17.116121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Getting quotas for project e6a99095fe7749f3890fcf6488348434. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:53:17.121987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Getting quotas for user 0ee189b67a164531b2ab3bbf51e47019 and project e6a99095fe7749f3890fcf6488348434. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:53:17.139604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:53:17.142014 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d20d7330-9f4e-454d-b9ff-f7d2dd6e5e72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:53:17.199654 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7497dae2-080c-4247-8ccf-d847b80155cc tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.782798 Jun 16 19:53:17.205330 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3561/7000] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:53:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:53:17.215370 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-3cc585b4-aef9-432c-8670-81f4dd72dde7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:17.216121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-3cc585b4-aef9-432c-8670-81f4dd72dde7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:17.282671 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-3cc585b4-aef9-432c-8670-81f4dd72dde7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:17.290394 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-3cc585b4-aef9-432c-8670-81f4dd72dde7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1248 microversion: 2.1 time: 0.083551 Jun 16 19:53:17.292591 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3562/7001] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:17 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:18.309511 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:18.310222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:18.318802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:18.319471 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:18.320456 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:18.321076 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:18.414757 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:18.423637 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-bfb99fd6-15e2-4930-9c54-eab99fe26694 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1300 microversion: 2.1 time: 0.118795 Jun 16 19:53:18.424585 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3563/7002] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:18 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:19.442024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:19.442666 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:19.451655 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:19.452405 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:19.453217 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:19.453680 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:19.715173 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:19.722754 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1a28765b-1964-4b21-8ada-b4ceca0ec9be tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.284783 Jun 16 19:53:19.723341 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3564/7003] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:19 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:20.095161 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-b5689475-71bd-4494-b551-761ac78ca033 req-0c816d63-f718-4fb7-bf64-9e70a8e1636d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b", "tag": "b496b17b-3908-4079-923a-f215d4756f96"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:20.113431 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b5689475-71bd-4494-b551-761ac78ca033 req-0c816d63-f718-4fb7-bf64-9e70a8e1636d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:20.115454 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-b5689475-71bd-4494-b551-761ac78ca033 req-0c816d63-f718-4fb7-bf64-9e70a8e1636d service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:20.141787 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-b5689475-71bd-4494-b551-761ac78ca033 req-0c816d63-f718-4fb7-bf64-9e70a8e1636d service nova] Creating event network-changed:b496b17b-3908-4079-923a-f215d4756f96 for instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b on n-h1-846209-2 Jun 16 19:53:20.149623 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-b5689475-71bd-4494-b551-761ac78ca033 req-0c816d63-f718-4fb7-bf64-9e70a8e1636d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060464 Jun 16 19:53:20.150825 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3565/7004] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:53:20.742203 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:20.742947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:20.749662 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:20.750185 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:20.750987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:20.751446 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:20.892765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:20.900303 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4e8485ea-27e5-443e-a94f-8a9d97e0a4cd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.163771 Jun 16 19:53:20.901541 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3566/7005] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:20 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:21.917287 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:21.918172 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:21.925194 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:21.925656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:21.926474 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:21.926924 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:22.121450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:22.129271 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-4a1b1bcc-1f1b-4235-9349-75070d043485 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.216160 Jun 16 19:53:22.129857 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3567/7006] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:21 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:23.147399 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:23.148060 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:23.155653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:23.156123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:23.156906 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:23.157360 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:23.304028 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:23.311913 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5158c28d-ce90-4365-8393-1ba5e7b38f95 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.168470 Jun 16 19:53:23.312494 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3568/7007] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:23 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:24.330105 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:24.330974 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:24.339208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:24.340010 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:24.340930 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:24.341440 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:24.484514 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:24.492608 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fb5bdec6-bfb3-45f8-8918-f7b0a5fb5ed3 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.167169 Jun 16 19:53:24.493198 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3569/7008] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:24 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:25.508905 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:25.509556 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:25.517342 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:25.518143 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:25.518956 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:25.519418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:25.656294 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:25.663841 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-507bb38e-ccf4-4682-b04f-4d705e0b814b tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.159012 Jun 16 19:53:25.664417 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3570/7009] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:25 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:26.682043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:26.683164 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:26.689607 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:26.690121 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:26.690912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:26.691373 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:26.826983 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:26.835148 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-9816a9db-53aa-4a28-a481-320246e44bc7 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.157448 Jun 16 19:53:26.835946 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3571/7010] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:26 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:26.963836 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-25c776ac-79fc-40f5-b94b-909b1f5549af req-80cb63cc-dee9-45f6-9725-6347a33b7c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b", "name": "network-vif-plugged", "status": "completed", "tag": "b496b17b-3908-4079-923a-f215d4756f96"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:26.972912 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-25c776ac-79fc-40f5-b94b-909b1f5549af req-80cb63cc-dee9-45f6-9725-6347a33b7c5b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:26.973524 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-25c776ac-79fc-40f5-b94b-909b1f5549af req-80cb63cc-dee9-45f6-9725-6347a33b7c5b service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:26.989636 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-25c776ac-79fc-40f5-b94b-909b1f5549af req-80cb63cc-dee9-45f6-9725-6347a33b7c5b service nova] Creating event network-vif-plugged:b496b17b-3908-4079-923a-f215d4756f96 for instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b on n-h1-846209-2 Jun 16 19:53:26.996674 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-25c776ac-79fc-40f5-b94b-909b1f5549af req-80cb63cc-dee9-45f6-9725-6347a33b7c5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Jun 16 19:53:26.997506 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3572/7011] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:53:27.850067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:27.850848 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=12 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:27.856464 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:27.857184 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:27.864418 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:27.864916 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:27.865798 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:27.866285 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:28.000802 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:28.010896 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-d900ce89-91eb-4f90-9e92-be41f013eebe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1373 microversion: 2.1 time: 0.161853 Jun 16 19:53:28.011478 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3573/7012] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:27 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:29.028163 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:29.028876 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:29.035775 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:29.036232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:29.037003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:29.037450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:29.170388 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:29.177881 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-a23cf541-93c7-434c-b2cc-625cf67d9fd8 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1559 microversion: 2.1 time: 0.153885 Jun 16 19:53:29.178471 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3574/7013] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:29 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:29.194416 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:29.195052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:29.202048 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:29.202527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:29.203309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:29.203771 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:29.340739 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:29.348458 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b62c890a-6f13-4238-9b99-b5e399292ef6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1559 microversion: 2.1 time: 0.157677 Jun 16 19:53:29.349045 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3575/7014] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:29 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:31.344568 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-2af6e6ae-d76f-43d5-8532-b6361bef70ce req-458b17aa-39c3-4e59-b2a0-b96e94a94f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b", "tag": "b496b17b-3908-4079-923a-f215d4756f96"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:31.355009 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2af6e6ae-d76f-43d5-8532-b6361bef70ce req-458b17aa-39c3-4e59-b2a0-b96e94a94f27 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:31.355567 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-2af6e6ae-d76f-43d5-8532-b6361bef70ce req-458b17aa-39c3-4e59-b2a0-b96e94a94f27 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:31.367501 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-2af6e6ae-d76f-43d5-8532-b6361bef70ce req-458b17aa-39c3-4e59-b2a0-b96e94a94f27 service nova] Creating event network-changed:b496b17b-3908-4079-923a-f215d4756f96 for instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b on n-h1-846209-2 Jun 16 19:53:31.372938 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-2af6e6ae-d76f-43d5-8532-b6361bef70ce req-458b17aa-39c3-4e59-b2a0-b96e94a94f27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032314 Jun 16 19:53:31.373560 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3576/7015] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:55:24.606613 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:55:24.607257 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:55:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 19:55:27.738220 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b78890fc-fd1c-4287-9622-5aa46edf0932] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 16 19:55:27.739593 n-d-846209-2 devstack@n-api.service[119206]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30af6387-12f8-4c8d-96ae-4dd67e67ea9e] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 16 19:55:27.740647 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:27.741653 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=74 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:27.747723 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-c85c65ee-d3c4-4396-b6a9-ea35a6e7a341 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1604686647"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:27.749083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-c85c65ee-d3c4-4396-b6a9-ea35a6e7a341 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:27.757350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85c65ee-d3c4-4396-b6a9-ea35a6e7a341 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:27.757863 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85c65ee-d3c4-4396-b6a9-ea35a6e7a341 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:27.758756 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85c65ee-d3c4-4396-b6a9-ea35a6e7a341 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:27.759255 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-c85c65ee-d3c4-4396-b6a9-ea35a6e7a341 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:28.037518 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-c85c65ee-d3c4-4396-b6a9-ea35a6e7a341 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "POST /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b/action" status: 202 len: 0 microversion: 2.1 time: 0.302158 Jun 16 19:55:28.038237 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3577/7016] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:55:27 2022] POST /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 16 19:55:33.767786 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] [30af6387-12f8-4c8d-96ae-4dd67e67ea9e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42408. Jun 16 19:55:33.769937 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] [b78890fc-fd1c-4287-9622-5aa46edf0932] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42406. Jun 16 19:55:33.853593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a0f074b8-917b-45fd-bf4d-86bda52455e2 req-1dd3736c-45d3-439d-ae69-55b5d0667b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b", "name": "network-vif-plugged", "status": "completed", "tag": "b496b17b-3908-4079-923a-f215d4756f96"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:33.867199 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a0f074b8-917b-45fd-bf4d-86bda52455e2 req-1dd3736c-45d3-439d-ae69-55b5d0667b3a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:33.868148 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a0f074b8-917b-45fd-bf4d-86bda52455e2 req-1dd3736c-45d3-439d-ae69-55b5d0667b3a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:33.881165 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a0f074b8-917b-45fd-bf4d-86bda52455e2 req-1dd3736c-45d3-439d-ae69-55b5d0667b3a service nova] Creating event network-vif-plugged:b496b17b-3908-4079-923a-f215d4756f96 for instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b on n-h1-846209-2 Jun 16 19:55:33.887814 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a0f074b8-917b-45fd-bf4d-86bda52455e2 req-1dd3736c-45d3-439d-ae69-55b5d0667b3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141363 Jun 16 19:55:33.889364 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3578/7017] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:55:34.828762 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:55:34.829410 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 19:55:41.571845 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1204761577", "imageRef": "da9631be-7ed2-4301-8c6f-b4d5deec052a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-500948264", "security_groups": [{"name": "tempest-secgroup-smoke-207037094"}], "networks": [{"uuid": "f5e58c13-e554-405c-8ef7-bfaf54657d39"}]}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:41.686134 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.network.neutron [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] validate_networks() for [('f5e58c13-e554-405c-8ef7-bfaf54657d39', None, None, None, None, None)] {{(pid=119206) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:55:42.072284 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Flavor limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:55:42.072724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Image limits 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:55:42.073222 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Flavor pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:55:42.073643 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Image pref 0:0:0 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:55:42.074100 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.virt.hardware [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:55:42.083224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:42.083687 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:42.084537 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:42.084989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:42.102033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Getting quotas for project e6a99095fe7749f3890fcf6488348434. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:55:42.108059 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.quota [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Getting quotas for user 0ee189b67a164531b2ab3bbf51e47019 and project e6a99095fe7749f3890fcf6488348434. Resources: {'cores', 'instances', 'ram'} {{(pid=119206) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:55:42.121777 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Going to run 1 instances... {{(pid=119206) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:55:42.124820 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da9631be-7ed2-4301-8c6f-b4d5deec052a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119206) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:55:42.171386 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-338e9fc4-df0d-426a-84b8-116c41c813f4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.604800 Jun 16 19:55:42.172055 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3579/7018] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jun 16 19:55:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:55:42.182062 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fd847833-be38-46d8-a5a1-c5e6aa666cc1 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:42.182684 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fd847833-be38-46d8-a5a1-c5e6aa666cc1 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:42.238087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fd847833-be38-46d8-a5a1-c5e6aa666cc1 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:42.245859 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fd847833-be38-46d8-a5a1-c5e6aa666cc1 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1248 microversion: 2.1 time: 0.067663 Jun 16 19:55:42.246451 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3580/7019] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:42 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:43.264224 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:43.264873 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:43.272386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:43.273270 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:43.274175 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:43.274730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:43.347814 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:43.358333 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-385584c3-cfad-450a-a313-1543679ed3c0 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1306 microversion: 2.1 time: 0.098614 Jun 16 19:55:43.359112 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3581/7020] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:43 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:44.385038 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:44.386682 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:44.395186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:44.396044 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:44.396964 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:44.397510 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:44.562486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:44.570557 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b540ef4c-36ef-49a4-9867-40265e8422da tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.198668 Jun 16 19:55:44.581114 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3582/7021] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:44 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:45.588506 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:45.589186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:45.596692 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:45.597309 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:45.598465 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:45.598936 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:45.766361 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:45.774780 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e972363c-25b3-4b4f-b335-3e6b67f95412 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.190140 Jun 16 19:55:45.776445 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3583/7022] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:45 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:45.781529 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-daa6b35e-0b35-4a87-a9da-719a570e2d1f req-7b7a192a-0b3a-4eab-af3d-a2f3c2dfc130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b", "name": "network-vif-unplugged", "status": "completed", "tag": "b496b17b-3908-4079-923a-f215d4756f96"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:45.795549 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-daa6b35e-0b35-4a87-a9da-719a570e2d1f req-7b7a192a-0b3a-4eab-af3d-a2f3c2dfc130 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:45.796027 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-daa6b35e-0b35-4a87-a9da-719a570e2d1f req-7b7a192a-0b3a-4eab-af3d-a2f3c2dfc130 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:45.809811 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-daa6b35e-0b35-4a87-a9da-719a570e2d1f req-7b7a192a-0b3a-4eab-af3d-a2f3c2dfc130 service nova] Creating event network-vif-unplugged:b496b17b-3908-4079-923a-f215d4756f96 for instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b on n-h1-846209-2 Jun 16 19:55:45.815666 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-daa6b35e-0b35-4a87-a9da-719a570e2d1f req-7b7a192a-0b3a-4eab-af3d-a2f3c2dfc130 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037791 Jun 16 19:55:45.819976 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3584/7023] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:46.795615 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:46.796587 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:46.806336 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:46.806885 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:46.807779 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:46.808244 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:46.965208 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:46.974191 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5f8dbf8f-21ea-4687-9a7e-4358f8e49e76 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.183854 Jun 16 19:55:46.975005 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3585/7024] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:46 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:47.991868 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:47.992569 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:48.000350 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:48.001232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:48.002190 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:48.002656 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:48.153901 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:48.163819 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f0f5a0b1-b285-419d-8e2c-cded0c3dcff6 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.175892 Jun 16 19:55:48.165297 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3586/7025] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:47 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:49.183297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:49.185728 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:49.194278 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:49.194748 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:49.195575 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:49.196024 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:49.362229 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:49.379387 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1aa1726d-439a-4afc-98bf-0ffa53bce7af tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.201051 Jun 16 19:55:49.382079 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3587/7026] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:49 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:50.396765 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:50.397437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:50.405228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:50.405796 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:50.406605 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:50.407052 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:50.560948 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:50.569820 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-50216037-fb45-40d6-a20f-15e9adcb7633 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.176928 Jun 16 19:55:50.571380 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3588/7027] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:50 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:51.589398 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:51.590130 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:51.597754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:51.598389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:51.599187 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:51.599751 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:51.735521 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:51.743169 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-5fc376f9-bc1c-4f1c-bb24-c033a9719a54 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.157714 Jun 16 19:55:51.743755 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3589/7028] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:51 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:52.348851 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=2 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:52.349429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell0:SELECT=8 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:52.426988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-599fba8d-83db-4bee-a411-96debe0061a7 req-44fe47b9-d0c5-4140-b862-2b721ef13e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c89554c-48a6-4401-9153-d44126515f0c", "tag": "6efbd62f-0a40-452b-b830-4d0b11fdfd7f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:52.437593 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-599fba8d-83db-4bee-a411-96debe0061a7 req-44fe47b9-d0c5-4140-b862-2b721ef13e31 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:52.438087 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-599fba8d-83db-4bee-a411-96debe0061a7 req-44fe47b9-d0c5-4140-b862-2b721ef13e31 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:52.452961 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-599fba8d-83db-4bee-a411-96debe0061a7 req-44fe47b9-d0c5-4140-b862-2b721ef13e31 service nova] Creating event network-changed:6efbd62f-0a40-452b-b830-4d0b11fdfd7f for instance 3c89554c-48a6-4401-9153-d44126515f0c on n-h2-846209-2 Jun 16 19:55:52.458587 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-599fba8d-83db-4bee-a411-96debe0061a7 req-44fe47b9-d0c5-4140-b862-2b721ef13e31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116176 Jun 16 19:55:52.459367 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3590/7029] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:52.764051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:52.765352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:52.774941 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:52.775632 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:52.776276 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:52.777005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:52.945308 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:52.954573 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-68f0f8c1-3171-4db2-b9d9-8ff9332e1387 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.197707 Jun 16 19:55:52.955159 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3591/7030] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:52 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:53.973604 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:53.974316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:53.982685 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:53.983144 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:53.984058 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:53.984580 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:54.124032 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:54.131873 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-15b74d73-cee7-43d5-a930-e383bc9db658 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.162300 Jun 16 19:55:54.132452 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3592/7031] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:53 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:55.149641 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:55.150437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:55.157645 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:55.158137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:55.158920 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:55.159368 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:55.299123 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:55.306791 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1f5863cd-c73a-44ed-8f18-2ac9fba9603c tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.161058 Jun 16 19:55:55.307386 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3593/7032] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:55 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:56.324210 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:56.325859 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:56.333582 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:56.334111 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:56.335033 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:56.335527 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:56.473826 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:56.482483 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8ffe4297-8281-4f03-8f4b-7448d2140897 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.162075 Jun 16 19:55:56.483079 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3594/7033] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:56 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:57.500119 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:57.500801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:57.507823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:57.508290 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:57.509061 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:57.509509 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:57.650351 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:57.654191 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:57.659785 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-e3030eda-8697-4af6-9772-5d353261cbbe tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.163873 Jun 16 19:55:57.660685 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3595/7034] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:57 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:58.046129 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-5eb53dc5-8bf0-4782-93d8-2b4292af0c78 req-22ca34b3-20fe-489b-870f-2b4e50c2d35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c89554c-48a6-4401-9153-d44126515f0c", "name": "network-vif-plugged", "status": "completed", "tag": "6efbd62f-0a40-452b-b830-4d0b11fdfd7f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:58.050051 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:58.058212 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5eb53dc5-8bf0-4782-93d8-2b4292af0c78 req-22ca34b3-20fe-489b-870f-2b4e50c2d35a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:58.058386 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-5eb53dc5-8bf0-4782-93d8-2b4292af0c78 req-22ca34b3-20fe-489b-870f-2b4e50c2d35a service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:58.073924 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-5eb53dc5-8bf0-4782-93d8-2b4292af0c78 req-22ca34b3-20fe-489b-870f-2b4e50c2d35a service nova] Creating event network-vif-plugged:6efbd62f-0a40-452b-b830-4d0b11fdfd7f for instance 3c89554c-48a6-4401-9153-d44126515f0c on n-h2-846209-2 Jun 16 19:55:58.081113 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-5eb53dc5-8bf0-4782-93d8-2b4292af0c78 req-22ca34b3-20fe-489b-870f-2b4e50c2d35a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038767 Jun 16 19:55:58.082203 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3596/7035] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:55:58.679754 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:58.680502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:58.687611 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:58.688083 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:58.688867 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:58.689339 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:58.825520 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:58.833408 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-25ed56da-a97b-4100-afb7-f61312ff9353 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1373 microversion: 2.1 time: 0.159136 Jun 16 19:55:58.834002 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3597/7036] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:58 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:59.850531 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:59.851228 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:59.858724 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:59.859204 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:59.859989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:59.860449 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:59.993639 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:56:00.002362 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-b360ede7-ab3f-441b-8a6c-44d11d98e8d4 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1559 microversion: 2.1 time: 0.155732 Jun 16 19:56:00.002944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3598/7037] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:59 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:56:00.018213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:00.018839 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:00.025677 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:00.026177 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:00.026988 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:00.027450 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:00.173115 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:56:00.181247 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-1c9b4311-f8f8-4534-80dc-4ba2bd2bd00e tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1559 microversion: 2.1 time: 0.166694 Jun 16 19:56:00.181831 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3599/7038] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:00 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:56:02.216910 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-886880e7-0dee-47cc-9896-517760554b7b req-0b1b8ea1-a323-4e74-83df-249c72f98823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c89554c-48a6-4401-9153-d44126515f0c", "tag": "6efbd62f-0a40-452b-b830-4d0b11fdfd7f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:56:02.226286 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-886880e7-0dee-47cc-9896-517760554b7b req-0b1b8ea1-a323-4e74-83df-249c72f98823 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:02.227003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-886880e7-0dee-47cc-9896-517760554b7b req-0b1b8ea1-a323-4e74-83df-249c72f98823 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:02.238667 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-886880e7-0dee-47cc-9896-517760554b7b req-0b1b8ea1-a323-4e74-83df-249c72f98823 service nova] Creating event network-changed:6efbd62f-0a40-452b-b830-4d0b11fdfd7f for instance 3c89554c-48a6-4401-9153-d44126515f0c on n-h2-846209-2 Jun 16 19:56:02.243678 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-886880e7-0dee-47cc-9896-517760554b7b req-0b1b8ea1-a323-4e74-83df-249c72f98823 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087087 Jun 16 19:56:02.244228 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3600/7039] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:57:23.827585 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=9 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:23.828591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=22 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:23.833764 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-dcfe7954-7d50-45c4-9b9a-5d0c066e387a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1938263863"}} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:23.834947 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-dcfe7954-7d50-45c4-9b9a-5d0c066e387a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:23.842744 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcfe7954-7d50-45c4-9b9a-5d0c066e387a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:23.843220 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcfe7954-7d50-45c4-9b9a-5d0c066e387a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:23.844017 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcfe7954-7d50-45c4-9b9a-5d0c066e387a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:23.844476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-dcfe7954-7d50-45c4-9b9a-5d0c066e387a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:24.132542 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-dcfe7954-7d50-45c4-9b9a-5d0c066e387a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "POST /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c/action" status: 202 len: 0 microversion: 2.1 time: 0.308056 Jun 16 19:57:24.133111 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3601/7040] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jun 16 19:57:23 2022] POST /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 16 19:57:28.533429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-a71c462d-fdba-40af-b228-79fe408c2817 req-6ba991b2-d037-4648-ad8d-55da8a82f503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c89554c-48a6-4401-9153-d44126515f0c", "name": "network-vif-plugged", "status": "completed", "tag": "6efbd62f-0a40-452b-b830-4d0b11fdfd7f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:28.548039 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a71c462d-fdba-40af-b228-79fe408c2817 req-6ba991b2-d037-4648-ad8d-55da8a82f503 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:28.548789 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-a71c462d-fdba-40af-b228-79fe408c2817 req-6ba991b2-d037-4648-ad8d-55da8a82f503 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:28.567218 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-a71c462d-fdba-40af-b228-79fe408c2817 req-6ba991b2-d037-4648-ad8d-55da8a82f503 service nova] Creating event network-vif-plugged:6efbd62f-0a40-452b-b830-4d0b11fdfd7f for instance 3c89554c-48a6-4401-9153-d44126515f0c on n-h2-846209-2 Jun 16 19:57:28.577190 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-a71c462d-fdba-40af-b228-79fe408c2817 req-6ba991b2-d037-4648-ad8d-55da8a82f503 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046491 Jun 16 19:57:28.578851 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3602/7041] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:57:38.790958 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_api:SELECT=4 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:38.791950 n-d-846209-2 devstack@n-api.service[119206]: DEBUG dbcounter [-] [119206] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:38.798003 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:38.798616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:38.806734 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:38.807486 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:38.808273 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:38.808730 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:38.837554 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:57:38.924716 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7d41d1b7-1a92-41df-b5d9-07d9797ee7ea tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 204 len: 0 microversion: 2.1 time: 0.135449 Jun 16 19:57:38.925785 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3603/7042] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:57:38 2022] DELETE /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:57:38.931380 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-541b14cc-954b-4eb8-974b-8f341f0ffbd2 req-5fceefa3-fcc8-457e-8880-1a6e931fdb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c89554c-48a6-4401-9153-d44126515f0c", "tag": "6efbd62f-0a40-452b-b830-4d0b11fdfd7f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:38.940005 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-541b14cc-954b-4eb8-974b-8f341f0ffbd2 req-5fceefa3-fcc8-457e-8880-1a6e931fdb44 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:38.940476 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-541b14cc-954b-4eb8-974b-8f341f0ffbd2 req-5fceefa3-fcc8-457e-8880-1a6e931fdb44 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:38.953868 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-541b14cc-954b-4eb8-974b-8f341f0ffbd2 req-5fceefa3-fcc8-457e-8880-1a6e931fdb44 service nova] Creating event network-changed:6efbd62f-0a40-452b-b830-4d0b11fdfd7f for instance 3c89554c-48a6-4401-9153-d44126515f0c on n-h2-846209-2 Jun 16 19:57:38.959234 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-541b14cc-954b-4eb8-974b-8f341f0ffbd2 req-5fceefa3-fcc8-457e-8880-1a6e931fdb44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032105 Jun 16 19:57:38.959852 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3604/7043] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:57:38.965067 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:38.966402 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:38.973071 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:38.973541 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:38.974389 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:38.974847 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:39.119691 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:39.127741 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-fbb01ac1-58b2-4ec2-a5c1-f5cbe1a7aa0a tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1683 microversion: 2.1 time: 0.166684 Jun 16 19:57:39.128685 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3605/7044] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:38 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:40.145073 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:40.145694 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:40.152668 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:40.153679 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:40.154530 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:40.154989 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:40.298364 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:40.306178 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-58c0b7ff-cb33-4283-ab72-5ae6efd42999 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1683 microversion: 2.1 time: 0.165107 Jun 16 19:57:40.306757 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3606/7045] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:40 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:57:40.496366 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-c2048ea8-8978-4ec1-b9b2-abf1f91bfc16 req-9e267d7a-8e64-4e3a-9f94-414787500b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c89554c-48a6-4401-9153-d44126515f0c", "name": "network-vif-unplugged", "status": "completed", "tag": "6efbd62f-0a40-452b-b830-4d0b11fdfd7f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:40.505761 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c2048ea8-8978-4ec1-b9b2-abf1f91bfc16 req-9e267d7a-8e64-4e3a-9f94-414787500b6e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:40.507429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-c2048ea8-8978-4ec1-b9b2-abf1f91bfc16 req-9e267d7a-8e64-4e3a-9f94-414787500b6e service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:40.521420 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-c2048ea8-8978-4ec1-b9b2-abf1f91bfc16 req-9e267d7a-8e64-4e3a-9f94-414787500b6e service nova] Creating event network-vif-unplugged:6efbd62f-0a40-452b-b830-4d0b11fdfd7f for instance 3c89554c-48a6-4401-9153-d44126515f0c on n-h2-846209-2 Jun 16 19:57:40.534506 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-c2048ea8-8978-4ec1-b9b2-abf1f91bfc16 req-9e267d7a-8e64-4e3a-9f94-414787500b6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041285 Jun 16 19:57:40.535292 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3607/7046] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:57:41.016347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-56ad0d01-61b5-442f-98ee-e9bc21db0136 req-82eda7d0-8c7b-4493-9f76-4b067e7c172f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c89554c-48a6-4401-9153-d44126515f0c", "name": "network-vif-deleted", "tag": "6efbd62f-0a40-452b-b830-4d0b11fdfd7f"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:41.025054 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-56ad0d01-61b5-442f-98ee-e9bc21db0136 req-82eda7d0-8c7b-4493-9f76-4b067e7c172f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:41.025574 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-56ad0d01-61b5-442f-98ee-e9bc21db0136 req-82eda7d0-8c7b-4493-9f76-4b067e7c172f service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:41.038377 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-56ad0d01-61b5-442f-98ee-e9bc21db0136 req-82eda7d0-8c7b-4493-9f76-4b067e7c172f service nova] Creating event network-vif-deleted:6efbd62f-0a40-452b-b830-4d0b11fdfd7f for instance 3c89554c-48a6-4401-9153-d44126515f0c on n-h2-846209-2 Jun 16 19:57:41.043637 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-56ad0d01-61b5-442f-98ee-e9bc21db0136 req-82eda7d0-8c7b-4493-9f76-4b067e7c172f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032107 Jun 16 19:57:41.045066 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3608/7047] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:57:41.325145 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:41.326801 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:41.344292 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:41.345001 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:41.346041 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:41.347077 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:41.395883 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:41.396352 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:41.396823 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.objects.instance [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lazy-loading 'fault' on Instance uuid 3c89554c-48a6-4401-9153-d44126515f0c {{(pid=119206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:57:41.454082 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:41.462305 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-74ae9085-f115-4407-8e1a-40fbbf647776 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 200 len: 1338 microversion: 2.1 time: 0.142379 Jun 16 19:57:41.462937 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3609/7048] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:41 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 1338 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:57:42.480468 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:42.481137 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: 3c89554c-48a6-4401-9153-d44126515f0c] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:42.488695 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:42.489162 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:42.489967 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:42.490426 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:42.504398 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] HTTP exception thrown: Instance 3c89554c-48a6-4401-9153-d44126515f0c could not be found. Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Request method failure captured: Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c HTTP/1.1 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4olM15UJjKxD7ip51xysi60UI85L33Nv00auMpokXed70pJ4j8l4iP3Exm9hUvFmkB3kbmK9rLcZvsKlot2UZzerl-h9Gb8Ca9Tfzs7sScoz7KND-Acb7s3Xzh8Z3lHqkiiple5HEY4LkVyZGBz2wBZXgBhBJC8gN8vwtGjjxFGV24 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: e6a99095fe7749f3890fcf6488348434 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestSnapshotPattern-1169431293 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6a99095fe7749f3890fcf6488348434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6a99095fe7749f3890fcf6488348434"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6a99095fe7749f3890fcf6488348434", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6a99095fe7749f3890fcf6488348434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestSnapshotPattern-1169431293 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: e6a99095fe7749f3890fcf6488348434 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestSnapshotPattern-1169431293 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestSnapshotPattern-1169431293-project Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0ee189b67a164531b2ab3bbf51e47019 Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestSnapshotPattern-1169431293-project Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance 3c89554c-48a6-4401-9153-d44126515f0c could not be found. Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': '3c89554c-48a6-4401-9153-d44126515f0c'} Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c89554c-48a6-4401-9153-d44126515f0c could not be found. Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c89554c-48a6-4401-9153-d44126515f0c could not be found. Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:57:42.506117 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c89554c-48a6-4401-9153-d44126515f0c could not be found. Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Returning 404 to user: Instance 3c89554c-48a6-4401-9153-d44126515f0c could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-7cd08b45-40b4-4fc7-8815-051922b38ed9 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c" status: 404 len: 111 microversion: 2.1 time: 0.031109 Jun 16 19:57:42.511534 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3610/7049] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:42 2022] GET /compute/v2.1/servers/3c89554c-48a6-4401-9153-d44126515f0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:57:44.178167 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:44.178780 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:44.186908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.187408 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.188206 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.188658 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.215316 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Going to try to terminate instance {{(pid=119206) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:57:44.295993 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-f2a92d74-e89d-4fc9-9b6d-6fad10ea259d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 204 len: 0 microversion: 2.1 time: 0.121473 Jun 16 19:57:44.296945 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3611/7050] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jun 16 19:57:44 2022] DELETE /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:57:44.304616 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-f16c01d7-c4c1-4642-b834-d659d162874b req-134f8761-05ec-41a2-bf8d-64622caed232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b", "tag": "b496b17b-3908-4079-923a-f215d4756f96"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:44.313186 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f16c01d7-c4c1-4642-b834-d659d162874b req-134f8761-05ec-41a2-bf8d-64622caed232 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.313644 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-f16c01d7-c4c1-4642-b834-d659d162874b req-134f8761-05ec-41a2-bf8d-64622caed232 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.324661 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-f16c01d7-c4c1-4642-b834-d659d162874b req-134f8761-05ec-41a2-bf8d-64622caed232 service nova] Creating event network-changed:b496b17b-3908-4079-923a-f215d4756f96 for instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b on n-h1-846209-2 Jun 16 19:57:44.331306 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-f16c01d7-c4c1-4642-b834-d659d162874b req-134f8761-05ec-41a2-bf8d-64622caed232 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032473 Jun 16 19:57:44.331944 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3612/7051] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:57:44.340213 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:44.341628 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:44.347959 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.348437 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.349232 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.350092 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.493429 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:44.502778 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-eb06c62a-7a31-4b04-91f8-e3eca2eae0d2 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1683 microversion: 2.1 time: 0.166848 Jun 16 19:57:44.503374 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3613/7052] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:44 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:45.520778 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:45.521410 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:45.531086 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:45.531591 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:45.532512 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:45.533043 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:45.672205 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:45.680452 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33720b54-37fa-4628-b140-db405ef690bf tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1683 microversion: 2.1 time: 0.163637 Jun 16 19:57:45.681242 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3614/7053] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:45 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:57:46.651678 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [req-38077109-cf4b-4b20-80ad-b64903f0d0e6 req-ab8aa69f-c334-4545-b552-d59cd4a62493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b", "name": "network-vif-deleted", "tag": "b496b17b-3908-4079-923a-f215d4756f96"}]} {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:46.663987 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-38077109-cf4b-4b20-80ad-b64903f0d0e6 req-ab8aa69f-c334-4545-b552-d59cd4a62493 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:46.664448 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [req-38077109-cf4b-4b20-80ad-b64903f0d0e6 req-ab8aa69f-c334-4545-b552-d59cd4a62493 service nova] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:46.678921 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.compute.server_external_events [req-38077109-cf4b-4b20-80ad-b64903f0d0e6 req-ab8aa69f-c334-4545-b552-d59cd4a62493 service nova] Creating event network-vif-deleted:b496b17b-3908-4079-923a-f215d4756f96 for instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b on n-h1-846209-2 Jun 16 19:57:46.684062 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [req-38077109-cf4b-4b20-80ad-b64903f0d0e6 req-ab8aa69f-c334-4545-b552-d59cd4a62493 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036726 Jun 16 19:57:46.685353 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3615/7054] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:57:46.700297 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:46.701484 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:46.708830 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:46.709307 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:46.710158 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:46.710620 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:46.779457 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.policy [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee189b67a164531b2ab3bbf51e47019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a99095fe7749f3890fcf6488348434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119206) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:46.787226 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-8c700911-e687-4f24-95c5-5582c223c814 tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 200 len: 1333 microversion: 2.1 time: 0.091390 Jun 16 19:57:46.787810 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3616/7055] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:46 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:57:47.804849 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:47.805570 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.compute.api [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] [instance: dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b] Fetching instance by UUID {{(pid=119206) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:47.813598 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:47.814107 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:47.814895 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:47.815347 n-d-846209-2 devstack@n-api.service[119206]: DEBUG oslo_concurrency.lockutils [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Lock "f0ed644d-d923-4936-abdc-156d87bd571f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:47.829793 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.wsgi [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] HTTP exception thrown: Instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b could not be found. Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Request method failure captured: Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: request: GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b HTTP/1.1 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: Accept: application/json Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: Accept-Encoding: identity Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: Connection: close Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: Content-Length: 0 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: Content-Type: application/json Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: Host: 10.222.0.27 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: Openstack-System-Scope: None Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: User-Agent: python-urllib3/1.26.9 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Auth-Token: gAAAAABiq4olM15UJjKxD7ip51xysi60UI85L33Nv00auMpokXed70pJ4j8l4iP3Exm9hUvFmkB3kbmK9rLcZvsKlot2UZzerl-h9Gb8Ca9Tfzs7sScoz7KND-Acb7s3Xzh8Z3lHqkiiple5HEY4LkVyZGBz2wBZXgBhBJC8gN8vwtGjjxFGV24 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Id: None Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Domain-Name: None Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Identity-Status: Confirmed Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Is-Admin-Project: True Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Id: default Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Domain-Name: Default Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Id: e6a99095fe7749f3890fcf6488348434 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Project-Name: tempest-TestSnapshotPattern-1169431293 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Role: member,reader Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Roles: member,reader Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6a99095fe7749f3890fcf6488348434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6a99095fe7749f3890fcf6488348434"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6a99095fe7749f3890fcf6488348434", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6a99095fe7749f3890fcf6488348434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant: tempest-TestSnapshotPattern-1169431293 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Id: e6a99095fe7749f3890fcf6488348434 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-Tenant-Name: tempest-TestSnapshotPattern-1169431293 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-User: tempest-TestSnapshotPattern-1169431293-project Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Id: default Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-User-Domain-Name: Default Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-User-Id: 0ee189b67a164531b2ab3bbf51e47019 Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: X-User-Name: tempest-TestSnapshotPattern-1169431293-project Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: method: > Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: exception: Instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b could not be found. Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: action_args: {'id': 'dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b'} Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b could not be found. Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b could not be found. Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:57:47.831502 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b could not be found. Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: ERROR nova.api.openstack.wsgi Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Returning 404 to user: Instance dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b could not be found. {{(pid=119206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-33a48d70-c16e-4d00-bdc7-6b3a473c353d tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b" status: 404 len: 111 microversion: 2.1 time: 0.032084 Jun 16 19:57:47.835908 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3617/7056] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:47 2022] GET /compute/v2.1/servers/dfdc80ea-dfc6-4048-8ae9-c0e15f6e1d3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:57:48.010139 n-d-846209-2 devstack@n-api.service[119206]: DEBUG nova.api.openstack.wsgi [None req-44574f87-6462-4655-8277-c0c67faacbbd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] Calling method '.version_select at 0x7f866ddb8a60>' {{(pid=119206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:48.028924 n-d-846209-2 devstack@n-api.service[119206]: INFO nova.api.openstack.requestlog [None req-44574f87-6462-4655-8277-c0c67faacbbd tempest-TestSnapshotPattern-1169431293 tempest-TestSnapshotPattern-1169431293-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-500948264" status: 202 len: 0 microversion: 2.1 time: 0.022694 Jun 16 19:57:48.029898 n-d-846209-2 devstack@n-api.service[119206]: [pid: 119206|app: 0|req: 3618/7057] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jun 16 19:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-500948264 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:58:44.615879 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:58:44.617029 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:58:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 19:58:46.162780 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:58:46.163422 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 19:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:58:54.837636 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:58:54.838269 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 19:58:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 20:00:26.630984 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:00:26.631562 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 20:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:02:04.624899 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:02:04.625493 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 20:02:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 20:02:06.171524 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:02:06.172124 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 20:02:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:02:14.845705 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:02:14.846369 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 20:02:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 20:03:46.639076 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:03:46.639664 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 20:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:03:56.882164 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:03:56.882864 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 20:03:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:05:24.632968 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:05:24.633538 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 20:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!! Jun 16 20:05:26.179141 n-d-846209-2 devstack@n-api.service[119206]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:05:26.179652 n-d-846209-2 devstack@n-api.service[119206]: Thu Jun 16 20:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:05:34.855108 n-d-846209-2 devstack@n-api.service[119207]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:05:34.855749 n-d-846209-2 devstack@n-api.service[119207]: Thu Jun 16 20:05:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e22a30e-5168-4b6d-b3e0-a04994d6b37f/action (ip 10.222.0.27) !!!